-- Logs begin at Tue 2022-10-18 15:15:31 UTC, end at Tue 2022-10-18 18:03:21 UTC. -- Oct 18 15:50:04.438490 n-d-858383-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 15:50:04.446534 n-d-858383-14 devstack@n-api.service[104486]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 15:50:04 2022] *** Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: nodename: n-d-858383-14 Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: machine: x86_64 Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: clock source: unix Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: pcre jit disabled Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: detected number of CPU cores: 4 Oct 18 15:50:04.448528 n-d-858383-14 devstack@n-api.service[104486]: current working directory: / Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: detected binary path: /usr/bin/uwsgi-core Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: your processes number limit is 47680 Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: your memory page size is 4096 bytes Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: detected max file descriptor number: 2048 Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: lock engine: pthread robust mutexes Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: thunder lock: enabled Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 15:50:04.449143 n-d-858383-14 devstack@n-api.service[104486]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 15:50:04.492708 n-d-858383-14 devstack@n-api.service[104486]: Python main interpreter initialized at 0x55ed6115d9c0 Oct 18 15:50:04.492708 n-d-858383-14 devstack@n-api.service[104486]: python threads support enabled Oct 18 15:50:04.492708 n-d-858383-14 devstack@n-api.service[104486]: your server socket listen backlog is limited to 100 connections Oct 18 15:50:04.492708 n-d-858383-14 devstack@n-api.service[104486]: your mercy for graceful operations on workers is 90 seconds Oct 18 15:50:04.493139 n-d-858383-14 devstack@n-api.service[104486]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 15:50:04.493260 n-d-858383-14 devstack@n-api.service[104486]: *** Operational MODE: preforking *** Oct 18 15:50:04.493427 n-d-858383-14 devstack@n-api.service[104486]: *** uWSGI is running in multiple interpreter mode *** Oct 18 15:50:04.493427 n-d-858383-14 devstack@n-api.service[104486]: spawned uWSGI master process (pid: 104486) Oct 18 15:50:04.493632 n-d-858383-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 15:50:04.497341 n-d-858383-14 devstack@n-api.service[104486]: spawned uWSGI worker 1 (pid: 104487, cores: 1) Oct 18 15:50:04.497341 n-d-858383-14 devstack@n-api.service[104486]: spawned uWSGI worker 2 (pid: 104488, cores: 1) Oct 18 15:50:04.497341 n-d-858383-14 devstack@n-api.service[104486]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 15:50:05.157597 n-d-858383-14 devstack@n-api.service[104487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:50:05.166804 n-d-858383-14 devstack@n-api.service[104488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:50:06.250184 n-d-858383-14 devstack@n-api.service[104487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:50:06.250184 n-d-858383-14 devstack@n-api.service[104487]: from cryptography.utils import int_from_bytes Oct 18 15:50:06.250751 n-d-858383-14 devstack@n-api.service[104487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:50:06.250751 n-d-858383-14 devstack@n-api.service[104487]: from cryptography.utils import int_from_bytes Oct 18 15:50:06.255187 n-d-858383-14 devstack@n-api.service[104488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:50:06.255187 n-d-858383-14 devstack@n-api.service[104488]: from cryptography.utils import int_from_bytes Oct 18 15:50:06.255648 n-d-858383-14 devstack@n-api.service[104488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:50:06.255648 n-d-858383-14 devstack@n-api.service[104488]: from cryptography.utils import int_from_bytes Oct 18 15:50:08.777859 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:50:08.778458 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:50:08.778696 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:50:08.779002 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:50:08.779258 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:50:08.779642 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.779969 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.780342 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.780691 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.781029 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:50:08.781403 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.781485 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:50:08.781561 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.781659 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.781822 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:50:08.781978 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.782188 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:50:08.782304 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.782446 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:50:08.782563 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.782833 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.782918 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783158 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783242 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-14 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783483 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783589 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783787 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.783877 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784095 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784191 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784413 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784500 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784719 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.784804 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785061 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785149 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785370 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785462 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785639 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785861 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.785967 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.786982 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-14 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787123 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787230 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787325 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787410 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787487 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787644 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787773 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787894 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.787975 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788058 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788196 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788290 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788367 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788444 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788583 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.788860 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789064 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789265 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789385 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789571 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789789 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-14 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.789908 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790110 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790247 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790425 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790508 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790738 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.790824 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791094 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791180 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791402 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791495 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791723 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.791822 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792032 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792118 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792360 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792505 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-14 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792667 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.792753 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793010 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793117 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793333 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793420 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793650 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793756 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.793969 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794054 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794272 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794357 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794581 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794674 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794892 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.794985 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.795210 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.795295 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.795515 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.795611 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.796354 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.796446 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.796611 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.796709 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797029 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797119 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797319 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797402 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797627 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797711 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.797936 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798032 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798207 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798292 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798457 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798544 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798777 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.798875 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799064 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799149 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799370 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799464 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799689 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799773 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.799996 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800088 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800312 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800411 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800552 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800636 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800800 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.800907 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801140 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801247 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801460 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801546 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801766 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.801851 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802078 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802199 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802383 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802483 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802687 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802784 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.802989 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803092 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803294 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803442 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803596 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803733 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803899 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.803984 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804213 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804320 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804525 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804624 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804848 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.804934 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805178 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805276 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805497 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805591 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805890 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.805974 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806139 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806223 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806446 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806547 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806782 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.806867 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807098 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807183 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807399 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807492 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807655 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807739 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.807956 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808047 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808268 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808365 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808588 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808673 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808896 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.808985 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809229 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809321 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809537 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809632 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809838 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.809930 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810088 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810173 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810390 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810477 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810695 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.810787 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.811015 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.811101 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.811317 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.811422 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812196 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812297 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812510 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812647 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812813 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.812929 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813145 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813268 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813456 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813577 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813765 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.813901 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814073 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814223 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814382 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814531 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814697 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.814840 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815003 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815147 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815313 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815454 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815618 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815776 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.815923 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816081 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816249 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816387 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816560 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816707 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.816870 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817035 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817202 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817343 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817510 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817661 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817820 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.817968 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818142 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818279 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818449 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818597 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818755 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.818899 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819078 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819203 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819383 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819519 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819688 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.819824 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820005 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820127 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820317 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820445 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820624 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820714 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.820943 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821085 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821273 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821383 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821582 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821675 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821900 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.821992 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822208 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822303 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822515 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822607 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822819 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.822904 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823121 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823213 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823424 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823511 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823728 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.823856 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.824029 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.824127 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.824331 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.824418 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.824636 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.824721 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.824953 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.825063 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.825296 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.825390 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.825608 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.825693 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.825915 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.826009 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.826220 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.826312 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.826539 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:50:08.826624 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.826874 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.826958 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827231 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827368 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827546 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827665 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827855 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.827941 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828171 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828255 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828491 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828576 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828812 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.828898 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829152 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829238 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829471 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829642 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829785 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.829890 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830099 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830191 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830406 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830537 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830716 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.830809 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831036 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831121 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831351 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831434 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831661 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831747 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.831983 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832075 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832301 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832395 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832622 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832708 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.832933 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833032 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833278 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833375 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833589 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833674 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833897 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.833983 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834207 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834309 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834549 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834634 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834859 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.834943 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835170 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835264 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835486 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835572 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835798 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.835885 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836106 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836190 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836415 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836498 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836722 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.836813 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837061 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837154 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837376 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837465 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837684 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837769 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.837998 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838091 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838308 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838393 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838630 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838715 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.838941 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839033 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839247 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839331 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839556 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839641 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839865 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.839950 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840170 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840255 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840476 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840628 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840784 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.840880 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841099 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841200 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841406 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841502 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841715 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.841808 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842019 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842106 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842331 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842424 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842671 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842810 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.842973 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843063 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843277 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843372 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843586 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843672 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843893 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.843977 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844201 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844295 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844505 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844589 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844806 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.844890 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845142 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845233 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845453 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845539 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845760 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.845847 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846082 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846168 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846389 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846473 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846694 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.846779 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847000 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847086 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847307 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847400 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847612 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847709 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.847922 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848019 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848229 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848314 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848537 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848637 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848850 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.848937 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849179 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849264 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849502 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849614 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849806 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.849890 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.850114 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.850446 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.850536 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.850777 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.850864 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851081 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851166 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851393 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851490 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851710 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.851795 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852023 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852109 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852326 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852487 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852635 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852720 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.852938 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.853128 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.853267 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.853364 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.853572 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.853944 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854147 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854269 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854450 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854574 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854755 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.854902 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855060 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855222 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855366 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855528 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855671 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855838 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.855994 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856142 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856303 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856448 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856608 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856755 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.856913 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857091 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857241 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857398 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857584 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857703 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.857888 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.858008 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.858749 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.858937 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859103 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859198 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859425 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859542 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859750 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.859843 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860065 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860151 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860381 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860478 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860692 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.860784 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861026 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861145 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861346 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861451 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861658 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861753 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.861980 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862068 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862292 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862387 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862613 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862699 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.862923 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863007 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863241 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863326 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863552 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863635 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863864 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.863948 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864169 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864254 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864487 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864580 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864825 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.864910 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865192 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865280 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865514 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865598 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865829 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.865913 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866141 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866227 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866456 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866541 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866765 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.866863 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867073 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867158 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867383 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867474 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867697 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.867796 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868017 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868102 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868328 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868413 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868654 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868748 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.868965 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869082 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869301 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869395 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869611 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869711 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.869921 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870005 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870225 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870318 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870536 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870637 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870876 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.870998 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871170 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871258 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871485 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871572 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871792 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.871876 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872112 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872197 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872422 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872518 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872733 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.872821 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873055 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873141 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873361 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873447 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873667 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.873765 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874053 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874180 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874391 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874569 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874817 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.874902 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875136 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875230 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875449 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875534 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875766 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.875852 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876079 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876176 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876386 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876478 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876693 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.876779 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877018 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877122 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877343 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877428 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877655 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877746 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.877967 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878061 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878276 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878368 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878581 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878665 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878891 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.878984 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879199 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879294 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879505 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879648 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879810 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.879897 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880117 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880202 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880419 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880504 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880760 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.880847 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881096 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881190 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881404 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881491 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881721 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.881815 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882042 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882128 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882351 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882436 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882664 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882752 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.882968 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883053 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883276 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883369 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883599 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883685 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.883912 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884003 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884216 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884310 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884524 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884609 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884834 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.884920 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885171 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885270 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885485 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885570 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885809 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.885894 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886117 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886212 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886430 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886515 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886740 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.886826 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887045 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887138 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887357 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887441 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887673 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887764 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.887987 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.888240 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.888326 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.888577 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.888669 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.888896 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.889006 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.889233 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.889329 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.890083 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.890187 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.890778 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.891023 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.891342 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.891669 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.891879 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.892759 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.892847 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.893127 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.893365 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.893452 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.893686 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.893772 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894009 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894111 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894326 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894423 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894640 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894727 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.894957 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895042 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895267 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895365 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895580 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895674 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895892 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.895978 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896205 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896292 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896514 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896599 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896823 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.896908 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897154 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897241 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897464 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897548 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897775 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.897859 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898080 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898174 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898386 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898471 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898691 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898775 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.898995 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899081 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899306 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899403 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899604 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899698 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899907 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.899993 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900216 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900303 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900521 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900614 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900847 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.900934 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901184 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901312 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901493 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901592 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901799 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.901885 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902106 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902266 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902435 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902529 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902744 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.902835 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903054 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903139 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903358 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903451 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903662 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903747 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.903972 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904057 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904288 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904382 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904586 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904671 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.904900 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905054 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905288 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905385 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905599 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905686 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.905975 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906073 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906280 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906374 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906591 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906684 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906895 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.906990 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907208 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907295 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907515 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907599 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907819 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.907912 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908123 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908214 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908431 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908515 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908738 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.908904 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909062 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909151 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909376 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909485 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909678 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909773 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.909983 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910079 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910293 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910377 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910596 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910683 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910899 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.910990 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911207 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911293 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911511 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911604 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911814 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.911906 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912123 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912207 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912431 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912517 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912735 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.912818 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913063 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913150 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913378 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913466 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913682 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913765 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.913983 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914079 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914294 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914378 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914617 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914702 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.914935 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915028 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915242 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915326 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915553 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915639 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915856 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.915957 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916158 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916242 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916466 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916568 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916774 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.916869 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917101 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917192 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917408 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917495 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917712 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.917799 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918015 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918100 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918319 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918404 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918642 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918735 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.918949 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919042 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919253 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919345 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919559 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919656 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919860 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.919946 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.920164 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.920257 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.920490 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.920577 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.921348 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.921451 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.921686 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.921793 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922003 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922088 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922325 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922410 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922641 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922738 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.922954 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923039 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923267 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923351 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923573 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923670 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923887 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.923981 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924198 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924291 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924511 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924613 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924815 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.924900 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925143 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925235 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925451 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925536 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925767 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.925851 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926075 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926159 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926396 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926483 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926718 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.926810 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927041 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927127 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927347 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927440 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927657 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927742 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.927970 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928054 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928278 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928400 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928633 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928769 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.928893 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.929415 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.929529 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.929756 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.929861 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.929963 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930065 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930205 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930311 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930413 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930515 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930704 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.930820 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931011 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931122 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931320 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931433 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931625 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931770 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.931952 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932072 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932263 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932382 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932568 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932687 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.932876 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.933056 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.933209 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.933321 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.935643 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.936286 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.936375 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937142 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937142 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937292 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937292 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937454 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937454 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937594 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937594 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937732 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937818 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937904 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.937988 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938067 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938067 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938213 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938213 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938368 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938444 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938520 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938597 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938681 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938759 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938835 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938911 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.938987 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939062 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939213 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939294 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939369 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939445 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939522 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939599 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939707 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939838 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.939920 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940021 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940223 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940328 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940539 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940625 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940855 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.940947 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941191 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941295 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941499 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941585 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941812 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.941967 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942140 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942279 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942447 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942586 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942755 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.942999 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943092 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943311 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943404 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943619 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943704 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.943941 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944026 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944265 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944375 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944591 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944676 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.944898 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945019 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945238 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945412 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945549 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945727 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.945875 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946039 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946199 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946364 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946511 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946688 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.946825 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947019 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947132 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947327 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947454 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947641 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947776 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.947953 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948089 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948277 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948410 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948602 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948826 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.948918 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949178 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949346 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949495 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949582 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949818 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.949952 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950147 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950235 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950457 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950541 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950763 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.950856 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951075 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951186 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951381 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951514 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951689 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.951829 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952050 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952304 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952392 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952663 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952746 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.952976 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953097 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953309 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953395 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953618 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953704 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.953921 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954007 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954246 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954333 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954549 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954642 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954872 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.954957 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955181 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955273 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955495 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955579 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955808 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.955909 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956110 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956195 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956414 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956498 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956728 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.956864 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957050 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957140 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957359 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957457 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957665 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957750 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.957986 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958070 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958297 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958390 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958603 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958688 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.958927 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959012 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959237 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959330 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959543 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959629 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959849 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.959934 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960155 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960245 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960496 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960588 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960804 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.960889 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961151 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961239 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961476 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961562 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961782 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.961867 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962088 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962174 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962395 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962480 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962700 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.962786 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963004 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963097 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963308 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963394 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963615 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963710 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.963918 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964013 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964219 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964304 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964519 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964613 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964841 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.964928 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965172 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965261 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965494 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965592 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965804 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.965901 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966104 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966210 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966410 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966511 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966713 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.966806 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.967024 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.967111 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.967341 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.967433 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.968192 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.968302 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.968582 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.968783 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.968910 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969021 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969242 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969327 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969550 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969636 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969857 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.969945 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970172 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970256 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970492 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970576 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970807 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.970892 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971122 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971206 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971429 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971523 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971745 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.971844 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.972062 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.972148 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.972379 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.972475 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.972698 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973049 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973155 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973360 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973447 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973680 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973773 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.973991 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974085 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974301 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974386 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974616 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974702 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.974929 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975014 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975241 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975477 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975564 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975824 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.975907 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976133 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976231 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976448 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976535 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976763 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.976851 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977102 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977190 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977426 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977513 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977741 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.977834 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.978051 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.978145 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.978363 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.978449 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.978937 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979083 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979265 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979422 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979589 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979683 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979892 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.979977 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980209 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980304 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980525 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980612 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980838 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.980924 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981180 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981270 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981494 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981581 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981806 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.981892 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982119 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982206 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982430 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982515 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982738 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.982837 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983051 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983145 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983598 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983703 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983703 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.983836 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984027 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984124 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984343 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984430 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984658 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984753 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.984969 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985150 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985303 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985390 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985618 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985821 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.985933 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986140 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986263 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986474 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986585 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986799 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.986896 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987122 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987225 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987438 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987535 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987755 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.987841 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988081 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988307 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988402 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988624 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988709 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.988961 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989071 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989295 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989392 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989598 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989686 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.989920 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990007 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990237 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990370 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990541 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990627 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990856 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.990942 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.991163 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.991255 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.991478 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.991693 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.991786 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992039 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992133 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992353 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992438 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992676 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.992761 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993018 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993121 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993329 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993420 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993636 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993723 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.993959 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994174 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994269 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994525 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994612 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994843 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.994928 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995154 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995239 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995458 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995544 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995762 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.995856 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996071 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996165 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996380 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996470 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996683 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.996777 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997009 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997107 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997317 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997408 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997628 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997722 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.997935 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.998029 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.998239 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.998324 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.998544 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.998639 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.999367 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.999516 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.999714 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.999810 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:08.999992 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000085 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000296 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000380 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000600 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000701 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.000910 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001018 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001239 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001324 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001547 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001632 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001848 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.001934 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002150 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002234 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002457 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002543 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002763 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.002857 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003065 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003151 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003376 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003471 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003678 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003763 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.003982 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004069 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004283 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004376 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004591 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004681 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.004912 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005025 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005250 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005352 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005553 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005639 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005876 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.005962 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.006180 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.006278 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.006483 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.006718 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.006805 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007057 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007152 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007381 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007468 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007701 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.007785 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008010 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008108 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008336 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008421 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008645 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008731 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.008951 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009208 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009299 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009545 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009631 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009868 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.009956 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010205 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010292 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010513 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010597 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010822 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.010916 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011130 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011222 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011436 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011520 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011744 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.011839 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012053 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012139 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012361 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012446 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012669 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012764 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.012978 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013130 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013310 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013396 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013617 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013702 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.013926 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014012 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014235 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014327 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014620 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014734 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.014933 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015027 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015244 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015329 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015554 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015641 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015865 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.015950 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016174 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016269 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016490 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016656 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016836 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.016922 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017181 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017283 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017502 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017588 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017819 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.017906 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.018126 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.018219 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.018437 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.018748 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.018833 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019060 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019146 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019368 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019455 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019683 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.019769 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020013 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020113 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020327 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020459 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020632 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020718 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.020959 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.021308 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.021395 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.021620 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.021706 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.021954 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022039 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022278 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022363 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022592 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022684 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.022914 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023008 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023222 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023307 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023530 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023616 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023838 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.023944 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024148 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024235 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024466 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024551 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024776 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.024870 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025105 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025196 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025413 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025497 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025722 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.025810 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026026 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026111 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026329 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026461 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026635 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026723 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.026940 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027032 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027248 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027334 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027551 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027637 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027856 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.027982 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028158 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028243 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028460 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028545 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028761 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.028846 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029091 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029190 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029400 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029493 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029702 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.029794 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.030003 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.030629 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.030841 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.030932 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031148 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031234 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031452 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031548 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031757 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.031843 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032058 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032147 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032365 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032460 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032669 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032754 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.032972 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033119 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033302 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033396 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033604 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033691 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033907 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.033994 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034239 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034326 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034574 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034661 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034889 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.034975 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035212 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035298 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035524 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035609 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035839 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.035933 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036147 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036232 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036456 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036583 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036768 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.036870 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037102 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037197 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037411 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037495 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037746 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.037845 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038054 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038139 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038364 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038449 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038677 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038837 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.038989 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039082 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039298 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039384 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039607 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039700 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.039933 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040017 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040246 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040341 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040552 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040637 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040882 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.040974 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041199 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041288 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041511 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041599 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041823 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.041908 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042135 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042228 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042448 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042534 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042760 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.042844 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043073 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043167 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043383 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043469 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043694 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.043781 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044004 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044097 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044320 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044404 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044631 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044717 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.044943 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.045072 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.045287 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.045372 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.045603 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.045700 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046067 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046161 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046398 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046484 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046712 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.046798 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.047045 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.047132 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.047291 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:50:09.047385 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.047706 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.048166 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.048519 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.048853 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.049194 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.049512 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.049819 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:50:09.050065 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:50:09.201622 n-d-858383-14 devstack@n-api.service[104487]: INFO dbcounter [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Registered counter for database nova_api Oct 18 15:50:09.203963 n-d-858383-14 devstack@n-api.service[104488]: INFO dbcounter [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Registered counter for database nova_api Oct 18 15:50:09.222308 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_db.sqlalchemy.engines [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.224395 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.229330 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writer thread running {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.231204 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writer thread running {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.285381 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.context [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=104487) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:50:09.288861 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.context [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=104488) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:50:09.289171 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.289642 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.291243 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.291957 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.292398 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.292735 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.293249 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.294380 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_concurrency.lockutils [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.294819 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.295544 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.296567 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.297184 n-d-858383-14 devstack@n-api.service[104487]: INFO dbcounter [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Registered counter for database nova_cell0 Oct 18 15:50:09.298570 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.300553 n-d-858383-14 devstack@n-api.service[104488]: INFO dbcounter [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Registered counter for database nova_cell0 Oct 18 15:50:09.301338 n-d-858383-14 devstack@n-api.service[104487]: INFO dbcounter [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Registered counter for database nova_cell1 Oct 18 15:50:09.304583 n-d-858383-14 devstack@n-api.service[104488]: INFO dbcounter [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Registered counter for database nova_cell1 Oct 18 15:50:09.309627 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_db.sqlalchemy.engines [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.311229 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_db.sqlalchemy.engines [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.312804 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.313739 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.318926 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writer thread running {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.319265 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writer thread running {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.320688 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writer thread running {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.322228 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writer thread running {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.464285 n-d-858383-14 devstack@n-api.service[104487]: INFO dbcounter [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Registered counter for database nova_cell0 Oct 18 15:50:09.470730 n-d-858383-14 devstack@n-api.service[104488]: INFO dbcounter [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Registered counter for database nova_cell0 Oct 18 15:50:09.473227 n-d-858383-14 devstack@n-api.service[104487]: DEBUG oslo_db.sqlalchemy.engines [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.477644 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:50:09.477976 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writer thread running {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.482500 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writer thread running {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:50:09.829717 n-d-858383-14 devstack@n-api.service[104488]: WARNING keystonemiddleware.auth_token [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:50:09.834707 n-d-858383-14 devstack@n-api.service[104487]: WARNING keystonemiddleware.auth_token [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:50:09.836902 n-d-858383-14 devstack@n-api.service[104488]: WARNING keystonemiddleware.auth_token [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:50:09.841956 n-d-858383-14 devstack@n-api.service[104487]: WARNING keystonemiddleware.auth_token [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:50:10.181868 n-d-858383-14 devstack@n-api.service[104488]: WARNING keystonemiddleware.auth_token [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:50:10.188116 n-d-858383-14 devstack@n-api.service[104488]: WARNING keystonemiddleware.auth_token [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:50:10.191337 n-d-858383-14 devstack@n-api.service[104487]: WARNING keystonemiddleware.auth_token [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:50:10.193407 n-d-858383-14 devstack@n-api.service[104488]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed6115d9c0 pid: 104488 (default app) Oct 18 15:50:10.195463 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:10.196664 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Oct 18 15:50:10.197090 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Tue Oct 18 15:50:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:10.197345 n-d-858383-14 devstack@n-api.service[104487]: WARNING keystonemiddleware.auth_token [None req-cbefd71d-6ac4-4501-b35f-38f269ed827d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:50:10.203995 n-d-858383-14 devstack@n-api.service[104487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed6115d9c0 pid: 104487 (default app) Oct 18 15:51:32.394922 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:32.395963 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 18 15:51:32.396370 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:51:32.414019 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_api:SELECT=3 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:32.414955 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_cell1:SELECT=3 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:32.415960 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_cell0:SELECT=3 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:32.417255 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:33.286148 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-58a05f64-1c62-4be3-b813-503f0a2a4032 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:33.319154 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-58a05f64-1c62-4be3-b813-503f0a2a4032 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915170 Oct 18 15:51:33.320120 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 15:51:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:35.981675 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:35.982947 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-0cfaf37d-6189-4024-9279-357f77e50381 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Oct 18 15:51:35.983573 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:36.440274 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-626d5791-55d1-4366-b496-5690c3a5b6e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:36.487721 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-626d5791-55d1-4366-b496-5690c3a5b6e1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497947 Oct 18 15:51:36.488291 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:36.503952 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_api:SELECT=3 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.504882 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_cell1:SELECT=3 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.505930 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_cell0:SELECT=3 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.506688 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.716926 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-30380958-7d7b-4725-9ec4-4b848a3908ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:36.786688 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-30380958-7d7b-4725-9ec4-4b848a3908ec admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289266 Oct 18 15:51:36.786849 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 18 15:51:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:39.424434 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-626d5791-55d1-4366-b496-5690c3a5b6e1 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:39.425421 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-626d5791-55d1-4366-b496-5690c3a5b6e1 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 18 15:51:39.425848 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:40.250783 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-7a96dd8a-810f-4b76-a8b1-c845dd508953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:40.305375 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-7a96dd8a-810f-4b76-a8b1-c845dd508953 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.871913 Oct 18 15:51:40.306452 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:40.321212 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-33258ab8-446d-4f4a-a8f4-1360195f2e73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:40.383535 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-33258ab8-446d-4f4a-a8f4-1360195f2e73 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066260 Oct 18 15:51:40.386308 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 18 15:51:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:43.342936 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-7a96dd8a-810f-4b76-a8b1-c845dd508953 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:43.344165 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-7a96dd8a-810f-4b76-a8b1-c845dd508953 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Oct 18 15:51:43.349225 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:43.788104 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-eaa1504e-edcb-4c8e-b5b9-df929f8c1d0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:43.811711 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-eaa1504e-edcb-4c8e-b5b9-df929f8c1d0a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460077 Oct 18 15:51:43.817360 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:43.825493 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-2bd8888f-3d4d-4999-b00b-9615e066b6c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:43.857676 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-2bd8888f-3d4d-4999-b00b-9615e066b6c9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036468 Oct 18 15:51:43.868918 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 18 15:51:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:46.557073 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-eaa1504e-edcb-4c8e-b5b9-df929f8c1d0a admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:46.558098 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-eaa1504e-edcb-4c8e-b5b9-df929f8c1d0a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Oct 18 15:51:46.558495 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:46.998599 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-e18c3cec-1703-4e7e-b0f8-acc937464a57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d3"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:47.023201 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-e18c3cec-1703-4e7e-b0f8-acc937464a57 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458456 Oct 18 15:51:47.024010 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:47.038406 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-a128e5e6-052d-4aad-b07a-fed3bc7ad97c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:47.069504 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-a128e5e6-052d-4aad-b07a-fed3bc7ad97c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034909 Oct 18 15:51:47.070422 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 18 15:51:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:49.794869 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-e18c3cec-1703-4e7e-b0f8-acc937464a57 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:49.796524 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-e18c3cec-1703-4e7e-b0f8-acc937464a57 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Oct 18 15:51:49.807269 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:50.255690 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:50.276549 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473094 Oct 18 15:51:50.277111 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:50.289241 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-17923c15-e430-49c1-924f-e265424d2b35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:50.315143 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-17923c15-e430-49c1-924f-e265424d2b35 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029516 Oct 18 15:51:50.316228 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 18 15:51:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:53.046417 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:53.047363 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 18 15:51:53.047824 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:51:53.529462 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-4c6ee7a3-2791-4095-9f4e-4a085fdd93ff admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:53.563953 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-4c6ee7a3-2791-4095-9f4e-4a085fdd93ff admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.509378 Oct 18 15:51:53.564945 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 15:51:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:51:56.352690 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:56.354117 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-84e95b4f-8528-4f56-a3ed-293949d6de4f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Oct 18 15:51:56.354556 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:56.824770 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-806a5e6f-e10c-4dc3-8e60-91ab51b96fd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:56.846640 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-806a5e6f-e10c-4dc3-8e60-91ab51b96fd3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485470 Oct 18 15:51:56.847518 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:51:56.864001 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-f365344c-8aa6-4b5e-8832-778129f2f3f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:56.898670 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-f365344c-8aa6-4b5e-8832-778129f2f3f9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039819 Oct 18 15:51:56.899264 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 18 15:51:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:59.784655 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-806a5e6f-e10c-4dc3-8e60-91ab51b96fd3 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:59.785777 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-806a5e6f-e10c-4dc3-8e60-91ab51b96fd3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 18 15:51:59.786152 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:00.197319 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-5934b07e-8a46-4360-ac01-af2782a729bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048, "vcpus": 1, "id": "2", "name": "m1.small"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:00.217531 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-5934b07e-8a46-4360-ac01-af2782a729bd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423880 Oct 18 15:52:00.220703 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:51:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:00.230863 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-fcf149b6-f713-4bdf-a437-0f7d5462b4c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:00.254581 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-fcf149b6-f713-4bdf-a437-0f7d5462b4c6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028308 Oct 18 15:52:00.255165 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 18 15:52:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:02.926957 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-5934b07e-8a46-4360-ac01-af2782a729bd admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:02.928347 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-5934b07e-8a46-4360-ac01-af2782a729bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Oct 18 15:52:02.929535 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:03.313855 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-924f75a0-1f4e-4734-9821-1a25098944d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:03.337605 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-924f75a0-1f4e-4734-9821-1a25098944d6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.400603 Oct 18 15:52:03.338564 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:52:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:03.350867 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-cf5ba39c-0863-4fe4-99cc-0dcdc96c6ff2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:03.356057 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:03.381183 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-cf5ba39c-0863-4fe4-99cc-0dcdc96c6ff2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034106 Oct 18 15:52:03.381764 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 18 15:52:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:06.110778 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-924f75a0-1f4e-4734-9821-1a25098944d6 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:06.111788 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-924f75a0-1f4e-4734-9821-1a25098944d6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 18 15:52:06.112736 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:06.560479 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-72b41462-31ea-4eb4-b32c-106916b163e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:06.581794 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-72b41462-31ea-4eb4-b32c-106916b163e7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462457 Oct 18 15:52:06.590267 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:52:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:06.595082 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-a153562f-8f6b-43f1-8674-e5fddac3c2fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:06.622833 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-a153562f-8f6b-43f1-8674-e5fddac3c2fa admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031308 Oct 18 15:52:06.623985 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 18 15:52:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:09.342870 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-72b41462-31ea-4eb4-b32c-106916b163e7 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:09.343896 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-72b41462-31ea-4eb4-b32c-106916b163e7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 18 15:52:09.344451 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:09.781241 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:09.790332 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:09.807424 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457142 Oct 18 15:52:09.813028 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 18 15:52:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:52:09.820812 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-9f820eb2-7518-4772-a049-2e3198f2562a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:09.847188 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-9f820eb2-7518-4772-a049-2e3198f2562a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030616 Oct 18 15:52:09.849145 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 18 15:52:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:31.120445 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:31.121490 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 18 15:52:31.121896 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:31.132386 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:31.518581 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-8659c413-81ca-462c-967b-02aa1924a59a admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:31.537660 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-8659c413-81ca-462c-967b-02aa1924a59a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409648 Oct 18 15:52:31.538127 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 15:52:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:32.868065 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:32.869142 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-5d73de38-ca23-4f67-aeb0-f9f61f9b7ec9 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Oct 18 15:52:32.869536 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:33.406367 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-4495fc33-a70b-4a05-8d5f-5485136f03d4 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.411606 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.wsgi [None req-4495fc33-a70b-4a05-8d5f-5485136f03d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-4495fc33-a70b-4a05-8d5f-5485136f03d4 admin admin] Request method failure captured: Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Accept: application/json Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Accept-Encoding: gzip, deflate Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Connection: keep-alive Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Content-Length: 0 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Host: 10.222.0.78 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: Openstack-System-Scope: None Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: User-Agent: python-novaclient Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Auth-Token: gAAAAABjTsvAlNlzP772OfnKv0HDhntLyg-BsH_m1QQvRI9ZDMdJ4muhZ8mIcy8w0k1LPL_Ip--6lIeGgYi9tgZcNDitEH68tKk60bN75FuiIzpFS7ZIsIWKAF0JARTd9Qbrocd-RQUHz57Nt9s-t6A5ijSM3YSnJfC7XXeXQwQZqOwrqjP6-1c Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Id: None Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Name: None Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Identity-Status: Confirmed Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Is-Admin-Project: True Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Id: default Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Name: Default Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Name: admin Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Role: member,reader,admin Oct 18 15:52:33.415653 n-d-858383-14 devstack@n-api.service[104487]: X-Roles: member,reader,admin Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant: admin Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Name: admin Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-User: admin Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Id: default Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Name: Default Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: X-User-Name: admin Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: method: > Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: exception: Flavor 42 could not be found. Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: action_args: {'id': '42'} Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:33.417370 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:33.418411 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.419780 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-4495fc33-a70b-4a05-8d5f-5485136f03d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:33.421096 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-4495fc33-a70b-4a05-8d5f-5485136f03d4 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.401588 Oct 18 15:52:33.421096 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:33.427933 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-1b14eb1c-4930-4f54-b10d-cc2c9d6578a2 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.450453 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-1b14eb1c-4930-4f54-b10d-cc2c9d6578a2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027002 Oct 18 15:52:33.451007 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:33.466816 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-3a6014ae-1ee0-4a00-936f-41d1c5b46677 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.490043 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-3a6014ae-1ee0-4a00-936f-41d1c5b46677 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028033 Oct 18 15:52:33.490587 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:33.500857 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-a8a96155-e744-44d4-a1b0-845d987e9aae admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.506238 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.wsgi [None req-a8a96155-e744-44d4-a1b0-845d987e9aae admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-a8a96155-e744-44d4-a1b0-845d987e9aae admin admin] Request method failure captured: Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Accept: application/json Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Accept-Encoding: gzip, deflate Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Connection: keep-alive Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Content-Length: 0 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Host: 10.222.0.78 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: Openstack-System-Scope: None Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: User-Agent: python-novaclient Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Auth-Token: gAAAAABjTsvAlNlzP772OfnKv0HDhntLyg-BsH_m1QQvRI9ZDMdJ4muhZ8mIcy8w0k1LPL_Ip--6lIeGgYi9tgZcNDitEH68tKk60bN75FuiIzpFS7ZIsIWKAF0JARTd9Qbrocd-RQUHz57Nt9s-t6A5ijSM3YSnJfC7XXeXQwQZqOwrqjP6-1c Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Id: None Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Name: None Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Identity-Status: Confirmed Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Is-Admin-Project: True Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Id: default Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Name: Default Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Name: admin Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Role: member,reader,admin Oct 18 15:52:33.509540 n-d-858383-14 devstack@n-api.service[104488]: X-Roles: member,reader,admin Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant: admin Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Name: admin Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-User: admin Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Id: default Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Name: Default Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: X-User-Name: admin Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: method: > Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: exception: Flavor 42 could not be found. Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: action_args: {'id': '42'} Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:33.511174 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:33.512153 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:33.513536 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-a8a96155-e744-44d4-a1b0-845d987e9aae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:33.514839 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-a8a96155-e744-44d4-a1b0-845d987e9aae admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013657 Oct 18 15:52:33.514839 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:34.766944 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-3a6014ae-1ee0-4a00-936f-41d1c5b46677 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:34.767997 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-3a6014ae-1ee0-4a00-936f-41d1c5b46677 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 18 15:52:34.768401 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:35.298163 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-506781c3-a082-4ecc-8fa2-4e6ed9600506 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.303180 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.wsgi [None req-506781c3-a082-4ecc-8fa2-4e6ed9600506 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-506781c3-a082-4ecc-8fa2-4e6ed9600506 admin admin] Request method failure captured: Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Accept: application/json Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Accept-Encoding: gzip, deflate Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Connection: keep-alive Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Content-Length: 0 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Host: 10.222.0.78 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: Openstack-System-Scope: None Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: User-Agent: python-novaclient Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Auth-Token: gAAAAABjTsvCU1sorN_EQlaDzbo4cLMJ5mQQo5y9iHuOU6xs2wz4INAYlD5i26o17oSGlTseG-v0DU9n8rYb9c7dSie328R1s2I-SZu0CDz5jFR3d0gPq-rVwk6CT0sjEbVVLt32Lu0Twnf1bMj0_ULBmqWOg6Q6SgSGlDmgnmCmQygTT6bw2uw Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Id: None Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Name: None Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Identity-Status: Confirmed Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Is-Admin-Project: True Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Id: default Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Name: Default Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Name: admin Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Role: member,reader,admin Oct 18 15:52:35.305250 n-d-858383-14 devstack@n-api.service[104488]: X-Roles: member,reader,admin Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant: admin Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Name: admin Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-User: admin Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Id: default Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Name: Default Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: X-User-Name: admin Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: method: > Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: exception: Flavor 84 could not be found. Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: action_args: {'id': '84'} Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:35.306657 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:35.307474 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.308532 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-506781c3-a082-4ecc-8fa2-4e6ed9600506 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:35.309861 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-506781c3-a082-4ecc-8fa2-4e6ed9600506 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399181 Oct 18 15:52:35.309861 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 15:52:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:35.316390 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-6d9d0b9d-59a4-4c10-8990-b661615fb57c admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.331882 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-6d9d0b9d-59a4-4c10-8990-b661615fb57c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019062 Oct 18 15:52:35.332421 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:35.342355 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-ee4b5f6b-6369-495d-920f-0e6ad46a0e89 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.358589 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-ee4b5f6b-6369-495d-920f-0e6ad46a0e89 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019771 Oct 18 15:52:35.359119 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:35.369071 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-8ac25dcc-13d4-4504-8517-b8416052c70f admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.374220 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.wsgi [None req-8ac25dcc-13d4-4504-8517-b8416052c70f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-8ac25dcc-13d4-4504-8517-b8416052c70f admin admin] Request method failure captured: Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Accept: application/json Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Accept-Encoding: gzip, deflate Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Connection: keep-alive Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Content-Length: 0 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Host: 10.222.0.78 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: Openstack-System-Scope: None Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: User-Agent: python-novaclient Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Auth-Token: gAAAAABjTsvCU1sorN_EQlaDzbo4cLMJ5mQQo5y9iHuOU6xs2wz4INAYlD5i26o17oSGlTseG-v0DU9n8rYb9c7dSie328R1s2I-SZu0CDz5jFR3d0gPq-rVwk6CT0sjEbVVLt32Lu0Twnf1bMj0_ULBmqWOg6Q6SgSGlDmgnmCmQygTT6bw2uw Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Id: None Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Name: None Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Identity-Status: Confirmed Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Is-Admin-Project: True Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Id: default Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Name: Default Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Name: admin Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Role: member,reader,admin Oct 18 15:52:35.375699 n-d-858383-14 devstack@n-api.service[104487]: X-Roles: member,reader,admin Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant: admin Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Name: admin Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-User: admin Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Id: default Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Name: Default Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: X-User-Name: admin Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: method: > Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: exception: Flavor 84 could not be found. Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: action_args: {'id': '84'} Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:35.377336 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:35.378242 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:35.379393 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-8ac25dcc-13d4-4504-8517-b8416052c70f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:35.380407 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-8ac25dcc-13d4-4504-8517-b8416052c70f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012095 Oct 18 15:52:35.380407 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 15:52:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:36.599491 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-ee4b5f6b-6369-495d-920f-0e6ad46a0e89 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:36.600511 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-ee4b5f6b-6369-495d-920f-0e6ad46a0e89 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 18 15:52:36.600909 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:37.124127 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-cf42e7f6-0c96-49dc-8c63-05a8bd8ef8bc admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.129908 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.wsgi [None req-cf42e7f6-0c96-49dc-8c63-05a8bd8ef8bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-cf42e7f6-0c96-49dc-8c63-05a8bd8ef8bc admin admin] Request method failure captured: Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Accept: application/json Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Accept-Encoding: gzip, deflate Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Connection: keep-alive Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Content-Length: 0 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Host: 10.222.0.78 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: Openstack-System-Scope: None Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: User-Agent: python-novaclient Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Auth-Token: gAAAAABjTsvEM-8k0tBh-aqsk5MR7rK0OZQRloE7D_oVaSUTf8WxVEQ4WfqsFi9L46AYSIlWVoZpyKX5zo_2b6Ag5l2p0GimeVjo8eN6ZJqkDCr7PAu7GBatM9UF4LitlGfF7OeplTOndi_NbN93vU4LO-0m1CU6qu9VnWVS-Rag7lY0uued7kU Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Id: None Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Domain-Name: None Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Identity-Status: Confirmed Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Is-Admin-Project: True Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Id: default Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Domain-Name: Default Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Project-Name: admin Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Role: member,reader,admin Oct 18 15:52:37.131389 n-d-858383-14 devstack@n-api.service[104487]: X-Roles: member,reader,admin Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant: admin Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-Tenant-Name: admin Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-User: admin Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Id: default Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-User-Domain-Name: Default Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: X-User-Name: admin Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: method: > Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: exception: Flavor 451 could not be found. Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: action_args: {'id': '451'} Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:37.133669 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.134488 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.135732 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-cf42e7f6-0c96-49dc-8c63-05a8bd8ef8bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:37.136927 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-cf42e7f6-0c96-49dc-8c63-05a8bd8ef8bc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389147 Oct 18 15:52:37.136927 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 15:52:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:37.143246 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-eebf1186-34a7-488d-8f36-5b8081c0bdc8 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.158773 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-eebf1186-34a7-488d-8f36-5b8081c0bdc8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019171 Oct 18 15:52:37.159307 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:37.169608 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.184396 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018251 Oct 18 15:52:37.184940 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 18 15:52:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:37.194171 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-82f4f8e8-c1a5-4b04-a005-9e491b10d762 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.199883 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.wsgi [None req-82f4f8e8-c1a5-4b04-a005-9e491b10d762 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-82f4f8e8-c1a5-4b04-a005-9e491b10d762 admin admin] Request method failure captured: Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Accept: application/json Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Accept-Encoding: gzip, deflate Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Connection: keep-alive Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Content-Length: 0 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Host: 10.222.0.78 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Openstack-Api-Version: compute 2.92 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: Openstack-System-Scope: None Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: User-Agent: python-novaclient Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Auth-Token: gAAAAABjTsvEM-8k0tBh-aqsk5MR7rK0OZQRloE7D_oVaSUTf8WxVEQ4WfqsFi9L46AYSIlWVoZpyKX5zo_2b6Ag5l2p0GimeVjo8eN6ZJqkDCr7PAu7GBatM9UF4LitlGfF7OeplTOndi_NbN93vU4LO-0m1CU6qu9VnWVS-Rag7lY0uued7kU Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Id: None Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Domain-Name: None Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Identity-Status: Confirmed Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Is-Admin-Project: True Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Id: default Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Domain-Name: Default Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Project-Name: admin Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Role: member,reader,admin Oct 18 15:52:37.201410 n-d-858383-14 devstack@n-api.service[104488]: X-Roles: member,reader,admin Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c8d96b0623744b2b02923664ec6fcd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c8d96b0623744b2b02923664ec6fcd8"}]}] Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant: admin Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Id: 6c8d96b0623744b2b02923664ec6fcd8 Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-Tenant-Name: admin Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-User: admin Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Id: default Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-User-Domain-Name: Default Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-User-Id: 0ecf0b2053e545058e1b1127d92dea3a Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: X-User-Name: admin Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: method: > Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: exception: Flavor 451 could not be found. Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: action_args: {'id': '451'} Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:37.202990 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.203911 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.205200 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-82f4f8e8-c1a5-4b04-a005-9e491b10d762 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:37.206465 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-82f4f8e8-c1a5-4b04-a005-9e491b10d762 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012097 Oct 18 15:52:37.206465 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 15:52:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:38.428701 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:38.430268 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Oct 18 15:52:38.430661 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:38.954599 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-39a310a1-1fca-4546-a92b-d2bcee05e119 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:38.974047 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-39a310a1-1fca-4546-a92b-d2bcee05e119 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403799 Oct 18 15:52:38.974589 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 18 15:52:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:40.179928 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:40.180986 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 18 15:52:40.181399 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:40.720730 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-3d50df10-038c-4376-93fb-77997180edc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:40.738667 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-3d50df10-038c-4376-93fb-77997180edc0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.420154 Oct 18 15:52:40.739209 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 18 15:52:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:41.971326 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:41.972333 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 18 15:52:41.972726 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:42.494920 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-8e3da602-7bd3-421d-94f7-a8935033d88b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:42.513759 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-8e3da602-7bd3-421d-94f7-a8935033d88b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404042 Oct 18 15:52:42.514302 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 18 15:52:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:43.737773 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:43.738865 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 18 15:52:43.739337 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:44.263692 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-baf992e4-079d-4f51-a5d7-351dedf60c23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:44.284024 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-baf992e4-079d-4f51-a5d7-351dedf60c23 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.409062 Oct 18 15:52:44.284639 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 18 15:52:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:45.516529 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:45.517596 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 18 15:52:45.517989 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:46.042559 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-08bb897c-5de4-4648-a41c-62d03f50bcd3 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:46.062874 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-08bb897c-5de4-4648-a41c-62d03f50bcd3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409761 Oct 18 15:52:46.063419 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 18 15:52:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:43.304178 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.306245 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-fb9f68d6-aef5-4df3-8c80-7bd824e282c0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 18 15:53:43.306651 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:43.317149 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:43.702518 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-69a7cb8e-15c2-4774-b35e-12ea491fc085 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.723398 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-69a7cb8e-15c2-4774-b35e-12ea491fc085 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410814 Oct 18 15:53:43.723943 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:43.746539 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_api:SELECT=14 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:43.750453 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-1d1d79bc-c628-4c56-ae8e-90b7754d434b admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.757941 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-1d1d79bc-c628-4c56-ae8e-90b7754d434b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012897 Oct 18 15:53:43.758973 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:43.770580 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-8e642745-ad49-4e4d-9b0b-8527f885ac6b admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.778555 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-8e642745-ad49-4e4d-9b0b-8527f885ac6b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011580 Oct 18 15:53:43.779086 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:43.791275 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.798438 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 Oct 18 15:53:43.798952 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:43.810254 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-dd3a4904-513b-4f66-b997-3de5eee8825b admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.817466 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-dd3a4904-513b-4f66-b997-3de5eee8825b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010726 Oct 18 15:53:43.817989 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:59:00.976706 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:00.977743 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 18 15:59:00.978147 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:59:01.117392 n-d-858383-14 devstack@n-api.service[104488]: DEBUG dbcounter [-] [104488] Writing DB stats nova_api:SELECT=6 {{(pid=104488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:01.257505 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:01.262285 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:01.262757 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:01.263186 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:01.263928 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:01.264548 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:01.264971 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:01.303806 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-814288c0-7992-426d-b155-b0af56d16bf9 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.187582 Oct 18 15:59:01.304563 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 15:59:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:59:02.390816 n-d-858383-14 devstack@n-api.service[104487]: DEBUG nova.api.openstack.wsgi [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] Calling method '>' {{(pid=104487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:02.391880 n-d-858383-14 devstack@n-api.service[104487]: INFO nova.api.openstack.requestlog [None req-933f4712-a8ea-44e6-aae2-2aa32e9ee301 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 18 15:59:02.392274 n-d-858383-14 devstack@n-api.service[104487]: [pid: 104487|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 18 15:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:59:02.581848 n-d-858383-14 devstack@n-api.service[104488]: DEBUG nova.api.openstack.wsgi [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Calling method '>' {{(pid=104488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:02.585229 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:02.585705 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:02.586130 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:02.586831 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:02.587271 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:02.587684 n-d-858383-14 devstack@n-api.service[104488]: DEBUG oslo_concurrency.lockutils [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:02.612218 n-d-858383-14 devstack@n-api.service[104488]: INFO nova.api.openstack.requestlog [None req-b7adcfc9-86e4-45e3-b14e-e187abb4081c admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.080502 Oct 18 15:59:02.612793 n-d-858383-14 devstack@n-api.service[104488]: [pid: 104488|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 15:59:02 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:59:46.963422 n-d-858383-14 devstack@n-api.service[104486]: Tue Oct 18 15:59:46 2022 - graceful shutdown triggered... Oct 18 15:59:46.963206 n-d-858383-14 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 18 15:59:46.964392 n-d-858383-14 devstack@n-api.service[104487]: Gracefully killing worker 1 (pid: 104487)... Oct 18 15:59:46.964796 n-d-858383-14 devstack@n-api.service[104488]: Gracefully killing worker 2 (pid: 104488)... Oct 18 15:59:47.091248 n-d-858383-14 devstack@n-api.service[104487]: DEBUG dbcounter [-] [104487] Writing DB stats nova_api:SELECT=4 {{(pid=104487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:47.964210 n-d-858383-14 devstack@n-api.service[104486]: worker 1 buried after 1 seconds Oct 18 15:59:47.964797 n-d-858383-14 devstack@n-api.service[104486]: worker 2 buried after 1 seconds Oct 18 15:59:47.964797 n-d-858383-14 devstack@n-api.service[104486]: goodbye to uWSGI. Oct 18 15:59:47.965852 n-d-858383-14 systemd[1]: devstack@n-api.service: Succeeded. Oct 18 15:59:47.966400 n-d-858383-14 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 18 15:59:47.969153 n-d-858383-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 15:59:47.984746 n-d-858383-14 devstack@n-api.service[120557]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 15:59:47 2022] *** Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: nodename: n-d-858383-14 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: machine: x86_64 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: clock source: unix Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: pcre jit disabled Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: detected number of CPU cores: 4 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: current working directory: / Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: detected binary path: /usr/bin/uwsgi-core Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: your processes number limit is 47680 Oct 18 15:59:47.998311 n-d-858383-14 devstack@n-api.service[120557]: your memory page size is 4096 bytes Oct 18 15:59:47.999251 n-d-858383-14 devstack@n-api.service[120557]: detected max file descriptor number: 2048 Oct 18 15:59:47.999251 n-d-858383-14 devstack@n-api.service[120557]: lock engine: pthread robust mutexes Oct 18 15:59:47.999251 n-d-858383-14 devstack@n-api.service[120557]: thunder lock: enabled Oct 18 15:59:47.999251 n-d-858383-14 devstack@n-api.service[120557]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 15:59:47.999251 n-d-858383-14 devstack@n-api.service[120557]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 15:59:48.039893 n-d-858383-14 devstack@n-api.service[120557]: Python main interpreter initialized at 0x55c2e37639c0 Oct 18 15:59:48.039893 n-d-858383-14 devstack@n-api.service[120557]: python threads support enabled Oct 18 15:59:48.039893 n-d-858383-14 devstack@n-api.service[120557]: your server socket listen backlog is limited to 100 connections Oct 18 15:59:48.039893 n-d-858383-14 devstack@n-api.service[120557]: your mercy for graceful operations on workers is 90 seconds Oct 18 15:59:48.040368 n-d-858383-14 devstack@n-api.service[120557]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 15:59:48.040368 n-d-858383-14 devstack@n-api.service[120557]: *** Operational MODE: preforking *** Oct 18 15:59:48.040592 n-d-858383-14 devstack@n-api.service[120557]: *** uWSGI is running in multiple interpreter mode *** Oct 18 15:59:48.040592 n-d-858383-14 devstack@n-api.service[120557]: spawned uWSGI master process (pid: 120557) Oct 18 15:59:48.040805 n-d-858383-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 15:59:48.047540 n-d-858383-14 devstack@n-api.service[120557]: spawned uWSGI worker 1 (pid: 120570, cores: 1) Oct 18 15:59:48.047540 n-d-858383-14 devstack@n-api.service[120557]: spawned uWSGI worker 2 (pid: 120571, cores: 1) Oct 18 15:59:48.047540 n-d-858383-14 devstack@n-api.service[120557]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 15:59:48.712632 n-d-858383-14 devstack@n-api.service[120570]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:59:48.720335 n-d-858383-14 devstack@n-api.service[120571]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:59:49.880591 n-d-858383-14 devstack@n-api.service[120570]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:59:49.880591 n-d-858383-14 devstack@n-api.service[120570]: from cryptography.utils import int_from_bytes Oct 18 15:59:49.881232 n-d-858383-14 devstack@n-api.service[120570]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:59:49.881232 n-d-858383-14 devstack@n-api.service[120570]: from cryptography.utils import int_from_bytes Oct 18 15:59:49.913508 n-d-858383-14 devstack@n-api.service[120571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:59:49.913508 n-d-858383-14 devstack@n-api.service[120571]: from cryptography.utils import int_from_bytes Oct 18 15:59:49.914125 n-d-858383-14 devstack@n-api.service[120571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:59:49.914125 n-d-858383-14 devstack@n-api.service[120571]: from cryptography.utils import int_from_bytes Oct 18 15:59:52.303063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:59:52.303644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:59:52.303997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:59:52.304229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:59:52.304482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:59:52.304875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.305225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.305562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.306026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.306362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.306672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.306996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.307317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.307648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.307912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.308585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.308930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-14 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.309276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.309593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.309907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.310230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.310534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.310856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.311161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.311668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.312131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.312443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.312913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.313129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.313431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.313749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.314064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.314372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.314699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.315011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.315422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-14 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.315741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.316053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.316383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.316793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.317134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.317443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.317761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.318086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.318397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.318737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.319058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.319380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.319701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.320000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.320306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.320614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.320931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.321267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.321571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.321818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.322126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.322445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.322766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.323092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.323340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.323588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.324434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.324756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.325089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.325398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.325705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.326008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.326311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.326613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.326916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.327219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.327539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.327854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.328176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.328479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.328795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.329229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.329477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.329786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.330125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.330440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.330747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.331065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.331382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.331686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.331991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.332293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.332633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.332950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.333278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.333526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.333824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.334126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.334440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.334742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.335043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.335344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.335640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.335941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.336242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.336542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.336843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.337170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.337471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.337774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.338073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.338378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.338681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.339006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.339999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.340244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.340546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.340847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.341177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.341495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.341799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.342101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.342426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.342729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.343030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.343348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.343654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.343956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.344272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.344570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.344870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.345211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.345530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.345820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.346120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.346419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.346721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.347023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.347320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.347620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.347915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.348232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.348552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.348859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.349187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.349489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.349806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.350146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.350477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.350819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.351131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.351461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.351788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.352105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.352419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.352731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.353082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.353394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.353704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.354011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.354329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.354643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.355195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.355556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.356133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.356447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.356756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.357101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.357433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.357755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.358066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.358407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.358758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.359075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.359401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.359725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.360037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.360350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.360657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.361037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.361335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.361648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.361966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.362276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.362604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.362915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.363225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.363535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.363845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.364157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.364496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.364809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.365159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.365475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.365789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.366106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.366418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.366726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.367035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.367338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.367640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.367942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.368096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:59:52.368582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:59:52.368732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.368732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.369032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:59:52.369179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.369350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:59:52.369501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.369641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:59:52.369781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.369920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.370063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.370253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.371915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.372077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.372231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.372231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.372522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.372680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.372877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.373064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.373224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.373395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.373545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.373706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.373858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.373999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.374138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.374307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.374465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.374607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.374607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.374895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.375041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.375195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-14 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.375344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.375483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.375640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.375782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.375929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.376083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.376223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.376362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.376501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.376647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.376787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.376978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.377155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.377297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.377529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.377529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.377814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.377986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.378136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.378136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.378399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.378537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.378689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.378689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.378965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.378965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.379244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.379384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.379531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.379679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.379818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.379966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.380126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.380126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.380420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.380560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.380707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.380855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.381028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-14 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.381186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.381337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.381488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.381634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.381773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.381964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.382118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.382258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.382396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.382551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.382690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.382918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.383072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.383219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.383367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.383514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.383660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.383815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.383963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.383963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.384244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.384383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.384532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.384673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.384811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.384976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.385155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.385155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.385427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.385567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.385705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.385851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.385997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.386139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.386833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.386983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.387269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.387457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.388412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.388957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.389185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.389405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.389571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.389721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.389721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.390085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.390243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.390398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.390566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.390566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.390861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.391009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.391150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.391351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.391574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.391741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.391908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.392107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.392255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.392402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.392615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.392793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.392793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.393175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.393386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.393551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.393698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.393909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.394061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.394061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.394352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.394500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.394500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.394817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.394959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.395127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.395314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.395458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.395598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.395598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.395872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.396000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.396110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.396226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.396343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.396565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.396716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.396911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.397091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.397319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.397508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.397663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.397919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.398065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.398065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.398364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.398569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.398730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.398891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.399031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.399231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.399231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.399541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.399683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.399824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.399980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.399980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.400277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.400436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.400588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.400728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.400728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.400977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.401234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.401367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.401494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.401667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.402484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.402658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.402804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.402940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.403078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.403078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.403334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.403461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.403595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.403723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.403723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.404049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.404192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.404318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.404453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.404587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.404714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.404851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.404984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.405150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.405292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.405427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.405554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.405679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.405812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.405947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.406082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.406217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.406357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.406484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.406616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.406742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.406868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.406993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.407127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.407295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.407434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.407568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.407695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.407827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.407987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.408122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.408251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.408384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.408518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.408644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.408782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.408917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.409069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.409196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.409323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.409458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.409585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.409717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.409850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.409984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.410110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.410321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.410451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.410584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.410718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.410853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.410987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.411122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.411249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.411384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.411522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.411640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.411764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.411903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.412031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.412156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.412288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.412424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.412557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.412693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.412832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.412959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.413110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.413236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.413380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.413517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.413652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.413779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.413919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:59:52.414047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.414874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.415869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.416807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.417013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.417147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.417326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.417782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.417916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.418126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.418357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.418495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.418684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.418815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.419991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.420916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.421874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.422922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.423857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.424943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.425906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.426954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.427882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.428861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.429990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.430901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.431946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.432879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.433599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.433734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.433900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.434968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.435902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.436949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.437884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.438930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.439877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.440945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.441924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.442852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.443924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.444959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.445901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.446968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.447884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.448011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.448218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.448365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.448527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.448728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.449417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.449667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.449798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.450947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.451937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.452917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.453903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.454837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.455998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.456960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.457912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.458040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.458208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.458361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.459987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.460969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.461908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.462926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.463879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.464042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.464403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.464543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.464831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.465965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.466917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.467989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.468930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.469999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.470972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.471899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.472950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.473921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.474863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.475993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.476950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.477904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.478815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.479893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.480172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.480309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.480526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.480981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.481147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.481342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.481474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.481682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.481821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.482902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.483966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.484123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.484270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.485828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.489461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.489621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.489906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.490960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.491892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.492876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.493954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.494885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.495025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.495154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.495288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.495415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.496959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.497843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.498982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.499973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.500888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.501976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.502776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.503920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.504860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.505960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.506875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.507924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.508872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.509950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.510874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.511003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.511160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.511866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.512870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.513929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.514990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.515910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.516978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.517942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.518958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.519867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.520918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.521874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.522922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.523942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.524975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.525942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.526817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.527076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.527223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.527472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.527705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.527843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.528811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.529949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.530898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.531877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.532967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.533976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.534917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.535992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.536913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.537867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.538979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.539938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.540883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.541999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.542321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.542768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.542903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.543226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.543520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.543701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.543974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.544892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.545993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.546951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.547900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.548823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.549982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.550920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.551972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.552906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.553843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.554918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.555971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.556883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.557900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.558614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.558809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.559897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.560857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.561846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.562982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.563226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.563365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.563557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.563696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.563876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.564944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.565920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.566862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.567975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.568909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.569996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.570964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.571923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.572870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.573086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.573314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.573439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.573741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.574572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.574717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:59:52.574847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.575189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.575520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.577225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.577225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.578443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.579258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.579258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.579536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.580033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.583312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.584073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.584073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.584073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.584398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.584720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.585422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.585637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.585920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.586479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.586850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.587280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.587515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.587852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.588184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.588500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.588840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.589190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.589709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.590172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.590438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.590754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.591070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.591391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.591711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.592025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.592343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.592654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.593000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.593324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.593637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.593948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.594266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.594578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.594888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.595199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.595527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.595823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.596133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.596448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.596756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.597094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.597448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.597765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.598075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.598403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.598718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.599026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.599351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.599665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.599992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.600309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.600626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.600981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.601325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.601871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.602214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.602540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.602879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.603218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.603530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.603840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.604148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.604481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.604800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.605325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.606368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.606533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.606721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.607039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.607359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.607678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.607997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.608313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.608634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.608952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.609295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.609612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.609934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.610283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.610687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.610923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.611243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.611566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.611883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.612193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.612509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.612824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.613167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.613504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.613824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.614134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.614564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.614882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.615205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.615532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.615849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.616176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.616503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.616820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.617178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.617494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.617830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.618178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.618511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.618844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.619155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.619464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.619771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.620084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.620410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.621401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.621907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.622216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.622533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.622892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.623192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.623462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.623771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.624085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.624394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.624700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.625024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.625337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.625645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.625956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.626269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.626577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.626884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.627286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.627493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.627797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.628136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.628476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.628796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.629151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.629505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.629802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.630313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.630757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.631425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.631425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.631730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.632072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.632390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.632706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.633076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.633359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.633954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.633954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.634304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.634636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.634946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.635276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.635776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.635943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.637219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.637371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.637843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.638045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.638745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.638745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.639027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.639289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.639611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.639927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.640244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.640568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.640887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.641244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.641387 n-d-858383-14 devstack@n-api.service[120570]: INFO dbcounter [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Registered counter for database nova_api Oct 18 15:59:52.641580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.641897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.642229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.642563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.642917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.643237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.643583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.643917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.644237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.644553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.644857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:59:52.645128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:59:52.662031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_db.sqlalchemy.engines [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.669153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writer thread running {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.708793 n-d-858383-14 devstack@n-api.service[120571]: INFO dbcounter [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Registered counter for database nova_api Oct 18 15:59:52.725865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.context [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120570) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:59:52.729801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_db.sqlalchemy.engines [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.730044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.730657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.732564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.733272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.733714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.735713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.737506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writer thread running {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.737849 n-d-858383-14 devstack@n-api.service[120570]: INFO dbcounter [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Registered counter for database nova_cell0 Oct 18 15:59:52.741896 n-d-858383-14 devstack@n-api.service[120570]: INFO dbcounter [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Registered counter for database nova_cell1 Oct 18 15:59:52.749961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_db.sqlalchemy.engines [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.752474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_db.sqlalchemy.engines [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.760246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writer thread running {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.760608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writer thread running {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.797429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.context [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120571) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:59:52.801654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.802137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.803936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.804669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.805143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.807170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.810338 n-d-858383-14 devstack@n-api.service[120571]: INFO dbcounter [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Registered counter for database nova_cell0 Oct 18 15:59:52.814886 n-d-858383-14 devstack@n-api.service[120571]: INFO dbcounter [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Registered counter for database nova_cell1 Oct 18 15:59:52.824312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_db.sqlalchemy.engines [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.827087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_db.sqlalchemy.engines [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.832318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writer thread running {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.837422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writer thread running {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.909904 n-d-858383-14 devstack@n-api.service[120570]: INFO dbcounter [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Registered counter for database nova_cell0 Oct 18 15:59:52.916930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_db.sqlalchemy.engines [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:52.922167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writer thread running {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:52.990633 n-d-858383-14 devstack@n-api.service[120571]: INFO dbcounter [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Registered counter for database nova_cell0 Oct 18 15:59:52.998625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_db.sqlalchemy.engines [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:59:53.003797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writer thread running {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:59:53.257720 n-d-858383-14 devstack@n-api.service[120570]: WARNING keystonemiddleware.auth_token [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:59:53.265726 n-d-858383-14 devstack@n-api.service[120570]: WARNING keystonemiddleware.auth_token [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:59:53.327161 n-d-858383-14 devstack@n-api.service[120571]: WARNING keystonemiddleware.auth_token [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:59:53.334433 n-d-858383-14 devstack@n-api.service[120571]: WARNING keystonemiddleware.auth_token [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:59:53.621951 n-d-858383-14 devstack@n-api.service[120570]: WARNING keystonemiddleware.auth_token [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:59:53.627989 n-d-858383-14 devstack@n-api.service[120570]: WARNING keystonemiddleware.auth_token [None req-5dcff2aa-b40b-430a-8002-93323b7b1575 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:59:53.633307 n-d-858383-14 devstack@n-api.service[120570]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c2e37639c0 pid: 120570 (default app) Oct 18 15:59:53.679303 n-d-858383-14 devstack@n-api.service[120571]: WARNING keystonemiddleware.auth_token [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:59:53.686335 n-d-858383-14 devstack@n-api.service[120571]: WARNING keystonemiddleware.auth_token [None req-5ca6c0a1-0336-49a3-9283-c1020cc0ddcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:59:53.691799 n-d-858383-14 devstack@n-api.service[120571]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c2e37639c0 pid: 120571 (default app) Oct 18 16:00:33.579515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.581240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.582233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.583444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.256751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Calling method '.version_select at 0x7f5fd3c7bc10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:35.268112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120570) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 16:00:35.268853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:35.269533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:35.270128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:35.305938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:35.306890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:35.307358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:35.321767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:35.323013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:35.323708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:35.335752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b0c941b-f35f-4863-a756-8f07ca57f854 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.767307 Oct 18 16:00:35.336612 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1208 bytes} [Tue Oct 18 16:00:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:00:35.756130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f4f173c-f5bf-4dd3-aee8-0fb64a1b2a19 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-640847315"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:35.791804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-2f4f173c-f5bf-4dd3-aee8-0fb64a1b2a19 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Generated uuid e5399991-55c3-41c8-9fa2-57d6c5387684 for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:00:35.808046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.809777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.811174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.812532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.948323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f4f173c-f5bf-4dd3-aee8-0fb64a1b2a19 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.594078 Oct 18 16:00:35.956952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1/2] 10.222.0.78 () {62 vars in 1205 bytes} [Tue Oct 18 16:00:35 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:36.194999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a26690a-31bc-4cab-b0b6-e3638899051b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-872755642", "id": 2117713485, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:36.264612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a26690a-31bc-4cab-b0b6-e3638899051b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.698981 Oct 18 16:00:36.280426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:36.287739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4559d0a1-8a20-4bf0-b5fb-81c302281330 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1598133183"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:36.589926 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4559d0a1-8a20-4bf0-b5fb-81c302281330 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.300376 Oct 18 16:00:36.591252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3/4] 10.222.0.78 () {62 vars in 1210 bytes} [Tue Oct 18 16:00:36 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:36.596247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82c08caa-2782-49dc-ab19-61057e6560f3 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:36.656139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82c08caa-2782-49dc-ab19-61057e6560f3 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2117713485" status: 202 len: 0 microversion: 2.1 time: 0.063485 Oct 18 16:00:36.657749 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4/5] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:36 2022] DELETE /compute/v2.1/flavors/2117713485 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:37.066376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.071273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.074066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.074966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.077084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.079308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.080330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.181127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b036016-5f61-48fd-86c3-7ae1d57c33fb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.519066 Oct 18 16:00:37.182164 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 5/6] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:00:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:37.194167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '.version_select at 0x7f5fd3b20c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.197849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e538118c-0c31-485d-887c-f9c4aa973140 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.209566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e538118c-0c31-485d-887c-f9c4aa973140 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.016999 Oct 18 16:00:37.210118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120571) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 16:00:37.217312 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 6/7] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:37.217496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.217496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.217496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.217679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94e5a275-11a3-4436-98f0-308b34a14aa7 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.258643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94e5a275-11a3-4436-98f0-308b34a14aa7 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046305 Oct 18 16:00:37.259958 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 7/8] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:37.295300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.296138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.296723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.313445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.314355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.314956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.323356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bf19089-6c41-4157-9ce5-17f0da22006b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.372649 Oct 18 16:00:37.324523 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2/9] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:00:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:37.582428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Calling method '.version_select at 0x7f5fd3234e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.584866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.585611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.586300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.625132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.625789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.626370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.627589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ea1003c-b6c7-4b45-8c2f-9447abe027d4 tempest-AZAdminNegativeTestJSON-166966037 tempest-AZAdminNegativeTestJSON-166966037-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.629362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ea1003c-b6c7-4b45-8c2f-9447abe027d4 tempest-AZAdminNegativeTestJSON-166966037 tempest-AZAdminNegativeTestJSON-166966037-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '83ef7e6d488c48be89cb71ff6858d444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acfb4c9e04743d2a597d1c4ec387266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ea1003c-b6c7-4b45-8c2f-9447abe027d4 tempest-AZAdminNegativeTestJSON-166966037 tempest-AZAdminNegativeTestJSON-166966037-project] Request method failure captured: Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2hGPzBz6ds7im6Sj4zXg0K0ugGe-wQSbb3IMdg00qjumM1ocx4Fm86nPjIIzC1pExQhPiXX3nBl5biwOPFSJ3K2P-M6IJNz7R4lw2vxFfPn6h1K1xGqqkLCk9pTQNko1ZcXI35pDELArmaACJ0-02G8FDjXxiPSViPobtnOE2K2jI Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 0acfb4c9e04743d2a597d1c4ec387266 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AZAdminNegativeTestJSON-166966037 Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:00:37.639234 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0acfb4c9e04743d2a597d1c4ec387266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0acfb4c9e04743d2a597d1c4ec387266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0acfb4c9e04743d2a597d1c4ec387266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0acfb4c9e04743d2a597d1c4ec387266"}]}] Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AZAdminNegativeTestJSON-166966037 Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 0acfb4c9e04743d2a597d1c4ec387266 Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-166966037 Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AZAdminNegativeTestJSON-166966037-project Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 83ef7e6d488c48be89cb71ff6858d444 Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AZAdminNegativeTestJSON-166966037-project Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 16:00:37.640407 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:00:37.641224 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:37.642267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ea1003c-b6c7-4b45-8c2f-9447abe027d4 tempest-AZAdminNegativeTestJSON-166966037 tempest-AZAdminNegativeTestJSON-166966037-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:37.643168 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ea1003c-b6c7-4b45-8c2f-9447abe027d4 tempest-AZAdminNegativeTestJSON-166966037 tempest-AZAdminNegativeTestJSON-166966037-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.314600 Oct 18 16:00:37.646629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3/10] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 321 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:37.648349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.648975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.649626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.657431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7255292f-f9df-4184-aa46-591b9c809616 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.386336 Oct 18 16:00:37.664740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de15656a-0a21-4032-93c6-8c0fcead7250 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:37.666272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 8/11] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:37.673022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ec41670-ed81-456b-aaf7-1ffc37029f95 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1596935876", "id": 800308329, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:37.679930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15656a-0a21-4032-93c6-8c0fcead7250 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.683211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15656a-0a21-4032-93c6-8c0fcead7250 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.683743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15656a-0a21-4032-93c6-8c0fcead7250 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.702287 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ec41670-ed81-456b-aaf7-1ffc37029f95 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034191 Oct 18 16:00:37.703340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 9/12] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:37 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:37.708975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Calling method '.version_select at 0x7f5fd3235040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.711956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.712803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.713409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.733652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:37.734414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:37.735107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.743230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0cc64e5a-9dcc-476c-8967-c81e43f2b5a2 tempest-HypervisorAdminV228Test-279913979 tempest-HypervisorAdminV228Test-279913979-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.038637 Oct 18 16:00:37.756538 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 10/13] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:37.765274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8050417-585f-4f61-9707-833c2ed230c2 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.816961 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8050417-585f-4f61-9707-833c2ed230c2 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.059937 Oct 18 16:00:37.834573 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 11/14] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:37.841460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25a8c15b-ba0f-4fdd-92f6-1fe44644641e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.873627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25a8c15b-ba0f-4fdd-92f6-1fe44644641e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/800308329" status: 202 len: 0 microversion: 2.1 time: 0.037392 Oct 18 16:00:37.879376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 12/15] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:37 2022] DELETE /compute/v2.1/flavors/800308329 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:00:37.886180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e1d13a2-0970-4cc5-9f9c-8d720563cb91 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:37.919234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e1d13a2-0970-4cc5-9f9c-8d720563cb91 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037906 Oct 18 16:00:37.921443 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 13/16] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:37.943120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3f1f3f5-5b72-4de7-bf20-61aeec38c97b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1294665918", "id": 1259832096, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:37.969500 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3f1f3f5-5b72-4de7-bf20-61aeec38c97b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.029805 Oct 18 16:00:37.979779 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 14/17] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:37 2022] POST /compute/v2.1/flavors => generated 429 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:37.985569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77af16e9-f913-45c3-b504-0b7cec533a2f tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.006133 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77af16e9-f913-45c3-b504-0b7cec533a2f tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1259832096" status: 202 len: 0 microversion: 2.1 time: 0.025043 Oct 18 16:00:38.008135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 15/18] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:37 2022] DELETE /compute/v2.1/flavors/1259832096 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:38.016629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe967915-be4e-46f1-9d62-e7e240d2a66e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.040236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe967915-be4e-46f1-9d62-e7e240d2a66e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025895 Oct 18 16:00:38.049163 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 16/19] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:38.062117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97f94faa-115d-466f-9ace-d00450c99748 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1012177156", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:38.089070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97f94faa-115d-466f-9ace-d00450c99748 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029235 Oct 18 16:00:38.090580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 17/20] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:38 2022] POST /compute/v2.1/flavors => generated 507 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:38.105349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5935a20-88e7-4886-a034-5e4d8e9718ca tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.134178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5935a20-88e7-4886-a034-5e4d8e9718ca tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/baac2b27-98c6-40b0-acc2-6bd832ce4411" status: 202 len: 0 microversion: 2.1 time: 0.035140 Oct 18 16:00:38.137157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 18/21] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:00:38 2022] DELETE /compute/v2.1/flavors/baac2b27-98c6-40b0-acc2-6bd832ce4411 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:38.151199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c75bb9f2-0d89-41e1-8500-9caefaa0555a tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.185216 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c75bb9f2-0d89-41e1-8500-9caefaa0555a tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040020 Oct 18 16:00:38.185999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 19/22] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:38.210853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cec51169-de25-4e2c-85b8-b96b008db1df tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1138400670", "id": "0f6e8d9f-fe85-46e4-b325-cb378b1dec82", "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:38.238497 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cec51169-de25-4e2c-85b8-b96b008db1df tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028963 Oct 18 16:00:38.238497 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 20/23] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:38 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:38.255958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-def86953-a748-4952-820c-25833e61f2ef tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.281410 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-def86953-a748-4952-820c-25833e61f2ef tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/0f6e8d9f-fe85-46e4-b325-cb378b1dec82" status: 202 len: 0 microversion: 2.1 time: 0.034028 Oct 18 16:00:38.282581 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 21/24] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:00:38 2022] DELETE /compute/v2.1/flavors/0f6e8d9f-fe85-46e4-b325-cb378b1dec82 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:00:38.292415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6860f124-ba38-4b3b-88ef-14e6efbccbe2 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.315052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6860f124-ba38-4b3b-88ef-14e6efbccbe2 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028321 Oct 18 16:00:38.316186 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 22/25] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:38.339677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b9e96a5-8e0f-42f3-a429-cdbac0ed644e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-979875925", "id": 1004672287, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:38.369900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b9e96a5-8e0f-42f3-a429-cdbac0ed644e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.034509 Oct 18 16:00:38.373200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 23/26] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:38 2022] POST /compute/v2.1/flavors => generated 413 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:38.384143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09e3cf79-6712-4eff-81f7-5000ede64a91 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.425222 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09e3cf79-6712-4eff-81f7-5000ede64a91 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1004672287" status: 200 len: 413 microversion: 2.1 time: 0.045560 Oct 18 16:00:38.431326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 24/27] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/flavors/1004672287 => generated 413 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:38.857534 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de15656a-0a21-4032-93c6-8c0fcead7250 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.209329 Oct 18 16:00:38.858467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4/28] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Oct 18 16:00:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:38.870710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dfaa1c8f-7a1b-44e0-b4e7-968eeb81db06 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:38.905212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfaa1c8f-7a1b-44e0-b4e7-968eeb81db06 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:38.905859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfaa1c8f-7a1b-44e0-b4e7-968eeb81db06 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:38.906306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfaa1c8f-7a1b-44e0-b4e7-968eeb81db06 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:39.166261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dfaa1c8f-7a1b-44e0-b4e7-968eeb81db06 tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.296805 Oct 18 16:00:39.167019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 5/29] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Oct 18 16:00:38 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:00:39.184116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78ac9a33-7f03-46fe-ab3a-729b796ea8cb tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.268718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78ac9a33-7f03-46fe-ab3a-729b796ea8cb tempest-AggregatesAdminTestV241-2053455609 tempest-AggregatesAdminTestV241-2053455609-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.089382 Oct 18 16:00:39.269487 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 6/30] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 16:00:39 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:39.300785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77d5d2d9-c9a1-4cb6-8c40-6b761f910801 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-108760122", "name": "tempest-test_aggregate-1001404014"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:39.324453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-999e43ad-5155-44ce-8776-c35991051305 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.375100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-77d5d2d9-c9a1-4cb6-8c40-6b761f910801 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 3d349de4-2651-4094-9ff7-c25c55c31fad for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:00:39.412255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-999e43ad-5155-44ce-8776-c35991051305 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.974923 Oct 18 16:00:39.414384 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 25/31] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:39.451231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee96a8e0-4888-44c0-9f97-a1428024a7e4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.454085 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77d5d2d9-c9a1-4cb6-8c40-6b761f910801 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.157329 Oct 18 16:00:39.473700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 7/32] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 18 16:00:39 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:39.481953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec215f8b-ed0f-418b-98dd-f06bbced7366 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.488397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=15 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:39.494981 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee96a8e0-4888-44c0-9f97-a1428024a7e4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1004672287" status: 202 len: 0 microversion: 2.1 time: 0.049443 Oct 18 16:00:39.502303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 26/33] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:39 2022] DELETE /compute/v2.1/flavors/1004672287 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:39.513607 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec215f8b-ed0f-418b-98dd-f06bbced7366 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.036086 Oct 18 16:00:39.521263 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 8/34] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:00:39 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:39.521657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf95d8b9-2de4-4f21-a112-ab4b099669c4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.535169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bf995119-cd6d-43e5-95e5-83966696978b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:39.559517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf995119-cd6d-43e5-95e5-83966696978b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:39.562444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf995119-cd6d-43e5-95e5-83966696978b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:39.563184 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf95d8b9-2de4-4f21-a112-ab4b099669c4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058465 Oct 18 16:00:39.563607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf995119-cd6d-43e5-95e5-83966696978b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:39.584201 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 27/35] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:39.907135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bf995119-cd6d-43e5-95e5-83966696978b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.377605 Oct 18 16:00:39.908314 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 9/36] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:00:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:39.913258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4398fb5f-5c54-464f-b3cd-d6508a92248a tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-872223075", "id": 859325477, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:40.025619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4398fb5f-5c54-464f-b3cd-d6508a92248a tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.115628 Oct 18 16:00:40.028924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b25730f2-bd07-4d5d-ba05-6f3deb8b6f29 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2050884071", "ram": 512, "vcpus": 1, "disk": 10, "id": 1130261775, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:40.031440 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 10/37] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:39 2022] POST /compute/v2.1/flavors => generated 426 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:40.046201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ca0bb29-c317-4383-9e68-c7ccf136731f tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "859325477"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:40.072321 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b25730f2-bd07-4d5d-ba05-6f3deb8b6f29 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.484650 Oct 18 16:00:40.074324 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 28/38] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:39 2022] POST /compute/v2.1/flavors => generated 416 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:40.082076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4ca0bb29-c317-4383-9e68-c7ccf136731f tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] HTTP exception thrown: Flavor 859325477 could not be found. Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ca0bb29-c317-4383-9e68-c7ccf136731f tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Request method failure captured: Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 106 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2gOVfLKae_8u_58Re82f9R-8xEdZQUfOaAR_NUV50YCF1mUqvXVoAO1LPMryI6fXVl2o6V2e_cOPObILw8VB7BXJM0JN3KTpJuthRTgkBwbdVpvSafKvr6pVKzhiSOsnhO_jzP3NzMOX6uxhKk8F9RLcX1Yx1JtureSshgzLgkq_U Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1dcb9023ecb24b37b0473fda93a98753 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAdminTestJSON-67282336 Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:00:40.086474 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1dcb9023ecb24b37b0473fda93a98753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1dcb9023ecb24b37b0473fda93a98753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1dcb9023ecb24b37b0473fda93a98753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1dcb9023ecb24b37b0473fda93a98753"}]}] Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAdminTestJSON-67282336 Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1dcb9023ecb24b37b0473fda93a98753 Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-67282336 Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAdminTestJSON-67282336-project Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e461c8b3309147d8b63c734508763dea Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAdminTestJSON-67282336-project Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "test", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "859325477"}} Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:00:40.087708 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor 859325477 could not be found. Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '859325477'}}} Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 859325477 could not be found. Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.088689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 859325477 could not be found. Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.089838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:40.090788 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:40.090788 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:40.090788 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:40.090788 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 859325477 could not be found. Oct 18 16:00:40.090788 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.092861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ca0bb29-c317-4383-9e68-c7ccf136731f tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Returning 400 to user: Flavor 859325477 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:40.093972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ca0bb29-c317-4383-9e68-c7ccf136731f tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.054406 Oct 18 16:00:40.095138 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 11/39] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:40 2022] POST /compute/v2.1/servers => generated 80 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:40.106877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8aa8c05b-9c95-495a-a756-96051d5ddfc9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:40.142725 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8aa8c05b-9c95-495a-a756-96051d5ddfc9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/859325477" status: 202 len: 0 microversion: 2.1 time: 0.042010 Oct 18 16:00:40.144497 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 12/40] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:40 2022] DELETE /compute/v2.1/flavors/859325477 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:00:40.154704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f3d6a43-e8b8-4a0b-8963-18f0e5009bcb tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:40.236035 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f3d6a43-e8b8-4a0b-8963-18f0e5009bcb tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.087110 Oct 18 16:00:40.237997 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 13/41] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:40.264049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e98eb9d-87f4-4e00-86ed-ffb9167f26e6 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-864552903", "id": 707793576, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:40.297431 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e98eb9d-87f4-4e00-86ed-ffb9167f26e6 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039295 Oct 18 16:00:40.301871 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 14/42] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:40 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:40.311213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76b2f115-1d4b-4933-85b0-29a039600080 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-24243403", "id": 644378865, "os-flavor-access:is_public": "True"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:40.354610 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76b2f115-1d4b-4933-85b0-29a039600080 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.044796 Oct 18 16:00:40.356771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 15/43] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:40.376838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3b2a5d8-a17e-4966-9f0a-d34170604e6d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:40.415700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3b2a5d8-a17e-4966-9f0a-d34170604e6d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.050587 Oct 18 16:00:40.418303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 16/44] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 18 16:00:40 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:40.922100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba03ee96-e24d-4392-bd77-4472a65d8745 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:40.969735 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ba03ee96-e24d-4392-bd77-4472a65d8745 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] HTTP exception thrown: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba03ee96-e24d-4392-bd77-4472a65d8745 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Request method failure captured: Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2lpKxg3KB_D6k-3iPYjPoSxQXHcYAz0YFZnGSLmMwoPhW-iKlYKijuaIhF07kT4QtZCPF-1VGDZ6h6fTmw4727RD0DqSwGveNNqJMnuHrWQrJD4ze8yyzdT1ynvWHNf3sEI4uhX88VnbNwoJgbFjvO-mlICOdTV-mWXRivlfjgPVk Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:00:40.977857 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_351470dfeabd4647b5a3ed904652535f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}] Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e04062574cab47d4bd97e3704b6d272c Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:40.979096 n-d-858383-14 devstack@n-api.service[120570]: exception: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:cpu_thread_policy'} Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:40.979704 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:40.981059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba03ee96-e24d-4392-bd77-4472a65d8745 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Returning 404 to user: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:40.983449 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba03ee96-e24d-4392-bd77-4472a65d8745 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] 10.222.0.78 "GET /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.896773 Oct 18 16:00:40.985264 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 29/45] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:00:40 2022] GET /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 900 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:00:41.006594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4be34dd0-06e6-4c6f-8320-81df4abd28e7 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.061130 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4be34dd0-06e6-4c6f-8320-81df4abd28e7 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.073469 Oct 18 16:00:41.063928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 30/46] 10.222.0.78 () {58 vars in 1177 bytes} [Tue Oct 18 16:00:40 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:41.095156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ac40c7-78cc-442a-89e3-e9cd11f28950 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.128449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ac40c7-78cc-442a-89e3-e9cd11f28950 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e04062574cab47d4bd97e3704b6d272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351470dfeabd4647b5a3ed904652535f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ac40c7-78cc-442a-89e3-e9cd11f28950 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Request method failure captured: Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/flavors/1130261775/os-extra_specs HTTP/1.1 Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 66 Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2lpKxg3KB_D6k-3iPYjPoSxQXHcYAz0YFZnGSLmMwoPhW-iKlYKijuaIhF07kT4QtZCPF-1VGDZ6h6fTmw4727RD0DqSwGveNNqJMnuHrWQrJD4ze8yyzdT1ynvWHNf3sEI4uhX88VnbNwoJgbFjvO-mlICOdTV-mWXRivlfjgPVk Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:00:41.148462 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_351470dfeabd4647b5a3ed904652535f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}] Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e04062574cab47d4bd97e3704b6d272c Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 18 16:00:41.150411 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:00:41.151399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 16:00:41.152499 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.155606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ac40c7-78cc-442a-89e3-e9cd11f28950 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.159206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49ac40c7-78cc-442a-89e3-e9cd11f28950 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] 10.222.0.78 "POST /compute/v2.1/flavors/1130261775/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.081693 Oct 18 16:00:41.168478 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 31/47] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:41 2022] POST /compute/v2.1/flavors/1130261775/os-extra_specs => generated 124 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:41.183697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b82ca796-fad7-4dc1-aad7-0226941c4f0d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.211572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b82ca796-fad7-4dc1-aad7-0226941c4f0d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.039650 Oct 18 16:00:41.217211 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 32/48] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:41.227566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40b49142-3c32-4255-b8b1-745cec15a332 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.282088 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40b49142-3c32-4255-b8b1-745cec15a332 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1130261775/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063432 Oct 18 16:00:41.282869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 33/49] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:41 2022] POST /compute/v2.1/flavors/1130261775/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:41.292580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f8cfd17-470d-4faa-9369-a81cf5dfd6ab tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.317356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f8cfd17-470d-4faa-9369-a81cf5dfd6ab tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.032756 Oct 18 16:00:41.319719 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 34/50] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:41.330099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efe656be-dfb0-4523-966c-2d0ba02da9de tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.332359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-efe656be-dfb0-4523-966c-2d0ba02da9de tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e04062574cab47d4bd97e3704b6d272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351470dfeabd4647b5a3ed904652535f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efe656be-dfb0-4523-966c-2d0ba02da9de tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Request method failure captured: Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2lpKxg3KB_D6k-3iPYjPoSxQXHcYAz0YFZnGSLmMwoPhW-iKlYKijuaIhF07kT4QtZCPF-1VGDZ6h6fTmw4727RD0DqSwGveNNqJMnuHrWQrJD4ze8yyzdT1ynvWHNf3sEI4uhX88VnbNwoJgbFjvO-mlICOdTV-mWXRivlfjgPVk Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:00:41.334819 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_351470dfeabd4647b5a3ed904652535f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}] Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e04062574cab47d4bd97e3704b6d272c Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.336087 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:numa_nodes'} Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:00:41.336734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 16:00:41.338541 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.341051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efe656be-dfb0-4523-966c-2d0ba02da9de tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.342339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-efe656be-dfb0-4523-966c-2d0ba02da9de tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] 10.222.0.78 "DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021230 Oct 18 16:00:41.350704 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 35/51] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:00:41 2022] DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:41.358296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41ebeff7-a835-4060-ba9c-d8930764562e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.419385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-41ebeff7-a835-4060-ba9c-d8930764562e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5796 microversion: 2.1 time: 0.066002 Oct 18 16:00:41.421670 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 36/52] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5796 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.427487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1369802850", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "availability_zone": "tempest-test_az-108760122"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.428878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c869f72c-f685-4b31-97e8-1350c3cb1294 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.446664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:41.447281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:41.447894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:41.448751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:41.449674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:41.450366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:41.464137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c869f72c-f685-4b31-97e8-1350c3cb1294 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1130261775/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041103 Oct 18 16:00:41.466206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 37/53] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:41 2022] POST /compute/v2.1/flavors/1130261775/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:41.487109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0069128f-5ba3-4139-acf0-7d8a85c012a9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.517978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0069128f-5ba3-4139-acf0-7d8a85c012a9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5796 microversion: 2.1 time: 0.039267 Oct 18 16:00:41.518447 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 38/54] 10.222.0.78 () {58 vars in 1175 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5796 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.525535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4824772-bc1f-4ca4-a368-c62389682ec4 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.528978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4824772-bc1f-4ca4-a368-c62389682ec4 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e04062574cab47d4bd97e3704b6d272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351470dfeabd4647b5a3ed904652535f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4824772-bc1f-4ca4-a368-c62389682ec4 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Request method failure captured: Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 22 Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2lpKxg3KB_D6k-3iPYjPoSxQXHcYAz0YFZnGSLmMwoPhW-iKlYKijuaIhF07kT4QtZCPF-1VGDZ6h6fTmw4727RD0DqSwGveNNqJMnuHrWQrJD4ze8yyzdT1ynvWHNf3sEI4uhX88VnbNwoJgbFjvO-mlICOdTV-mWXRivlfjgPVk Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:00:41.530917 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_351470dfeabd4647b5a3ed904652535f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/351470dfeabd4647b5a3ed904652535f"}]}] Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 351470dfeabd4647b5a3ed904652535f Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e04062574cab47d4bd97e3704b6d272c Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: {"hw:numa_nodes": "1"} Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.531956 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:00:41.532614 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 16:00:41.533526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.534423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4824772-bc1f-4ca4-a368-c62389682ec4 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.534423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4824772-bc1f-4ca4-a368-c62389682ec4 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868 tempest-FlavorsExtraSpecsNegativeTestJSON-1051681868-project] 10.222.0.78 "PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012858 Oct 18 16:00:41.534423 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 39/55] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 18 16:00:41 2022] PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:41.542583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8d16c4f-c6a6-40ca-a982-14b04b8a771d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.568391 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8d16c4f-c6a6-40ca-a982-14b04b8a771d tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5796 microversion: 2.1 time: 0.034061 Oct 18 16:00:41.578644 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 40/56] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5796 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.578644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bb6a640-b7d5-48a4-8885-13465eab81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.583090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-2bb6a640-b7d5-48a4-8885-13465eab81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] HTTP exception thrown: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bb6a640-b7d5-48a4-8885-13465eab81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Request method failure captured: Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2nSIsgRKcIL2akTYCBp9hpSRwsH1TRlAABDIIvnwz_5aolPIIBCAPuX4kiKhcraJV4MYsztENzAdsifjGsgchMsPc6eTba8_O1TdW4Fy_VWL2I0NncrRv5SlhGCnZQNFN2-hWrDPXZwoWr7lBR6bZ11QIEyRdYsBEIv8l6Shpqy70 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:00:41.583753 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}] Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 44281e3c9f48493baf5dd9bb02afc211 Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.588887 n-d-858383-14 devstack@n-api.service[120570]: exception: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:cpu_thread_policy'} Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.589725 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bb6a640-b7d5-48a4-8885-13465eab81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Returning 404 to user: Flavor 1130261775 has no extra specs with key hw:cpu_thread_policy. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2bb6a640-b7d5-48a4-8885-13465eab81d2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015188 Oct 18 16:00:41.590982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 41/57] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:00:41 2022] DELETE /compute/v2.1/flavors/1130261775/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:41.596183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-939d7b5c-a33c-4650-af10-b74db45322a4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.620600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-939d7b5c-a33c-4650-af10-b74db45322a4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5796 microversion: 2.1 time: 0.028061 Oct 18 16:00:41.621309 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 42/58] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5796 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.633302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b230b8f-a972-4cd4-83f4-6fb4270508e2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.637317 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0b230b8f-a972-4cd4-83f4-6fb4270508e2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b230b8f-a972-4cd4-83f4-6fb4270508e2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Request method failure captured: Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 27 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2nSIsgRKcIL2akTYCBp9hpSRwsH1TRlAABDIIvnwz_5aolPIIBCAPuX4kiKhcraJV4MYsztENzAdsifjGsgchMsPc6eTba8_O1TdW4Fy_VWL2I0NncrRv5SlhGCnZQNFN2-hWrDPXZwoWr7lBR6bZ11QIEyRdYsBEIv8l6Shpqy70 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:00:41.641915 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}] Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 44281e3c9f48493baf5dd9bb02afc211 Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: {"hw:cpu_policy": "shared"} Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.643171 n-d-858383-14 devstack@n-api.service[120570]: exception: Request body and URI mismatch Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.644294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b230b8f-a972-4cd4-83f4-6fb4270508e2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b230b8f-a972-4cd4-83f4-6fb4270508e2 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020975 Oct 18 16:00:41.645471 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 43/59] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 18 16:00:41 2022] PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:41.648611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db69f487-cec1-4dc8-a592-374283d30960 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.672408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db69f487-cec1-4dc8-a592-374283d30960 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/644378865" status: 202 len: 0 microversion: 2.1 time: 0.027052 Oct 18 16:00:41.676112 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 44/60] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:41 2022] DELETE /compute/v2.1/flavors/644378865 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:41.679979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbccb8f6-1c47-442c-800e-d9c69bbd75a8 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbccb8f6-1c47-442c-800e-d9c69bbd75a8 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Request method failure captured: Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 49 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2nSIsgRKcIL2akTYCBp9hpSRwsH1TRlAABDIIvnwz_5aolPIIBCAPuX4kiKhcraJV4MYsztENzAdsifjGsgchMsPc6eTba8_O1TdW4Fy_VWL2I0NncrRv5SlhGCnZQNFN2-hWrDPXZwoWr7lBR6bZ11QIEyRdYsBEIv8l6Shpqy70 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:00:41.691889 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_29dbd2f7c07547fd8edaa5ba700cabcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29dbd2f7c07547fd8edaa5ba700cabcc"}]}] Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 29dbd2f7c07547fd8edaa5ba700cabcc Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 44281e3c9f48493baf5dd9bb02afc211 Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 18 16:00:41.693247 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'flavor_id': '1130261775', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance: Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 18 16:00:41.693910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.695078 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbccb8f6-1c47-442c-800e-d9c69bbd75a8 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cbccb8f6-1c47-442c-800e-d9c69bbd75a8 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020847 Oct 18 16:00:41.696648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 45/61] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 18 16:00:41 2022] PUT /compute/v2.1/flavors/1130261775/os-extra_specs/hw:numa_nodes => generated 117 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:00:41.702368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9c365bf-33ef-4615-ab84-acb9e58d212b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.731920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9c365bf-33ef-4615-ab84-acb9e58d212b tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.035176 Oct 18 16:00:41.745471 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 46/62] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.745471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c6e3fca-6f5e-4f0c-8b82-fa07901a96df tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.762453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c6e3fca-6f5e-4f0c-8b82-fa07901a96df tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1130261775" status: 202 len: 0 microversion: 2.1 time: 0.027948 Oct 18 16:00:41.766244 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 47/63] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:41 2022] DELETE /compute/v2.1/flavors/1130261775 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:41.771654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0062b3f4-91c5-4d70-a01a-8afef706e645 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.794850 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0062b3f4-91c5-4d70-a01a-8afef706e645 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/707793576" status: 202 len: 0 microversion: 2.1 time: 0.027431 Oct 18 16:00:41.797637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 48/64] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:41 2022] DELETE /compute/v2.1/flavors/707793576 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:41.802490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f623fb5f-90bd-4040-b40f-054203f970f9 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.825821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f623fb5f-90bd-4040-b40f-054203f970f9 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012 tempest-FlavorsExtraSpecsNegativeTestJSON-878744012-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027253 Oct 18 16:00:41.826741 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 49/65] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.831050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0492edd0-1d0b-4066-867b-72b344a0e226 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.851650 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0492edd0-1d0b-4066-867b-72b344a0e226 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023840 Oct 18 16:00:41.852247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 50/66] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.879493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0225443-baeb-415a-8734-f8c2830b84ad tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1555608194", "id": 2086376426, "os-flavor-access:is_public": "False"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.901742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0225443-baeb-415a-8734-f8c2830b84ad tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.025699 Oct 18 16:00:41.902283 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 51/67] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:41 2022] POST /compute/v2.1/flavors => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:41.913720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b253fa53-958e-42d9-8640-af2a33c1dfc9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.936743 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b253fa53-958e-42d9-8640-af2a33c1dfc9 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026488 Oct 18 16:00:41.940861 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 52/68] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:41.961706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c722800-f1d5-4382-9d8a-bd039afe6da2 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:41.987381 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c722800-f1d5-4382-9d8a-bd039afe6da2 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030875 Oct 18 16:00:41.988627 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 53/69] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:42.007982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72ae1c74-2fc5-45ae-9d8a-7349050a0635 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.030516 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72ae1c74-2fc5-45ae-9d8a-7349050a0635 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2086376426" status: 202 len: 0 microversion: 2.1 time: 0.026460 Oct 18 16:00:42.031190 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 54/70] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:42 2022] DELETE /compute/v2.1/flavors/2086376426 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:00:42.042392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c58a335f-7ebe-40f7-a25c-7489de97c80e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.074489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c58a335f-7ebe-40f7-a25c-7489de97c80e tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037749 Oct 18 16:00:42.075244 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 55/71] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:42.099570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4df54217-6cb2-4ef5-b025-8919c29e33ee tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-950544294", "id": 620678318, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:42.121845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=15,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:42.125433 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4df54217-6cb2-4ef5-b025-8919c29e33ee tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.033195 Oct 18 16:00:42.126168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 56/72] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:42 2022] POST /compute/v2.1/flavors => generated 410 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:42.142705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0759090-6cc2-4337-ae46-208a10786f25 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.169634 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0759090-6cc2-4337-ae46-208a10786f25 tempest-FlavorsAdminTestJSON-67282336 tempest-FlavorsAdminTestJSON-67282336-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.033014 Oct 18 16:00:42.177741 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 57/73] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:42 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:42.193400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf44d650-e199-41c9-90cd-c1dc5c1332d5 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.217517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf44d650-e199-41c9-90cd-c1dc5c1332d5 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/620678318" status: 202 len: 0 microversion: 2.1 time: 0.029914 Oct 18 16:00:42.218412 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 58/74] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:42 2022] DELETE /compute/v2.1/flavors/620678318 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:42.226596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31ee50db-20a2-4268-8ada-544d97724ae4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.248438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31ee50db-20a2-4268-8ada-544d97724ae4 tempest-FlavorsAdminTestJSON-676524813 tempest-FlavorsAdminTestJSON-676524813-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025804 Oct 18 16:00:42.261361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 59/75] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:43.012266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:00:43.422192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:00:43.422618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:00:43.423092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:00:43.423505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:00:43.423907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:00:43.439096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:43.439747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:43.440407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:43.441426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:43.442221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:43.442775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:43.536194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Getting quotas for project 187142db0e8645c6a31350392a6b5d33. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:00:43.575149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Getting quotas for user 8820c273919741fa8a16b0486dabb283 and project 187142db0e8645c6a31350392a6b5d33. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:00:43.610666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:00:43.613630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:00:43.736421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09115b12-725b-4dd3-8380-54ff5e8bd3d7 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.314218 Oct 18 16:00:43.743149 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 17/76] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:00:43.750122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31300afa-1d5a-49b2-99d7-4e71b74043af tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:43.750855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31300afa-1d5a-49b2-99d7-4e71b74043af tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:45.696038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31300afa-1d5a-49b2-99d7-4e71b74043af tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:45.737204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31300afa-1d5a-49b2-99d7-4e71b74043af tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1242 microversion: 2.1 time: 1.990297 Oct 18 16:00:45.741285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 60/77] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:43 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1242 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:46.766214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:46.767322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:46.789924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:46.792492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:46.793311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:46.794362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:46.794979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:46.795770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:47.358759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:47.382376 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-395a8857-1bc7-447c-906a-fb2775eeb400 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1290 microversion: 2.1 time: 0.619787 Oct 18 16:00:47.404892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 18/78] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:46 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1290 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:48.412207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:48.413650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:48.418327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:48.420638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=18 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:48.434107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:48.434847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:48.435445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:48.436373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:48.437554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:48.441756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:48.764958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:48.782798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-efe7447b-62d0-4fb7-948e-fb3aa0f95d21 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1296 microversion: 2.1 time: 0.375460 Oct 18 16:00:48.785448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 61/79] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:48 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1296 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:49.805871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:49.806541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:49.817034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:49.817517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:49.817951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:49.818657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:49.819106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:49.828525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:50.013030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2090281041", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:50.032421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=11,nova_api:DELETE=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:50.109962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:00:50.306521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:50.329935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3f2458e-8ece-4f2e-8af6-c095f554b5c6 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.527814 Oct 18 16:00:50.356866 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 62/80] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:49 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:50.781807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:00:50.782996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:00:50.783875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:00:50.784761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:00:50.785841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:00:50.823174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:50.824139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:50.825408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:50.826391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:50.827231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:50.838047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:50.867294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Getting quotas for project db104ba093c34a81b677c769995db538. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:00:50.883744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Getting quotas for user f01c86c8f32c4035a71dd59fc55eccdc and project db104ba093c34a81b677c769995db538. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:00:50.903976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:00:50.906949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:00:51.044409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1380ddf-fc2c-45fb-87ae-fbbbd534462f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692048 Oct 18 16:00:51.058018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 19/81] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:00:51.065158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b47fae6-9918-4e45-be60-197f6b581f97 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:51.065735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b47fae6-9918-4e45-be60-197f6b581f97 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:51.265451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5b47fae6-9918-4e45-be60-197f6b581f97 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:51.299261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b47fae6-9918-4e45-be60-197f6b581f97 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1220 microversion: 2.1 time: 0.239956 Oct 18 16:00:51.299866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 20/82] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:51 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:51.364525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:51.366715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:51.383043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:51.386028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:51.386641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:51.387946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:51.389451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:51.391695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:51.853771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:51.869342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d75bf908-0b8c-421b-b7a0-295bfb52d649 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.509233 Oct 18 16:00:51.887050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 21/83] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:51 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:51.965311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c282830f-db83-4d1e-8ea4-aa426bc0de26 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-660873144", "ram": 512, "vcpus": 1, "disk": 10, "id": 1020486781, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:52.016473 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c282830f-db83-4d1e-8ea4-aa426bc0de26 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.461708 Oct 18 16:00:52.034072 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 63/84] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:50 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:52.050704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b681971-7c98-4d10-8701-d516f0d7375d tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:52.163770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b681971-7c98-4d10-8701-d516f0d7375d tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.121798 Oct 18 16:00:52.164398 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 64/85] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:52 2022] POST /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:52.723365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adde5c13-7a00-4460-afc5-6f4e37c53ab2 tempest-FlavorsExtraSpecsTestJSON-113284782 tempest-FlavorsExtraSpecsTestJSON-113284782-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:52.752782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adde5c13-7a00-4460-afc5-6f4e37c53ab2 tempest-FlavorsExtraSpecsTestJSON-113284782 tempest-FlavorsExtraSpecsTestJSON-113284782-project] 10.222.0.78 "GET /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.581753 Oct 18 16:00:52.757884 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 65/86] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:00:52 2022] GET /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:52.773923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1df2d133-27c6-49c9-ae7a-2a6cb4ea11a4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:52.780485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1df2d133-27c6-49c9-ae7a-2a6cb4ea11a4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:52.896854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2fb48b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:53.302865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:53.304277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:53.306369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:53.313575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:53.314475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:53.315718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:53.352035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1df2d133-27c6-49c9-ae7a-2a6cb4ea11a4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:53.362801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1df2d133-27c6-49c9-ae7a-2a6cb4ea11a4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1220 microversion: 2.1 time: 0.603533 Oct 18 16:00:53.365682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 66/87] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:52 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1220 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:53.377348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa32a9f7-9a88-49f1-8fb8-19669e1de770 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:53.475131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa32a9f7-9a88-49f1-8fb8-19669e1de770 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.107223 Oct 18 16:00:53.475743 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 67/88] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:53 2022] POST /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:53.485984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:53.488606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:53.499503 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98067c20-816a-4f0e-8653-f00eca74399b tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd" status: 200 len: 240 microversion: 2.36 time: 1.611240 Oct 18 16:00:53.501356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 22/89] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Oct 18 16:00:51 2022] PUT /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd => generated 240 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:53.513549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:53.514266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:53.517161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:53.518170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:53.518944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:53.519525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:54.020569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ea361dc-59ed-4ec3-b9c2-ca06d303cfbb tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:54.039621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ea361dc-59ed-4ec3-b9c2-ca06d303cfbb tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.536886 Oct 18 16:00:54.054858 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 23/90] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:00:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:54.067958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4990f717-5690-4b4e-b0f1-506c4d04bb94 tempest-FlavorsExtraSpecsTestJSON-113284782 tempest-FlavorsExtraSpecsTestJSON-113284782-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:54.107760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4990f717-5690-4b4e-b0f1-506c4d04bb94 tempest-FlavorsExtraSpecsTestJSON-113284782 tempest-FlavorsExtraSpecsTestJSON-113284782-project] 10.222.0.78 "GET /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043845 Oct 18 16:00:54.112230 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 24/91] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:00:54 2022] GET /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes => generated 22 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:54.132378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Calling method '.version_select at 0x7f5fd2f3dca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:54.668602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:54.678522 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ac96c33-2714-48ce-b7c3-cd9b5da50a5b tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 1.197353 Oct 18 16:00:54.689194 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 68/92] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:53 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:55.008257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.011545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.012176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.014900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.016250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.019097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.064669 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d16d86c1-922e-41d8-bba4-32ffcd9ec5a0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd/detail" status: 200 len: 672 microversion: 2.36 time: 0.948081 Oct 18 16:00:55.077239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 25/93] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 18 16:00:54 2022] GET /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd/detail => generated 672 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:55.082650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bad114f7-7bba-4e47-a841-746417d3dba8 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:55.144287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bad114f7-7bba-4e47-a841-746417d3dba8 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064393 Oct 18 16:00:55.146441 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 26/94] 10.222.0.78 () {60 vars in 1224 bytes} [Tue Oct 18 16:00:55 2022] POST /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.156459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.162307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:55.188813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.189344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.189809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.190674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.191248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.191766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.253192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0db5f449-6de4-48ba-a488-08b4bf35daa8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1515952727", "id": 1066535079, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:55.292324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0db5f449-6de4-48ba-a488-08b4bf35daa8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.600917 Oct 18 16:00:55.300801 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 69/95] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:54 2022] POST /compute/v2.1/flavors => generated 425 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:55.302500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0db5f449-6de4-48ba-a488-08b4bf35daa8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.308756 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0db5f449-6de4-48ba-a488-08b4bf35daa8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001695 Oct 18 16:00:55.309810 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 70/96] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 16:00:55.441482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404767c1-4b22-433a-80f9-02b1e034bd51", "tag": "5dcdb471-fa9d-4f2a-aa31-929e2b2826e8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:55.470791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.473668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.474386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.521379 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Creating event network-changed:5dcdb471-fa9d-4f2a-aa31-929e2b2826e8 for instance 404767c1-4b22-433a-80f9-02b1e034bd51 on n-h1-858383-14 Oct 18 16:00:55.523631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:00:55.524437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab80ad48-c577-486c-befd-ddf8cd42e2ca req-014b3003-8e31-4558-9694-8d03bdf71617 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:00:55.528884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.529744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.530397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.531337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.535620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.536375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.558728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.rpcapi [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 16:00:55.562236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:00:55.596986 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e821172-c0e9-4584-a256-b1a961390ba2 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285677 Oct 18 16:00:55.599051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 71/97] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:55.616040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-202d6cab-0235-401d-9713-e0815a32e317 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.635742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-202d6cab-0235-401d-9713-e0815a32e317 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034557 Oct 18 16:00:55.636878 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 72/98] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.648226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b333d096-0f05-4e6e-9271-5dbc724449cd tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.672296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b333d096-0f05-4e6e-9271-5dbc724449cd tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034120 Oct 18 16:00:55.677832 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 73/99] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.683557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78f4d467-118c-4423-8040-e15634bdac93 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:55.739189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78f4d467-118c-4423-8040-e15634bdac93 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.060184 Oct 18 16:00:55.740466 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 74/100] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 18 16:00:55 2022] PUT /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes => generated 22 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.746465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eaceb11d-7a2b-4bd3-84a4-653eeb90481f tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-243189446", "id": 1423448929, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:55.782795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:55.791279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eaceb11d-7a2b-4bd3-84a4-653eeb90481f tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.049428 Oct 18 16:00:55.796343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68b0a239-c0b0-468f-a0cc-3d65bde01c47 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1278 microversion: 2.1 time: 0.648506 Oct 18 16:00:55.801811 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 27/102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1278 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:55.802010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 75/102] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:55 2022] POST /compute/v2.1/flavors => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:55.815536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6832594-a9b8-4c54-9b17-a01575c01e68 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.821785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.822410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:55.830587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.831678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.832704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.833616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:55.834213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:55.835713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:55.846879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6832594-a9b8-4c54-9b17-a01575c01e68 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042126 Oct 18 16:00:55.853312 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 76/103] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/flavors/1020486781/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.860763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1ba5fb2d-767b-49aa-a3c7-54ef5ef497d8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.900221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1ba5fb2d-767b-49aa-a3c7-54ef5ef497d8 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048382 Oct 18 16:00:55.910933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 77/104] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:55.924004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2275d1ee-9fcb-4a2b-ba20-33e5f5fa6009 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:55.985852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2275d1ee-9fcb-4a2b-ba20-33e5f5fa6009 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.072704 Oct 18 16:00:55.987088 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 78/105] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:00:55 2022] DELETE /compute/v2.1/flavors/1020486781/os-extra_specs/hw:numa_nodes => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:00:55.998040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6fb5d9cb-5362-45c9-9066-b185465746f8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Action: 'create', calling method: .version_select at 0x7f5fd30445e0>, body: {"keypair": {"name": "tempest-keypair-1466953210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaH9kmuk+q51fHXksXCb1c04J7iSVsmnPit7BgQ4Do1alkr24dDnNp6L1FhEpi6dnAUv/YhDoPsreoB+mWtZUz4GuImYlmu8tinOA2fC/pCF0iJSFaAqPrSFn4SgR7z8Q=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:56.070443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6fb5d9cb-5362-45c9-9066-b185465746f8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for project 06acce18eb064040a95fb5c282c07109. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:00:56.087293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6fb5d9cb-5362-45c9-9066-b185465746f8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for user 2afa642202234799a50a8460a3b6d36c and project 06acce18eb064040a95fb5c282c07109. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:00:56.097987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:56.131869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6fb5d9cb-5362-45c9-9066-b185465746f8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143142 Oct 18 16:00:56.141518 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 79/106] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:00:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:56.146565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-520259ce-829f-40f1-a186-de6be2b1655d tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:56.215945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-520259ce-829f-40f1-a186-de6be2b1655d tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1020486781/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.073059 Oct 18 16:00:56.216710 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 80/107] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:00:56 2022] DELETE /compute/v2.1/flavors/1020486781/os-extra_specs/hw:cpu_policy => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:00:56.227446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd315dee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:56.734199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:56.735677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:56.736136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:56.736942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:56.737482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:56.745668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:56.880311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:56.880839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:56.881370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:56.882258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:56.882765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:56.883212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:57.040931 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5a1eb36-5d53-40e6-8324-def3af59330e tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd?user_id=0c9dc767929c497ba108fbe1838376dc" status: 200 len: 240 microversion: 2.36 time: 0.823054 Oct 18 16:00:57.049308 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 81/108] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Oct 18 16:00:56 2022] PUT /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd?user_id=0c9dc767929c497ba108fbe1838376dc => generated 240 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:57.054420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4f07e54-8e7b-4457-a9c8-caf65db891bc tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:57.080466 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4f07e54-8e7b-4457-a9c8-caf65db891bc tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1020486781/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029834 Oct 18 16:00:57.081282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 82/109] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:00:57 2022] GET /compute/v2.1/flavors/1020486781/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:57.101781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:57.102621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:57.110438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:57.110993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:57.111980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:57.112448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:57.112985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:57.113475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:57.241598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:57.251378 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c136a6a1-dd80-4ab1-bf7a-04c2cf18cf73 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 1.447852 Oct 18 16:00:57.252060 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 28/110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:55 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:57.838562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-765f82ac-f84b-4337-ac97-ae534ae8d8da tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1251359415", "id": 871302834, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:57.864267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:57.878024 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da76871a-e31d-4595-9431-c4c3e1e3e029 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.795611 Oct 18 16:00:57.879670 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 83/111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:57 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:57.906141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d23a15e-29e9-4099-88c8-728ab566f972 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Calling method '.version_select at 0x7f5fd2f20670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:57.928898 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-765f82ac-f84b-4337-ac97-ae534ae8d8da tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.673196 Oct 18 16:00:57.934210 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 29/112] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:57.955480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-109b72dc-9b9e-4c76-a734-9ed70292d188 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:58.015322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-109b72dc-9b9e-4c76-a734-9ed70292d188 tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1020486781" status: 202 len: 0 microversion: 2.1 time: 0.077060 Oct 18 16:00:58.016634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 30/113] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:00:57 2022] DELETE /compute/v2.1/flavors/1020486781 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:58.027308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77ad9824-9b0b-42e3-adbf-18fb0e3768a2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:58.123137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d23a15e-29e9-4099-88c8-728ab566f972 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd?user_id=0c9dc767929c497ba108fbe1838376dc" status: 200 len: 282 microversion: 2.36 time: 0.226872 Oct 18 16:00:58.123735 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 84/114] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Oct 18 16:00:57 2022] GET /compute/v2.1/os-quota-sets/f26f305d7cb646179f07685f8f4dbacd?user_id=0c9dc767929c497ba108fbe1838376dc => generated 282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:00:58.142554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b210d8b-b856-4766-8912-fca011dae68a tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:58.189696 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77ad9824-9b0b-42e3-adbf-18fb0e3768a2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/871302834/action" status: 200 len: 96 microversion: 2.1 time: 0.171301 Oct 18 16:00:58.192875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 31/115] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 18 16:00:58 2022] POST /compute/v2.1/flavors/871302834/action => generated 96 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:58.205226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e56c944-ff3e-40c0-93c6-25144d1579b2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:58.229804 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b210d8b-b856-4766-8912-fca011dae68a tempest-FlavorsExtraSpecsTestJSON-1392370786 tempest-FlavorsExtraSpecsTestJSON-1392370786-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.104920 Oct 18 16:00:58.236101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 85/116] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:58 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:58.283288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:58.284003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:58.298076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:58.301893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:58.302486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:58.303477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:58.303950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:58.304760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:58.370527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4e56c944-ff3e-40c0-93c6-25144d1579b2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e56c944-ff3e-40c0-93c6-25144d1579b2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Request method failure captured: Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/flavors/871302834/action HTTP/1.1 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 67 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs22d_sFTRKclQ1WAxmL3EmrHWTkVbq47t2XsJllEr7XWN74w-jZ4JT5xAXvqT6HZrEzraxqbMgsjKe-VRKosUC5bNOsQYjQE5S8f1k4Qfv4M19SMaLeV8lV-S1D0r82QsMTwVXxhJ8C0rwV0kJkRJ7YLv3cYshrUWmiq7EZiPKkT_Q Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:00:58.447864 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}] Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 508f19b24ec147ce86627a6baea66f32 Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} Oct 18 16:00:58.449654 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '871302834', 'body': {'addTenantAccess': {'tenant': '23cc40dd8b5648ac9a919227f3ade7d3'}}} Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:00:58.450312 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-23cc40dd8b5648ac9a919227f3ade7d3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:00:58.451230 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 16:00:58.452891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:00:58.455379 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-23cc40dd8b5648ac9a919227f3ade7d3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 16, 0, 58, 355392), 'updated_at': None, 'flavor_id': 30, 'project_id': '23cc40dd8b5648ac9a919227f3ade7d3'}] Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:58.458269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:58.460346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:58.469372 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:58.471940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. Oct 18 16:00:58.471940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:58.477957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e56c944-ff3e-40c0-93c6-25144d1579b2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project 23cc40dd8b5648ac9a919227f3ade7d3 combination. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:58.479624 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e56c944-ff3e-40c0-93c6-25144d1579b2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/871302834/action" status: 409 len: 152 microversion: 2.1 time: 0.280314 Oct 18 16:00:58.484041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 32/117] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 18 16:00:58 2022] POST /compute/v2.1/flavors/871302834/action => generated 152 bytes in 283 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:00:58.492814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40216019-f0bf-4910-842c-1138f1c0f719 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:58.834756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:58.847036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9183734f-e415-47d1-b7c5-c73b5738c16a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.568887 Oct 18 16:00:58.867019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 86/118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:58 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:58.907143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:58.907755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:58.957776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:58.959640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:58.960222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:58.962930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:58.967473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:58.969046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:59.637239 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40216019-f0bf-4910-842c-1138f1c0f719 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/871302834/action" status: 200 len: 21 microversion: 2.1 time: 1.151770 Oct 18 16:00:59.646987 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 33/119] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 18 16:00:58 2022] POST /compute/v2.1/flavors/871302834/action => generated 21 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:00:59.660803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dd02c3b-00a3-4925-b9a0-5ba8a74fb948 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:59.722856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dd02c3b-00a3-4925-b9a0-5ba8a74fb948 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/871302834" status: 202 len: 0 microversion: 2.1 time: 0.073011 Oct 18 16:00:59.724068 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 34/120] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:00:59 2022] DELETE /compute/v2.1/flavors/871302834 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:00:59.747196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2d93a43-6216-441d-b927-893d3d2370f2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:59.818714 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2d93a43-6216-441d-b927-893d3d2370f2 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.089092 Oct 18 16:00:59.821880 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 35/121] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:00:59 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:59.844464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-851ca5b7-52ab-4628-a557-e0e7e8a350c8 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1327097879", "id": 38382268, "os-flavor-access:is_public": "True"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:59.846600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:59.858537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0de8fabf-51a0-43bd-b461-0c3fb0e10171 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.955753 Oct 18 16:00:59.879928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 87/122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:58 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:59.889308 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-851ca5b7-52ab-4628-a557-e0e7e8a350c8 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.047575 Oct 18 16:00:59.901748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 36/123] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:59 2022] POST /compute/v2.1/flavors => generated 432 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:59.910953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:59.911920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-640e67f7-c1a1-4316-b597-15a9d925cbbe tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:59.914183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:59.916210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:59.927227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-640e67f7-c1a1-4316-b597-15a9d925cbbe tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 18 16:00:59.929895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:59.931113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:59.931765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:59.932758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:59.933540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:59.934108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-640e67f7-c1a1-4316-b597-15a9d925cbbe tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Request method failure captured: Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/flavors/38382268/os-flavor-access HTTP/1.1 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs22d_sFTRKclQ1WAxmL3EmrHWTkVbq47t2XsJllEr7XWN74w-jZ4JT5xAXvqT6HZrEzraxqbMgsjKe-VRKosUC5bNOsQYjQE5S8f1k4Qfv4M19SMaLeV8lV-S1D0r82QsMTwVXxhJ8C0rwV0kJkRJ7YLv3cYshrUWmiq7EZiPKkT_Q Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:00:59.935107 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}] Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 508f19b24ec147ce86627a6baea66f32 Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: exception: Access list not available for public flavors. Oct 18 16:00:59.936502 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'flavor_id': '38382268'} Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 18 16:00:59.937139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:00:59.941399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-640e67f7-c1a1-4316-b597-15a9d925cbbe tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:59.942465 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-640e67f7-c1a1-4316-b597-15a9d925cbbe tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/38382268/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.037239 Oct 18 16:00:59.950454 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 37/124] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:00:59 2022] GET /compute/v2.1/flavors/38382268/os-flavor-access => generated 91 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:00:59.965998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48e70dbd-9989-47be-b6ba-c28533f48d72 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:59.998673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48e70dbd-9989-47be-b6ba-c28533f48d72 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/38382268" status: 202 len: 0 microversion: 2.1 time: 0.046156 Oct 18 16:01:00.005766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 38/125] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:00:59 2022] DELETE /compute/v2.1/flavors/38382268 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:00.014568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8769c496-0c6e-4f95-8231-293bdb2679d5 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:00.084737 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8769c496-0c6e-4f95-8231-293bdb2679d5 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.077624 Oct 18 16:01:00.121531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 39/126] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:00.153344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23f985ab-467a-4db5-b0f3-d21e247e959a tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-740479764", "id": 158359035, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:00.189581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23f985ab-467a-4db5-b0f3-d21e247e959a tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.039379 Oct 18 16:01:00.198962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 40/127] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:00.249028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:00.262011 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-edca7d6f-e9b1-426a-9a4d-a49767a679a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.379632 Oct 18 16:01:00.265658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 88/128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:59 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:00.562657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de6d8520-d279-457f-ab4c-9ff29f49c53c tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:00.568815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de6d8520-d279-457f-ab4c-9ff29f49c53c tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '049fbb88af0e4d568e51b9561cd68ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cc40dd8b5648ac9a919227f3ade7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de6d8520-d279-457f-ab4c-9ff29f49c53c tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Request method failure captured: Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/flavors/158359035/action HTTP/1.1 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 67 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2yWgtL-Nkco63d9BhxZSwDPVlhOi0b066tuzPpD4kp5Uew7yua7s333Jxvic6X4adAWuboHD6Y6Buo6KIivuS4huRkjM2XS8vA7K-WGEQHiJo4STgOK8JdWaP53Wqs7L_1wLLvbj8M3llrhkviAVGnGaOjpvWySZm6sS641p3pAP0 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 23cc40dd8b5648ac9a919227f3ade7d3 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:00.572807 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23cc40dd8b5648ac9a919227f3ade7d3"}]}] Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 23cc40dd8b5648ac9a919227f3ade7d3 Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAccessNegativeTestJSON-347728659-project Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 049fbb88af0e4d568e51b9561cd68ce3 Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-347728659-project Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} Oct 18 16:01:00.574297 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '158359035', 'body': {'addTenantAccess': {'tenant': '23cc40dd8b5648ac9a919227f3ade7d3'}}} Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:00.574935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 16:01:00.575930 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:00.579836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de6d8520-d279-457f-ab4c-9ff29f49c53c tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:00.580707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de6d8520-d279-457f-ab4c-9ff29f49c53c tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] 10.222.0.78 "POST /compute/v2.1/flavors/158359035/action" status: 403 len: 130 microversion: 2.1 time: 0.378629 Oct 18 16:01:00.581639 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 41/129] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 18 16:01:00 2022] POST /compute/v2.1/flavors/158359035/action => generated 130 bytes in 380 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:00.591053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf7543c3-765a-4df8-a462-b4eba8533a94 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:00.624403 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf7543c3-765a-4df8-a462-b4eba8533a94 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/158359035" status: 202 len: 0 microversion: 2.1 time: 0.038273 Oct 18 16:01:00.625550 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 89/130] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:01:00 2022] DELETE /compute/v2.1/flavors/158359035 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:00.634097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-82a55338-1382-41b4-b0d0-1d2b4fad5196 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:00.678354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-82a55338-1382-41b4-b0d0-1d2b4fad5196 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048419 Oct 18 16:01:00.680125 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 42/131] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:00 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:00.711323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c28eb55-3edd-4df8-9a9f-84ddf80d206b tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-781614352", "id": 1315282594, "os-flavor-access:is_public": "False"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:00.750546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c28eb55-3edd-4df8-9a9f-84ddf80d206b tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.048001 Oct 18 16:01:00.753850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 90/132] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:00.769247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f46aac1-23e6-41cf-bbd2-5b413c30c83f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:00.895303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:00.898783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:00.912968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:00.918142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:00.919067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:00.927548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:00.928357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:00.929106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.106011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f46aac1-23e6-41cf-bbd2-5b413c30c83f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1315282594/action" status: 200 len: 97 microversion: 2.1 time: 0.340052 Oct 18 16:01:01.111931 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 43/133] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 18 16:01:00 2022] POST /compute/v2.1/flavors/1315282594/action => generated 97 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:01:01.131239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b53b6ed1-2e93-4e2a-8b38-1493da0ec1c0 tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:01.141909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b53b6ed1-2e93-4e2a-8b38-1493da0ec1c0 tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '049fbb88af0e4d568e51b9561cd68ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cc40dd8b5648ac9a919227f3ade7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b53b6ed1-2e93-4e2a-8b38-1493da0ec1c0 tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Request method failure captured: Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/flavors/1315282594/action HTTP/1.1 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 70 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2yWgtL-Nkco63d9BhxZSwDPVlhOi0b066tuzPpD4kp5Uew7yua7s333Jxvic6X4adAWuboHD6Y6Buo6KIivuS4huRkjM2XS8vA7K-WGEQHiJo4STgOK8JdWaP53Wqs7L_1wLLvbj8M3llrhkviAVGnGaOjpvWySZm6sS641p3pAP0 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 23cc40dd8b5648ac9a919227f3ade7d3 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:01.148036 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23cc40dd8b5648ac9a919227f3ade7d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23cc40dd8b5648ac9a919227f3ade7d3"}]}] Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 23cc40dd8b5648ac9a919227f3ade7d3 Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-347728659 Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAccessNegativeTestJSON-347728659-project Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 049fbb88af0e4d568e51b9561cd68ce3 Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-347728659-project Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: {"removeTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} Oct 18 16:01:01.149303 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1315282594', 'body': {'removeTenantAccess': {'tenant': '23cc40dd8b5648ac9a919227f3ade7d3'}}} Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can( Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:01.150012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 16:01:01.151779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:01.160110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b53b6ed1-2e93-4e2a-8b38-1493da0ec1c0 tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:01.161644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b53b6ed1-2e93-4e2a-8b38-1493da0ec1c0 tempest-FlavorsAccessNegativeTestJSON-347728659 tempest-FlavorsAccessNegativeTestJSON-347728659-project] 10.222.0.78 "POST /compute/v2.1/flavors/1315282594/action" status: 403 len: 133 microversion: 2.1 time: 0.045041 Oct 18 16:01:01.162836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 44/134] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 18 16:01:01 2022] POST /compute/v2.1/flavors/1315282594/action => generated 133 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:01.175589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a16be4b1-e4a9-460f-b06a-60c0d6629d43 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "23cc40dd8b5648ac9a919227f3ade7d3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:01.288456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:01.303956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d61bea1-21aa-4975-ae67-f4492cdbd8f3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.412808 Oct 18 16:01:01.305055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 91/135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:00 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:01.324564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:01.325460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:01.335262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:01.340138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:01.341117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.342321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:01.350395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:01.351616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.377364 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a16be4b1-e4a9-460f-b06a-60c0d6629d43 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1315282594/action" status: 200 len: 21 microversion: 2.1 time: 0.209516 Oct 18 16:01:01.382172 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 45/136] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 18 16:01:01 2022] POST /compute/v2.1/flavors/1315282594/action => generated 21 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:01:01.524491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02c612c-4ae5-4d2d-9e26-89ee02ce426c", "tag": "1cee8441-1353-4a40-bfe3-398323033792"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:01.586293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:01.586920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:01.587367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.635492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Creating event network-changed:1cee8441-1353-4a40-bfe3-398323033792 for instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c on n-h2-858383-14 Oct 18 16:01:01.636231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:01:01.636684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39ab3a4b-3620-45b2-9c95-2029fbc3fa37 req-e8415432-f148-4d52-a8de-8424c298d47b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:01:01.638525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:01.638987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:01.639704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.641067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:01.641934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:01.642628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:01.656330 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.rpcapi [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 16:01:01.657753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] Releasing lock "compute-rpcapi-router" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:01:01.679257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e00c784-62ef-4d65-b406-5a5a5b2e531a None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295476 Oct 18 16:01:01.682752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 46/137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:01.694403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ebed97d3-58c8-44be-a686-159eb953d280 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:01.755662 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ebed97d3-58c8-44be-a686-159eb953d280 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1315282594" status: 202 len: 0 microversion: 2.1 time: 0.071030 Oct 18 16:01:01.760330 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 47/138] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:01:01 2022] DELETE /compute/v2.1/flavors/1315282594 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:01.774307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0ce2480-dc30-40e2-8d98-2e6f66f37e08 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:01.825966 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0ce2480-dc30-40e2-8d98-2e6f66f37e08 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.060794 Oct 18 16:01:01.833331 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 48/139] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:01 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:01.859307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e49d79e-2dfa-4d00-bd54-aacb35857448 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-419596968", "id": 315473567, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:01.902718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e49d79e-2dfa-4d00-bd54-aacb35857448 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.048598 Oct 18 16:01:01.906460 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 49/140] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:01 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:01.954484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c46ea677-3f6a-4c93-8a90-4674c14dcd1c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d77cdbac5fb64f5cb281b0f497325117"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:01.956290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:01.971098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f5acb1e-0b61-4026-bbd9-43f60e1a666f tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.660500 Oct 18 16:01:01.988015 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 92/141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:01 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:02.104251 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c46ea677-3f6a-4c93-8a90-4674c14dcd1c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] HTTP exception thrown: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c46ea677-3f6a-4c93-8a90-4674c14dcd1c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Request method failure captured: Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/flavors/315473567/action HTTP/1.1 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 70 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs22d_sFTRKclQ1WAxmL3EmrHWTkVbq47t2XsJllEr7XWN74w-jZ4JT5xAXvqT6HZrEzraxqbMgsjKe-VRKosUC5bNOsQYjQE5S8f1k4Qfv4M19SMaLeV8lV-S1D0r82QsMTwVXxhJ8C0rwV0kJkRJ7YLv3cYshrUWmiq7EZiPKkT_Q Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:02.111582 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9f08b61f8d954d6998b05bbf69699b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9f08b61f8d954d6998b05bbf69699b14"}]}] Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9f08b61f8d954d6998b05bbf69699b14 Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867 Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 508f19b24ec147ce86627a6baea66f32 Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: {"removeTenantAccess": {"tenant": "d77cdbac5fb64f5cb281b0f497325117"}} Oct 18 16:01:02.113058 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '315473567', 'body': {'removeTenantAccess': {'tenant': 'd77cdbac5fb64f5cb281b0f497325117'}}} Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 18 16:01:02.113818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:02.115024 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c46ea677-3f6a-4c93-8a90-4674c14dcd1c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Returning 404 to user: Flavor access not found for 34 / d77cdbac5fb64f5cb281b0f497325117 combination. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c46ea677-3f6a-4c93-8a90-4674c14dcd1c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/315473567/action" status: 404 len: 124 microversion: 2.1 time: 0.195027 Oct 18 16:01:02.117212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 50/142] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 18 16:01:01 2022] POST /compute/v2.1/flavors/315473567/action => generated 124 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:02.126023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9745f23f-3d9e-4885-b8fb-6014db17a190 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:02.178106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9745f23f-3d9e-4885-b8fb-6014db17a190 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/315473567" status: 202 len: 0 microversion: 2.1 time: 0.054675 Oct 18 16:01:02.180800 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 93/143] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:01:02 2022] DELETE /compute/v2.1/flavors/315473567 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:02.190645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8b055f8-50c1-422b-a2a2-6febfed80b9c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:02.240831 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8b055f8-50c1-422b-a2a2-6febfed80b9c tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.056104 Oct 18 16:01:02.260230 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 51/144] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:02 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:02.274745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1860437040", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "1423448929", "adminPass": "***", "networks": [{"uuid": "183b9d91-b0c5-4694-9fd6-513142f29890"}], "security_groups": [{"name": "tempest-securitygroup--948827732"}], "key_name": "tempest-keypair-1466953210", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:02.330140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:02.331304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:02.340751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:02.342165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:02.342744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:02.344636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:02.345757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:02.348124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:02.788085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:02.809837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fce5a7cd-e859-43ae-833b-560c133f5d00 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.481687 Oct 18 16:01:02.812919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 52/145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:02 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:02.998749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:02.999975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:03.011440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:03.016290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:03.019162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:03.021234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:03.023892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:03.028984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:03.802905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:03.820059 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-747a2d41-4a66-44f3-a58f-a0c7cb24e701 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.824926 Oct 18 16:01:03.822572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 53/146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:02 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:03.853977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:03.858976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:03.884823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:03.887077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:03.888209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:03.891127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:03.891852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:03.894155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:04.282112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:04.304845 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b435d171-b485-445c-a45c-44aa7168ab2b tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.470978 Oct 18 16:01:04.308327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 54/147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:03 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:04.856183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:04.857479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:04.873747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:04.875594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:04.876221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:04.877662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:04.879019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:04.880242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:05.003316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=24 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:05.372608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:05.384322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8cea6d3c-ef21-4aa3-8ceb-14be2ed50e47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.533768 Oct 18 16:01:05.384907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 55/148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:04 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:05.415838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:05.416818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:05.424062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:05.424759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:05.425715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:05.426632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:05.427311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:05.427932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:05.603696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:05.621079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-403c8a86-780b-48b6-acf0-68fab0cf79c4 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.213187 Oct 18 16:01:05.633404 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 56/149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:05 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:06.416207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:06.418105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:06.450303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:06.451389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:06.453822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:06.456375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:06.457677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:06.459583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:06.471442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=87 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:06.911307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:06.915894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=7 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:06.927345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f728bba-1ba4-41dc-8e5a-62048af1ba58 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.516653 Oct 18 16:01:06.928021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 57/150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:06 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:06.955681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:06.956302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:06.964809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:06.965328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:06.965783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:06.966576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:06.967723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:06.968175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:07.159845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:07.169503 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35aa36df-0b04-4762-820c-31e164ac6f12 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.239214 Oct 18 16:01:07.174611 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 58/151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:06 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:07.968754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] validate_networks() for [('183b9d91-b0c5-4694-9fd6-513142f29890', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:01:08.100447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=24 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:08.480399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce6247a0-fdd8-437d-9b95-6b1ede334a2b tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] Calling method '.version_select at 0x7f5fd2cf1b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:08.643902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce6247a0-fdd8-437d-9b95-6b1ede334a2b tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.788090 Oct 18 16:01:08.644709 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 59/152] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:01:07 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:08.654115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:08.655820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:08.662417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:08.663083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:08.663592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:08.664622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:08.665430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:08.665927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:08.821704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:08.831361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d61a2f11-adcb-4175-9dc1-24307e2f1f7d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.182114 Oct 18 16:01:08.832702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 60/153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:08 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:08.841257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:08.842121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:08.848220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:08.848804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:08.849375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:08.850131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:08.850653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:08.851151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:09.015592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:09.024936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddcd3f90-02f5-4e77-8b73-45aac8cc1136 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.190960 Oct 18 16:01:09.026137 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 61/154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:08 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:09.030766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30e45e8b-43ea-4512-b642-e3548ddc1de0 tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] Calling method '.version_select at 0x7f5fd2d18280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:09.137977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-30e45e8b-43ea-4512-b642-e3548ddc1de0 tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks/e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5" status: 200 len: 652 microversion: 2.1 time: 0.110705 Oct 18 16:01:09.139040 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 62/155] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:01:09 2022] GET /compute/v2.1/os-networks/e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5 => generated 652 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:09.147169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c7076fc-340c-494c-b38c-aab7260529ff tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] Calling method '.version_select at 0x7f5fd2d183a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:09.269061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:09.269531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:09.270593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:09.271455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:09.272475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:09.279517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c7076fc-340c-494c-b38c-aab7260529ff tempest-NetworksTest-206204575 tempest-NetworksTest-206204575-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.135934 Oct 18 16:01:09.284944 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 63/156] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:01:09 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:09.287472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:09.288122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:09.288837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:09.290754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:09.291752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:09.292708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:09.312199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for project 06acce18eb064040a95fb5c282c07109. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:09.318676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for user 2afa642202234799a50a8460a3b6d36c and project 06acce18eb064040a95fb5c282c07109. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:09.330658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:01:09.333683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:01:09.399275 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea564fbd-32f0-4e05-82d0-9119d3c64be6 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.128615 Oct 18 16:01:09.407257 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 94/157] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 7138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:01:09.412782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bd7bd7e-5b00-4928-ae06-22737048bd3a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:09.413831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bd7bd7e-5b00-4928-ae06-22737048bd3a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:09.498479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bd7bd7e-5b00-4928-ae06-22737048bd3a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:09.508666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bd7bd7e-5b00-4928-ae06-22737048bd3a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1265 microversion: 2.1 time: 0.099318 Oct 18 16:01:09.509637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 95/158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:09 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:09.745380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bd8f186-9ba0-4c73-a218-ad1efb93fc6b tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-168533125", "id": 903563074, "os-flavor-access:is_public": "True"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:09.777200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bd8f186-9ba0-4c73-a218-ad1efb93fc6b tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.490836 Oct 18 16:01:09.778417 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 64/159] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:01:09 2022] POST /compute/v2.1/flavors => generated 445 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:09.856344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:09.858005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:09.865896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:09.866672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:09.867366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:09.868632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:09.869359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:09.870025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:10.153697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06baced7-4d16-4ed4-9509-98108e9aef7e tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.162914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06baced7-4d16-4ed4-9509-98108e9aef7e tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] 10.222.0.78 "GET /compute/v2.1/flavors/903563074" status: 200 len: 445 microversion: 2.55 time: 0.375425 Oct 18 16:01:10.164650 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 96/160] 10.222.0.78 () {60 vars in 1196 bytes} [Tue Oct 18 16:01:09 2022] GET /compute/v2.1/flavors/903563074 => generated 445 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:10.170038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.170816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:10.178152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:10.179145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:10.179734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:10.180736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:10.181389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:10.181961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:10.234631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:10.248049 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2401de9d-8b5d-4463-b883-63f75a661240 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.394460 Oct 18 16:01:10.249239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 65/161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:09 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:10.272246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1de1f59b-8253-43aa-bf73-3a22668d346d tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd4046280>, body: {"flavor": {"description": "new"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:10.325823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1de1f59b-8253-43aa-bf73-3a22668d346d tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/903563074" status: 200 len: 446 microversion: 2.55 time: 0.058180 Oct 18 16:01:10.326430 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 66/162] 10.222.0.78 () {62 vars in 1216 bytes} [Tue Oct 18 16:01:10 2022] PUT /compute/v2.1/flavors/903563074 => generated 446 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:10.343267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-707a9b84-8604-4024-ab78-81aea7fba54c tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.384927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-707a9b84-8604-4024-ab78-81aea7fba54c tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.049077 Oct 18 16:01:10.386146 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 67/163] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:01:10 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:10.392578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:10.401865 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-334fc78f-3228-44c5-bb5d-558430635d2c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.235859 Oct 18 16:01:10.402444 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 97/164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:10 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:10.410094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f154f620-3860-4de6-b271-08a1c516e204 tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.439581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f154f620-3860-4de6-b271-08a1c516e204 tempest-FlavorsV255TestJSON-2104205789 tempest-FlavorsV255TestJSON-2104205789-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.035245 Oct 18 16:01:10.440634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 68/165] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Oct 18 16:01:10 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:10.458188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d98b94a0-71a3-47ae-8117-0cd526a38282 tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.472482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:10.477453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d98b94a0-71a3-47ae-8117-0cd526a38282 tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/903563074" status: 202 len: 0 microversion: 2.55 time: 0.023206 Oct 18 16:01:10.481842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 98/166] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Oct 18 16:01:10 2022] DELETE /compute/v2.1/flavors/903563074 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:01:10.489034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1371b309-4674-4880-ab19-d7e18296fd69 tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.532068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1371b309-4674-4880-ab19-d7e18296fd69 tempest-FlavorsV255TestJSON-1617816953 tempest-FlavorsV255TestJSON-1617816953-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.048132 Oct 18 16:01:10.533225 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 69/167] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:01:10 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:01:10.561957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:10.562807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:10.580730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:10.582075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:10.582738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:10.583681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:10.584789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:10.585336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:10.669329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:10.681472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60b4a8ab-3245-4ecd-a8c1-8cd5ece53393 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1282 microversion: 2.1 time: 0.153095 Oct 18 16:01:10.682064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 99/168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:10 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:11.279585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:11.280157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:11.295210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.299986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.302258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.303163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.304790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.309346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.436338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:11.438836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:11.459725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.460583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.462862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.463972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.464677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.465507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.654410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:11.734610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:11.743741 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26932230-51cd-4047-b46e-bac6cd74b860 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.320219 Oct 18 16:01:11.745828 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 100/169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:11 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:11.751940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:11.752877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:11.761073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.761796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.762378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.763235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:11.763824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:11.764526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:11.844021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:11.852929 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-862cfe5c-2fbe-4d9f-a9d8-6409e21c6e48 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1282 microversion: 2.1 time: 0.105042 Oct 18 16:01:11.853813 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 101/170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:11 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:11.925880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:11.952050 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-710552c7-e58b-4ad7-a638-d4723bdf012a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.676502 Oct 18 16:01:11.968159 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 70/171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:11 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:12.271516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f61e7777-c251-446c-99bc-f63515498417 tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1945624095", "id": 1964218246, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:12.312127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f61e7777-c251-446c-99bc-f63515498417 tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.457020 Oct 18 16:01:12.313888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 102/172] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:01:11 2022] POST /compute/v2.1/flavors => generated 471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:12.329981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac43ed40-cece-46ab-8e63-5f26e04390cc tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:12.528216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac43ed40-cece-46ab-8e63-5f26e04390cc tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1964218246/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.204448 Oct 18 16:01:12.529126 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 71/173] 10.222.0.78 () {62 vars in 1265 bytes} [Tue Oct 18 16:01:12 2022] POST /compute/v2.1/flavors/1964218246/os-extra_specs => generated 62 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:12.538842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67f84666-ddb2-47a3-a9cf-6f4289d32b45 tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:12.558459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67f84666-ddb2-47a3-a9cf-6f4289d32b45 tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1964218246" status: 202 len: 0 microversion: 2.86 time: 0.022883 Oct 18 16:01:12.563477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 103/174] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 18 16:01:12 2022] DELETE /compute/v2.1/flavors/1964218246 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:01:12.569309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-352a8bce-c3de-4635-a7f8-39ed6042651d tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:12.579531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=8,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:12.598082 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-352a8bce-c3de-4635-a7f8-39ed6042651d tempest-FlavorMetadataValidation-529379608 tempest-FlavorMetadataValidation-529379608-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.033674 Oct 18 16:01:12.605344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 72/175] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:01:12 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:12.767959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:12.768963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:12.779836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:12.780777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:12.781483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:12.782289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:12.782879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:12.783386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:12.879380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:12.888848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:12.897727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:12.899254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:12.900284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:12.901474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:12.902255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:12.902927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:12.985265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:12.994459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17c9ea60-c4c0-45f8-91de-ed3343aa0bd4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1338 microversion: 2.1 time: 0.119042 Oct 18 16:01:12.995039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 73/176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:12 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1338 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:13.000964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:13.001871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:13.014171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:13.014954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:13.015972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:13.016896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:13.017716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:13.018752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:13.036837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:13.053564 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3047d3f8-91a8-41b2-8efe-f75f00841eb8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.286011 Oct 18 16:01:13.054453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 104/177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:12 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:13.209936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:13.220473 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-390fb7f0-96e4-458f-85c5-daa685e43372 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.222576 Oct 18 16:01:13.221388 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 74/178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:12 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:14.021336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:14.022603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:14.031752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.032237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.032843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.033720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.034316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.035281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.078321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:14.080087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:14.087349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.088144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.088844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.089889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.090491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.090920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.131294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:14.140221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:14.143753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-164f007e-90af-4faf-be99-81041c266d97 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1344 microversion: 2.1 time: 0.130671 Oct 18 16:01:14.161789 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 105/179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:14 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:14.244305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:14.245073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:14.255453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.256903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.257479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.258355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:14.263277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:14.264042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:14.271174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:14.280476 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a09f9f5-a28d-4da2-8dc0-49ab9f2a6269 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.207942 Oct 18 16:01:14.281090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 75/180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:14 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:14.512484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:14.525896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b224870b-242f-403c-bf69-0db7f24d90ed tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.286054 Oct 18 16:01:14.541830 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 106/181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:14 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:15.175837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:15.178055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:15.194676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.206735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.207480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.210570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.211844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.213785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.304140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:15.305708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:15.317472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.318041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.318486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.324240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.324782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.326498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.503090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:15.518372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-deaeb9d5-941e-444f-a12b-39c13a87268e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.344405 Oct 18 16:01:15.520362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 76/182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:15 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:15.544697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661561e8-887f-41da-b4ab-de196e88e361", "tag": "5c192c27-a855-4f3c-9f96-7c2cb8d058a9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:15.564474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.565337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.567544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.594049 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] Creating event network-changed:5c192c27-a855-4f3c-9f96-7c2cb8d058a9 for instance 661561e8-887f-41da-b4ab-de196e88e361 on n-h1-858383-14 Oct 18 16:01:15.608461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a475fb2c-a96d-4821-ad36-6ed7714ebe41 req-470d65c3-3cc1-4da6-9e1e-da115ad9959c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086167 Oct 18 16:01:15.610249 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 77/183] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:15.622247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:15.625294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:15.642531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.645108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.645725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.646455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:15.646910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:15.647335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:15.949662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:15.966422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d763156-4036-4cc7-ba50-5e2c925b13e8 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.353616 Oct 18 16:01:15.969171 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 78/184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:15 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:15.977336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:15.991975 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1ae833e-9d4f-4c21-a24c-d019050cef7e tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.692031 Oct 18 16:01:16.001784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 107/185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:15 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:16.200220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f641962a-91cd-48c3-84d7-9807ecd69758 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] Calling method '.version_select at 0x7f5fd2cf1b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.224748 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f641962a-91cd-48c3-84d7-9807ecd69758 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.254635 Oct 18 16:01:16.225580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 79/186] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:01:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.235933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.239747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.241354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.242703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.243485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98a22fab-1d92-49e1-9e8b-7383b6b6a09d tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2d15d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:16.244314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.245878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.246395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.293621 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17d6a916-1e9b-435c-8394-98637dc00b2f tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 970 microversion: 2.1 time: 0.290559 Oct 18 16:01:16.294461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 108/187] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-services => generated 970 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.307577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.312965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.313883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.314532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.315532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.316391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.317033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.347933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f35865db-d77c-4586-ad69-a06aef07cd52 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-858383-14" status: 200 len: 581 microversion: 2.1 time: 0.044364 Oct 18 16:01:16.357516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 109/188] 10.222.0.78 () {58 vars in 1174 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-services?host=n-d-858383-14 => generated 581 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.362743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.366623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.367447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.368445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.369426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.370157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.370872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.396609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60a6d271-7db0-41c7-80f8-08364816d142 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 403 microversion: 2.1 time: 0.037688 Oct 18 16:01:16.397506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 110/189] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 403 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.411197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.415550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.416291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.416948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.417904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.418574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.419195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.447077 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bfd31226-f693-4d39-a2de-a0dcd456c193 tempest-ServicesAdminTestJSON-1024178968 tempest-ServicesAdminTestJSON-1024178968-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 970 microversion: 2.1 time: 0.039166 Oct 18 16:01:16.457097 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 111/190] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-services => generated 970 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.547675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.548806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:16.579512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.581422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.582158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.584544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:16.588472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:16.589218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:16.724056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98a22fab-1d92-49e1-9e8b-7383b6b6a09d tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.488065 Oct 18 16:01:16.724671 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 80/191] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Oct 18 16:01:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.741496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a70f41c6-7bf7-4383-8f06-780405486a03 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] Calling method '.version_select at 0x7f5fd2cc2310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.762078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a70f41c6-7bf7-4383-8f06-780405486a03 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028871 Oct 18 16:01:16.765120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 81/192] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:16.779802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b659056-23c9-48a3-bf27-1ef1e3973c08 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2d18940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:16.796668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:16.806451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72cf5164-55f4-4df2-b8d8-4e38c26ffc50 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.264108 Oct 18 16:01:16.821017 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 112/193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:16.886288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=22,nova_api:INSERT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:16.914446 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b659056-23c9-48a3-bf27-1ef1e3973c08 tempest-QuotaClassesAdminTestJSON-1238073012 tempest-QuotaClassesAdminTestJSON-1238073012-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.142028 Oct 18 16:01:16.915329 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 82/194] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Oct 18 16:01:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:16.996092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:16.996704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:17.002743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.003232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.003666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.004364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.004842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.005306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.149442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:17.157787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-545aad45-f9a1-49b0-a460-60b257100a84 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.165818 Oct 18 16:01:17.161113 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 83/195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:17.166003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:17.168137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:17.178597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.179171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.179758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.180871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.181462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.182121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.244007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae20e08e-d3a8-4a8d-9c15-d21244157b03 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Calling method '.version_select at 0x7f5fd2f2c9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:17.348128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:17.360047 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-111feab6-4c41-48ba-a33e-1cd299a84fab tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.200683 Oct 18 16:01:17.361065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 84/196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:17 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:17.403057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae20e08e-d3a8-4a8d-9c15-d21244157b03 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 371 microversion: 2.1 time: 0.472206 Oct 18 16:01:17.415484 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 113/197] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:01:16 2022] GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:17.416334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2be3820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:17.664296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.664866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.665350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.668336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.669345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.669793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.770876 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28b60927-0417-443c-bbbc-0f714ee58062 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 328 microversion: 2.1 time: 0.358943 Oct 18 16:01:17.781102 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 85/198] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:17 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 328 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:17.834377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:17.835006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:17.848103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.849474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.849969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:17.855953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:17.856479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:17.856937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.072539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:18.086117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f235ef3-c3c1-4fd7-ac1f-0aed4648975c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.254709 Oct 18 16:01:18.087794 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 114/199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:17 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:18.183181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:18.184068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:18.190987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.191761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.192207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.193216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.193716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.194145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.218507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1839095495", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:18.297744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:01:18.395767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:18.404985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bbf22cb2-7ef7-4b87-9d55-6d4a6166e363 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.227176 Oct 18 16:01:18.407186 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 115/200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:18 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:18.552795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:18.553796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:18.554447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:18.555420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:18.555949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:18.565954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.566631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.567210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.568435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.569074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.569497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.592678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:18.598998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for user 61dd0db9c36e46bdba9f6570379591af and project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:18.613787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.utils [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] cores quota exceeded for 923fa1b9a3e2461fa0f7fea416c5a986, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120571) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 16:01:18.614989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Request method failure captured: Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 145 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3LssLt1J5iUlmw3HSUmpqBcO-HBo8cLOZFWt4XnpYbypg2GusrLOcDO1fwBtXbUFTnNexhzqDGA0d9bXHDzMMooCWyTSkQV3t749LFzAPiNhoA19VbT3_3RJ26udnFnT56kjC2e88ZWGVNVq5NORaOQqwvQ6ibws8uT_KvzTv9QQA Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:18.622003 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}] Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 61dd0db9c36e46bdba9f6570379591af Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1839095495", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} Oct 18 16:01:18.623457 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1839095495', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452'}}} Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 16:01:18.624221 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:18.625565 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.627088 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 16:01:18.628338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:18.629662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:18.630689 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a44a3f1-365d-479d-9e7a-bae58259c590 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.669221 Oct 18 16:01:18.632223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 86/201] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:17 2022] POST /compute/v2.1/servers => generated 111 bytes in 671 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:18.640028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:18.641028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:18.650692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.651438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.652115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.653183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.653894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.654625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.825494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404767c1-4b22-433a-80f9-02b1e034bd51", "name": "network-vif-plugged", "status": "completed", "tag": "5dcdb471-fa9d-4f2a-aa31-929e2b2826e8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:18.836321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:18.837641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:18.838331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:18.855454 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] Creating event network-vif-plugged:5dcdb471-fa9d-4f2a-aa31-929e2b2826e8 for instance 404767c1-4b22-433a-80f9-02b1e034bd51 on n-h1-858383-14 Oct 18 16:01:18.861565 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3b055725-2ec5-4a4d-95e6-c246f6ddc4b5 req-9bd0f964-5f9e-4313-9d9d-04f77321cb2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.447089 Oct 18 16:01:18.862159 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 116/202] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:18.867894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2edf9d0>, body: {"quota_set": {"cores": 20}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:18.975614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:18.989603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc4571db-05e4-47d2-bf4b-14428b662385 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.356114 Oct 18 16:01:19.006891 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 87/203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:18 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:19.082098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.082580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.083293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.084012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.084606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.085088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.086102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2b184c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.090773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.091535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.091768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.093139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.093779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.094051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.129658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-955790cd-c8a1-4203-a125-a7aef4185e36 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.121444 Oct 18 16:01:19.136791 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 88/204] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:19.141873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.142493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:19.148743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.149262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.149748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.150582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.150987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.151392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.174350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d5fd4a5-9bd1-45fc-b84f-c3ed0527c060 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 329 microversion: 2.1 time: 0.310799 Oct 18 16:01:19.175278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 117/205] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:18 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 329 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:19.186725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2ed9280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.196785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.201945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.203533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.204624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.205355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.206449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.244486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da669c86-011c-4871-87e9-253898d5df97 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.067906 Oct 18 16:01:19.245225 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 118/206] 10.222.0.78 () {58 vars in 1139 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:19.259034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-351f69ce-06c3-49ce-9c1a-592a17697c94 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Calling method '.version_select at 0x7f5fd2f2cc10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.358527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:19.369663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-367e7cb5-bb8e-4eec-86ee-50b77627ca93 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.231324 Oct 18 16:01:19.370899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 89/207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:19.377666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2aadd30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.382399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.383224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.384612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.386495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.387370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.388011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.420893 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f3d4304-7092-435e-b72b-1c688fd7348c tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.048442 Oct 18 16:01:19.422292 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 90/208] 10.222.0.78 () {58 vars in 1145 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:01:19.434081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:19.435559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:19.443480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.444139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.444669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.445718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.446276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.446842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.451533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:19.596197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:19.607429 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aad6d43f-5907-4f2d-a3ac-5870b0c8347a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.180717 Oct 18 16:01:19.608659 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 91/209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:19.750859 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-351f69ce-06c3-49ce-9c1a-592a17697c94 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 371 microversion: 2.1 time: 0.496570 Oct 18 16:01:19.759039 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 119/210] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:01:19 2022] GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:19.763624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2abe820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:19.992707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.993363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.993886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:19.994506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:19.994956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:19.995416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.017423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:20.018771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:20.028465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.029758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.030692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.031722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.033115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.034200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.217771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:20.222696 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-028362a6-f42e-4bdf-abad-4683b5616622 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 328 microversion: 2.1 time: 0.462720 Oct 18 16:01:20.235798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 92/211] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:19 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:20.240849 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb30ec7a-cdbf-41f0-9ab7-eeb10b47539c tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.230795 Oct 18 16:01:20.241718 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 120/212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:20 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:20.370188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1211064695", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:20.393355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:20.393969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:20.401352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.402091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.402487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.403225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.403808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.404270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.431317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:01:20.585550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:20.593717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-414ddbde-2383-4be7-aea0-21f98ff697fd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.204103 Oct 18 16:01:20.594297 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 121/213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:20 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:20.631893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:20.632508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:20.639964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.640686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.641344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.642281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.643032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.643883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.686895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:20.687502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:20.687916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:20.688318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:20.688774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:20.706023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.706511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.706939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.707806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.708239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.708657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.731613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:20.737983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for user 61dd0db9c36e46bdba9f6570379591af and project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:20.751204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.utils [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] instances quota exceeded for 923fa1b9a3e2461fa0f7fea416c5a986, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120571) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 16:01:20.751729 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Request method failure captured: Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 145 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3LssLt1J5iUlmw3HSUmpqBcO-HBo8cLOZFWt4XnpYbypg2GusrLOcDO1fwBtXbUFTnNexhzqDGA0d9bXHDzMMooCWyTSkQV3t749LFzAPiNhoA19VbT3_3RJ26udnFnT56kjC2e88ZWGVNVq5NORaOQqwvQ6ibws8uT_KvzTv9QQA Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:20.753952 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}] Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 61dd0db9c36e46bdba9f6570379591af Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1211064695", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} Oct 18 16:01:20.755383 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1211064695', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452'}}} Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 16:01:20.756139 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:20.757127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.758845 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:20.763738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2051df4a-2eea-4de2-b567-ba9053a30e41 tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.397897 Oct 18 16:01:20.768432 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 93/214] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:20.775642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2b18670>, body: {"quota_set": {"instances": 10}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:20.801766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:20.810281 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e414f30c-e490-4d3a-8bf5-ba44ebb636a3 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1338 microversion: 2.1 time: 0.182388 Oct 18 16:01:20.810839 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 122/215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:20 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1338 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:20.876976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02c612c-4ae5-4d2d-9e26-89ee02ce426c", "name": "network-vif-plugged", "status": "completed", "tag": "1cee8441-1353-4a40-bfe3-398323033792"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:20.887397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:20.887888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:20.888289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:20.901761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] Creating event network-vif-plugged:1cee8441-1353-4a40-bfe3-398323033792 for instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c on n-h2-858383-14 Oct 18 16:01:20.906898 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6bada4cc-154f-419f-b05b-2e3c5c70b57d req-9cf1f3ac-fb6e-4323-9445-9e14d8eb89be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Oct 18 16:01:20.907956 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 123/216] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:21.013111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.013788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.014276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.015064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.015479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.015893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.049236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2e7b8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.054267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.055462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.056127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.064407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.065303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.065977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.073951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] HTTP exception thrown: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Request method failure captured: Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 HTTP/1.1 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 56 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3QCmQenobcS-oiUvd7IjFdG3_jKMfEkGz4cwKCHrlzGPfBHgBznirbtr-DlLP9NKN7ERPYWngedkMrxknvXIpZ-9w32klolxRDdaycjYw_n57_Pl1oEaPo7oR9-a8AUwS1M0n8oPRmqk_fF_zEykRHvzbgIwJ_IYGeeC-haiphoT0 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:21.079203 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}] Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 422e6dd483a049298edad49946ed7bb8 Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:21.080534 n-d-858383-14 devstack@n-api.service[120570]: exception: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '26a4fc35-d958-436a-92d0-f2dd6bf69308', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.081276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.082372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Returning 404 to user: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9db6d2fd-d374-466f-b883-aeb669d50dec tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308" status: 404 len: 110 microversion: 2.53 time: 0.131317 Oct 18 16:01:21.083426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 124/217] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 18 16:01:20 2022] PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 => generated 110 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:21.085517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35756ff3-5c58-4418-9434-d57512882ab3 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 329 microversion: 2.1 time: 0.313239 Oct 18 16:01:21.086830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 94/218] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:20 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:21.096037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2c471f0>, body: {"status": "disabled"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.099931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.100408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.100835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.109874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.110346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.110772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.117773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] HTTP exception thrown: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Request method failure captured: Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 HTTP/1.1 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 22 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3QCmQenobcS-oiUvd7IjFdG3_jKMfEkGz4cwKCHrlzGPfBHgBznirbtr-DlLP9NKN7ERPYWngedkMrxknvXIpZ-9w32klolxRDdaycjYw_n57_Pl1oEaPo7oR9-a8AUwS1M0n8oPRmqk_fF_zEykRHvzbgIwJ_IYGeeC-haiphoT0 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:21.119814 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}] Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 422e6dd483a049298edad49946ed7bb8 Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: {"status": "disabled"} Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: exception: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.121243 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '26a4fc35-d958-436a-92d0-f2dd6bf69308', 'body': {'status': 'disabled'}} Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.121968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:21.123235 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:21.124242 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.124242 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.124242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Returning 404 to user: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.124242 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-023a43da-cf26-4d45-a925-9b9b76901602 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308" status: 404 len: 110 microversion: 2.53 time: 0.029153 Oct 18 16:01:21.124242 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 95/219] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 18 16:01:21 2022] PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:01:21.129029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4cbb83e9-032a-4e1c-9b77-32a2b0803933 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Calling method '.version_select at 0x7f5fd330df70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.159206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1532dc23-7cfb-483a-b124-c659792b8a8f tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T16%3A01%3A21.076427&end=2022-10-19T16%3A01%3A21.076427" status: 404 len: 112 microversion: - time: 0.076993 Oct 18 16:01:21.165158 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 125/220] 10.222.0.78 () {58 vars in 1316 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T16%3A01%3A21.076427&end=2022-10-19T16%3A01%3A21.076427 => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 16:01:21.165401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2dac940>, body: {"status": "enabled"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.169258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.169653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.170080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.175775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.176347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.176877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.182385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] HTTP exception thrown: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Request method failure captured: Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 HTTP/1.1 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 21 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3QCmQenobcS-oiUvd7IjFdG3_jKMfEkGz4cwKCHrlzGPfBHgBznirbtr-DlLP9NKN7ERPYWngedkMrxknvXIpZ-9w32klolxRDdaycjYw_n57_Pl1oEaPo7oR9-a8AUwS1M0n8oPRmqk_fF_zEykRHvzbgIwJ_IYGeeC-haiphoT0 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:21.184023 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cd1b78fb2720437c83019f97bd21085c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cd1b78fb2720437c83019f97bd21085c"}]}] Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: cd1b78fb2720437c83019f97bd21085c Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422 Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 422e6dd483a049298edad49946ed7bb8 Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: {"status": "enabled"} Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: exception: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.185240 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '26a4fc35-d958-436a-92d0-f2dd6bf69308', 'body': {'status': 'enabled'}} Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.186060 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:21.187192 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:21.188269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. Oct 18 16:01:21.188269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.188269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Returning 404 to user: Service 26a4fc35-d958-436a-92d0-f2dd6bf69308 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.188269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eea23808-3a4b-4211-bc0a-4b1b37c59fb0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308" status: 404 len: 110 microversion: 2.53 time: 0.024702 Oct 18 16:01:21.188269 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 126/221] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 18 16:01:21 2022] PUT /compute/v2.1/os-services/26a4fc35-d958-436a-92d0-f2dd6bf69308 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:21.190894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50fec269-7249-4565-ba74-9563d3f447d2 tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] Calling method '.version_select at 0x7f5fd2dac4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.196658 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-50fec269-7249-4565-ba74-9563d3f447d2 tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50fec269-7249-4565-ba74-9563d3f447d2 tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] Request method failure captured: Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-simple-tenant-usage/c6175b9a7762451cbcb57d7d96b630de?start=2022-10-19T16%3A01%3A21.076427&end=2022-10-17T16%3A01%3A21.076427 HTTP/1.1 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3Q58SrxaUpGW5gisyz0_G0heyNz2n3Vg1W0XVF7Piw91ow8jjX9nycoK9-FXO_68dkLnp3bwOl6mWTU0inRIHTZXy1OoFqGComFcq7QL-QNw0e8rMDGJfBuNJe8orjJhkQV_bNrRoM6y0vr7SKXSW-ihO8Bppw5W7xPMrN5L-VlBE Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4ec8a482bb3e4edc8774c9b857bad514 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1987142246 Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:21.198352 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ec8a482bb3e4edc8774c9b857bad514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ec8a482bb3e4edc8774c9b857bad514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ec8a482bb3e4edc8774c9b857bad514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ec8a482bb3e4edc8774c9b857bad514"}]}] Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1987142246 Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4ec8a482bb3e4edc8774c9b857bad514 Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1987142246 Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: da77bf441acf4f6a8f0fe782a271795f Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid start time. The start time cannot occur after the end time. Oct 18 16:01:21.199718 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c6175b9a7762451cbcb57d7d96b630de'} Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 16:01:21.201372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50fec269-7249-4565-ba74-9563d3f447d2 tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.202391 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50fec269-7249-4565-ba74-9563d3f447d2 tempest-TenantUsagesNegativeTestJSON-1987142246 tempest-TenantUsagesNegativeTestJSON-1987142246-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/c6175b9a7762451cbcb57d7d96b630de?start=2022-10-19T16%3A01%3A21.076427&end=2022-10-17T16%3A01%3A21.076427" status: 400 len: 111 microversion: 2.1 time: 0.012823 Oct 18 16:01:21.203089 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 127/222] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-simple-tenant-usage/c6175b9a7762451cbcb57d7d96b630de?start=2022-10-19T16%3A01%3A21.076427&end=2022-10-17T16%3A01%3A21.076427 => generated 111 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:21.208065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4cbb83e9-032a-4e1c-9b77-32a2b0803933 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 371 microversion: 2.1 time: 0.085333 Oct 18 16:01:21.208182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.208850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 96/223] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:21.212133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.212670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.213130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.213852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.214302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.214716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.240222 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60967647-af0a-46a6-a2f8-48117a6c31d0 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1265 microversion: 2.53 time: 0.039094 Oct 18 16:01:21.240807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 128/224] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services => generated 1265 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:21.245920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2dc3310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.310435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.310907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.311338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.312052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.312501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.312920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.315673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d2c23e2-9ef2-49dd-ac7b-a90f36e3793d tempest-TenantUsagesNegativeTestJSON-1714231526 tempest-TenantUsagesNegativeTestJSON-1714231526-project] Calling method '.version_select at 0x7f5fd2abe0d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.319172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d2c23e2-9ef2-49dd-ac7b-a90f36e3793d tempest-TenantUsagesNegativeTestJSON-1714231526 tempest-TenantUsagesNegativeTestJSON-1714231526-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8f1e42af5ed84f9f855210861ec1e48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6175b9a7762451cbcb57d7d96b630de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d2c23e2-9ef2-49dd-ac7b-a90f36e3793d tempest-TenantUsagesNegativeTestJSON-1714231526 tempest-TenantUsagesNegativeTestJSON-1714231526-project] Request method failure captured: Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T16%3A01%3A21.076427&end=2022-10-19T16%3A01%3A21.076427&detailed=1 HTTP/1.1 Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3QGxp54P13KCoWx21ZgpiEtQFRBwJ1bMLeS-4A0qQgplMdoLvoOCPn2PrssP6XmQucaY71d0FBrTE2w3erDruw7TsHAZO2cqyMGMHM25Qo8Bj2pTB08-nUhUoy1osEOps5K_Kxsei6ZAcqeX7C2qy-fg5abqpNGq9oKlkHKIJCsrE Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c6175b9a7762451cbcb57d7d96b630de Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1714231526 Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:21.321438 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c6175b9a7762451cbcb57d7d96b630de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c6175b9a7762451cbcb57d7d96b630de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c6175b9a7762451cbcb57d7d96b630de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c6175b9a7762451cbcb57d7d96b630de"}]}] Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1714231526 Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c6175b9a7762451cbcb57d7d96b630de Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1714231526 Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TenantUsagesNegativeTestJSON-1714231526-project Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 8f1e42af5ed84f9f855210861ec1e48b Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1714231526-project Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:01:21.322636 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:21.323360 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:21.324432 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:21.325471 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 16:01:21.325471 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.325471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d2c23e2-9ef2-49dd-ac7b-a90f36e3793d tempest-TenantUsagesNegativeTestJSON-1714231526 tempest-TenantUsagesNegativeTestJSON-1714231526-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.325471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d2c23e2-9ef2-49dd-ac7b-a90f36e3793d tempest-TenantUsagesNegativeTestJSON-1714231526 tempest-TenantUsagesNegativeTestJSON-1714231526-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T16%3A01%3A21.076427&end=2022-10-19T16%3A01%3A21.076427&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.113138 Oct 18 16:01:21.325471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 97/225] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T16%3A01%3A21.076427&end=2022-10-19T16%3A01%3A21.076427&detailed=1 => generated 123 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:21.330701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.333555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.337114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.338396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.339268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.340298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.340763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.341827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.373998 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d064941b-5870-465f-8284-fdbc0760daf1 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1265 microversion: 2.53 time: 0.049591 Oct 18 16:01:21.374230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7e6575c-52e5-4537-914d-3e3d52d83f8c tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 325 microversion: 2.1 time: 0.132381 Oct 18 16:01:21.374608 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 98/226] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1265 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:21.375379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 129/227] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:21 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 325 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:21.379066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.379672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:21.383238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.389204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.392785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.393363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.393862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.394672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.395202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.395653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.399946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.401591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.403330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.405529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.406304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.406738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.421616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-832c27b1-43a3-4f15-9846-47f1e15285ac tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1265 microversion: 2.53 time: 0.036478 Oct 18 16:01:21.422773 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 130/228] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services => generated 1265 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:21.439315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.443363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.444139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.444730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.445686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.446432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.447036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.478444 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af2d1ad6-6fb8-4673-8e10-3a69af06b864 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-858383-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.043041 Oct 18 16:01:21.479606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 131/229] 10.222.0.78 () {60 vars in 1237 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services?host=n-d-858383-14&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:21.503022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.507164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.507731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.508402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.509170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.509625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.510053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.538335 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c58df264-39ce-44c9-baa7-d8538a3e5297 tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1265 microversion: 2.53 time: 0.050075 Oct 18 16:01:21.539934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 132/230] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services => generated 1265 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:21.558636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.562389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.563139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.563576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.564667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.565244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.566121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.601019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69a2f09c-d632-40e7-8963-dc6a7a4ae90e tempest-ServicesAdminNegativeV253TestJSON-1020201422 tempest-ServicesAdminNegativeV253TestJSON-1020201422-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.051701 Oct 18 16:01:21.602754 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 133/231] 10.222.0.78 () {60 vars in 1239 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:21.683502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:21.705628 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7201bfb-ffbf-4406-ac9d-e12dd3f22a30 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.316282 Oct 18 16:01:21.707921 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 99/232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:21.716312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-163832949", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.788711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:01:21.859285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69eba925-69e5-4986-b95b-ade5c5503f06 tempest-ServicesAdminNegativeV253TestJSON-959702611 tempest-ServicesAdminNegativeV253TestJSON-959702611-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.863502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69eba925-69e5-4986-b95b-ade5c5503f06 tempest-ServicesAdminNegativeV253TestJSON-959702611 tempest-ServicesAdminNegativeV253TestJSON-959702611-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4fef60ce3152469e8c131a770f6a55e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e4d67419ff4527924ff094245c8004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69eba925-69e5-4986-b95b-ade5c5503f06 tempest-ServicesAdminNegativeV253TestJSON-959702611 tempest-ServicesAdminNegativeV253TestJSON-959702611-project] Request method failure captured: Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3QRVZeKIiMLS0RSVWe7Mf8sSavSQKl8YDxVuEdhPpiTbNbZQndXzxK_gu8NIGEsTXFUln1E-JW3rctLVBwUNyksyuZL9mzS2tt_8onFQAJ5zrprEKPv6nK7Av2jZyTRZZrB0Dj3RRMRphKTU4pmPnEBMmYiiMaLOCNhQx8WsAOtEI Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d1e4d67419ff4527924ff094245c8004 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-959702611 Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:21.865148 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1e4d67419ff4527924ff094245c8004"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1e4d67419ff4527924ff094245c8004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1e4d67419ff4527924ff094245c8004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1e4d67419ff4527924ff094245c8004"}]}] Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-959702611 Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d1e4d67419ff4527924ff094245c8004 Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-959702611 Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServicesAdminNegativeV253TestJSON-959702611-project Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4fef60ce3152469e8c131a770f6a55e8 Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-959702611-project Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:01:21.866642 n-d-858383-14 devstack@n-api.service[120570]: action_args: {} Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:21.867828 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:01:21.869270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:21.870615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69eba925-69e5-4986-b95b-ade5c5503f06 tempest-ServicesAdminNegativeV253TestJSON-959702611 tempest-ServicesAdminNegativeV253TestJSON-959702611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:21.870615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69eba925-69e5-4986-b95b-ade5c5503f06 tempest-ServicesAdminNegativeV253TestJSON-959702611 tempest-ServicesAdminNegativeV253TestJSON-959702611-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.251265 Oct 18 16:01:21.870615 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 134/233] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:21.874231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:21.874972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:21.882606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.883315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.884284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.885178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.885967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.887160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.040779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:22.041360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:22.042174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:22.042595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:22.043084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:22.054304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.054876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.055316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.057081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.058620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.059059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.082143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:22.102198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Getting quotas for user 61dd0db9c36e46bdba9f6570379591af and project 923fa1b9a3e2461fa0f7fea416c5a986. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:22.111377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:22.123260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.utils [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] ram quota exceeded for 923fa1b9a3e2461fa0f7fea416c5a986, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120571) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 16:01:22.123886 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Request method failure captured: Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 144 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3LssLt1J5iUlmw3HSUmpqBcO-HBo8cLOZFWt4XnpYbypg2GusrLOcDO1fwBtXbUFTnNexhzqDGA0d9bXHDzMMooCWyTSkQV3t749LFzAPiNhoA19VbT3_3RJ26udnFnT56kjC2e88ZWGVNVq5NORaOQqwvQ6ibws8uT_KvzTv9QQA Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:22.126032 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}] Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 61dd0db9c36e46bdba9f6570379591af Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-163832949", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} Oct 18 16:01:22.127375 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-163832949', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452'}}} Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 16:01:22.128015 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:22.128956 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.130879 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.134582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:22.135566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:22.135769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b608fbd3-fb3e-4c8c-959a-2f74e66a83bb tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.417013 Oct 18 16:01:22.135769 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 100/234] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:22.139544 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b392ba7-8bf0-44e9-b999-56699408c214 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.270346 Oct 18 16:01:22.140176 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 135/235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:21 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:22.143538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:22.144157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:22.152964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.153477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.156768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.157669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.158132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.161636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.163484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2dacca0>, body: {"quota_set": {"ram": 51200}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:22.401271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.401871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.402381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.403175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.403764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.404186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.444579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:22.453857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e40bbfb-48ae-4103-83c5-27064f77df3a tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1487 microversion: 2.1 time: 0.321095 Oct 18 16:01:22.454671 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 101/236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:22 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1487 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:22.472454 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6bb5af80-9013-4e89-a81e-a0a0f3ac765b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 200 len: 329 microversion: 2.1 time: 0.317132 Oct 18 16:01:22.473662 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 136/237] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:22 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:22.487781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:22.488396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:22.490084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f3e5b9d-ec71-4dc2-a91b-5e03d04eb5da tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Action: 'update', calling method: .version_select at 0x7f5fd2dc3c10>, body: {"quota_set": {"ram": 0}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:22.497039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f3e5b9d-ec71-4dc2-a91b-5e03d04eb5da tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '61dd0db9c36e46bdba9f6570379591af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fa1b9a3e2461fa0f7fea416c5a986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f3e5b9d-ec71-4dc2-a91b-5e03d04eb5da tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Request method failure captured: Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 HTTP/1.1 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 25 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3LssLt1J5iUlmw3HSUmpqBcO-HBo8cLOZFWt4XnpYbypg2GusrLOcDO1fwBtXbUFTnNexhzqDGA0d9bXHDzMMooCWyTSkQV3t749LFzAPiNhoA19VbT3_3RJ26udnFnT56kjC2e88ZWGVNVq5NORaOQqwvQ6ibws8uT_KvzTv9QQA Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:22.499545 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_923fa1b9a3e2461fa0f7fea416c5a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/923fa1b9a3e2461fa0f7fea416c5a986"}]}] Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 923fa1b9a3e2461fa0f7fea416c5a986 Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856736143 Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 61dd0db9c36e46bdba9f6570379591af Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-QuotasAdminNegativeTest-1856736143-project Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: {"quota_set": {"ram": 0}} Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 16:01:22.500986 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '923fa1b9a3e2461fa0f7fea416c5a986', 'body': {'quota_set': {'ram': 0}}} Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:22.502075 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.503082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f3e5b9d-ec71-4dc2-a91b-5e03d04eb5da tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f3e5b9d-ec71-4dc2-a91b-5e03d04eb5da tempest-QuotasAdminNegativeTest-1856736143 tempest-QuotasAdminNegativeTest-1856736143-project] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986" status: 403 len: 116 microversion: 2.1 time: 0.016174 Oct 18 16:01:22.504146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 137/238] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:01:22 2022] PUT /compute/v2.1/os-quota-sets/923fa1b9a3e2461fa0f7fea416c5a986 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:22.513509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.518941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.519408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.520193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.520619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.521072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.741050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:22.741675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:22.754909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.756311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.761743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.762344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.762808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.763240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.937744 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd9ddeb0-db88-452d-a01d-5968b1f4447d tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1640 microversion: 2.1 time: 0.460655 Oct 18 16:01:22.938364 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 102/239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:22 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1640 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:22.963198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:22.963766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:22.972697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.973536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.974017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.974786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:22.975338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:22.975896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:22.977083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.984327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-714eed9b-262b-43dd-a753-f8020cdfc732 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1320 microversion: 2.1 time: 0.249664 Oct 18 16:01:22.998577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 138/240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:22 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:23.006793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:01:23.154084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4af47f4c-3f2e-4e03-aec3-592126a5d514 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "DELETE /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 204 len: 0 microversion: 2.1 time: 0.195122 Oct 18 16:01:23.155200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 103/241] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:01:22 2022] DELETE /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:01:23.166390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:23.167177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:23.180793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:23.181581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:23.182170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:23.183535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:23.185207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:23.185939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:23.186368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:23.188764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:23.202968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:23.203734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:23.204392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:23.205686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:23.206331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:23.207089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:23.438682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:23.458990 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0da12c91-1cf8-4373-880d-8817eaf2a568 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.284914 Oct 18 16:01:23.474185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 104/242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:23 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:23.475444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:23.478238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:23.490214 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0402000b-7cee-4160-b912-e09453162eaf tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1493 microversion: 2.1 time: 0.329578 Oct 18 16:01:23.490804 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 139/243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:23 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1493 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:23.660972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661561e8-887f-41da-b4ab-de196e88e361", "name": "network-vif-plugged", "status": "completed", "tag": "5c192c27-a855-4f3c-9f96-7c2cb8d058a9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:23.675677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:23.676219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:23.677422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:23.694549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] Creating event network-vif-plugged:5c192c27-a855-4f3c-9f96-7c2cb8d058a9 for instance 661561e8-887f-41da-b4ab-de196e88e361 on n-h1-858383-14 Oct 18 16:01:23.703017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d585ca82-45ca-43fc-b6b2-d100e8620a84 req-d1220f1f-4aa3-4333-be66-74f63b64c274 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045868 Oct 18 16:01:23.704760 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 105/244] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:24.010137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:24.011409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:24.017756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.026183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.026849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.027649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.028307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.028933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.181300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:24.189936 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33829fd7-158e-49a6-8930-4c0693789092 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1469 microversion: 2.1 time: 0.184166 Oct 18 16:01:24.190430 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 140/245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:24 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:24.485268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:24.486270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:24.496346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.497167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.497798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.498752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.499412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.500130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.582668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:24.583246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:24.593018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.593539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.594318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.596404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.597126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.598764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.634947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:01:24.704518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:24.714990 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb25e4fc-57c8-4057-ae03-47c98d644c9e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.234532 Oct 18 16:01:24.715845 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 141/246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:24 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:24.721371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:24.722515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:24.730497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.731464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.732263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.733390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.734054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.734688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.791657 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-54072a11-4f1e-4a03-ac10-5164a3ca938f tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 204 len: 0 microversion: 2.1 time: 0.581002 Oct 18 16:01:24.792431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 106/247] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:01:24 2022] DELETE /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:01:24.806610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:24.807748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:24.817606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.818100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.818627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.819398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:24.819965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:24.820836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:24.909899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:24.921986 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6885793b-9cce-4d6e-b5cd-948584875b47 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1493 microversion: 2.1 time: 0.200936 Oct 18 16:01:24.921986 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 142/248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:24 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1493 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:24.999958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:25.009130 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f31515a-f817-42cc-ba68-693dbe8c7af3 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1475 microversion: 2.1 time: 0.211908 Oct 18 16:01:25.010088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 107/249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:24 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1475 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:25.740740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:25.741379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:25.750401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:25.750993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:25.751435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:25.752459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:25.752936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:25.753586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:25.951308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:25.954659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:25.966215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:25.966705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:25.967137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:25.976083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:25.976083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:25.976083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.128529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:26.139923 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-329d1a3f-4edd-4917-933e-f64f3413d309 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1493 microversion: 2.1 time: 0.199545 Oct 18 16:01:26.145397 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 108/250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:25 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1493 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:26.153082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:26.153887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:26.160783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:26.161805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:26.162390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.163574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:26.164403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:26.167005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.396312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:26.405955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb7c2a08-8605-43c2-83f8-e0e1c9eb5ffd tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1411 microversion: 2.1 time: 0.668936 Oct 18 16:01:26.408893 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 143/251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:25 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1411 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:26.438423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:26.454279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e180cfdb-621d-477b-acad-4545a097fe3f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1475 microversion: 2.1 time: 0.307165 Oct 18 16:01:26.455497 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 109/252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:26 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1475 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:26.623801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-640163650", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:26.686848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:26.687409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:26.687878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:26.688277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:26.688678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:26.697804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:26.698503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:26.699219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.700108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:26.700704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:26.701295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.723169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Getting quotas for project d3a3257e135e42b4848850358a05cd5f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:26.731584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Getting quotas for user e087a69e4fcf42849e275585aa0b9da6 and project d3a3257e135e42b4848850358a05cd5f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:26.750887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:01:26.754555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:01:26.798337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404767c1-4b22-433a-80f9-02b1e034bd51", "name": "network-vif-deleted", "tag": "5dcdb471-fa9d-4f2a-aa31-929e2b2826e8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:26.816096 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ea8ddcd-1216-4c1d-8d49-504461fdfc5a tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.391650 Oct 18 16:01:26.817173 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 144/253] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:01:26.819418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:26.820578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:26.821424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:26.829421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:26.833928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:26.853899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] Creating event network-vif-deleted:5dcdb471-fa9d-4f2a-aa31-929e2b2826e8 for instance 404767c1-4b22-433a-80f9-02b1e034bd51 on n-h1-858383-14 Oct 18 16:01:26.862982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f5bdfcc3-7808-464c-86ba-509b610a8e9a req-a06f54b4-d7fb-4e77-b1f1-40366234b845 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068543 Oct 18 16:01:26.867900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 110/254] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:26.987621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:26.997879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:26.999689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.012467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-031cfc2d-31e9-46ee-8b50-1ffac2b2cfa8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "PUT /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1358 microversion: 2.75 time: 0.186937 Oct 18 16:01:27.013931 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 145/255] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Oct 18 16:01:26 2022] PUT /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:01:27.041817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:27.043749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:27.163793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:27.164569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:27.172277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.174551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.175279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.178552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.179748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.180577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.220200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.220781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.221303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.221976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lazy-loading 'fault' on Instance uuid 404767c1-4b22-433a-80f9-02b1e034bd51 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:01:27.276474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8820c273919741fa8a16b0486dabb283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187142db0e8645c6a31350392a6b5d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.285092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f6508b4-e18c-484f-ab42-f1bcc86e388d tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 200 len: 1328 microversion: 2.1 time: 0.124919 Oct 18 16:01:27.296958 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 146/256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:27 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:27.362728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.371450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.372899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.381280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8272040a-c3af-48f2-8315-04e10644fc01 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1358 microversion: 2.75 time: 0.344316 Oct 18 16:01:27.381853 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 111/257] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:27 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:27.436863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:27.437528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:27.446942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.447957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.449077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.450019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.450478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.450903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.481672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:27.482325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:27.495454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.495950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.496390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.497244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.497877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.498456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.683554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.687413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:27.706054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:27.715451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25fb0749-8d77-4ed9-afa0-5d5267a1baff tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1433 microversion: 2.1 time: 0.226328 Oct 18 16:01:27.718039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 112/258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:27 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1433 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:27.719824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e1b5ff8-3c38-4e2d-8d3d-0153be8acfed tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1609 microversion: 2.1 time: 0.287363 Oct 18 16:01:27.745979 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 147/259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:27 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1609 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:27.765134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:27.766034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:27.785922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02c612c-4ae5-4d2d-9e26-89ee02ce426c", "name": "network-vif-deleted", "tag": "1cee8441-1353-4a40-bfe3-398323033792"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:27.797407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.803654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.806509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.807296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.807764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.808190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.815359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:27.816144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:27.816935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:27.832874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] Creating event network-vif-deleted:1cee8441-1353-4a40-bfe3-398323033792 for instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c on n-h2-858383-14 Oct 18 16:01:27.877660 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d4cf340b-85a6-4308-a54b-4f6c572cd788 req-b73b529d-727d-4b46-b867-2dbbac1267b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096673 Oct 18 16:01:27.879079 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 148/260] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:27.921343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-088ceebd-cd4e-48cc-be15-0240bc9998a8 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168021 Oct 18 16:01:27.921867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 113/261] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:01:27 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:28.311430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:28.312378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:28.319007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.319874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.320556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.321618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.322288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.322923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.339159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] HTTP exception thrown: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Request method failure captured: Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 HTTP/1.1 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2gj0FyDsT0kGNqdDbSVJBT910Bg1zX2qXm9tzUUuIM6XLsjtkeCAr46RyIxt2MyQ7m_4JwSlSb2XlMk5Y_XtAWgL8yh_I9mFdvnEDpUOPCSMFQG_fEi3XLzz-j6wUYUlpQuZXoQJtA9H961ieG0WlBWtZs6aE7aZOJAwVzENHr2N0 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:28.342542 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_187142db0e8645c6a31350392a6b5d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}] Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 8820c273919741fa8a16b0486dabb283 Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:28.343715 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '404767c1-4b22-433a-80f9-02b1e034bd51'} Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:28.344396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:28.345559 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:28.348032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Returning 404 to user: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:28.349340 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae075113-5891-4a7e-9d9e-ffdaa2ced352 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 404 len: 111 microversion: 2.1 time: 0.042656 Oct 18 16:01:28.354410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 149/262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:28 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:28.361958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-147d7bfc-5990-4dd2-beb2-3b589e05fe5e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:28.381331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-147d7bfc-5990-4dd2-beb2-3b589e05fe5e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.382254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-147d7bfc-5990-4dd2-beb2-3b589e05fe5e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.383664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-147d7bfc-5990-4dd2-beb2-3b589e05fe5e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.413323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:28.414876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:28.422232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.423150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.424215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.425858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.426566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.427195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.571931 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-147d7bfc-5990-4dd2-beb2-3b589e05fe5e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.216294 Oct 18 16:01:28.572554 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 114/263] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:28 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:28.591826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7618d70-dcd8-4b7c-87e7-aa89296be2a6 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:28.622243 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7618d70-dcd8-4b7c-87e7-aa89296be2a6 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.034687 Oct 18 16:01:28.623600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 115/264] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:28 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:28.636936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0298c8cd-a275-4eae-add6-b08ebf475993 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1979641629"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:28.641160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-0298c8cd-a275-4eae-add6-b08ebf475993 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 4145b587-3561-420d-ae5b-c59a6cd4f9aa for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:28.666232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0298c8cd-a275-4eae-add6-b08ebf475993 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033701 Oct 18 16:01:28.669146 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 116/265] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:28.682354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da22bd4b-cdb3-42a7-86c8-75eeeb481fa3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:28.695136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da22bd4b-cdb3-42a7-86c8-75eeeb481fa3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.695876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da22bd4b-cdb3-42a7-86c8-75eeeb481fa3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.696474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da22bd4b-cdb3-42a7-86c8-75eeeb481fa3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.874141 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-da22bd4b-cdb3-42a7-86c8-75eeeb481fa3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.195936 Oct 18 16:01:28.882193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 117/266] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:28 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:28.895884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:28.897789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:28.913914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.916551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.917276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.918369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.919009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.919591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.964169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:28.965176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:28.965953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:28.966619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid d02c612c-4ae5-4d2d-9e26-89ee02ce426c {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:01:28.972520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:28.981908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:28.983352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:29.001475 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f5ad06e-6b89-47de-81a3-87c4b2d97b4d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1418 microversion: 2.75 time: 0.594796 Oct 18 16:01:29.002047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 150/267] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:28 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1418 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:01:29.010398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50f72dad-282c-4000-bbfc-d569b88a0393 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:29.019968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:29.032024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3388d5e7-3a2b-4a90-a17c-25dffc52d1d2 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 200 len: 1310 microversion: 2.1 time: 0.147979 Oct 18 16:01:29.033574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 118/268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:28 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 1310 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:29.050955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50f72dad-282c-4000-bbfc-d569b88a0393 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.047676 Oct 18 16:01:29.052136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 151/269] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:01:29 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:29.065171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec9693a2-0c50-4330-b08f-9d99ea4ad8a7 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:29.081846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec9693a2-0c50-4330-b08f-9d99ea4ad8a7 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:29.082645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec9693a2-0c50-4330-b08f-9d99ea4ad8a7 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:29.083326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec9693a2-0c50-4330-b08f-9d99ea4ad8a7 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:29.228351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec9693a2-0c50-4330-b08f-9d99ea4ad8a7 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.167411 Oct 18 16:01:29.229515 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 119/270] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:29.240540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4bd252e3-c4dd-44dc-a3da-8519a1da79c2 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:29.251765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:29.269270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4bd252e3-c4dd-44dc-a3da-8519a1da79c2 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.032142 Oct 18 16:01:29.270401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 152/271] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:29 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:29.280649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17b0f752-73e7-4b4c-bae1-0f8dbc370b49 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-505157259"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:29.284801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-17b0f752-73e7-4b4c-bae1-0f8dbc370b49 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid b48b84ca-b30c-48d9-aeb2-366662159d5f for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:29.309911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17b0f752-73e7-4b4c-bae1-0f8dbc370b49 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033135 Oct 18 16:01:29.313050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 120/272] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:29.324613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73cfb576-60b2-414f-acef-b3c03aa2e2bf tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:29.339230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73cfb576-60b2-414f-acef-b3c03aa2e2bf tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:29.339775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73cfb576-60b2-414f-acef-b3c03aa2e2bf tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:29.340280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73cfb576-60b2-414f-acef-b3c03aa2e2bf tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:29.768911 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73cfb576-60b2-414f-acef-b3c03aa2e2bf tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.449972 Oct 18 16:01:29.770195 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 153/273] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:29 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:29.781463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb00c3b4-99e8-4a1d-b1f5-cc947e562a89 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:29.809305 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb00c3b4-99e8-4a1d-b1f5-cc947e562a89 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.025585 Oct 18 16:01:29.811283 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 121/274] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:01:29 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:29.828526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e350dbe-9c82-490e-afe0-63a3f793e642 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:29.842513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e350dbe-9c82-490e-afe0-63a3f793e642 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:29.843112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e350dbe-9c82-490e-afe0-63a3f793e642 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:29.843604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e350dbe-9c82-490e-afe0-63a3f793e642 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:29.993719 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e350dbe-9c82-490e-afe0-63a3f793e642 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.169019 Oct 18 16:01:29.994653 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 154/275] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:29 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:30.010349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc22db4a-0993-4b68-9b08-f1fe9175a370 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:30.015562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:30.041015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:30.041519 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc22db4a-0993-4b68-9b08-f1fe9175a370 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.038956 Oct 18 16:01:30.041762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:30.049585 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 122/276] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:30 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:30.052234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.052772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.053309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.054073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.054552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.054996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.057333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-128602ed-1a7b-4dea-938a-8c533bb40493 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318154786"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:30.061640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-128602ed-1a7b-4dea-938a-8c533bb40493 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 8be82860-2550-4edf-812f-5f026678c708 for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:30.091645 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-128602ed-1a7b-4dea-938a-8c533bb40493 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038946 Oct 18 16:01:30.100636 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 123/277] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:30.107813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:30.108857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:30.117381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.118307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.118982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.119966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.120694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.121352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.140677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c HTTP/1.1 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:30.143516 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:01:30.145037 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd02c612c-4ae5-4d2d-9e26-89ee02ce426c'} Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:30.145733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:01:30.146813 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:30.151034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:30.152336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f88ad2c-858c-4bb7-b9a0-a86810e4058f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 404 len: 111 microversion: 2.1 time: 0.049185 Oct 18 16:01:30.152938 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 124/278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:30 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:30.165796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b1b33f1-122f-4138-9fed-7ac707c4dbfd tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:30.194116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b1b33f1-122f-4138-9fed-7ac707c4dbfd tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.194810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b1b33f1-122f-4138-9fed-7ac707c4dbfd tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.195650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b1b33f1-122f-4138-9fed-7ac707c4dbfd tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.360982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b1b33f1-122f-4138-9fed-7ac707c4dbfd tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.201159 Oct 18 16:01:30.361812 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 125/279] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:30 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:30.371173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1466288497", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:30.431783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:01:30.512118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:30.522309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:30.525609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:30.535618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ceea5c8b-8b98-49c0-a7e5-276993373e55 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1416 microversion: 2.75 time: 0.501962 Oct 18 16:01:30.536910 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 155/280] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:30 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1416 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:30.542887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-107e09b3-2b99-4920-9503-f85acbbd9126 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:30.557927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-107e09b3-2b99-4920-9503-f85acbbd9126 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.558743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-107e09b3-2b99-4920-9503-f85acbbd9126 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.559473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-107e09b3-2b99-4920-9503-f85acbbd9126 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.686588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:30.687021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:30.687554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:30.687976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:30.688395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:30.700733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.701260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.701704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.702515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:30.702976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:30.707219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:30.740326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Getting quotas for project db104ba093c34a81b677c769995db538. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:01:30.746522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Getting quotas for user f01c86c8f32c4035a71dd59fc55eccdc and project db104ba093c34a81b677c769995db538. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:01:30.761578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:01:30.764681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:01:30.822470 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e8cebb8-98d1-4461-8160-5f75a0dbb2bf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456019 Oct 18 16:01:30.823423 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 126/281] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:01:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:01:30.835612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3769efa5-7813-4bae-add2-0cff3e73933a tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:30.836465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3769efa5-7813-4bae-add2-0cff3e73933a tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:30.904204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-107e09b3-2b99-4920-9503-f85acbbd9126 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.365822 Oct 18 16:01:30.905234 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 156/282] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:30 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:30.917402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d979800-719f-4973-9c19-5a18a6d07102 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:30.931015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3769efa5-7813-4bae-add2-0cff3e73933a tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:30.939409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3769efa5-7813-4bae-add2-0cff3e73933a tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1220 microversion: 2.1 time: 0.108906 Oct 18 16:01:30.940296 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 127/283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:30 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:30.969064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d979800-719f-4973-9c19-5a18a6d07102 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055511 Oct 18 16:01:30.977399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 157/284] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:30.990275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2b181cb-19e7-495c-a3fd-61c82fa213f2 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1809991990"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.011184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-f2b181cb-19e7-495c-a3fd-61c82fa213f2 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 7988da45-6d12-4b5a-8880-659a5cf28adf for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:31.015273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd414b310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.019856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.020714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.021361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.022245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.024649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.025312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.061836 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58db5774-fbe5-4c0a-a673-c8b507c64ed3 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.053144 Oct 18 16:01:31.062554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 158/285] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:31.082119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2f6e280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.085560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2b181cb-19e7-495c-a3fd-61c82fa213f2 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097333 Oct 18 16:01:31.087527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 128/286] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.091914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.093556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.094229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.099883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.104112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.104558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.106541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bac26431-ecc3-4356-883b-2b818df35828 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.152442 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bac26431-ecc3-4356-883b-2b818df35828 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.055784 Oct 18 16:01:31.153059 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 129/287] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 16:01:31.161119 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be3abf35-0ee2-4b8d-8b8e-36269f9bbac4 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.090357 Oct 18 16:01:31.163155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-927397df-3b04-426b-b67e-acab126be764 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.165853 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 159/288] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.180365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2f20820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.183869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.184352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.184789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.188057 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-927397df-3b04-426b-b67e-acab126be764 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-927397df-3b04-426b-b67e-acab126be764 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Request method failure captured: Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2jds1UA92cm0g1Qkhr_VPsabTLtBlWwJYle2-rHj-0Zd_3daaQLQY172g5SbnVPOdlM4foIZSX13OuV_iL1JAY9XiSHqdJwzRkLR2Mp4DSJbxMWfoQKgxsCcMmGj4jTpK0sq8xMG2V6aSIRqexGGvHQHYPSj7DIw3BPOx5nsVbTtA Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:31.192112 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}] Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9b5e11548f6b44a2a202c8ff7d8d5705 Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: exception: Aggregate 6 could not be found. Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6'} Oct 18 16:01:31.193661 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.194531 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.197084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-927397df-3b04-426b-b67e-acab126be764 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:31.198497 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-927397df-3b04-426b-b67e-acab126be764 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.036508 Oct 18 16:01:31.198497 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 130/289] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:01:31.198659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.198659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.198659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.212805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d7ecb1-2fb9-4279-8bef-9dfb9d33643b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.252708 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-71d7ecb1-2fb9-4279-8bef-9dfb9d33643b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 18 16:01:31.255483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58826016-3c67-4fde-8cd1-4e687a3338ad tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.080731 Oct 18 16:01:31.256098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 160/290] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d7ecb1-2fb9-4279-8bef-9dfb9d33643b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Request method failure captured: Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2jds1UA92cm0g1Qkhr_VPsabTLtBlWwJYle2-rHj-0Zd_3daaQLQY172g5SbnVPOdlM4foIZSX13OuV_iL1JAY9XiSHqdJwzRkLR2Mp4DSJbxMWfoQKgxsCcMmGj4jTpK0sq8xMG2V6aSIRqexGGvHQHYPSj7DIw3BPOx5nsVbTtA Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:31.258573 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}] Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9b5e11548f6b44a2a202c8ff7d8d5705 Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: exception: Aggregate 6 could not be found. Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6'} Oct 18 16:01:31.259751 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:31.260469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.261511 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.265033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.265033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:31.265033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:31.265033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 18 16:01:31.265033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.266369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d7ecb1-2fb9-4279-8bef-9dfb9d33643b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:31.267817 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71d7ecb1-2fb9-4279-8bef-9dfb9d33643b tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.068791 Oct 18 16:01:31.268877 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 131/291] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:31.271625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2e7b790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.274729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06f627c4-f41f-4387-9c5c-7748d901d3d4 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2110790999"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.280491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-06f627c4-f41f-4387-9c5c-7748d901d3d4 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 23f4f5d7-6591-479b-95f5-ce7c68386faa for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:31.292484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.293986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.299915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.322621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06f627c4-f41f-4387-9c5c-7748d901d3d4 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052130 Oct 18 16:01:31.324385 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 132/292] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.330059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d9ea8a4-6a50-425e-a06a-697392d5619e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-272520365", "name": "tempest-test_aggregate-598053560"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.340667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.341191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.346617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.371533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-1d9ea8a4-6a50-425e-a06a-697392d5619e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 3287403f-09fc-4173-85b8-61aa8cbf417c for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:31.400874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00eb429f-c12d-4521-b274-cb4d5a31dd99 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h1-858383-14" status: 200 len: 471 microversion: 2.1 time: 0.134588 Oct 18 16:01:31.409329 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 161/293] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-hosts/n-h1-858383-14 => generated 471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.420274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a4c208d-041d-40fe-8c58-ffe23772aff7 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.434701 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d9ea8a4-6a50-425e-a06a-697392d5619e tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.108880 Oct 18 16:01:31.435885 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 133/294] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 18 16:01:31 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.439486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a4c208d-041d-40fe-8c58-ffe23772aff7 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.441079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a4c208d-041d-40fe-8c58-ffe23772aff7 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.441737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a4c208d-041d-40fe-8c58-ffe23772aff7 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.443234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Calling method '.version_select at 0x7f5fd2abea60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.453907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.454627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.455225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.476589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.477598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.478673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.532406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a251986a-100c-47d7-8333-64c2c0636648 tempest-HostsAdminTestJSON-516728640 tempest-HostsAdminTestJSON-516728640-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h2-858383-14" status: 200 len: 471 microversion: 2.1 time: 0.093983 Oct 18 16:01:31.533516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 134/295] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-hosts/n-h2-858383-14 => generated 471 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.541140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-57c314c5-0f1d-4512-ac20-0931cd62f3d1 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.577962 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-57c314c5-0f1d-4512-ac20-0931cd62f3d1 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.043146 Oct 18 16:01:31.578951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 135/296] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:31.587781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.589431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:31.602468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.602789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.603446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.604369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.604959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.606231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.642676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a4c208d-041d-40fe-8c58-ffe23772aff7 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 243 microversion: 2.1 time: 0.231895 Oct 18 16:01:31.644136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 162/297] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:31 2022] POST /compute/v2.1/os-aggregates/7/action => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:31.650248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b35-f336-44f5-bc95-64daad5d5785 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.684474 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1fbf6b35-f336-44f5-bc95-64daad5d5785 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b35-f336-44f5-bc95-64daad5d5785 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Request method failure captured: Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2jds1UA92cm0g1Qkhr_VPsabTLtBlWwJYle2-rHj-0Zd_3daaQLQY172g5SbnVPOdlM4foIZSX13OuV_iL1JAY9XiSHqdJwzRkLR2Mp4DSJbxMWfoQKgxsCcMmGj4jTpK0sq8xMG2V6aSIRqexGGvHQHYPSj7DIw3BPOx5nsVbTtA Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:31.696381 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}] Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9b5e11548f6b44a2a202c8ff7d8d5705 Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: exception: Aggregate 8 could not be found. Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '8'} Oct 18 16:01:31.697744 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.698512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 18 16:01:31.699661 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.705770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b35-f336-44f5-bc95-64daad5d5785 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:31.706832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1fbf6b35-f336-44f5-bc95-64daad5d5785 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.061661 Oct 18 16:01:31.707717 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 163/298] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:31.725387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.754644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.756832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.760041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.818548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-858383-14. Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 40 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:31.838490 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: {"add_host": {"host": "n-h1-858383-14"}} Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:31.839981 n-d-858383-14 devstack@n-api.service[120570]: exception: Aggregate 7 already has host n-h1-858383-14. Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-858383-14'}}} Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:01:31.840743 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858383-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:01:31.841976 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 16:01:31.843046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:01:31.844850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858383-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 16, 1, 31, 799616), 'updated_at': None, 'host': 'n-h1-858383-14', 'aggregate_id': 7}] Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.846771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-858383-14. Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.848619 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-858383-14. Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:31.855505 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:31.858910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-858383-14. Oct 18 16:01:31.858910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.859197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:31.859197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:31.859816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:31.861029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-858383-14. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:31.862211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d5c3eff3-c640-42d0-8349-cd1671b2b34b tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.153355 Oct 18 16:01:31.863431 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 164/299] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:31 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 18 16:01:31.882061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1187a1e6-cc02-46b8-bdc9-c5bf6c4f015f tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.912984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1187a1e6-cc02-46b8-bdc9-c5bf6c4f015f tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 18 16:01:31.913439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f453806c-77e8-44e2-82dc-246f3881e836 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1416 microversion: 2.75 time: 0.330776 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1187a1e6-cc02-46b8-bdc9-c5bf6c4f015f tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Request method failure captured: Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2jds1UA92cm0g1Qkhr_VPsabTLtBlWwJYle2-rHj-0Zd_3daaQLQY172g5SbnVPOdlM4foIZSX13OuV_iL1JAY9XiSHqdJwzRkLR2Mp4DSJbxMWfoQKgxsCcMmGj4jTpK0sq8xMG2V6aSIRqexGGvHQHYPSj7DIw3BPOx5nsVbTtA Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:31.915450 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eedcd670e5b4403081b32b8c79fec62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eedcd670e5b4403081b32b8c79fec62a"}]}] Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: eedcd670e5b4403081b32b8c79fec62a Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-649805038 Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9b5e11548f6b44a2a202c8ff7d8d5705 Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminTestJSON-649805038-project-admin Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: exception: Aggregate 8 could not be found. Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '8'} Oct 18 16:01:31.916757 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:31.922357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:31.924885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:31.928539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:31.928539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:31.928539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:31.928539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 18 16:01:31.928539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:31.929765 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 136/300] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1416 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:31.930261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1187a1e6-cc02-46b8-bdc9-c5bf6c4f015f tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:31.930261 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1187a1e6-cc02-46b8-bdc9-c5bf6c4f015f tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.052314 Oct 18 16:01:31.930261 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 165/301] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:31.940163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-823be62b-f161-4a2f-8c4e-e4cb0b51c422 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:31.940665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:31.963885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:31.982572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.983059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.983495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.984199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.988084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:31.989585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:31.997609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823be62b-f161-4a2f-8c4e-e4cb0b51c422 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:31.998158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823be62b-f161-4a2f-8c4e-e4cb0b51c422 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:32.000477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823be62b-f161-4a2f-8c4e-e4cb0b51c422 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:32.283910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-823be62b-f161-4a2f-8c4e-e4cb0b51c422 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.366330 Oct 18 16:01:32.291814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 137/302] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:31 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:32.315934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-819b45dc-a785-46ff-a3dd-481bd9f0fa19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1546450616"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:32.327328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-819b45dc-a785-46ff-a3dd-481bd9f0fa19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid af64d8be-54f1-43cd-95ce-2b197e7d087f for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:32.378027 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-819b45dc-a785-46ff-a3dd-481bd9f0fa19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090038 Oct 18 16:01:32.394979 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 138/303] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:32.411455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661561e8-887f-41da-b4ab-de196e88e361", "tag": "5c192c27-a855-4f3c-9f96-7c2cb8d058a9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:32.432797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:32.434321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:32.435834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:32.463816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] Creating event network-changed:5c192c27-a855-4f3c-9f96-7c2cb8d058a9 for instance 661561e8-887f-41da-b4ab-de196e88e361 on n-h1-858383-14 Oct 18 16:01:32.483084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d9c23706-5848-4373-8989-191f3fc45384 req-fac6fb75-4da3-497f-a66f-39af5809170e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086852 Oct 18 16:01:32.484053 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 139/304] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:32.489151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:32.496133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:32.512178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:32.512728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:32.517383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:32.518219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:32.519039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:32.522276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:32.690427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:32.708014 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0268542a-ce15-4180-83d5-6a0ac6bfb2b8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1272 microversion: 2.1 time: 0.222337 Oct 18 16:01:32.708918 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 140/305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:32 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:32.735133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c452b820-4902-4ca7-9a9d-1429f38f6250 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:32.788110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c452b820-4902-4ca7-9a9d-1429f38f6250 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.064497 Oct 18 16:01:32.797138 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 141/306] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:32.806607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d60c4dd-1b66-44d5-8639-12ea4523a8c8 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:32.818654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=9,nova_api:INSERT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:32.825383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d60c4dd-1b66-44d5-8639-12ea4523a8c8 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.029605 Oct 18 16:01:32.833856 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 142/307] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:01:32 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:32.834332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-766c5c8d-f096-4ab3-aa31-68eca1781442 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-395889575"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:32.858313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-766c5c8d-f096-4ab3-aa31-68eca1781442 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid fb066ba6-34f1-4168-9a0a-6d11264eeba8 for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:32.930673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-766c5c8d-f096-4ab3-aa31-68eca1781442 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101992 Oct 18 16:01:32.933721 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 143/308] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:32.944745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-901e4ea6-4bda-4aaa-8acb-f41857ddc5c3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:33.011006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-901e4ea6-4bda-4aaa-8acb-f41857ddc5c3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.075925 Oct 18 16:01:33.013862 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 144/309] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 18 16:01:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:33.409279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e048e037-8435-4027-9002-113bd241a867 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:33.413943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e048e037-8435-4027-9002-113bd241a867 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e048e037-8435-4027-9002-113bd241a867 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 40 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:33.417912 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: {"add_host": {"host": "n-h1-858383-14"}} Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:33.419327 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-858383-14'}}} Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:33.423562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 16:01:33.424823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:33.426943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e048e037-8435-4027-9002-113bd241a867 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:33.426943 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e048e037-8435-4027-9002-113bd241a867 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.401730 Oct 18 16:01:33.426943 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 145/310] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 406 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:33.434171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:33.436861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:33.457633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:33.458051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:33.458487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:33.459213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:33.463963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:33.464425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:33.569197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:33.579173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:33.582655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:33.595969 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1989112-7608-44f0-8e2b-089756714f51 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1437 microversion: 2.75 time: 0.174178 Oct 18 16:01:33.596684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 146/311] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:33 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:33.601675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e869a4f0-283b-4906-b3e8-aeda1eeef843 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:33.613533 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e869a4f0-283b-4906-b3e8-aeda1eeef843 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.015655 Oct 18 16:01:33.620904 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 147/312] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:01:33 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:33.625739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72feaca2-b6d5-4c20-85e7-ad19ae91cfc3 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:33.665589 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72feaca2-b6d5-4c20-85e7-ad19ae91cfc3 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.049276 Oct 18 16:01:33.669356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 148/313] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:33 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:33.675151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d5b1257-ba20-450b-a227-c715da6441e4 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:33.712102 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d5b1257-ba20-450b-a227-c715da6441e4 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.041154 Oct 18 16:01:33.712972 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 149/314] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:33 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:33.720476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:33.725571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:33.736525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:33.737044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:33.737484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:33.738193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:33.738645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:33.739066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:33.846224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:01:33.848027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:01:33.848027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:01:33.848777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:01:33.849458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:01:33.886433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:33.899741 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4517e692-b265-4193-a7ee-26d70ae755c5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 200 len: 1588 microversion: 2.1 time: 1.973095 Oct 18 16:01:33.900626 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 166/315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:31 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 1588 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:33.908806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-185ad3c9-5c3c-4a3e-b740-190afddf403f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-563109261"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:33.916434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-185ad3c9-5c3c-4a3e-b740-190afddf403f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 10f679c4-8258-4657-9009-6c9e94390d50 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:33.975189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-185ad3c9-5c3c-4a3e-b740-190afddf403f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073233 Oct 18 16:01:33.984055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 167/316] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:33.988740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1c6c3ad-47d0-41bf-a0aa-f0f71bb86b19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2064129585", "availability_zone": "tempest-test_az-1950680297"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:33.990500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:33.998367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:33.998855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:33.999286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:33.999982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.000428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.000844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.064030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-c1c6c3ad-47d0-41bf-a0aa-f0f71bb86b19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 803280af-cc44-4f26-b95d-0758784eac42 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:34.126453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.130712 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1c6c3ad-47d0-41bf-a0aa-f0f71bb86b19 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.144500 Oct 18 16:01:34.131519 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 168/317] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 18 16:01:33 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.139041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.144306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.144924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:34.146673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.159541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.160039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.160468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e788ab9-106e-464e-b3bf-fe17e3a14e5b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "POST /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf/action" status: 202 len: 1494 microversion: 2.75 time: 0.443892 Oct 18 16:01:34.160599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.162095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.170705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 150/318] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:01:33 2022] POST /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf/action => generated 1494 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 16:01:34.173187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.173754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.198073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-317800997"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.226357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.226918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.234327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.250492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.250683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.253827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.268238 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-317800997 could not be found. Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 57 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:34.270456 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: {"add_host": {"host": "tempest-nonexist_host-317800997"}} Oct 18 16:01:34.271701 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: exception: Compute host tempest-nonexist_host-317800997 could not be found. Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-317800997'}}} Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-317800997' is not mapped to any cell Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.272447 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 18 16:01:34.273617 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-317800997 could not be found. Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-317800997 could not be found. Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.274715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-317800997 could not be found. Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-317800997 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d9df04c3-e09e-4871-9b82-9b1481c7b8f6 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.089140 Oct 18 16:01:34.277288 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 151/319] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:34.281016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a39a399-3aed-4f50-acec-75163b00e384 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2064129585_new", "availability_zone": "tempest-test_az-1950680297_new"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.428285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a39a399-3aed-4f50-acec-75163b00e384 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.428772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a39a399-3aed-4f50-acec-75163b00e384 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.430559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a39a399-3aed-4f50-acec-75163b00e384 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.439576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.451499 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e7ab3d1-c3c6-4303-9d25-abfba976b192 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1278 microversion: 2.1 time: 0.311831 Oct 18 16:01:34.463078 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 169/320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:34 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:34.484716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.486781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:34.499338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a39a399-3aed-4f50-acec-75163b00e384 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.223709 Oct 18 16:01:34.500264 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 152/321] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:01:34 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.511637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.512154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.512863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.513691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.514778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.515218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.516936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94a1efe0-4833-4007-947a-6bafc8af75fa tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.558977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:34.571446 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94a1efe0-4833-4007-947a-6bafc8af75fa tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.070045 Oct 18 16:01:34.572646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 153/322] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:34.581169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89074f75-d0e0-4185-98ae-27fbe6bd8a6a tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.598177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89074f75-d0e0-4185-98ae-27fbe6bd8a6a tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.020613 Oct 18 16:01:34.607433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 154/323] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:01:34 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.615331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5018df4-21a3-4220-8432-f2fb72101f86 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5018df4-21a3-4220-8432-f2fb72101f86 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 283 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:34.629882 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.631421 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:01:34.632099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.633077 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.634305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.635325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:01:34.635325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:01:34.635325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:01:34.635325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.635325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5018df4-21a3-4220-8432-f2fb72101f86 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.635710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a5018df4-21a3-4220-8432-f2fb72101f86 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.030440 Oct 18 16:01:34.635710 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 155/324] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:34.637682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0d8935d-af90-4fd6-b436-cb94db207244 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.669696 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0d8935d-af90-4fd6-b436-cb94db207244 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.036035 Oct 18 16:01:34.670290 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 156/325] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:34.679908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea6b15b9-9fbf-45fe-b05d-979bfc3818ea tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea6b15b9-9fbf-45fe-b05d-979bfc3818ea tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 27 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:34.687751 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: {"aggregate": {"name": ""}} Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.689224 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi '' Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.690078 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:01:34.692868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.693968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea6b15b9-9fbf-45fe-b05d-979bfc3818ea tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.693968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea6b15b9-9fbf-45fe-b05d-979bfc3818ea tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014166 Oct 18 16:01:34.693968 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 157/326] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:34.698580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b6766bd-dd26-4762-a0d9-7e60a74eb3eb tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1195868831"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.702428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-1b6766bd-dd26-4762-a0d9-7e60a74eb3eb tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Generated uuid 739f5b7e-81c8-45f5-89f2-76c85801581a for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:34.728417 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b6766bd-dd26-4762-a0d9-7e60a74eb3eb tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037091 Oct 18 16:01:34.735846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 158/327] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.740751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03a6fc5a-1e98-4216-a338-a5753659e66a tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-759058633"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.744776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03a6fc5a-1e98-4216-a338-a5753659e66a tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.744940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03a6fc5a-1e98-4216-a338-a5753659e66a tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 59 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:34.746611 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: {"aggregate": {"name": "tempest-test_aggregate-759058633"}} Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.748020 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-759058633'}}} Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:34.753349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:34.754464 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 16:01:34.755544 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.755544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03a6fc5a-1e98-4216-a338-a5753659e66a tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.755544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03a6fc5a-1e98-4216-a338-a5753659e66a tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011102 Oct 18 16:01:34.755544 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 159/328] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:34.755544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa893811-1347-41c2-a40e-8540a5f026e3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.758829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.760298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.766711 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91e05ea2-6913-46d5-8352-1cceae459260 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.302288 Oct 18 16:01:34.768604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 170/329] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:34 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:34.768879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa893811-1347-41c2-a40e-8540a5f026e3 tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.019413 Oct 18 16:01:34.776686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f096a3a-f44a-4ec5-bef5-b57ff34c11cf tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1602413112"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.777206 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 160/330] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:01:34 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.782438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-6f096a3a-f44a-4ec5-bef5-b57ff34c11cf tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 587c126f-2323-4071-b80e-00e57501bbe6 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:34.788762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce7303ff-d859-494d-bb5b-e22baa3ed1dc tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.811544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce7303ff-d859-494d-bb5b-e22baa3ed1dc tempest-AggregatesAdminTestJSON-649805038 tempest-AggregatesAdminTestJSON-649805038-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.033473 Oct 18 16:01:34.815437 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 161/331] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:34.817344 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f096a3a-f44a-4ec5-bef5-b57ff34c11cf tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045637 Oct 18 16:01:34.825184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.825372 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 171/332] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.827036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:34.832789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1602413112"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.833587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.834074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.834505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.835990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.836476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.836899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.837766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid b7b90e54-e6e9-4d6b-a2d0-6d5764e6b775 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:34.852659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1602413112 already exists. Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 60 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:34.856126 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: {"aggregate": {"name": "tempest-test_aggregate-1602413112"}} Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:34.857931 n-d-858383-14 devstack@n-api.service[120570]: exception: Aggregate tempest-test_aggregate-1602413112 already exists. Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1602413112'}}} Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 18 16:01:34.858778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1602413112 already exists. Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:34.859996 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1602413112 already exists. Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1602413112 already exists. Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1602413112 already exists. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.861298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f4a8555-b077-4120-8e0a-07d961dbcbdb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.029757 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] HTTP exception thrown: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Request method failure captured: Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 HTTP/1.1 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2gj0FyDsT0kGNqdDbSVJBT910Bg1zX2qXm9tzUUuIM6XLsjtkeCAr46RyIxt2MyQ7m_4JwSlSb2XlMk5Y_XtAWgL8yh_I9mFdvnEDpUOPCSMFQG_fEi3XLzz-j6wUYUlpQuZXoQJtA9H961ieG0WlBWtZs6aE7aZOJAwVzENHr2N0 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:34.862992 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_187142db0e8645c6a31350392a6b5d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}] Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 8820c273919741fa8a16b0486dabb283 Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.865076 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '404767c1-4b22-433a-80f9-02b1e034bd51'} Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.866589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.868288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.869644 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 172/333] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:01:34.869644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f5391db-ec76-4211-9971-71d80d696b78 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.872129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Returning 404 to user: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.873148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40f13a29-38dc-4496-96a1-b8a6edcea482 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "DELETE /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 404 len: 111 microversion: 2.1 time: 0.053500 Oct 18 16:01:34.873912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 162/334] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:34.881596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.882836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] [instance: 404767c1-4b22-433a-80f9-02b1e034bd51] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:34.885986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:34.889177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.889674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.890111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.890793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:34.891408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:34.892151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:34.901720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f5391db-ec76-4211-9971-71d80d696b78 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.037395 Oct 18 16:01:34.902303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 173/335] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:34.907911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] HTTP exception thrown: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Request method failure captured: Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 HTTP/1.1 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2gj0FyDsT0kGNqdDbSVJBT910Bg1zX2qXm9tzUUuIM6XLsjtkeCAr46RyIxt2MyQ7m_4JwSlSb2XlMk5Y_XtAWgL8yh_I9mFdvnEDpUOPCSMFQG_fEi3XLzz-j6wUYUlpQuZXoQJtA9H961ieG0WlBWtZs6aE7aZOJAwVzENHr2N0 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:34.909771 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_187142db0e8645c6a31350392a6b5d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/187142db0e8645c6a31350392a6b5d33"}]}] Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 187142db0e8645c6a31350392a6b5d33 Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1340900580 Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 8820c273919741fa8a16b0486dabb283 Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminTestJSON-1340900580-project Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.911192 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '404767c1-4b22-433a-80f9-02b1e034bd51'} Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.911984 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. Oct 18 16:01:34.913337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.914540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82e17b43-6d5b-4f6b-95c6-b60eb6986179 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071866332"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:34.914638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] Returning 404 to user: Instance 404767c1-4b22-433a-80f9-02b1e034bd51 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.915605 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d0cbc67-88ea-4ad9-bf0f-5efcf73636d0 tempest-AggregatesAdminTestJSON-1340900580 tempest-AggregatesAdminTestJSON-1340900580-project] 10.222.0.78 "GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51" status: 404 len: 111 microversion: 2.1 time: 0.037860 Oct 18 16:01:34.916592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 163/336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:34 2022] GET /compute/v2.1/servers/404767c1-4b22-433a-80f9-02b1e034bd51 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:34.920007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-82e17b43-6d5b-4f6b-95c6-b60eb6986179 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid e674065c-a734-4dee-bda9-3053601c5b75 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:34.950934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82e17b43-6d5b-4f6b-95c6-b60eb6986179 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042335 Oct 18 16:01:34.952365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 174/337] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:34.963502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-077ec735-638b-4533-ad23-e01e3c784760 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:34.965619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-077ec735-638b-4533-ad23-e01e3c784760 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-077ec735-638b-4533-ad23-e01e3c784760 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:34.967902 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 16:01:34.969225 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '15'} Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:34.970069 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 16:01:34.971145 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:34.972960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-077ec735-638b-4533-ad23-e01e3c784760 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:34.974031 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-077ec735-638b-4533-ad23-e01e3c784760 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015133 Oct 18 16:01:34.974974 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 164/338] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:34.986653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa78f63a-08ac-4db0-ab60-28435902d6eb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.020973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa78f63a-08ac-4db0-ab60-28435902d6eb tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.038894 Oct 18 16:01:35.022692 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 175/339] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:35.032547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39236672-e700-4a5a-b776-ce7f83fcd5af tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.047898 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-39236672-e700-4a5a-b776-ce7f83fcd5af tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39236672-e700-4a5a-b776-ce7f83fcd5af tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:35.050852 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: exception: Aggregate -1 could not be found. Oct 18 16:01:35.052369 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '-1'} Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:35.053299 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.055860 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 16:01:35.058205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.060793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39236672-e700-4a5a-b776-ce7f83fcd5af tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:35.062538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39236672-e700-4a5a-b776-ce7f83fcd5af tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034252 Oct 18 16:01:35.063577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 165/340] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:35 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:35.073642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-446e5757-3ed3-4d80-b109-4c96b87f337c tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564185716"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.077813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-446e5757-3ed3-4d80-b109-4c96b87f337c tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 13eceb8e-83fc-4bb1-8b80-15548dc859b4 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:35.122165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-446e5757-3ed3-4d80-b109-4c96b87f337c tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049581 Oct 18 16:01:35.125598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 176/341] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:35.136680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f45239dd-a738-4a44-8254-a90ae6eee89d tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.138580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f45239dd-a738-4a44-8254-a90ae6eee89d tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f45239dd-a738-4a44-8254-a90ae6eee89d tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:35.141730 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 16:01:35.143192 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '16'} Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:35.143878 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.144897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f45239dd-a738-4a44-8254-a90ae6eee89d tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:35.145940 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f45239dd-a738-4a44-8254-a90ae6eee89d tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013095 Oct 18 16:01:35.149785 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 166/342] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:35 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:35.156450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6e77f26-419f-458d-96c0-fa74750bab06 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.183330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6e77f26-419f-458d-96c0-fa74750bab06 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.032623 Oct 18 16:01:35.193742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-527305f5-cd77-4d3f-8378-b55099eac9b5 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.199834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 177/343] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:35 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:35.206054 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-527305f5-cd77-4d3f-8378-b55099eac9b5 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-527305f5-cd77-4d3f-8378-b55099eac9b5 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:35.208275 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: exception: Aggregate -1 could not be found. Oct 18 16:01:35.209774 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '-1'} Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.211376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 16:01:35.212652 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.214937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-527305f5-cd77-4d3f-8378-b55099eac9b5 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:35.216376 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-527305f5-cd77-4d3f-8378-b55099eac9b5 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026589 Oct 18 16:01:35.228049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2241205a-a695-4d09-be8b-428bd3916ced tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.230482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2241205a-a695-4d09-be8b-428bd3916ced tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:35.232407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 167/344] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:35 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2241205a-a695-4d09-be8b-428bd3916ced tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:35.233420 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 16:01:35.234682 n-d-858383-14 devstack@n-api.service[120570]: action_args: {} Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:35.235357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.236336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2241205a-a695-4d09-be8b-428bd3916ced tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:35.238262 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2241205a-a695-4d09-be8b-428bd3916ced tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.012694 Oct 18 16:01:35.245469 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 178/345] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:01:35 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:35.249550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-161cbcbc-6153-42ba-9349-9d508406ccb2 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-230429137"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.255531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.aggregate [None req-161cbcbc-6153-42ba-9349-9d508406ccb2 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 30e3c610-1002-47aa-99c9-d28a8651be32 for aggregate {{(pid=120571) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:35.288124 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-161cbcbc-6153-42ba-9349-9d508406ccb2 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044220 Oct 18 16:01:35.290333 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 168/346] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:35.302533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d43f7185-3c3f-448a-bb11-72820beff4a8 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.319399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43f7185-3c3f-448a-bb11-72820beff4a8 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.320260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43f7185-3c3f-448a-bb11-72820beff4a8 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.320979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43f7185-3c3f-448a-bb11-72820beff4a8 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.494239 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d43f7185-3c3f-448a-bb11-72820beff4a8 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.195799 Oct 18 16:01:35.496079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.496688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:35.497909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 179/347] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:35.508277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34d5f42e-1e1f-40e3-a2f3-136d50e124c4 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.517492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.520521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34d5f42e-1e1f-40e3-a2f3-136d50e124c4 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '76287c8ded5f4077bd8c2817b14fb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174f2eeb6cc948ec8e086efad11449a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:35.521546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.523627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.526050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.529998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34d5f42e-1e1f-40e3-a2f3-136d50e124c4 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Request method failure captured: Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 43 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2hGuzmYP4aKK9yJnGwhIEkS_n7LhJnvsIGXuaEZX64W3V3EyRDYP2zZ79vb5iFJzp6UB94Ym2Q2xeq1w6WJZ4Ko-D1NjjCFeafbKWhVHPwQIownfeQPT8k3hcuL-UFPN3URCImpQ6RLtKC64muJu1WigDfvNXz-WTkZN0pEGjUX1Q Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:35.530934 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_174f2eeb6cc948ec8e086efad11449a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/174f2eeb6cc948ec8e086efad11449a1"}]}] Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 174f2eeb6cc948ec8e086efad11449a1 Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-402170001 Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 76287c8ded5f4077bd8c2817b14fb03f Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-402170001-project Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: {"remove_host": {"host": "n-h1-858383-14"}} Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:35.532094 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858383-14'}}} Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:35.532791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 16:01:35.533869 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:35.536469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.537373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34d5f42e-1e1f-40e3-a2f3-136d50e124c4 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:35.542277 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34d5f42e-1e1f-40e3-a2f3-136d50e124c4 tempest-AggregatesAdminNegativeTestJSON-402170001 tempest-AggregatesAdminNegativeTestJSON-402170001-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.039379 Oct 18 16:01:35.543250 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 180/348] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:35.562406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a826b7c-7fe7-400a-a731-69c667872d49 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.583831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a826b7c-7fe7-400a-a731-69c667872d49 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.587662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a826b7c-7fe7-400a-a731-69c667872d49 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.591228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a826b7c-7fe7-400a-a731-69c667872d49 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.774432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:35.787364 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e409ccf4-98de-4696-8fd3-be02a0c8f33d tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1278 microversion: 2.1 time: 0.301260 Oct 18 16:01:35.791406 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 169/349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:35 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:35.803087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.804540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:35.806874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a826b7c-7fe7-400a-a731-69c667872d49 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.254876 Oct 18 16:01:35.812934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 181/350] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:35.821823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.822644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.823148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.823975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:35.824495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:35.824887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:35.829701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b650a240-c100-4643-b987-b2099bdd4939 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:35.876008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:35.880265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b650a240-c100-4643-b987-b2099bdd4939 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.052044 Oct 18 16:01:35.881949 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 182/351] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:35 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:35.902045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c85654b-f980-4cd1-9a39-d5a28fa32413 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-958515174"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:35.916756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-4c85654b-f980-4cd1-9a39-d5a28fa32413 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Generated uuid 6c7b929c-3b26-436d-ab14-4d9cf6a001d1 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:01:35.967515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c85654b-f980-4cd1-9a39-d5a28fa32413 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075107 Oct 18 16:01:35.977371 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 183/352] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:35.985050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:36.001875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:36.002681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:36.006831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:36.013359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:36.028397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:36.032862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:36.045640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:36.046133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:36.046577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:36.049830 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52eee2d9-aeab-481c-a5ed-c55e93e8d632 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.256750 Oct 18 16:01:36.051794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 170/353] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:35 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:36.091545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.compute.aggregates [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 16:01:36.092374 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Request method failure captured: Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 42 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2kd92rbiYlaj1TYk761A97ABGsRc-VU6hJdQsPiZ4KPrtyn7QmPRVFXN-3REe_55c_59Kcz_ouuVmiKrf3mImkxi3iKeoaAgB73oD6yugYTDNaO85CRUDXA-AjRzsQ3GFON66EtJ7oqrTSOph5g36TgL0bJbGDxzsEUqKG7bqRoGo Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:36.094643 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b8f13773b92f4486a72ff866f2d03373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b8f13773b92f4486a72ff866f2d03373"}]}] Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b8f13773b92f4486a72ff866f2d03373 Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027 Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 14a286ff6df64de9a3ec05c669d7abfc Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: {"remove_host": {"host": "nonexist_host"}} Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:01:36.096224 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 16:01:36.097103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 18 16:01:36.098328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.099504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 18 16:01:36.101915 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:36.105331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:36.107971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5483dc5b-bdcf-47f8-97af-0c09dd42316f tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.129467 Oct 18 16:01:36.108875 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 184/354] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:01:35 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:36.118892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dcf42b6-b82a-4468-9024-6e2324f48d93 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:36.173447 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dcf42b6-b82a-4468-9024-6e2324f48d93 tempest-AggregatesAdminNegativeTestJSON-2061267027 tempest-AggregatesAdminNegativeTestJSON-2061267027-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.059412 Oct 18 16:01:36.189557 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 171/355] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:01:36 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:01:36.831106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:36.831963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:36.846777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:36.848799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:36.849415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:36.856638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:36.857376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:36.858217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:36.996623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=44 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:37.088660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:37.090143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:37.106232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:37.107623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:37.109509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:37.110697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:37.113466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:37.113945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:37.332510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:37.349943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:37.356067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:37.365522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=12,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:37.376372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e67f51a0-18fe-4355-99f1-2bdae33fe69b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.295755 Oct 18 16:01:37.377802 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 172/356] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:37 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:37.999412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a67aea60-e4bf-4d53-bdfd-a33271c0e686 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Calling method '.version_select at 0x7f5fd28583a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.001603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a67aea60-e4bf-4d53-bdfd-a33271c0e686 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ac9ce6da395b4c2b9bcce789fbb307b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a561a55f57f84b06abe9e7c932dbb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a67aea60-e4bf-4d53-bdfd-a33271c0e686 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Request method failure captured: Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3fbMuXTehCmNE_ezgq6bNYY-41FhaX7FpqMYW0XAD2ZRLbUinUQyfrMKPtfbhYOqDbVr53yzoO3hcDKQ7A-23TlStRoPMxssRSGqFU3lU3_Bw_pzuShp-rcKsrssIjhB7HnX86bK8eFHZQxLMqpC1rb5B6MkhyXTQnTLefjQ5oCAc Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:38.003640 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}] Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ac9ce6da395b4c2b9bcce789fbb307b4 Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:01:38.005072 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:38.006012 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 16:01:38.007631 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.008699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a67aea60-e4bf-4d53-bdfd-a33271c0e686 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.008699 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a67aea60-e4bf-4d53-bdfd-a33271c0e686 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.625967 Oct 18 16:01:38.011111 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 173/357] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:01:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:38.016388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7cffc3d3-4612-4347-8c3c-88d6d00c287c tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Calling method '.version_select at 0x7f5fd2c00820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.018810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7cffc3d3-4612-4347-8c3c-88d6d00c287c tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ac9ce6da395b4c2b9bcce789fbb307b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a561a55f57f84b06abe9e7c932dbb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7cffc3d3-4612-4347-8c3c-88d6d00c287c tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Request method failure captured: Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3fbMuXTehCmNE_ezgq6bNYY-41FhaX7FpqMYW0XAD2ZRLbUinUQyfrMKPtfbhYOqDbVr53yzoO3hcDKQ7A-23TlStRoPMxssRSGqFU3lU3_Bw_pzuShp-rcKsrssIjhB7HnX86bK8eFHZQxLMqpC1rb5B6MkhyXTQnTLefjQ5oCAc Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:38.020388 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}] Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ac9ce6da395b4c2b9bcce789fbb307b4 Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:01:38.021613 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:38.022337 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 16:01:38.024117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.025788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7cffc3d3-4612-4347-8c3c-88d6d00c287c tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.025788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7cffc3d3-4612-4347-8c3c-88d6d00c287c tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009503 Oct 18 16:01:38.025788 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 174/358] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:38.037761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e05eabe5-4d9c-4940-a076-3ec5919e12b4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Calling method '.version_select at 0x7f5fd288b310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.040660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e05eabe5-4d9c-4940-a076-3ec5919e12b4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ac9ce6da395b4c2b9bcce789fbb307b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a561a55f57f84b06abe9e7c932dbb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e05eabe5-4d9c-4940-a076-3ec5919e12b4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Request method failure captured: Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3fbMuXTehCmNE_ezgq6bNYY-41FhaX7FpqMYW0XAD2ZRLbUinUQyfrMKPtfbhYOqDbVr53yzoO3hcDKQ7A-23TlStRoPMxssRSGqFU3lU3_Bw_pzuShp-rcKsrssIjhB7HnX86bK8eFHZQxLMqpC1rb5B6MkhyXTQnTLefjQ5oCAc Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:38.042640 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}] Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ac9ce6da395b4c2b9bcce789fbb307b4 Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:01:38.043889 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:38.044660 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 16:01:38.045715 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.048138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e05eabe5-4d9c-4940-a076-3ec5919e12b4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.049792 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e05eabe5-4d9c-4940-a076-3ec5919e12b4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015864 Oct 18 16:01:38.057967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 175/359] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:38.344142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.359849 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e22f9dd2-c13b-4af8-b6af-d325b19e9776 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 1.533207 Oct 18 16:01:38.365257 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 185/360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:36 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:38.411352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.411979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:38.429878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.431424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.432833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.435707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.436046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Calling method '.version_select at 0x7f5fd28cc040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.437935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.438671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.439936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.445936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.446570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.510857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.513610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.514274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.551031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.551822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.552482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.565651 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7a13d00-8e32-47c8-8bb5-8fc3fe49b86d tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.506006 Oct 18 16:01:38.568869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 176/361] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:38.581643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49da4160-322b-4842-8f8c-bccbea973db4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Calling method '.version_select at 0x7f5fd2d18310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.584304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-49da4160-322b-4842-8f8c-bccbea973db4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ac9ce6da395b4c2b9bcce789fbb307b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a561a55f57f84b06abe9e7c932dbb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49da4160-322b-4842-8f8c-bccbea973db4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Request method failure captured: Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3fbMuXTehCmNE_ezgq6bNYY-41FhaX7FpqMYW0XAD2ZRLbUinUQyfrMKPtfbhYOqDbVr53yzoO3hcDKQ7A-23TlStRoPMxssRSGqFU3lU3_Bw_pzuShp-rcKsrssIjhB7HnX86bK8eFHZQxLMqpC1rb5B6MkhyXTQnTLefjQ5oCAc Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:38.592704 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}] Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ac9ce6da395b4c2b9bcce789fbb307b4 Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1'} Oct 18 16:01:38.595104 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:38.596489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 16:01:38.600659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.609279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49da4160-322b-4842-8f8c-bccbea973db4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.609279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49da4160-322b-4842-8f8c-bccbea973db4 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.030106 Oct 18 16:01:38.615109 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 177/362] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:38.628168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef694ae9-34c9-4da7-bf4d-1ff3e1b45475 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Calling method '.version_select at 0x7f5fd29cbe50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.644210 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ef694ae9-34c9-4da7-bf4d-1ff3e1b45475 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] HTTP exception thrown: Hypervisor with ID '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' could not be found. Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef694ae9-34c9-4da7-bf4d-1ff3e1b45475 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Request method failure captured: Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d/uptime HTTP/1.1 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3hPmopy_PvdUl0joi24XJxLLdBenbPKL28Fqp6gOeoONBxiZf375LZYMjxeo9K2_VybtSi9aXcn1GYNMdFX_yGLqvxEFvbEDIGPjEAfgSvUrr5heWX1P9qIVS91iDjsWWT2QsXUjWuaW3zs_F6RbRqMjIuD-zwbTOKNZox0b4PZcc Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 60ec1e213c5847bba717b4ff4a1306b7 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:38.668776 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/60ec1e213c5847bba717b4ff4a1306b7"}]}] Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 60ec1e213c5847bba717b4ff4a1306b7 Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: bfcc8a9daba9466d87f6739c6be8a1bf Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: exception: Hypervisor with ID '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' could not be found. Oct 18 16:01:38.671414 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d'} Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 16:01:38.672768 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' could not be found. Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.675197 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' could not be found. Oct 18 16:01:38.679640 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.687226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef694ae9-34c9-4da7-bf4d-1ff3e1b45475 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Returning 404 to user: Hypervisor with ID '7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d' could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.687226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef694ae9-34c9-4da7-bf4d-1ff3e1b45475 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.066072 Oct 18 16:01:38.690145 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 178/363] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors/7f38bb5a-cbf9-409e-9aaf-96d1686bcb4d/uptime => generated 123 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:38.719713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Calling method '.version_select at 0x7f5fd28580d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.726681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.726968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.728332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.802145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.803110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.806263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.877394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:38.879347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:38.885816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:38.907755 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd55db2d-c23b-4b0c-99d4-30459e25921c tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.213789 Oct 18 16:01:38.923997 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 179/364] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:38.942910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ec2011b-755c-4bac-84f8-1133c0ca1d59 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Calling method '.version_select at 0x7f5fd29cb820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:38.954821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1ec2011b-755c-4bac-84f8-1133c0ca1d59 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ac9ce6da395b4c2b9bcce789fbb307b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a561a55f57f84b06abe9e7c932dbb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ec2011b-755c-4bac-84f8-1133c0ca1d59 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Request method failure captured: Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3fbMuXTehCmNE_ezgq6bNYY-41FhaX7FpqMYW0XAD2ZRLbUinUQyfrMKPtfbhYOqDbVr53yzoO3hcDKQ7A-23TlStRoPMxssRSGqFU3lU3_Bw_pzuShp-rcKsrssIjhB7HnX86bK8eFHZQxLMqpC1rb5B6MkhyXTQnTLefjQ5oCAc Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:38.968559 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a561a55f57f84b06abe9e7c932dbb470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a561a55f57f84b06abe9e7c932dbb470"}]}] Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a561a55f57f84b06abe9e7c932dbb470 Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907 Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ac9ce6da395b4c2b9bcce789fbb307b4 Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1143424907-project Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1'} Oct 18 16:01:38.971753 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:38.973211 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 16:01:38.975214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:38.990319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ec2011b-755c-4bac-84f8-1133c0ca1d59 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:38.993247 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ec2011b-755c-4bac-84f8-1133c0ca1d59 tempest-HypervisorAdminNegativeTestJSON-1143424907 tempest-HypervisorAdminNegativeTestJSON-1143424907-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.060434 Oct 18 16:01:39.004576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:39.012101 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 180/365] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 81 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:39.046416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25b8399c-7e0d-4efc-bab6-c695ee9d9299 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Calling method '.version_select at 0x7f5fd28ccc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:39.053001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:39.062840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:39.063143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-25b8399c-7e0d-4efc-bab6-c695ee9d9299 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] HTTP exception thrown: Hypervisor with ID '48c1e485-81a9-44b4-bb87-9835bfdbbb12' could not be found. Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25b8399c-7e0d-4efc-bab6-c695ee9d9299 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Request method failure captured: Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/48c1e485-81a9-44b4-bb87-9835bfdbbb12 HTTP/1.1 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3hPmopy_PvdUl0joi24XJxLLdBenbPKL28Fqp6gOeoONBxiZf375LZYMjxeo9K2_VybtSi9aXcn1GYNMdFX_yGLqvxEFvbEDIGPjEAfgSvUrr5heWX1P9qIVS91iDjsWWT2QsXUjWuaW3zs_F6RbRqMjIuD-zwbTOKNZox0b4PZcc Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 60ec1e213c5847bba717b4ff4a1306b7 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:39.065068 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_60ec1e213c5847bba717b4ff4a1306b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/60ec1e213c5847bba717b4ff4a1306b7"}]}] Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 60ec1e213c5847bba717b4ff4a1306b7 Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151850831 Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: bfcc8a9daba9466d87f6739c6be8a1bf Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: exception: Hypervisor with ID '48c1e485-81a9-44b4-bb87-9835bfdbbb12' could not be found. Oct 18 16:01:39.066488 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '48c1e485-81a9-44b4-bb87-9835bfdbbb12'} Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '48c1e485-81a9-44b4-bb87-9835bfdbbb12' Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 16:01:39.067295 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:01:39.068706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '48c1e485-81a9-44b4-bb87-9835bfdbbb12' could not be found. Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '48c1e485-81a9-44b4-bb87-9835bfdbbb12' could not be found. Oct 18 16:01:39.071188 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:39.075741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25b8399c-7e0d-4efc-bab6-c695ee9d9299 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] Returning 404 to user: Hypervisor with ID '48c1e485-81a9-44b4-bb87-9835bfdbbb12' could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:39.077934 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25b8399c-7e0d-4efc-bab6-c695ee9d9299 tempest-HypervisorAdminNegativeTestJSON-151850831 tempest-HypervisorAdminNegativeTestJSON-151850831-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/48c1e485-81a9-44b4-bb87-9835bfdbbb12" status: 404 len: 123 microversion: 2.1 time: 0.061386 Oct 18 16:01:39.082665 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 181/366] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:01:39 2022] GET /compute/v2.1/os-hypervisors/48c1e485-81a9-44b4-bb87-9835bfdbbb12 => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:39.085979 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a285b309-513e-44d5-b1d6-3cdb5347a8c1 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.679337 Oct 18 16:01:39.109247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 186/367] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:38 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:01:39.395298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:39.396333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:39.408542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:39.410199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:39.412985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:39.418637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:39.420271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:39.424321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:39.729523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfc9a06-deb9-4a8f-981a-7daef24d63f8", "tag": "a42d3670-1162-44b1-ac83-33187cac5ce3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:39.755806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:39.756233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:39.756654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:39.791102 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] Creating event network-changed:a42d3670-1162-44b1-ac83-33187cac5ce3 for instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 on n-h1-858383-14 Oct 18 16:01:39.822530 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-66e3c5d7-80dd-43fa-b9da-2c85ab916839 req-df9ec614-0db3-47bc-8cf3-bea213674564 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097378 Oct 18 16:01:39.826741 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 187/368] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:40.127213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:40.128365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:40.144478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:40.145670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:40.146346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:40.147917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:40.148711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:40.150025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:40.364355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:40.374329 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea7b2f0b-4834-4b9d-8c92-dc375a527111 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.986102 Oct 18 16:01:40.378222 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 182/369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:39 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:40.459350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:40.473411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:40.473411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:40.500510 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4eeb5a49-43cb-4d4d-99cc-dabb248f2e12 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.385206 Oct 18 16:01:40.501108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 188/370] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:40 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:40.935768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:41.402279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:41.402902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:41.422645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:41.423753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:41.430387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:41.431582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:41.432077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:41.432518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:41.462864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] Calling method '.version_select at 0x7f5fd28588b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:41.692130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c70f4f3-4a40-4962-a42c-393888056ed6 could not be found", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:01:41.692820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] HTTP exception thrown: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] Request method failure captured: Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-floating-ips/3c70f4f3-4a40-4962-a42c-393888056ed6 HTTP/1.1 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3kN1n7MR5ORRedp9mZ3BIvGByjRE75SJ3pEqHK7ypZzxoS5eY0wtjCk0LG5P0M5Jg7cAHqY4_suwJOCZufxqc8INs4pSz3K7LhSfI82rqO1ACWnqStVFfpHNBEy3hAeDuvb_ovRo5UrKj49aX81rP2VOYW46AJofKiB7Q3uGTT7Xw Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 63444a4996f445398a0f529e53ed5d7a Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1056251217 Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:41.710027 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63444a4996f445398a0f529e53ed5d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63444a4996f445398a0f529e53ed5d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63444a4996f445398a0f529e53ed5d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63444a4996f445398a0f529e53ed5d7a"}]}] Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1056251217 Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 63444a4996f445398a0f529e53ed5d7a Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1056251217 Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: be47a02c67bc4697b77ebf7a21dc9c49 Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: exception: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6 Oct 18 16:01:41.712386 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3c70f4f3-4a40-4962-a42c-393888056ed6'} Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:01:41.713325 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c70f4f3-4a40-4962-a42c-393888056ed6 could not be found Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deeceb56-f722-48c3-bbb2-fced89329889'] Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6. Oct 18 16:01:41.715280 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6 Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:41.717823 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:41.720402 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:41.720402 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6 Oct 18 16:01:41.720402 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:41.720402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] Returning 404 to user: Floating IP not found for ID 3c70f4f3-4a40-4962-a42c-393888056ed6 {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:41.720402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b1eef0c4-4ac1-498d-a1b1-7d30e83c996c tempest-FloatingIPDetailsNegativeTestJSON-1056251217 tempest-FloatingIPDetailsNegativeTestJSON-1056251217-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/3c70f4f3-4a40-4962-a42c-393888056ed6" status: 404 len: 111 microversion: 2.1 time: 0.982471 Oct 18 16:01:41.721535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 183/371] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:01:40 2022] GET /compute/v2.1/os-floating-ips/3c70f4f3-4a40-4962-a42c-393888056ed6 => generated 111 bytes in 992 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:41.733061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:41.733692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:41.752864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:41.761069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:41.761561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:41.762398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:41.763061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:41.763495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:42.040587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:42.056036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:42.060369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:42.079080 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad6f3be5-f3ab-4485-97f6-357fe2f7755c tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.352981 Oct 18 16:01:42.080082 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 184/372] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:41 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:42.342405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:42.359391 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af815dcf-48a8-4246-9d58-a28704cb95c5 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.961594 Oct 18 16:01:42.364663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 189/373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:41 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:42.468336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Calling method '.version_select at 0x7f5fd28ccee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:42.471864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:42.472345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:42.472781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:42.474561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:42.475453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:42.479985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:42.487707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=25 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:42.538704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08853e20-98ec-4bb8-9d0a-c4cbc246510f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.455587 Oct 18 16:01:42.539298 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 185/374] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:01:42 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:43.109552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.110411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:43.124972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:43.130919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:43.131906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:43.133058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:43.133715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:43.134355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:43.184876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61120bb1-1f3a-4788-82c9-68a71c89d49c tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Calling method '.version_select at 0x7f5fd2a7e040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.188942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-61120bb1-1f3a-4788-82c9-68a71c89d49c tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61120bb1-1f3a-4788-82c9-68a71c89d49c tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:43.194346 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: action_args: {} Oct 18 16:01:43.196033 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.196918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 16:01:43.198247 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.207820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61120bb1-1f3a-4788-82c9-68a71c89d49c tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.208853 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61120bb1-1f3a-4788-82c9-68a71c89d49c tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.661969 Oct 18 16:01:43.213688 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 190/375] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:01:42 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 667 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:43.232642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5be3d088-16f7-49d4-bafc-8b7f07c8beb9 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Calling method '.version_select at 0x7f5fd2a75820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.234853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5be3d088-16f7-49d4-bafc-8b7f07c8beb9 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5be3d088-16f7-49d4-bafc-8b7f07c8beb9 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts/n-d-858383-14/reboot HTTP/1.1 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:43.246898 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'n-d-858383-14'} Oct 18 16:01:43.248355 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.249215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 16:01:43.250268 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.251892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5be3d088-16f7-49d4-bafc-8b7f07c8beb9 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.252776 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5be3d088-16f7-49d4-bafc-8b7f07c8beb9 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-858383-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032894 Oct 18 16:01:43.263845 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 191/376] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/n-d-858383-14/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:43.280256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0da4ff7e-9e34-4b4f-a500-ae15bfc1fb2d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Calling method '.version_select at 0x7f5fd2f40790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.291730 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0da4ff7e-9e34-4b4f-a500-ae15bfc1fb2d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0da4ff7e-9e34-4b4f-a500-ae15bfc1fb2d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:43.294470 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'nonexistent_hostname'} Oct 18 16:01:43.295883 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:43.296642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 16:01:43.297740 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.298969 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.302697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0da4ff7e-9e34-4b4f-a500-ae15bfc1fb2d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.302697 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0da4ff7e-9e34-4b4f-a500-ae15bfc1fb2d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.030084 Oct 18 16:01:43.310529 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 192/377] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:43.323624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddcc428e-e0e6-403d-8deb-22b6f3394a82 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Calling method '.version_select at 0x7f5fd2a4c280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.326127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddcc428e-e0e6-403d-8deb-22b6f3394a82 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddcc428e-e0e6-403d-8deb-22b6f3394a82 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts/n-d-858383-14 HTTP/1.1 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:43.327726 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'n-d-858383-14'} Oct 18 16:01:43.328862 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.329672 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 16:01:43.330654 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.331540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddcc428e-e0e6-403d-8deb-22b6f3394a82 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.331540 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddcc428e-e0e6-403d-8deb-22b6f3394a82 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-858383-14" status: 403 len: 109 microversion: 2.1 time: 0.017510 Oct 18 16:01:43.331540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 193/378] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/n-d-858383-14 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:43.344794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0f12aee-b929-4303-87f7-ba17e944aa46 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Calling method '.version_select at 0x7f5fd2a7e700>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.357695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e0f12aee-b929-4303-87f7-ba17e944aa46 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0f12aee-b929-4303-87f7-ba17e944aa46 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:43.359549 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'nonexistent_hostname'} Oct 18 16:01:43.360725 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.361466 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.362451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.363446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0f12aee-b929-4303-87f7-ba17e944aa46 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.363446 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e0f12aee-b929-4303-87f7-ba17e944aa46 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022259 Oct 18 16:01:43.368634 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 194/379] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:43.374650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa1a180e-932f-4ea6-9f96-de72d5922ee5 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Calling method '.version_select at 0x7f5fd2a4c280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.391685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa1a180e-932f-4ea6-9f96-de72d5922ee5 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa1a180e-932f-4ea6-9f96-de72d5922ee5 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hosts/n-d-858383-14/shutdown HTTP/1.1 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:43.394006 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'n-d-858383-14'} Oct 18 16:01:43.395180 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.395893 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 16:01:43.396889 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.398457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa1a180e-932f-4ea6-9f96-de72d5922ee5 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.398457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa1a180e-932f-4ea6-9f96-de72d5922ee5 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-858383-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.025707 Oct 18 16:01:43.405850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 195/380] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/n-d-858383-14/shutdown => generated 113 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:43.416605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.421277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:43.434050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:43.434578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:43.435026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:43.435763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:43.452353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:43.453414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:43.507922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.525026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.534047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.546355 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-362d6718-99e4-4418-9cfb-f24c67286748 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.442416 Oct 18 16:01:43.548634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 186/381] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:01:43.556137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dab30ec3-327f-44f3-bdeb-494d88f62aaf tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Calling method '.version_select at 0x7f5fd2919d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.582907 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-dab30ec3-327f-44f3-bdeb-494d88f62aaf tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dab30ec3-327f-44f3-bdeb-494d88f62aaf tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.591884 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'nonexistent_hostname'} Oct 18 16:01:43.593134 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:43.593842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 16:01:43.594846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.595933 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.597610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dab30ec3-327f-44f3-bdeb-494d88f62aaf tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.602383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dab30ec3-327f-44f3-bdeb-494d88f62aaf tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.051085 Oct 18 16:01:43.604431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 187/382] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:43.619986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e30140f-0c3f-436e-acb5-701b0f361690 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Calling method '.version_select at 0x7f5fd2803700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.624468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e30140f-0c3f-436e-acb5-701b0f361690 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e30140f-0c3f-436e-acb5-701b0f361690 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hosts/n-d-858383-14/startup HTTP/1.1 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:43.631227 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-d-858383-14'} Oct 18 16:01:43.633699 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.634562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 16:01:43.635853 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.638144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e30140f-0c3f-436e-acb5-701b0f361690 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.639829 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e30140f-0c3f-436e-acb5-701b0f361690 tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-858383-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.028281 Oct 18 16:01:43.642553 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 188/383] 10.222.0.78 () {58 vars in 1194 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/n-d-858383-14/startup => generated 110 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:01:43.655659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b3b23d1-e424-4f58-87b4-339888eef57b tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Calling method '.version_select at 0x7f5fd2803700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:43.681803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6b3b23d1-e424-4f58-87b4-339888eef57b tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b3b23d1-e424-4f58-87b4-339888eef57b tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.686487 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'nonexistent_hostname'} Oct 18 16:01:43.687689 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:43.688426 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 16:01:43.689620 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.690885 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.693728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b3b23d1-e424-4f58-87b4-339888eef57b tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.695638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b3b23d1-e424-4f58-87b4-339888eef57b tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.046499 Oct 18 16:01:43.696958 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 189/384] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:01:43.709310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-967599fe-b5ce-450e-989d-52a3a8d0871d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd40e0d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-967599fe-b5ce-450e-989d-52a3a8d0871d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-hosts/n-d-858383-14 HTTP/1.1 Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 51 Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.714775 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: {"status": "enable", "maintenance_mode": "invalid"} Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.716642 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-d-858383-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance: Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.717618 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.718976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.722580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.722580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:01:43.722580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:01:43.722580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.722580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.724071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-967599fe-b5ce-450e-989d-52a3a8d0871d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.725426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-967599fe-b5ce-450e-989d-52a3a8d0871d tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-858383-14" status: 400 len: 199 microversion: 2.1 time: 0.022901 Oct 18 16:01:43.730898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 190/385] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 16:01:43 2022] PUT /compute/v2.1/os-hosts/n-d-858383-14 => generated 199 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:43.739626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad08c132-b91c-4dfd-9e9a-676c2a713b18 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2858a60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad08c132-b91c-4dfd-9e9a-676c2a713b18 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-hosts/n-d-858383-14 HTTP/1.1 Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 51 Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.745827 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: {"status": "invalid", "maintenance_mode": "enable"} Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.747376 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-d-858383-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance: Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.748174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.749526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.750530 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.750530 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:01:43.750530 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:01:43.750530 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 16:01:43.750530 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.753203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad08c132-b91c-4dfd-9e9a-676c2a713b18 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.754397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad08c132-b91c-4dfd-9e9a-676c2a713b18 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-858383-14" status: 400 len: 189 microversion: 2.1 time: 0.018503 Oct 18 16:01:43.755781 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 191/386] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 16:01:43 2022] PUT /compute/v2.1/os-hosts/n-d-858383-14 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:43.775410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa7d6080-7838-41fa-a8d7-c20378e1e78f tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Action: 'update', calling method: .version_select at 0x7f5fd2919d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:43.781523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa7d6080-7838-41fa-a8d7-c20378e1e78f tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '094bf0c48f0142c9a69bad604b39da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd922e86ff82145e49a876f54379abc85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa7d6080-7838-41fa-a8d7-c20378e1e78f tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Request method failure captured: Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-hosts/n-d-858383-14 HTTP/1.1 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 50 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3kg9v0249psGBULY6LDqwOoJbOESPs7_Ldmx0R5g3kDZSZnUQYIN30b72jt44bbeWRtxYc5oPE1DqyFqjrZdjjPC_hAjMMdpeC0iHiW7zG5rv2Ktr9IVBvRZbpx7F-X9wCUnkna-jPx8ukAeDyaT9wLegUEPVCDSAEKobgLzO4YLE Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:43.785080 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d922e86ff82145e49a876f54379abc85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d922e86ff82145e49a876f54379abc85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d922e86ff82145e49a876f54379abc85"}]}] Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d922e86ff82145e49a876f54379abc85 Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1024468683 Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 094bf0c48f0142c9a69bad604b39da8a Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1024468683-project Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 16:01:43.786268 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-d-858383-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.787054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 16:01:43.793682 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.798211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa7d6080-7838-41fa-a8d7-c20378e1e78f tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.799281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa7d6080-7838-41fa-a8d7-c20378e1e78f tempest-HostsAdminNegativeTestJSON-1024468683 tempest-HostsAdminNegativeTestJSON-1024468683-project] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-858383-14" status: 403 len: 111 microversion: 2.1 time: 0.037034 Oct 18 16:01:43.805228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 192/387] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 16:01:43 2022] PUT /compute/v2.1/os-hosts/n-d-858383-14 => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:43.812716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11e091b2-2944-4c97-9a8b-2149c9644929 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd27245e0>, body: {"status": null, "maintenance_mode": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11e091b2-2944-4c97-9a8b-2149c9644929 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-hosts/n-d-858383-14 HTTP/1.1 Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 42 Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.820598 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: {"status": null, "maintenance_mode": null} Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 16:01:43.822075 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-d-858383-14', 'body': {'status': None, 'maintenance_mode': None}} Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance: Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi None Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.823122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.824752 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11e091b2-2944-4c97-9a8b-2149c9644929 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.827899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11e091b2-2944-4c97-9a8b-2149c9644929 tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-858383-14" status: 400 len: 127 microversion: 2.1 time: 0.017457 Oct 18 16:01:43.833516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 193/388] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 18 16:01:43 2022] PUT /compute/v2.1/os-hosts/n-d-858383-14 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:01:43.844651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2803a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:43.862123 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.hosts [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Enabling host nonexistent_hostname. Oct 18 16:01:43.887054 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Request method failure captured: Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 50 Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3lekhXqwPJ8s2LtN9kXwm0RiY8JPHjFLIeVF_nu8AL4zh9F7Qmn0ETiXcBmepNOvuzWJkuHuM9bNvFTxLvL7E63Jxyu2_SUd9ELy29PTEGiMPUaBn_hgxTqFYon_4pregNfN724inEhkYvBp39pyPBz2h-_UftZ1FPdDCoFW-Ds9g Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:43.889196 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7a9f1fa7d744fbba4887e6b8abb5c9b"}]}] Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a7a9f1fa7d744fbba4887e6b8abb5c9b Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941264148 Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0fccdc810d9541bebcae58f53bc825c0 Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941264148-project-admin Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.890394 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 16:01:43.891163 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:01:43.892134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:43.895406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:43.898043 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f32a8733-2cd1-415b-920a-f73eb097ff6f tempest-HostsAdminNegativeTestJSON-941264148 tempest-HostsAdminNegativeTestJSON-941264148-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.054250 Oct 18 16:01:43.898043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 194/389] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Oct 18 16:01:43 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:01:44.087359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:44.101227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b304b32a-20f2-46ef-8120-d207b01d7142 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.694185 Oct 18 16:01:44.104393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 196/390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:43 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:44.579207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:44.580466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:44.591007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:44.598746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:44.599355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:44.601700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:44.606255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:44.606826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:44.769975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:44.780684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:44.789631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:44.808079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-234b8bd1-3edc-44be-b2b1-5bc7ab4b4e36 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.233762 Oct 18 16:01:44.813883 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 195/391] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:44 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:45.127823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:45.129958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:45.146854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:45.147908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:45.148360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:45.157742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:45.158253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:45.160484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:45.454164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:45.466149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9e82beb-7960-4aa7-b9b5-a8ed885c56cf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.344026 Oct 18 16:01:45.469308 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 197/392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:45 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:45.843193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:45.844476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:45.858734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:45.859997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:45.860636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:45.872310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:45.874323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:45.875137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.041918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:46.045742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=42 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:46.057536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:46.059003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:46.075368 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21e8412a-cead-4443-bc94-26ca6b5f29dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.236402 Oct 18 16:01:46.076163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 196/393] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:45 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:46.327256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:46.329992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.332916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.333444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.334425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.336025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.337354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.395514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da606594-4bf6-4be9-9fb6-cca83c890a1b tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.532836 Oct 18 16:01:46.396524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 198/394] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 18 16:01:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:01:46.411390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:46.413653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.414038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.414480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.415304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.415790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.416278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.490091 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a61a5539-6f2d-4dd3-98c6-5ea382468a8a tempest-AZAdminV2TestJSON-577895008 tempest-AZAdminV2TestJSON-577895008-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.079636 Oct 18 16:01:46.492567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 197/395] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:01:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:46.496021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:46.497475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:46.508618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.512030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.523410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.524443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:46.525323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:46.528806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:46.920762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:46.933393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68388c79-80b6-4a1a-b60d-a9305ac38d83 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.441873 Oct 18 16:01:46.949515 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 199/396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:46 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:47.112937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:47.113641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:47.134357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:47.136087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:47.137523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:47.139285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:47.145178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:47.147814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:47.429902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:47.463095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:47.465934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:47.486427 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fe674ec-7b12-4295-870e-f33933a38f91 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.380330 Oct 18 16:01:47.490286 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 198/397] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:47 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:47.959535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:47.961519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:47.968793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:47.969777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:47.970222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:47.970920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:47.971601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:47.972174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.488683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:48.503887 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f21e860-89a2-4dbc-a40c-52cce1f8d500 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.549730 Oct 18 16:01:48.508281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 200/398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:47 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:48.534665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Calling method '.version_select at 0x7f5fd2858160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:48.542813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:48.543224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:48.543672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.554953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:48.555913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:48.563812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:48.565564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:48.567283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.568593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:48.572571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:48.573284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.573842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:48.575713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:48.577829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.591596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:48.592611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:48.593359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:48.607078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3dd655e6-d729-4d40-bfe8-0de5ba8e9953 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.399456 Oct 18 16:01:48.624105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 199/399] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:01:48.733688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:48.754547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:48.758538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:48.775498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c367a086-578e-4922-b57f-ff714eaf6871 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.228920 Oct 18 16:01:48.777138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 201/400] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:48 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:48.998870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35aacef3-4609-4934-9072-e17a9db7493e tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Calling method '.version_select at 0x7f5fd28589d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.003989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35aacef3-4609-4934-9072-e17a9db7493e tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '39df268480c54cdbabf8b0468d7aaca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b38919f24694316bc40989641626d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35aacef3-4609-4934-9072-e17a9db7493e tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Request method failure captured: Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/n-h1-858383-14/search HTTP/1.1 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3qPlu5SlBHj5my3B2nlB0qdwh1K8kIi4xCF3y5_vsgZV3w--NhogHZ-PnqWo8SekCYdT2sp7rlLVxmDj95D0F0jbBWUD-IQgA7HPy4ib1yo0lQ2-CvgUCV65UeMGHNPzi99lXIqfCn5ZB43rc-IVBZtLHCogOHJA5KV7BkL4IA2w8 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 6b38919f24694316bc40989641626d36 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:01:49.006440 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b38919f24694316bc40989641626d36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b38919f24694316bc40989641626d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b38919f24694316bc40989641626d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b38919f24694316bc40989641626d36"}]}] Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 6b38919f24694316bc40989641626d36 Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-108472217-project Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 39df268480c54cdbabf8b0468d7aaca9 Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217-project Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 16:01:49.008280 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'n-h1-858383-14'} Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:49.009140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 16:01:49.010202 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.011203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35aacef3-4609-4934-9072-e17a9db7493e tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:49.017287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35aacef3-4609-4934-9072-e17a9db7493e tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-858383-14/search" status: 403 len: 117 microversion: 2.1 time: 0.385327 Oct 18 16:01:49.017904 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 200/401] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 18 16:01:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-14/search => generated 117 bytes in 393 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:49.028647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Calling method '.version_select at 0x7f5fd2a7ef70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.030332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.030814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.031246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.083367 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Request method failure captured: Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3sGU3wcb34OBeG523u0lRwqOBnFBqoKJzfLeauXVpdt3PFoYgwRDigK_Q1NxX5L1Am7AHi3b8Nzbq9s2ZoYFPISmZD-iX3zDHnaAalegoY02_h9TVSbVfpSZ7ampZkr9_xlhXvTDOrDvOJCgHcMzBR6ueTNFKN68WB-GWTZ04ZoGA Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 66595d3c12224791b9f537e6bdf2db86 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:01:49.089128 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66595d3c12224791b9f537e6bdf2db86"}]}] Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 66595d3c12224791b9f537e6bdf2db86 Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9296195940fb432eaeefe8a57b227dcc Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 16:01:49.090624 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.091530 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.092900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.092900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:49.092900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:49.092900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 16:01:49.092900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.098423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:49.101470 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52b8cbf7-5f48-49c2-9747-be53f6dfcee9 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.074989 Oct 18 16:01:49.102559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 202/402] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:49.112788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Calling method '.version_select at 0x7f5fd2724a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.117936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.118803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.119432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.172967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.174566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.181085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.204335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.205138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.205958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.230800 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94a590c8-aee3-49a4-9690-660c290fe246 tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108917 Oct 18 16:01:49.232054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 201/403] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:49.244587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bf936fd-2e67-4ed1-868c-68469773a9ff tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Calling method '.version_select at 0x7f5fd3c96f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.246857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2bf936fd-2e67-4ed1-868c-68469773a9ff tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '39df268480c54cdbabf8b0468d7aaca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b38919f24694316bc40989641626d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bf936fd-2e67-4ed1-868c-68469773a9ff tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Request method failure captured: Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3qPlu5SlBHj5my3B2nlB0qdwh1K8kIi4xCF3y5_vsgZV3w--NhogHZ-PnqWo8SekCYdT2sp7rlLVxmDj95D0F0jbBWUD-IQgA7HPy4ib1yo0lQ2-CvgUCV65UeMGHNPzi99lXIqfCn5ZB43rc-IVBZtLHCogOHJA5KV7BkL4IA2w8 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6b38919f24694316bc40989641626d36 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:01:49.251248 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b38919f24694316bc40989641626d36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b38919f24694316bc40989641626d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b38919f24694316bc40989641626d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b38919f24694316bc40989641626d36"}]}] Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6b38919f24694316bc40989641626d36 Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217 Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-108472217-project Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 39df268480c54cdbabf8b0468d7aaca9 Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-108472217-project Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 16:01:49.252854 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '1'} Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:01:49.253808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 16:01:49.255350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.258644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bf936fd-2e67-4ed1-868c-68469773a9ff tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:49.260508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2bf936fd-2e67-4ed1-868c-68469773a9ff tempest-HypervisorAdminNegativeUnderV252Test-108472217 tempest-HypervisorAdminNegativeUnderV252Test-108472217-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021698 Oct 18 16:01:49.262101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 203/404] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:49.281262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Calling method '.version_select at 0x7f5fd2858790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.284581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.285494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.298491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.328793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] HTTP exception thrown: No hypervisor matching '15a5ed52-ce97-4a00-b1a2-4eedfa73e537' could be found. Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Request method failure captured: Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-hypervisors/15a5ed52-ce97-4a00-b1a2-4eedfa73e537/servers HTTP/1.1 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3sGU3wcb34OBeG523u0lRwqOBnFBqoKJzfLeauXVpdt3PFoYgwRDigK_Q1NxX5L1Am7AHi3b8Nzbq9s2ZoYFPISmZD-iX3zDHnaAalegoY02_h9TVSbVfpSZ7ampZkr9_xlhXvTDOrDvOJCgHcMzBR6ueTNFKN68WB-GWTZ04ZoGA Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 66595d3c12224791b9f537e6bdf2db86 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:01:49.335872 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66595d3c12224791b9f537e6bdf2db86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66595d3c12224791b9f537e6bdf2db86"}]}] Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 66595d3c12224791b9f537e6bdf2db86 Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578 Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9296195940fb432eaeefe8a57b227dcc Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: exception: No hypervisor matching '15a5ed52-ce97-4a00-b1a2-4eedfa73e537' could be found. Oct 18 16:01:49.337309 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '15a5ed52-ce97-4a00-b1a2-4eedfa73e537'} Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '15a5ed52-ce97-4a00-b1a2-4eedfa73e537' could be found. Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.338106 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '15a5ed52-ce97-4a00-b1a2-4eedfa73e537' could be found. Oct 18 16:01:49.339290 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:01:49.345658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] Returning 404 to user: No hypervisor matching '15a5ed52-ce97-4a00-b1a2-4eedfa73e537' could be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:01:49.347187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9178859-01bc-407b-9ac8-dc141aca41cc tempest-HypervisorAdminNegativeUnderV252Test-293339578 tempest-HypervisorAdminNegativeUnderV252Test-293339578-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/15a5ed52-ce97-4a00-b1a2-4eedfa73e537/servers" status: 404 len: 123 microversion: 2.1 time: 0.076251 Oct 18 16:01:49.350124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 202/405] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/os-hypervisors/15a5ed52-ce97-4a00-b1a2-4eedfa73e537/servers => generated 123 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:01:49.531960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.532403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:49.544386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.545200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.545655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.546681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.547294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.547736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.818386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:49.820686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:49.831661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.832551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.835754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.837089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:49.838657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:49.840289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:49.991319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:50.000783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:50.007241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:50.021138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-625160bd-aa07-4b63-9b4f-6f5f57038e34 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.216968 Oct 18 16:01:50.037445 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 203/406] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:50.133719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:50.145838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a30c506-b110-439e-afa4-421e8a56c555 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.617842 Oct 18 16:01:50.146393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 204/407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:49 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:50.790551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfc9a06-deb9-4a8f-981a-7daef24d63f8", "name": "network-vif-plugged", "status": "completed", "tag": "a42d3670-1162-44b1-ac83-33187cac5ce3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:50.811277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:50.815599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:50.816522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:50.845729 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] Creating event network-vif-plugged:a42d3670-1162-44b1-ac83-33187cac5ce3 for instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 on n-h1-858383-14 Oct 18 16:01:50.859793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1e408e8a-6ced-4361-9a7e-d9f9c825253b req-de401a09-c3aa-4983-8654-2c109e78e5bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069940 Oct 18 16:01:50.860974 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 204/408] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:01:51.054057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:51.055389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:51.076506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:51.079391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:51.087776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:51.088824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:51.091495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:51.092511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:51.170514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:51.171220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:51.193674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:51.195094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:51.195545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:51.196400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:51.196924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:51.197378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:51.416848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:51.428987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:51.442009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:51.462701 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5f784d7-4c4a-4d98-ab2e-b4635ad007fe tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.413243 Oct 18 16:01:51.464689 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 205/409] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:51 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:51.769418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:51.785644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b26d6f98-6919-4c5a-9b29-10554a64a215 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.619466 Oct 18 16:01:51.790411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 205/410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:51 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:52.496268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:52.496936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:52.507572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.508063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.508495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.515255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.515737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.516371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.679101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:52.688113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:52.689584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:52.704088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90c55ea8-e08e-4083-bab5-f1d36cdd5216 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.216448 Oct 18 16:01:52.714168 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 206/411] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:52 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:52.740957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Calling method '.version_select at 0x7f5fd2a7e3a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:52.748717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.753572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.754685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.799204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.801198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.801863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.815079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:52.815992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:52.823727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.833940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.835582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.836472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.838391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.839704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.893793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.895310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.895768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:52.950967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:52.952593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:52.954639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.035753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.037266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.045211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.061984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.072459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3a55f16-5271-41ba-92e2-cb90ef2d520a tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.891732 Oct 18 16:01:53.073607 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 206/412] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:01:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:53.093472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Calling method '.version_select at 0x7f5fd2f40940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:53.102914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.103723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.104387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.124370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.125225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.126498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.166809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.167716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.169916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.183004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.185326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.186409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.187069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.215725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.216614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.217313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.226301 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f311f115-356e-45aa-bbac-089909beeb11 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.136983 Oct 18 16:01:53.236506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 207/413] 10.222.0.78 () {60 vars in 1222 bytes} [Tue Oct 18 16:01:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:53.247519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Calling method '.version_select at 0x7f5fd2d96670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:53.251576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.260066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.261546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.308706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.310028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.311625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.324975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:53.327498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.339056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcc5ecf8-4fd3-449c-b01a-38318a1eb473 tempest-HypervisorAdminV253TestBase-371229276 tempest-HypervisorAdminV253TestBase-371229276-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2d14818d-fb60-4ea7-9cc9-dfc7d499b699" status: 200 len: 794 microversion: 2.53 time: 0.098747 Oct 18 16:01:53.343843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e0afad6-242b-40c9-bc51-acda39d80296 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1320 microversion: 2.1 time: 0.532351 Oct 18 16:01:53.344130 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 208/414] 10.222.0.78 () {60 vars in 1298 bytes} [Tue Oct 18 16:01:53 2022] GET /compute/v2.1/os-hypervisors/2d14818d-fb60-4ea7-9cc9-dfc7d499b699 => generated 794 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:53.350922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 207/415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:52 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:01:53.749154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:53.749767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:53.766155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.769209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.769887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.772716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:53.773533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:53.775555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:53.913607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:53.931753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:53.934572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:53.946532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23d2090a-8a9c-4315-851d-29e858cfd625 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.202083 Oct 18 16:01:53.947700 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 209/416] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:53 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:54.376315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:54.376916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:54.386581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:54.391714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:54.394558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:54.395348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:54.395794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:54.396227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:54.686668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:54.695732 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d6b75ff-fc5f-4f77-973e-a9800e32debe tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1470 microversion: 2.1 time: 0.323123 Oct 18 16:01:54.710809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 208/417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:54 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1470 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:54.722850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:54.727657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:54.737493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:54.737912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:54.738345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:54.739192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:54.739649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:54.740248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:54.979295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:54.980136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:54.994874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fed16f91-eb46-48fc-8267-9280f3295355 tempest-DeleteServersAdminTestJSON-682109943 tempest-DeleteServersAdminTestJSON-682109943-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8/action" status: 202 len: 0 microversion: 2.1 time: 0.278590 Oct 18 16:01:54.996499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:54.997373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 210/418] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:01:54 2022] POST /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:54.997680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:54.998199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:54.998967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.002612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.005250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.013954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:55.021669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:55.031986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.032731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.033349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.034218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.035123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.035706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.078543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.079521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.080178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.080780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:01:55.250310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:55.269442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:55.272083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:55.280900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52291fbd-2cbb-4073-b39d-af5339e2a59b tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.309832 Oct 18 16:01:55.282638 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 209/419] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:54 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:55.876431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:55.885170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a289fee7-c308-4a7e-9ae4-a1758eb49c71 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1453 microversion: 2.1 time: 0.884699 Oct 18 16:01:55.889340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 211/420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:54 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1453 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:55.912435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:55.913874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:55.920259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.920880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.921428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.922201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:55.922882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:55.923739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:55.958295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:01:56.160605 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23101113-9bc2-469b-a2f8-e1a3ccf419d7 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 204 len: 0 microversion: 2.1 time: 0.250325 Oct 18 16:01:56.163917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 212/421] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:01:55 2022] DELETE /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:01:56.173540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:56.174490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:56.183585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:56.184307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:56.184891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:56.185962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:56.186724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:56.187842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:56.210818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35f3bb5f-2965-4e5f-a54e-ec9b52a732f5 tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-861085042", "id": 1039274383, "os-flavor-access:is_public": "True"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:56.249641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:56.252785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:56.255393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:56.255822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:01:56.260737 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35f3bb5f-2965-4e5f-a54e-ec9b52a732f5 tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.776420 Oct 18 16:01:56.262884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 210/422] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:01:55 2022] POST /compute/v2.1/flavors => generated 467 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:01:56.357412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:56.435083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:56.479520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:56.490654 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1217330-286e-46d8-a13f-81dedecf6b55 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1459 microversion: 2.1 time: 0.322859 Oct 18 16:01:56.491898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 213/423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:56 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1459 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:56.497984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:56.498802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:56.505003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:56.505611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:56.506299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:56.507400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:56.508149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:56.508770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:56.628750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1e0d694-1b39-4432-b95e-c6addbee6b24 tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:56.658129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1e0d694-1b39-4432-b95e-c6addbee6b24 tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] 10.222.0.78 "GET /compute/v2.1/flavors/1039274383" status: 200 len: 467 microversion: 2.61 time: 0.382735 Oct 18 16:01:56.659033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 211/424] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Oct 18 16:01:56 2022] GET /compute/v2.1/flavors/1039274383 => generated 467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:01:56.680489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:56.689168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4897a44-b720-4fea-a7f5-be4da91c293a tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:56.695491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:56.703345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:56.710268 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe4f8b61-e000-48c9-8fc5-87680cabe9ed tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.217086 Oct 18 16:01:56.713094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 214/425] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:56 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:56.782331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4897a44-b720-4fea-a7f5-be4da91c293a tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1039274383" status: 200 len: 468 microversion: 2.61 time: 0.113375 Oct 18 16:01:56.785586 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 212/426] 10.222.0.78 () {62 vars in 1219 bytes} [Tue Oct 18 16:01:56 2022] PUT /compute/v2.1/flavors/1039274383 => generated 468 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:01:56.804128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00ae49bb-46cb-405c-bb0e-d2e8a466835a tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:56.853487 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00ae49bb-46cb-405c-bb0e-d2e8a466835a tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 7158 microversion: 2.61 time: 0.058672 Oct 18 16:01:56.854836 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 215/427] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:01:56 2022] GET /compute/v2.1/flavors/detail => generated 7158 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:56.885192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9723a2e-3494-4b49-be1e-e0e5e0e220c3 tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:56.938456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d9723a2e-3494-4b49-be1e-e0e5e0e220c3 tempest-FlavorsV261TestJSON-439411472 tempest-FlavorsV261TestJSON-439411472-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.61 time: 0.063904 Oct 18 16:01:56.939616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 213/428] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Oct 18 16:01:56 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:56.957536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb4921ca-164b-49a5-8e68-c566f36ce53a tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:57.010900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb4921ca-164b-49a5-8e68-c566f36ce53a tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1039274383" status: 202 len: 0 microversion: 2.61 time: 0.057503 Oct 18 16:01:57.020881 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 216/429] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 18 16:01:56 2022] DELETE /compute/v2.1/flavors/1039274383 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:01:57.028726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b663807d-8022-4670-8dfb-e53e206dcd13 tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:57.120885 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b663807d-8022-4670-8dfb-e53e206dcd13 tempest-FlavorsV261TestJSON-104101790 tempest-FlavorsV261TestJSON-104101790-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.098546 Oct 18 16:01:57.135867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 214/430] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:01:57 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:57.543852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:57.546447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:57.574471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:57.576265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:57.577489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:57.578648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:57.579777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:57.582136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:57.742348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:57.743682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:57.744041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:57.746441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:57.748295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:57.751943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:01:57.761985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:57.762481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:57.773815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:57.784365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:57.785741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:57.790442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:58.006703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:58.024278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:58.031171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:58.057564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d137141b-e10c-4e64-b635-4216decc5b50 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.315139 Oct 18 16:01:58.078426 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 215/431] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:57 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:01:59.096430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:01:59.098159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:59.106885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:59.123271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bebbb499-6251-4191-b126-9817808162c8 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1459 microversion: 2.1 time: 1.603528 Oct 18 16:01:59.130848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:59.149365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 217/432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:01:57 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1459 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:01:59.157769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:59.158405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:59.163674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:59.164163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:59.164730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:59.488415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:59.503563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:59.505177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:01:59.533146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25653bb1-f4d1-4cd4-a5e6-5e24be7705cb tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.437205 Oct 18 16:01:59.540576 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 216/433] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:01:59 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:00.165301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:00.165990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:00.179746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:00.186205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:00.187835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:00.190048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:00.192639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:00.195114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:00.283116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:00.283939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:00.284664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:00.285700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:00.569984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:00.571171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:00.590097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:00.598719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:00.603477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:00.604422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:00.605097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:00.605931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:00.862318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:00.880594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:00.884605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:00.890928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:00.902596 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d10c9005-b056-4dbc-a51e-db02fa47cedc tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1446 microversion: 2.75 time: 0.338526 Oct 18 16:02:00.906972 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 217/434] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:00 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1446 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:01.206028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a4292b7-7ef2-435d-87ad-09dcbf9c690a tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:01.210151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0a4292b7-7ef2-435d-87ad-09dcbf9c690a tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a4292b7-7ef2-435d-87ad-09dcbf9c690a tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin] Request method failure captured: Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs34pe_XuEHOEVNOnD8wpLx1IvRFUjE-7zcALkzNLF4NILyTG_P-OV0o7d3LNwbwfa-q6TA5lp9lmjDdXf2lhKtL0CIuQ0hEawt_po6jPxzAMGi01GPo7Oxmq1S8aLWFi3t5ejBJdORRiWTchQLyIFS0TUeJeKxwB_0W50pJQ9E4ELk Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 552f476e981743d0a30a73b2b4a657bb Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:02:01.222753 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/552f476e981743d0a30a73b2b4a657bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/552f476e981743d0a30a73b2b4a657bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_552f476e981743d0a30a73b2b4a657bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/552f476e981743d0a30a73b2b4a657bb"}]}] Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 552f476e981743d0a30a73b2b4a657bb Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3e6995bdd3d3431b9a8adcee11f39f8c Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:01.224262 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid timestamp for date invalid_time Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'invalid_time'} Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:01.225584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 18 16:02:01.226946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.229409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a4292b7-7ef2-435d-87ad-09dcbf9c690a tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:01.230838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a4292b7-7ef2-435d-87ad-09dcbf9c690a tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172 tempest-InstanceUsageAuditLogNegativeTestJSON-1622845172-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.322171 Oct 18 16:02:01.233067 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 218/435] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:01.535069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aceaa43a-6854-42da-ac06-45157e728f82 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:01.538046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aceaa43a-6854-42da-ac06-45157e728f82 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3e0a4336a8a0444c9a99d18e539082a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14b7c39a6c447bdb4d0ee6993d83941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aceaa43a-6854-42da-ac06-45157e728f82 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Request method failure captured: Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs321ezKA4-_l1tlHd_POXu24kVP7JQAjGGQtPiUykXE1nD8jzOfIdjcnYeSXbj_XlBDrIUenkG95oiG2LA8HzZ2DiCt-NjtzrldYWfJYQ6AuV3BFpsNA7_iKA88TPiEzWmWFwdNJ7dbdEXAiFjubw8IlsTcGs8d1xBHUI1Qh1ovRnI Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d14b7c39a6c447bdb4d0ee6993d83941 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:02:01.556335 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d14b7c39a6c447bdb4d0ee6993d83941"}]}] Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d14b7c39a6c447bdb4d0ee6993d83941 Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3e0a4336a8a0444c9a99d18e539082a2 Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project Oct 18 16:02:01.557831 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:02:01.558551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 16:02:01.559838 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.565816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aceaa43a-6854-42da-ac06-45157e728f82 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:01.568323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aceaa43a-6854-42da-ac06-45157e728f82 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.323296 Oct 18 16:02:01.575715 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 219/436] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:02:01 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 329 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:01.609213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fddf3c1-deec-4f7a-af14-7bd2f8d6b9a8 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:01.616293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fddf3c1-deec-4f7a-af14-7bd2f8d6b9a8 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3e0a4336a8a0444c9a99d18e539082a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14b7c39a6c447bdb4d0ee6993d83941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fddf3c1-deec-4f7a-af14-7bd2f8d6b9a8 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Request method failure captured: Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2016:02:01 HTTP/1.1 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs321ezKA4-_l1tlHd_POXu24kVP7JQAjGGQtPiUykXE1nD8jzOfIdjcnYeSXbj_XlBDrIUenkG95oiG2LA8HzZ2DiCt-NjtzrldYWfJYQ6AuV3BFpsNA7_iKA88TPiEzWmWFwdNJ7dbdEXAiFjubw8IlsTcGs8d1xBHUI1Qh1ovRnI Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d14b7c39a6c447bdb4d0ee6993d83941 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:02:01.635833 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d14b7c39a6c447bdb4d0ee6993d83941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d14b7c39a6c447bdb4d0ee6993d83941"}]}] Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d14b7c39a6c447bdb4d0ee6993d83941 Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3e0a4336a8a0444c9a99d18e539082a2 Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project Oct 18 16:02:01.637395 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2022-10-18 16:02:01'} Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:02:01.638045 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 16:02:01.639358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:01.645193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fddf3c1-deec-4f7a-af14-7bd2f8d6b9a8 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:01.652271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fddf3c1-deec-4f7a-af14-7bd2f8d6b9a8 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021 tempest-InstanceUsageAuditLogNegativeTestJSON-845530021-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 16:02:01" status: 403 len: 128 microversion: 2.1 time: 0.070233 Oct 18 16:02:01.655735 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 220/437] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:02:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2016%3A02%3A01 => generated 128 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:01.795172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:01.834134 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-718a0a46-f8ba-412a-a7e1-9af890f9ea41 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1459 microversion: 2.1 time: 1.674092 Oct 18 16:02:01.842011 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 218/438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:00 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1459 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:01.935638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:01.937011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:01.952567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:01.958886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:01.961679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:01.969130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:01.971260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:01.974896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:02.397331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:02.424176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:02.434803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:02.455777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5113bd6f-9a3f-4e72-8a36-97cb757f92ef tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1452 microversion: 2.75 time: 0.524231 Oct 18 16:02:02.456609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 221/439] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:01 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1452 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:02.499249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfc9a06-deb9-4a8f-981a-7daef24d63f8", "name": "network-vif-deleted", "tag": "a42d3670-1162-44b1-ac83-33187cac5ce3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:02.534855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:02.535357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:02.535795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:02.575002 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] Creating event network-vif-deleted:a42d3670-1162-44b1-ac83-33187cac5ce3 for instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 on n-h1-858383-14 Oct 18 16:02:02.598642 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-56707d7f-0f91-420b-98ac-1b682b6f9ede req-896297fc-382f-4797-a685-3418869e62f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104675 Oct 18 16:02:02.601620 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 219/440] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:02.875354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:02.876259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:02.903566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:02.904082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:02.904520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:02.905268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:02.905728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:02.906155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:03.016445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:03.034397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:03.039253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:03.040533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lazy-loading 'fault' on Instance uuid 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:03.169935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01c86c8f32c4035a71dd59fc55eccdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db104ba093c34a81b677c769995db538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:03.181528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe29cb4c-2fa5-4bd6-aa56-940f734366b1 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 200 len: 1310 microversion: 2.1 time: 0.310169 Oct 18 16:02:03.196223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 222/441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:02 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:03.503157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:03.504626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:03.527061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:03.527698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:03.560041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:03.563666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:03.578401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:03.581140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:03.738868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:03.993019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:04.011604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:04.019726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:04.032082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0462af4e-21a6-432c-aa25-8e72271d74dd tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1452 microversion: 2.75 time: 0.534398 Oct 18 16:02:04.036219 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 220/442] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:03 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1452 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:04.237060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:04.238946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:04.259732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.263307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.265212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.266185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.269524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.273246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.337100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 HTTP/1.1 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:02:04.346516 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.348109 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6bfc9a06-deb9-4a8f-981a-7daef24d63f8'} Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:04.348921 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.350839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.352034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:04.352339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-246b9483-d2a5-46f9-ad38-083f3737a29f tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 404 len: 111 microversion: 2.1 time: 0.126504 Oct 18 16:02:04.362110 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 223/443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:04 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:04.373653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:04.374152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:04.385226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.385793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.386563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.388392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.389108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.389719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.426429 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 HTTP/1.1 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:02:04.430633 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.431895 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6bfc9a06-deb9-4a8f-981a-7daef24d63f8'} Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:04.432578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.433730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.436482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:04.438963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf107f17-ceaf-4a3c-9e95-47a2cfd7acbf tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 404 len: 111 microversion: 2.1 time: 0.069724 Oct 18 16:02:04.442319 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 221/444] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:04 2022] DELETE /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:04.451306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:04.452396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: 6bfc9a06-deb9-4a8f-981a-7daef24d63f8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:04.464674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.465520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.466313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.467243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.468433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.469170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.485809 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 HTTP/1.1 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:02:04.487836 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.489129 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6bfc9a06-deb9-4a8f-981a-7daef24d63f8'} Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:04.489807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. Oct 18 16:02:04.490989 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.495968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance 6bfc9a06-deb9-4a8f-981a-7daef24d63f8 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:04.497289 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d22a0520-79fe-4c36-8071-0c985058af95 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8" status: 404 len: 111 microversion: 2.1 time: 0.050656 Oct 18 16:02:04.498376 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 224/445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:04 2022] GET /compute/v2.1/servers/6bfc9a06-deb9-4a8f-981a-7daef24d63f8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:04.509959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:04.511652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:04.520724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.522167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.523003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.524650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.525564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.526246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.545416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c HTTP/1.1 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:02:04.547670 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.548987 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'd02c612c-4ae5-4d2d-9e26-89ee02ce426c'} Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:04.549679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.550759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.557596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:04.560082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2a2f62a-ec33-4c0c-bd94-f9113eab6537 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 404 len: 111 microversion: 2.1 time: 0.057679 Oct 18 16:02:04.561231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 222/446] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:04 2022] DELETE /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:04.570033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:04.572363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] [instance: d02c612c-4ae5-4d2d-9e26-89ee02ce426c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:04.580072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.580944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.581624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.583165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:04.583897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:04.585711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:04.606186 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] HTTP exception thrown: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Request method failure captured: Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c HTTP/1.1 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2t5XDtZPYYAX09Y_h3e5JWCHOy5NTFYOYuS3E2glg9-7Hb_Qj0FqsGAuBqxaY0zAWGjN2avGL2JaFUZWNDzzcLDWz88NGQUVzpKMi8EGmAX5RJidfd-kquV52slVuFvxivN8IOjF_WExmOdH3vzNVKDAw1mHV5Ke8IyQMU3prt3As Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:02:04.608111 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db104ba093c34a81b677c769995db538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db104ba093c34a81b677c769995db538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db104ba093c34a81b677c769995db538"}]}] Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: db104ba093c34a81b677c769995db538 Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1433828523 Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f01c86c8f32c4035a71dd59fc55eccdc Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersAdminTestJSON-1433828523-project Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.609475 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd02c612c-4ae5-4d2d-9e26-89ee02ce426c'} Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:04.610180 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. Oct 18 16:02:04.611264 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:04.616192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] Returning 404 to user: Instance d02c612c-4ae5-4d2d-9e26-89ee02ce426c could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:04.617368 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3044ed05-c51d-47eb-b18e-10ac2ed4cee9 tempest-DeleteServersAdminTestJSON-1433828523 tempest-DeleteServersAdminTestJSON-1433828523-project] 10.222.0.78 "GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c" status: 404 len: 111 microversion: 2.1 time: 0.052269 Oct 18 16:02:04.618818 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 225/447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:04 2022] GET /compute/v2.1/servers/d02c612c-4ae5-4d2d-9e26-89ee02ce426c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:05.094517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:05.095541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:05.121355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:05.122306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:05.123154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:05.124393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:05.125102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:05.128127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:05.539170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:05.570458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:05.572021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:05.608342 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12d5f8b5-677b-4a9c-a775-01c71208ed21 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1452 microversion: 2.75 time: 0.520047 Oct 18 16:02:05.608936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 223/448] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:05 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1452 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:06.659078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:06.662512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:06.673791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:06.678447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:06.683427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:06.689907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:06.691484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:06.692675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:06.784689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7f6c622-2a03-4ad7-90d0-30c26f802e04 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Action: 'create', calling method: .version_select at 0x7f5fd28cc040>, body: {"keypair": {"name": "tempest-keypair-1138871693", "type": "ssh", "user_id": "33e40e9dc1284124a6daa6549d41e04d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwEFqadywL+9xg9/URXOkmM/2lX4FI6X+wOKPGfpA4hYif7yj8sbYVj8OEc5Jxy8XfQSTycbwF4rmG2qC8cnusLf4q32qAEMGCJIrgx59XzyHeIQ8A+o/fyuU/dYUTcBA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:06.842513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f7f6c622-2a03-4ad7-90d0-30c26f802e04 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:06.853907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f7f6c622-2a03-4ad7-90d0-30c26f802e04 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for user 48fffa0932534c94a74061f055f6accd and project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:06.915386 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7f6c622-2a03-4ad7-90d0-30c26f802e04 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.564206 Oct 18 16:02:06.921443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 226/449] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:02:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 566 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:02:06.947913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94331649-c164-4380-99fc-37d70d425409 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Action: 'create', calling method: .version_select at 0x7f5fd2724a60>, body: {"keypair": {"name": "tempest-keypair-1185013472", "type": "ssh", "user_id": "33e40e9dc1284124a6daa6549d41e04d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv3intru1Uw6/04SdF4ZKFgmqdXsNvUCjJohT8zySP9Lq3DYrpZFK8XxZZi7ZoIfzESVWU3xYlNtKF6rnzfjemTj6CFBNfBDAii3FfNO2BSICL/29zj4Bw+csm47YPJ8w=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:06.984277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:07.011246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:07.012929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:07.029202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-94331649-c164-4380-99fc-37d70d425409 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:07.034268 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26ff445d-f1ca-4802-9691-131425a1f859 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1437 microversion: 2.75 time: 0.379230 Oct 18 16:02:07.034873 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 224/450] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:06 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1437 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:07.044582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-94331649-c164-4380-99fc-37d70d425409 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for user 48fffa0932534c94a74061f055f6accd and project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:07.165531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94331649-c164-4380-99fc-37d70d425409 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.234369 Oct 18 16:02:07.171789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 227/451] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:02:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 16:02:07.194237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2366e36-cf9f-4350-8875-9e22f85459c3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Calling method '.version_select at 0x7f5fd2747940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.208586 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2366e36-cf9f-4350-8875-9e22f85459c3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1138871693?user_id=33e40e9dc1284124a6daa6549d41e04d" status: 200 len: 512 microversion: 2.10 time: 0.029084 Oct 18 16:02:07.218900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 228/452] 10.222.0.78 () {60 vars in 1340 bytes} [Tue Oct 18 16:02:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1138871693?user_id=33e40e9dc1284124a6daa6549d41e04d => generated 512 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:07.232533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d628a77a-566c-49ee-a891-bfc04f9de5f3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Action: 'create', calling method: .version_select at 0x7f5fd2747af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-787217340", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgV0ukMuZwn2FpXvJzA8TK/woBEaDgfBgYlUhHrBQ1QliikY9EboPU1qsUYOzOljc7InZpLmc+2+PYEwpXb3OgFqQA5cRF2+ir5Yfxqgzj89IY8cGYztk4pXo6IZT9XpQ=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:07.291964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d628a77a-566c-49ee-a891-bfc04f9de5f3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:07.327063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d628a77a-566c-49ee-a891-bfc04f9de5f3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Getting quotas for user 48fffa0932534c94a74061f055f6accd and project d97ad842918d4bcd8418405b594f2c6d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:07.410309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d628a77a-566c-49ee-a891-bfc04f9de5f3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.183274 Oct 18 16:02:07.411413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 229/453] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:02:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 16:02:07.426403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63132e2e-3fe5-4110-bde5-0a4baa36b9b3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Calling method '.version_select at 0x7f5fd26ebf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.431829 n-d-858383-14 devstack@n-api.service[120571]: WARNING oslo_db.sqlalchemy.utils [None req-63132e2e-3fe5-4110-bde5-0a4baa36b9b3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:02:07.461581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63132e2e-3fe5-4110-bde5-0a4baa36b9b3 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs?user_id=33e40e9dc1284124a6daa6549d41e04d" status: 200 len: 726 microversion: 2.10 time: 0.038734 Oct 18 16:02:07.463113 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 230/454] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 18 16:02:07 2022] GET /compute/v2.1/os-keypairs?user_id=33e40e9dc1284124a6daa6549d41e04d => generated 726 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:02:07.481564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3065651c-a45b-4112-b640-604a2521ec4c tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Calling method '.version_select at 0x7f5fd26df160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.544634 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3065651c-a45b-4112-b640-604a2521ec4c tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-787217340" status: 204 len: 0 microversion: 2.10 time: 0.069820 Oct 18 16:02:07.545941 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 231/455] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Oct 18 16:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-787217340 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 16:02:07.562645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76b61cb0-91cc-4bb3-b64c-4f6c4e82f6f0 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Calling method '.version_select at 0x7f5fd272b790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.619408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76b61cb0-91cc-4bb3-b64c-4f6c4e82f6f0 tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185013472?user_id=33e40e9dc1284124a6daa6549d41e04d" status: 204 len: 0 microversion: 2.10 time: 0.060422 Oct 18 16:02:07.626100 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 232/456] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185013472?user_id=33e40e9dc1284124a6daa6549d41e04d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:02:07.636020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a3b4bbc-eb96-4378-858b-a8bad525457f tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] Calling method '.version_select at 0x7f5fd26df1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.674353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a3b4bbc-eb96-4378-858b-a8bad525457f tempest-KeyPairsV210TestJSON-180852036 tempest-KeyPairsV210TestJSON-180852036-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138871693?user_id=33e40e9dc1284124a6daa6549d41e04d" status: 204 len: 0 microversion: 2.10 time: 0.042530 Oct 18 16:02:07.679982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 233/457] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138871693?user_id=33e40e9dc1284124a6daa6549d41e04d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:02:07.763756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:07.767664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:07.778774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:07.785903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:07.786679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:07.788588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:07.789309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:07.789952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:08.115953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:08.129544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:08.133168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:08.134075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:08.136043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:08.387956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:08.422500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:08.429694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:08.430307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:08.431197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:08.442204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:08.442922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:08.978395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:09.177384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0163a3c7-6abb-4790-8639-a78cad9940a6 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf/action" status: 202 len: 1942 microversion: 2.75 time: 2.096902 Oct 18 16:02:09.179264 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 225/458] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:02:07 2022] POST /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf/action => generated 1942 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 16:02:09.221909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:09.221909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:09.222505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:09.238777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:09.243909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:09.246561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:09.247292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:09.248798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:09.701288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:09.928086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0476462-3aac-40f2-9043-e4f30b1ebeee tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.713537 Oct 18 16:02:09.933145 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 234/459] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:09 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:10.969197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:10.970354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:10.989532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:10.990638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:10.991108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:10.991861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:10.992332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:10.992765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:11.241759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:11.299427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-101a4a8e-3123-4742-84a3-9148618e51ca tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.334351 Oct 18 16:02:11.303475 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 226/460] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:10 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:12.353587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:12.356181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:12.373120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:12.373634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:12.374085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:12.379834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:12.380338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:12.380899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:12.597922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:12.642666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7bb61e4b-140a-44f5-83d0-1716b5bc4884 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.309720 Oct 18 16:02:12.653033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 227/461] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:12 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:12.944692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1328079252", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:13.105191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:13.271336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1045049663", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:13.432699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:14.164194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:14.164627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:14.165245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:14.165785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:14.166383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:14.188561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.195624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.199144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.201444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.207204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.213703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.266550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Getting quotas for project c1615e4a1ea345b4ac972f3a3cb08f2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:14.278309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Getting quotas for user 0c29841aaaee47c8ac0bde44c50105dc and project c1615e4a1ea345b4ac972f3a3cb08f2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:14.311052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:14.317829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:14.453608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94766479-9989-4c96-ba8b-03c9c3df5ce1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303320 Oct 18 16:02:14.456342 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 228/462] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:14.468478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:14.493637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:14.529599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:14.543269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.546810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.546810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.550185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.551434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.561081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.784803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:14.851422 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fedc21a5-d4bd-4683-bc60-045b208ac147 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.393734 Oct 18 16:02:14.863329 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 229/463] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:14 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:14.869286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e896438-d025-47fe-9ae4-61bbbf6923f1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:14.891581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e896438-d025-47fe-9ae4-61bbbf6923f1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:15.116854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e896438-d025-47fe-9ae4-61bbbf6923f1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:15.130018 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e896438-d025-47fe-9ae4-61bbbf6923f1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1219 microversion: 2.1 time: 0.259171 Oct 18 16:02:15.130712 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 230/464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:14 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:15.896969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:15.901162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:15.933494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:15.934156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:15.934883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:15.936059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:15.937654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:15.938276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:16.045350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:16.045350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:16.045350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:16.045350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:16.045350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:16.070081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:16.072235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:16.084123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:16.088512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:16.092283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:16.092841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:16.127300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:16.167147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b759baf-8a61-4848-a772-2a6db8bf3088 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.279366 Oct 18 16:02:16.171255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 231/465] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:15 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:16.232798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:16.252745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:16.317296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:16.335908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:16.435802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-14c9497d-d648-4402-9cff-f730ab0d3d71 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.178505 Oct 18 16:02:16.443186 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 235/466] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:16.487869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:16.493140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:16.527953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:16.528941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:16.530327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:16.531799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:16.532409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:16.532982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d35f13b-63e2-4d47-bf12-845ab89dc2cc tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-163627685", "id": 1222037800, "os-flavor-access:is_public": "False"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:16.538089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:16.584389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d35f13b-63e2-4d47-bf12-845ab89dc2cc tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.409059 Oct 18 16:02:16.594309 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 232/467] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:16 2022] POST /compute/v2.1/flavors => generated 430 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:16.608939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81dca160-e2d4-4166-85a7-28c1e3fbef6f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:16.609985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81dca160-e2d4-4166-85a7-28c1e3fbef6f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:16.674890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:16.687330 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-648dad38-cd1b-44ff-8215-7d6ce2b122d3 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1271 microversion: 2.1 time: 0.242672 Oct 18 16:02:16.701596 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 236/468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:16 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:16.710258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-119f612d-723f-4216-a592-d610bd4a41d0 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3857b7f90a764b2da93cdc4b27ec2ffb"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:16.718660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81dca160-e2d4-4166-85a7-28c1e3fbef6f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:16.733792 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81dca160-e2d4-4166-85a7-28c1e3fbef6f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1208 microversion: 2.1 time: 0.136402 Oct 18 16:02:16.736161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 233/469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:16 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1208 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:17.203950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:17.204486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:17.219283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.221411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.221870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:17.227639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.228140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.228589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:17.566832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-119f612d-723f-4216-a592-d610bd4a41d0 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1222037800/action" status: 200 len: 97 microversion: 2.1 time: 0.861985 Oct 18 16:02:17.569281 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 237/470] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 18 16:02:16 2022] POST /compute/v2.1/flavors/1222037800/action => generated 97 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:02:17.583443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:17.659481 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acabd5c7-5ded-4d96-9f81-63bdcf25b699 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.459107 Oct 18 16:02:17.668539 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 234/471] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:17 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:17.715634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:17.716244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:17.732209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.735428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.737938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:17.738853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.742453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.753472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.072047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87b8b724-a6d5-4cce-a770-a5e440693ebe tempest-FlavorsAccessTestJSON-1373419831 tempest-FlavorsAccessTestJSON-1373419831-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.125507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:18.126330 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87b8b724-a6d5-4cce-a770-a5e440693ebe tempest-FlavorsAccessTestJSON-1373419831 tempest-FlavorsAccessTestJSON-1373419831-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6240 microversion: 2.1 time: 0.551048 Oct 18 16:02:18.128061 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 238/472] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:02:17 2022] GET /compute/v2.1/flavors/detail => generated 6240 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:18.139812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.140912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-92ed912e-9865-43d3-b67f-ba12c224bd66 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1277 microversion: 2.1 time: 0.428166 Oct 18 16:02:18.143399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:18.145474 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 235/473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:17 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1277 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:18.175966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9385e1c2-c15f-4c2e-9a76-3beecdee0a7f tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3857b7f90a764b2da93cdc4b27ec2ffb"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:18.180693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.181684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.182728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.184190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.186011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.189734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.636907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:18.649306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68a4919b-9a77-450d-9994-bc867740bce9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1204 microversion: 2.1 time: 0.519782 Oct 18 16:02:18.650408 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 239/474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:18 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1204 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:18.703707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.704526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:18.715373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:18.717234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.720014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.722498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.723804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.725603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.728446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.807016 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9385e1c2-c15f-4c2e-9a76-3beecdee0a7f tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1222037800/action" status: 200 len: 21 microversion: 2.1 time: 0.656360 Oct 18 16:02:18.815445 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 236/475] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 18 16:02:18 2022] POST /compute/v2.1/flavors/1222037800/action => generated 21 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:02:18.822177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f55d3df-f2d9-4092-a9c7-17aaab0dc71f tempest-FlavorsAccessTestJSON-1373419831 tempest-FlavorsAccessTestJSON-1373419831-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.853177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f55d3df-f2d9-4092-a9c7-17aaab0dc71f tempest-FlavorsAccessTestJSON-1373419831 tempest-FlavorsAccessTestJSON-1373419831-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.036213 Oct 18 16:02:18.889248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 237/476] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:02:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:18.911258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff38a4fb-81bc-4d5e-9de1-489a6a3027e1 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.959713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:18.963928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff38a4fb-81bc-4d5e-9de1-489a6a3027e1 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1222037800" status: 202 len: 0 microversion: 2.1 time: 0.072061 Oct 18 16:02:18.971196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 238/477] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:02:18 2022] DELETE /compute/v2.1/flavors/1222037800 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:02:18.983597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b77a8764-3f16-4fde-bb2d-a84b1b3195ae tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.023139 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d60beddf-f36f-4794-979f-686b1c445eb9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.324123 Oct 18 16:02:19.041075 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 240/478] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:18 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:19.050325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b77a8764-3f16-4fde-bb2d-a84b1b3195ae tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.074151 Oct 18 16:02:19.066820 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 239/479] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:02:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:19.085346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6bbc373-e685-46b6-adac-ad6a6c27e5e6 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-954342103", "id": 1123746087, "os-flavor-access:is_public": "False"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:19.134772 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6bbc373-e685-46b6-adac-ad6a6c27e5e6 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.059145 Oct 18 16:02:19.140845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 241/480] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:19.152270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c5531d2-a288-4b48-ada5-d43953984597 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.178833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.179497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:19.210279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c5531d2-a288-4b48-ada5-d43953984597 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1123746087/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.061490 Oct 18 16:02:19.213346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.216235 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 240/481] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:02:19 2022] GET /compute/v2.1/flavors/1123746087/os-flavor-access => generated 21 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:02:19.217314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.225205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.226417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.228619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.231130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.239854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b5e476b-2d35-4b2c-a163-3511d20241bf tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.304610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b5e476b-2d35-4b2c-a163-3511d20241bf tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1123746087" status: 202 len: 0 microversion: 2.1 time: 0.082136 Oct 18 16:02:19.306290 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 241/482] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:02:19 2022] DELETE /compute/v2.1/flavors/1123746087 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:02:19.319774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5f9ac84-51b7-4df3-8e53-7114b961c0c0 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.360623 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5f9ac84-51b7-4df3-8e53-7114b961c0c0 tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.049402 Oct 18 16:02:19.362152 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 242/483] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:02:19 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:19.433502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:19.447497 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7505603-11f9-4b51-855a-709a66fe3851 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1277 microversion: 2.1 time: 0.275928 Oct 18 16:02:19.451277 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 242/484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:19 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:19.676560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.677382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:19.687497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.687986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.688430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.692914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.694145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.696140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.062845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:20.063465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:20.078058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.078830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.079582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.080839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.081693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.082431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.228940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:20.246006 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5d48d57-f924-4e01-a536-f3411b30486c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1266 microversion: 2.1 time: 0.570413 Oct 18 16:02:20.246894 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 243/485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:19 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1266 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:20.477946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:20.478821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:20.491053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.492035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.492816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.498921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.499561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.500181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.558503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:20.611591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d45fbb85-bf9c-4149-aee6-ae686d4ed7f9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.552758 Oct 18 16:02:20.612188 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 243/486] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:20 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:21.076871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:21.084656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:21.090343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31d572cb-abff-47bf-92f4-8ed3d27a1089 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.616303 Oct 18 16:02:21.095526 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 244/487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:20 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:21.279965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:21.281958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:21.318793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.334798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.337245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.338366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.339064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.341858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.650137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:21.651722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:21.684498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.685022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.685488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.691958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.693554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.702844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:22.014234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:22.064425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94e80238-8c5d-4015-bc5e-0d23867bc39a tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.421403 Oct 18 16:02:22.065370 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 245/488] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:21 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:22.083034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:22.088340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:22.097742 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2af86239-7fb5-4432-9322-c8616e11575c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.828108 Oct 18 16:02:22.099725 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 244/489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:21 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:22.123173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:22.125210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:22.144576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:22.149564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:22.150564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:22.154030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:22.156813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:22.157584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:22.873641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:22.885416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36beb668-229b-4b68-a4fd-859fc4a7d0f7 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.774370 Oct 18 16:02:22.891889 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 246/490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:22 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:23.102368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:23.103632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:23.124620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:23.125615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:23.132790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.133756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.134483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.135146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.136092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.136843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.137727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.138397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.139880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.140589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.146177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.147223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.374050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:23.417275 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0a903b1-4658-4fc7-b4bb-97edf6c96dc5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.319468 Oct 18 16:02:23.418184 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 245/491] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:23 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:23.681242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:23.695272 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0734f34c-78c8-4c4f-b3bb-459c0a74cae1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.572840 Oct 18 16:02:23.696962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 247/492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:23 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:23.919920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:23.921049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:23.935313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.939665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.940615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.943619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.945338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.947512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.418574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b986b879-56f0-4df2-b920-5190e7d66270", "tag": "893ebe8b-1675-4ccf-8515-2b328c45464a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:24.451687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:24.453802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.454330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.466016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.510552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] Creating event network-changed:893ebe8b-1675-4ccf-8515-2b328c45464a for instance b986b879-56f0-4df2-b920-5190e7d66270 on n-h1-858383-14 Oct 18 16:02:24.518864 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d3283b95-3d1c-478f-9d7d-3839f7b08630 req-cfefd36a-7d2d-49ba-9f09-d291c8c3398b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107508 Oct 18 16:02:24.522425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 248/493] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:24.529317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:24.530659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:24.541684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.542400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.543136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.544604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.545274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.545864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.875796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:24.890515 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0cc4e8e-561e-409a-a17e-966c20604f05 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.976596 Oct 18 16:02:24.909488 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 246/494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:23 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:24.919719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:24.921453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:24.956280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.957228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.957890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.959377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.960131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.960779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.428339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:25.489068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-efba7557-a2ff-47a6-b5e0-0b1401c87401 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.963587 Oct 18 16:02:25.493593 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 249/495] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:24 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:25.643212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e562de-78e7-432d-ba83-ad3976ee3f59", "tag": "3725126f-b6be-4f30-a4db-75ea69648195"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:25.662451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.665627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.666313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.696265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] Creating event network-changed:3725126f-b6be-4f30-a4db-75ea69648195 for instance e6e562de-78e7-432d-ba83-ad3976ee3f59 on n-h2-858383-14 Oct 18 16:02:25.702595 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2fc29212-5df4-40d8-bd3e-684600f0e7c3 req-4b73db93-a9b0-437c-8eac-3e4a5ccfd3b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066206 Oct 18 16:02:25.705591 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 250/496] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:25.780647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:25.792439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e89da398-6e54-4162-99a5-f3a5255564f4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.881412 Oct 18 16:02:25.798745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 247/497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:24 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:25.950877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:25.952080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:25.974947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.977436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.978137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.979627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.983495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.984136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:26.526634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:26.527507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:26.529663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:26.532411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=18 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:26.550349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:26.550840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:26.551280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:26.552026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:26.552480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:26.552905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:26.724699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:26.998331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:27.053520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89c6f268-6cbf-4357-9507-ef525e0f17be tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.532723 Oct 18 16:02:27.055285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 248/498] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:26 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:27.064286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:27.067469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:27.082791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:27.085869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:27.086608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:27.092803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:27.093553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:27.094267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:27.122191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:27.141393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8d7f9ae-792c-4d16-8617-230f03dd0a71 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 1.216892 Oct 18 16:02:27.159657 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 251/499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:25 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:27.412239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:27.428622 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd33b98e-6e7a-4612-bd48-8099b0cc2277 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.371998 Oct 18 16:02:27.434894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 249/500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:27 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:28.088376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.089336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:28.098288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.102123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.106747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.108322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.110506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.111580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.315990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98a2b2bf-7ada-4939-a7f6-557c6ea34e92 tempest-InstanceUsageAuditLogTestJSON-69821941 tempest-InstanceUsageAuditLogTestJSON-69821941-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.366714 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98a2b2bf-7ada-4939-a7f6-557c6ea34e92 tempest-InstanceUsageAuditLogTestJSON-69821941 tempest-InstanceUsageAuditLogTestJSON-69821941-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 16:02:28" status: 200 len: 318 microversion: 2.1 time: 0.305200 Oct 18 16:02:28.367785 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 252/501] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2016%3A02%3A28 => generated 318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:28.373735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.375060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:28.382712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.383725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.384455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.385737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.386419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.387065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.520223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:28.582746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fbf17ca-b536-4a39-ae30-cdae0691adf5 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.499054 Oct 18 16:02:28.584114 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 250/502] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:28.596833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a598cae4-faac-4963-9f73-898c98ae4aff tempest-InstanceUsageAuditLogTestJSON-69821941 tempest-InstanceUsageAuditLogTestJSON-69821941-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.646289 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a598cae4-faac-4963-9f73-898c98ae4aff tempest-InstanceUsageAuditLogTestJSON-69821941 tempest-InstanceUsageAuditLogTestJSON-69821941-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.060930 Oct 18 16:02:28.648816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:28.660459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 251/503] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:28.660966 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fdaf153-d8aa-4138-9163-5c5d51c88f14 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.288059 Oct 18 16:02:28.661996 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 253/504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:28.666039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.667040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:28.673401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.674588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.675212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.676497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.677811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.678578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.159704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:29.174426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ea9205d-2c82-42aa-b124-2404c3b34528 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.512115 Oct 18 16:02:29.175981 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 252/505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:29.614401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:29.615133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:29.625295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.634926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.635531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.636778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.637529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.638215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.688796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:29.689847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:29.702547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.703771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.706596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.707658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.710683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.711420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.882692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:29.941139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3897cba-8ebd-4e23-84bf-f54d2ff81f7c tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.330803 Oct 18 16:02:29.963506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 254/506] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:29 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:30.203480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:30.204106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:30.219125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:30.223966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:30.225972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:30.229866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:30.229866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:30.234490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:30.452550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:30.461733 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-548c5c64-db68-4d99-925d-e9e225aa8941 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.777032 Oct 18 16:02:30.465890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 253/507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:29 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:30.977909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:30.978947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:30.991526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:30.992415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:30.997726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:30.998845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:30.999679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.000341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.150999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:31.194379 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20d2478f-cd67-47aa-84e1-804aeed42051 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.222422 Oct 18 16:02:31.197459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 254/508] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:30 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:31.227890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:31.253354 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-71f1729c-e5d4-4477-8a49-4a0e0656767e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 1.051459 Oct 18 16:02:31.256445 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 255/509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:30 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:31.485921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:31.487576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:31.502092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.505619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.506275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.507171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.507874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.509523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.979847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:31.996391 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61539509-2146-40f7-a233-a5df407351b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.514195 Oct 18 16:02:31.997022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 255/510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:31 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:32.230698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:32.231674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:32.246953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.248052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.249588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:32.251924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.253031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.254392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:32.475077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:32.517917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1856508277", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "5102e26d-02ba-494b-a69e-fcb88c84af09"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:32.530580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5afc197f-edda-4cf9-9d1a-5d753631e31d tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.304050 Oct 18 16:02:32.532407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 256/511] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:32 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:32.553858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:32.557026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:32.568136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.568736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.569330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:32.570049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.570505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.571925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:32.673154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] validate_networks() for [('5102e26d-02ba-494b-a69e-fcb88c84af09', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:32.943790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:32.959149 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed3634ba-f52f-470a-af03-5789655f4c60 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.425190 Oct 18 16:02:32.960132 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 257/512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:32 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:33.026682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:33.027450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:33.041435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:33.042318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:33.043646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:33.045903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:33.048409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:33.049155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:33.414223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:33.423466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15ef5f58-e5a5-40fd-bb28-af686da064b4 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.401119 Oct 18 16:02:33.437018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 258/513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:33 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:33.561786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:33.566887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:33.592567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:33.593490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:33.594121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:33.602940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:33.607278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:33.611907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:33.815926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:33.863060 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e86de198-01f4-42d6-b5a1-839de5639b31 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.305125 Oct 18 16:02:33.868623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 259/514] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:33 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:33.986430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:33.987424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:34.010645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.011425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.014708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.017153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.017858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.019217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.066300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:34.323295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.334544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e1c29fc-eba8-4478-972c-394b83885aa0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.352505 Oct 18 16:02:34.336806 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 260/515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:33 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:34.437383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:34.437872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:34.437872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:34.438795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:34.438795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:34.453541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.454275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:34.454405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.454787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.454933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:34.455528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.459200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.459704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.470729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.471710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.474903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.475724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.476204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.483886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.527667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:34.534891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for user 19e2cb9474fb47a6b3f3793c7f162caf and project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:34.554370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:34.557472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:34.607537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:34.646802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7a8433c-9ea1-4cf3-91fa-53c02e79ce2f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.899234 Oct 18 16:02:34.651989 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 256/516] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:02:34.691815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:34.709636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:34.829941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.841968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-263f1eb6-0b0e-46f0-9555-9d496641bb28 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.391587 Oct 18 16:02:34.843323 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 261/517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:34 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:34.862902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e562de-78e7-432d-ba83-ad3976ee3f59", "name": "network-vif-plugged", "status": "completed", "tag": "3725126f-b6be-4f30-a4db-75ea69648195"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:34.881061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.881746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.884730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.950293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.952051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] Creating event network-vif-plugged:3725126f-b6be-4f30-a4db-75ea69648195 for instance e6e562de-78e7-432d-ba83-ad3976ee3f59 on n-h2-858383-14 Oct 18 16:02:34.965203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e010251a-829b-4e5b-84c9-4abc49cf62d8 req-7d9ecf70-5ecf-4d68-add2-881c5a8d7923 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118985 Oct 18 16:02:34.965825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.967532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.970234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8822300-ba7c-4441-8710-1c518a879104 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1262 microversion: 2.25 time: 0.290345 Oct 18 16:02:34.970804 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 257/519] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:34 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1262 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:34.985356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 262/519] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:34.986087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:34.986087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:35.000318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.000772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.001243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.001953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.002415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.002855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.257283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:35.298659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf120455-82c4-46ed-a1f9-f9be47bd53e9 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1929 microversion: 2.75 time: 0.321877 Oct 18 16:02:35.299649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 258/520] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:34 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1929 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:35.376010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:35.378286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:35.444056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.447148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.447984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.459712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.462760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.466460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.815469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:35.816135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:35.834223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.839999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.840565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.842990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.845756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.849744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.952646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:02:36.197496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ab146ff-2295-4158-9322-d7c03c8d4454 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 204 len: 0 microversion: 2.1 time: 0.384100 Oct 18 16:02:36.210614 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 259/521] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:35 2022] DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:02:36.229034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:36.241528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:36.242479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:36.243789 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-641a2a94-7a92-434d-bdb5-2390cd2c0479 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.878949 Oct 18 16:02:36.245616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 263/522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:35 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:36.255642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:36.259247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.260240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.261620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.261824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:36.263945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.266910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.267580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.279828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.280727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.281635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.284494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.285580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.288235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.437943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:36.469285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:36.476637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:36.479292 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce99fda6-a3a3-414a-af1b-05d899ba9d56 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1258 microversion: 2.25 time: 0.231162 Oct 18 16:02:36.480837 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 264/523] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:36 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:36.501845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:36.503081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:36.535623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.536176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.537302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.538047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.538520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.538958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.674296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:36.686899 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c72ee01-329a-46c0-9598-a9fdad68ff87 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.472537 Oct 18 16:02:36.695769 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 260/524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:36 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:36.710129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:36.732682 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16a50d2c-b5a0-428c-b29a-ceabb12ba412 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1935 microversion: 2.75 time: 0.250459 Oct 18 16:02:36.734662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 265/525] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:36 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1935 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:36.759669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-59020451", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "1066535079", "adminPass": "***", "networks": [{"uuid": "183b9d91-b0c5-4694-9fd6-513142f29890"}], "security_groups": [{"name": "tempest-securitygroup--948827732"}], "key_name": "tempest-keypair-1466953210", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:36.977687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] validate_networks() for [('183b9d91-b0c5-4694-9fd6-513142f29890', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:37.236686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b986b879-56f0-4df2-b920-5190e7d66270", "name": "network-vif-plugged", "status": "completed", "tag": "893ebe8b-1675-4ccf-8515-2b328c45464a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:37.266632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.268154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.269319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.315336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] Creating event network-vif-plugged:893ebe8b-1675-4ccf-8515-2b328c45464a for instance b986b879-56f0-4df2-b920-5190e7d66270 on n-h1-858383-14 Oct 18 16:02:37.342233 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1298937f-8df3-4d15-94c6-70d007f31ffa req-0c66c04e-8270-46c8-bda8-c43a04b97f28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109361 Oct 18 16:02:37.347070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 266/526] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:02:37.371594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:37.372326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:37.420409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.424133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.427758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.429753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.435164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.436922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.840180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:37.840851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:37.841636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:37.842266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:37.844167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:37.915078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.915793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.919368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.920177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.920653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.921113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.999899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.002128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for project 06acce18eb064040a95fb5c282c07109. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:38.009408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Getting quotas for user 2afa642202234799a50a8460a3b6d36c and project 06acce18eb064040a95fb5c282c07109. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:38.010325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-abe7a1fc-677c-4a45-b2dd-6986fd198e88 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1308 microversion: 2.1 time: 0.661946 Oct 18 16:02:38.010926 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 267/527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:37 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:38.037720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:38.040395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.041074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:38.055966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:38.065094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.065600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.069186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.070333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.073360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.083507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.218873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.235340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.237095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.240607 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-699cda31-d2bd-49e1-bd27-85c959fc7598 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1314 microversion: 2.25 time: 0.217022 Oct 18 16:02:38.254042 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 268/528] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:38.300842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90b83eb8-e0f7-4560-a711-61876033b0ab tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.546921 Oct 18 16:02:38.310222 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 261/529] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:38.325363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.325984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:38.389754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.390248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.402690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.407543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.408340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.411578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.637375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:38.811041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c502c96-e1c0-44a5-b239-3dd751b1d29c tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] Calling method '.version_select at 0x7f5fd272b820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.832439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c502c96-e1c0-44a5-b239-3dd751b1d29c tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.576184 Oct 18 16:02:38.834678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 269/530] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:38.857851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.859797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:38.892347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.895787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.896404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.898383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.901452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.902192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:39.185462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:39.198415 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5553ad57-5f14-48bd-b045-7fc0f00f31bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1319 microversion: 2.1 time: 0.878353 Oct 18 16:02:39.203646 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 262/531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1319 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:39.219279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1865d43-9565-46c1-a0ec-181741c3466d tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:39.219917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1865d43-9565-46c1-a0ec-181741c3466d tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:39.469315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:39.514872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8576e08c-a53b-4b97-a26d-ba5c6e096746 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1935 microversion: 2.75 time: 0.677136 Oct 18 16:02:39.515844 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 270/532] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1935 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:39.533886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d5993a-4e41-424c-9e2d-6117adceeb96 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd262e0d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:39.668653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:UPDATE=7 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:39.695955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20d5993a-4e41-424c-9e2d-6117adceeb96 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.178087 Oct 18 16:02:39.696953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 271/533] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Oct 18 16:02:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:39.701949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:39.704046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:39.712613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.713579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.714249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:39.715235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.715965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.716668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.041078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.064048 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d381bfe-0fdb-485b-bc3c-36a000a858e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1488 microversion: 2.1 time: 0.365647 Oct 18 16:02:40.078081 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 272/534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:39 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:40.106658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:40.106658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:40.139094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.139614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.140012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.140825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.141460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.141750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.283052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.308755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.313506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.316354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98bf28bd-e71c-490c-a88d-96d1de5b753b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1320 microversion: 2.25 time: 0.237019 Oct 18 16:02:40.322205 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 273/535] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:40 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:40.337996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51231f33-4649-4aa1-ae0e-d7b719f8d6a5 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] Calling method '.version_select at 0x7f5fd272bc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:40.377210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1865d43-9565-46c1-a0ec-181741c3466d tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.390914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1865d43-9565-46c1-a0ec-181741c3466d tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1263 microversion: 2.1 time: 1.186157 Oct 18 16:02:40.392118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 263/536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:39 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1263 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:40.404283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:40.412621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:40.420370 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51231f33-4649-4aa1-ae0e-d7b719f8d6a5 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.096296 Oct 18 16:02:40.431768 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 274/537] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Oct 18 16:02:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:40.436636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:40.437280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:40.438742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.446137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.447328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.451657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.453578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.458276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.458648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.459321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.469232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.470294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.475283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.476049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.510535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:40.630589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bbf47c97-a025-40ee-986a-eae948af667c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59/action" status: 202 len: 0 microversion: 2.1 time: 0.236858 Oct 18 16:02:40.631861 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 264/538] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:02:40 2022] POST /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:02:40.638781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0781d848-33d3-4b9f-be84-a1dc25801f96 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd28e0940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:40.863730 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0781d848-33d3-4b9f-be84-a1dc25801f96 tempest-QuotaClassesAdmin257Test-611972217 tempest-QuotaClassesAdmin257Test-611972217-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.226166 Oct 18 16:02:40.872171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 265/539] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Oct 18 16:02:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:40.894413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:40.895375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:40.962249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.962775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.963233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.963979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.964444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.964875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.436248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] Lazy-loading 'services' on Instance uuid e2219746-baa4-42a1-9857-6b38488c55bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:41.525360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1751c30-d003-40e0-9ecc-0093522de041 tempest-ServersAdmin275Test-749157043 tempest-ServersAdmin275Test-749157043-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1920 microversion: 2.75 time: 0.649542 Oct 18 16:02:41.530659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 266/540] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:40 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1920 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:41.545433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:41.546226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:41.571534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.572665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.573473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.574422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.575104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.575748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.937410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:41.963145 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7214bb47-dd21-48f5-a328-4cc240484c91 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1469 microversion: 2.1 time: 1.529143 Oct 18 16:02:41.966924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 275/541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:40 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1469 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:41.985824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:41.989411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:42.015422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.016175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.018194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.019345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.023541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.024742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.191870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:42.200533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:42.214484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:42.217338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-673025af-1cf3-4bcc-a45f-8e831d635ba3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1320 microversion: 2.25 time: 0.247654 Oct 18 16:02:42.221818 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 276/542] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:41 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:42.233947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:42.235591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:42.262402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.263416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.264555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.266116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.267885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.270997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.461594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:42.474796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a86be2ce-7a96-49bf-9633-9a6624635bad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1321 microversion: 2.1 time: 0.251239 Oct 18 16:02:42.478494 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 277/543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:42 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:42.491941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:42.492472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:42.507766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.508589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.510977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.513010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.514937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.515551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.570355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:02:42.807688 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c02652bc-6b7f-42c7-8f68-ef3eb5232224 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 204 len: 0 microversion: 2.75 time: 0.327167 Oct 18 16:02:42.809577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 278/544] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:02:42 2022] DELETE /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:02:43.008517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:43.016371 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f265b69-76ed-481b-b191-90d74f07aaca tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 200 len: 1473 microversion: 2.1 time: 1.484477 Oct 18 16:02:43.016945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 267/545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:41 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 1473 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:43.232424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1576526738", "block_migration": true, "disk_over_commit": false}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:43.236039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:43.255023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.259653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.261314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.262264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.262891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.272202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.327036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab69d23f-a987-40c2-809f-879760665177 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Action: 'create', calling method: .version_select at 0x7f5fd28e0dc0>, body: {"keypair": {"name": "tempest-keypair-1585740191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlDlLxrMPy6/YOm5ZcNPPV+PukyQ+XduwY0+k0YHebQkb25ee5wgk1VdY8jIp/RqCCO8rpECb3zS9AbwMmKOkYDj2zVzhLOvyRDad/ZjTR/3UIXc2J6qWpJKnGURm9bYQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:43.335979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:43.394579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ab69d23f-a987-40c2-809f-879760665177 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Getting quotas for project eb88ccffb014497b801541b53d8bb505. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:43.412084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ab69d23f-a987-40c2-809f-879760665177 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Getting quotas for user 40da67f39f4d4a6fb25ea033b0f14071 and project eb88ccffb014497b801541b53d8bb505. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:43.488194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab69d23f-a987-40c2-809f-879760665177 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.459148 Oct 18 16:02:43.490757 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 268/546] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:02:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:43.509651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:43.510480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:43.517419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lazy-loading 'flavor' on Instance uuid b986b879-56f0-4df2-b920-5190e7d66270 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:43.571243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.574460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.574930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.575767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.581552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.582960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.776722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Going to try to live migrate instance to tempest-host-1576526738 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:02:43.790643 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] HTTP exception thrown: Compute host tempest-host-1576526738 could not be found. Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Request method failure captured: Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270/action HTTP/1.1 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 107 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4EG9ZsRoYYj459JkNd8oprDbNqqE6Gezuo6x6h8H3zf-hyywBDy3W44re313DD8TV7h_l0TAn8UsnAhGOnBRQ0F_iamCwQSx5iLMhhF3_UXLkE1dOuWIkedP8OsjULRaymms5B_LTCW7nkjNr2sJxu_5YNh9x44bT7iAMUirPa34s Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1b35ef71883643ecb60ab2adaf04d643 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:02:43.813461 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b35ef71883643ecb60ab2adaf04d643"}]}] Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1b35ef71883643ecb60ab2adaf04d643 Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationNegativeTest-2029665077-project-admin Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c0fd25fdf6154d42a06be866e4d47712 Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationNegativeTest-2029665077-project-admin Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: {"os-migrateLive": {"host": "tempest-host-1576526738", "block_migration": true, "disk_over_commit": false}} Oct 18 16:02:43.815176 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: exception: Compute host tempest-host-1576526738 could not be found. Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b986b879-56f0-4df2-b920-5190e7d66270', 'body': {'os-migrateLive': {'host': 'tempest-host-1576526738', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:02:43.816166 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1576526738 could not be found. Oct 18 16:02:43.818597 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1576526738 could not be found. Oct 18 16:02:43.819905 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1576526738 could not be found. Oct 18 16:02:43.821173 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:02:43.822958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Returning 400 to user: Compute host tempest-host-1576526738 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:43.824279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5bae0600-032a-4b47-8bdc-1a44f540a490 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270/action" status: 400 len: 100 microversion: 2.1 time: 1.011797 Oct 18 16:02:43.825120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 279/547] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 18 16:02:42 2022] POST /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270/action => generated 100 bytes in 1013 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:02:43.830709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-258129720"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:43.835191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:43.854495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.854985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.861759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.862967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.863711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.865115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.237384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:44.258992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:44.261999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:44.296169 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8cb5a9e-29d2-452c-b253-b5a30e01d6c8 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1443 microversion: 2.75 time: 0.789122 Oct 18 16:02:44.297566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 269/548] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:43 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1443 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:44.303269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:44.305700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:44.324551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.325581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.327002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.327949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.328619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.329301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.638128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0da08de5-526d-4a97-aae4-09ed77daf2bd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59/action" status: 202 len: 0 microversion: 2.1 time: 0.797689 Oct 18 16:02:44.638926 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 280/549] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:02:43 2022] POST /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:02:44.650263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:44.679061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:44.730101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.731077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.731503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.732220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.732667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.741023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.909792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:44.923038 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0070d15-7e87-49dd-84ba-52bf2edb8ea2 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1321 microversion: 2.1 time: 0.276885 Oct 18 16:02:44.925042 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 281/550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:44 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:44.946128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:44.952468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:44.965914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.966448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.966899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.967659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.968161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.968677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:45.390252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.400632 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f0d652c-e1b5-4661-b52d-87f55842c416 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1469 microversion: 2.1 time: 0.471510 Oct 18 16:02:45.406279 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 282/551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:44 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1469 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:45.415207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7ee9495-ddcc-442f-a72f-5eb8d40b110c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd24fe1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:45.514300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7ee9495-ddcc-442f-a72f-5eb8d40b110c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.106721 Oct 18 16:02:45.516724 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 283/552] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:45 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:45.521941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661561e8-887f-41da-b4ab-de196e88e361", "name": "network-vif-deleted", "tag": "5c192c27-a855-4f3c-9f96-7c2cb8d058a9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:45.567701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:45.569598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:45.570082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:45.594707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] Creating event network-vif-deleted:5c192c27-a855-4f3c-9f96-7c2cb8d058a9 for instance 661561e8-887f-41da-b4ab-de196e88e361 on n-h1-858383-14 Oct 18 16:02:45.617643 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f9e4b6fa-2f3d-4134-b7ac-0ef61dca78ce req-24b9f950-220e-40e4-bdb5-db328a50626d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095670 Oct 18 16:02:45.619845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 284/553] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:45.632507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:45.635038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:45.650899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:45.652929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:45.654316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:45.655301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:45.656527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:45.657724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:45.772952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.791030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.798788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e087a69e4fcf42849e275585aa0b9da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a3257e135e42b4848850358a05cd5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.823061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b309f5d-0f85-4da8-b051-dee5f64945e9 tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 200 len: 1443 microversion: 2.75 time: 0.200165 Oct 18 16:02:45.824807 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 285/554] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:45 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:45.833652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1979406286", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:45.975287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:46.246463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.263829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.268494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.274838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f0fa512-f267-41bd-a04f-d155ec14a02e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 1.975654 Oct 18 16:02:46.275918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 270/555] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:44 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:46.289435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.290222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:46.304589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.305075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.305634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.306816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.307543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.308076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.431215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.457873 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-742c9f62-55b8-420d-9e9a-9d6ec4e7bf2e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1321 microversion: 2.1 time: 0.180272 Oct 18 16:02:46.469410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 271/556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:46.535618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4255417c-d18a-4600-b101-a4b1767cb148 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd274faf0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.592775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:46.593699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:46.594351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:46.594914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:46.595499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:46.632323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.632838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.633310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.634045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.634507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.634933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.690776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Getting quotas for project c1615e4a1ea345b4ac972f3a3cb08f2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:46.704405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Getting quotas for user 0c29841aaaee47c8ac0bde44c50105dc and project c1615e4a1ea345b4ac972f3a3cb08f2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:46.716193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4255417c-d18a-4600-b101-a4b1767cb148 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.185876 Oct 18 16:02:46.719924 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 272/557] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:46.736704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:46.747901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:46.856512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.857164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] [instance: e2219746-baa4-42a1-9857-6b38488c55bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:46.871178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.875186 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a81f1cfd-e008-4008-85b5-6c9b1a7e9144 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047709 Oct 18 16:02:46.875762 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 286/558] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:46.888429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.891275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.892738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b4952eb-71ea-4188-8607-75978200c03f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.893137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.897913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.899501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.905963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b4952eb-71ea-4188-8607-75978200c03f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:46.975305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] HTTP exception thrown: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Request method failure captured: Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf HTTP/1.1 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3VQ8yarWAnqIVrc81IGSFHsunc7o_d-RNy8Jkg5YPsMPBw8SVDEZtncL3kQ8vNr0MiGlu5ssaYTNXPc-dDUFVhcfrHzp26Nyx06M6AToMAsEo7s7k1LqljQUrlLLVpZiinoGAYpxTL59W8_lkOqtQZAnZntRiBgeUq30J9OSzQmKA Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.75 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d3a3257e135e42b4848850358a05cd5f Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdmin275Test-881532643 Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:02:46.983773 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3a3257e135e42b4848850358a05cd5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3a3257e135e42b4848850358a05cd5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3a3257e135e42b4848850358a05cd5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3a3257e135e42b4848850358a05cd5f"}]}] Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdmin275Test-881532643 Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d3a3257e135e42b4848850358a05cd5f Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdmin275Test-881532643 Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdmin275Test-881532643-project Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e087a69e4fcf42849e275585aa0b9da6 Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdmin275Test-881532643-project Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. Oct 18 16:02:46.985495 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e2219746-baa4-42a1-9857-6b38488c55bf'} Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:46.986396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. Oct 18 16:02:46.987782 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:02:46.993823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] Returning 404 to user: Instance e2219746-baa4-42a1-9857-6b38488c55bf could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:46.998511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-451c759f-501e-4aa7-b64d-3f2890fad87d tempest-ServersAdmin275Test-881532643 tempest-ServersAdmin275Test-881532643-project] 10.222.0.78 "GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf" status: 404 len: 111 microversion: 2.75 time: 0.142631 Oct 18 16:02:46.999785 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 273/559] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/servers/e2219746-baa4-42a1-9857-6b38488c55bf => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:02:47.309712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:47.311404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:47.345019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.346575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.349982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:47.351708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.355581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.358425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:47.815337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b4952eb-71ea-4188-8607-75978200c03f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:47.835689 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b4952eb-71ea-4188-8607-75978200c03f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1219 microversion: 2.1 time: 0.939974 Oct 18 16:02:47.845623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 287/560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1219 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:47.879391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:47.881376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:47.889514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.890342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.891096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:47.892338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.893254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.893875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:47.971592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:48.067970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.083522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33074b42-df88-48a8-a358-5bee74d4c127 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1321 microversion: 2.1 time: 0.221590 Oct 18 16:02:48.086118 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 288/561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:47 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:48.091673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c13c5a1-3dd7-40be-8ed7-e4595765f11c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd25ca310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:48.192354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c13c5a1-3dd7-40be-8ed7-e4595765f11c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.103468 Oct 18 16:02:48.193520 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 289/562] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:48 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:48.564811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.635667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.641892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.653638 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ee361a2-680d-4bd0-9072-79a7016b498f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 1.349360 Oct 18 16:02:48.658041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 274/563] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:47 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:48.832941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:48.848927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:48.848927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:48.851304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.876102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:48.876906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:48.898131 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] Creating event network-changed:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h1-858383-14 Oct 18 16:02:48.899605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:48.902521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:48.903340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.904333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:48.915538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:48.921082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.955420 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-72bb6576-6727-4e39-8237-3a12e8decf40 req-cb5fb830-227f-4af2-aa42-a67dfd59a033 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125916 Oct 18 16:02:48.965311 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 290/564] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:49.115397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:49.116438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:49.128506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.135426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.141552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.142366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.142849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.147437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.446961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:49.455928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc0ba196-9765-4776-acfa-a6710d0e5a7f tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1271 microversion: 2.1 time: 0.584502 Oct 18 16:02:49.473062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 275/565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:48 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1271 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:49.478453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0634d958-634a-459b-9fb3-f82cce5b1746 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd26e8040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:49.561949 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0634d958-634a-459b-9fb3-f82cce5b1746 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.102174 Oct 18 16:02:49.566190 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 276/566] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:49 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:49.698118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:49.699397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:49.714359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.717287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.718516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.721241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.722774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.726114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.796195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:49.810037 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df3f2f39-9e0f-410c-8166-abf26e85ff72 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.699013 Oct 18 16:02:49.812215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 291/567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:49 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:50.564524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd264f550>, body: {"quota_set": {"ram": "5120"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:50.695978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:50.696486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:50.696905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:50.697664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:50.698499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:50.698960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:50.827313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5aebeba8-acff-4fda-83c8-7837f8932e80 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59" status: 200 len: 148 microversion: 2.57 time: 0.548010 Oct 18 16:02:50.828647 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 292/568] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Oct 18 16:02:50 2022] PUT /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59 => generated 148 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:02:50.837210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:50.838271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:50.864803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:50.869178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:50.869975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:50.871012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:50.889351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:50.890249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.099479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.123980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.134331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.135997 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4836729-f22f-4e2d-8872-9554a11f85c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 1.454154 Oct 18 16:02:51.142905 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 277/569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:49 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:51.157637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa8f8c0f-eb1c-4d67-bbdd-1457e3086979 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd28e0940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:51.230581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.250476 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa8f8c0f-eb1c-4d67-bbdd-1457e3086979 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.106067 Oct 18 16:02:51.251432 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bf088321-7de7-46c9-acf2-7ee3edb6046d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1277 microversion: 2.1 time: 0.415991 Oct 18 16:02:51.276576 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 293/570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:50 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1277 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:51.278100 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 278/571] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:51 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:51.296211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Calling method '.version_select at 0x7f5fd2a574c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:51.297431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:51.299743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:51.314156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.315820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.318158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.320931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.323176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.324538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.727547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.741312 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a5143d25-4ac0-4fda-906b-f0f09bdbe2d4 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.452390 Oct 18 16:02:51.753105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 294/572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:51 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:51.755631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2009285771", "imageRef": "d84c58c8-d15a-4956-a36b-dda151ee95c8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "63cb715a-be3a-4f2e-a695-c333f33560cf"}], "security_groups": [{"name": "tempest-securitygroup--1281045584"}], "key_name": "tempest-keypair-1585740191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:51.912371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] validate_networks() for [('63cb715a-be3a-4f2e-a695-c333f33560cf', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:51.944106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.944581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.945041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.945744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.952468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.953218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.996608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=8,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:52.000293 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ece24bef-9d5c-4440-b184-a84bd164ea09 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59/detail" status: 200 len: 463 microversion: 2.57 time: 0.719207 Oct 18 16:02:52.001309 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 279/573] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 18 16:02:51 2022] GET /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59/detail => generated 463 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:52.171421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:52.173613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:52.190963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.191841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.194764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.195825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.200723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.201412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.796663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:52.809293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:52.811614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:52.813463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98897a98-733c-4dff-a13f-7b1984f31df3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 0.647644 Oct 18 16:02:52.815039 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 280/574] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:52 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:02:52.823074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dab615df-6fbd-4ffc-a885-2a28e24016af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd274f8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:52.943871 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dab615df-6fbd-4ffc-a885-2a28e24016af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.127110 Oct 18 16:02:52.944804 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 281/575] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:52 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:52.960565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:52.965616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:52.982343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.983106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.983708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.984629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.985281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.985867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.198996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:53.208779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77d7f190-243a-4d11-82c5-91f63fafab99 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1277 microversion: 2.1 time: 0.260863 Oct 18 16:02:53.231306 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 282/576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:52 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:53.274266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:53.274840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:53.275137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:53.275540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:53.275944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:53.290007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.290488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.290920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.291637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.292090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.292510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.319215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Getting quotas for project eb88ccffb014497b801541b53d8bb505. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:53.341324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Getting quotas for user 40da67f39f4d4a6fb25ea033b0f14071 and project eb88ccffb014497b801541b53d8bb505. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:53.360827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:53.364116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d84c58c8-d15a-4956-a36b-dda151ee95c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:53.465993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f08fba8e-794d-47d5-ab68-c12c2313b378 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.717179 Oct 18 16:02:53.467372 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 295/577] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:53.477680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e562de-78e7-432d-ba83-ad3976ee3f59", "name": "network-vif-plugged", "status": "completed", "tag": "3725126f-b6be-4f30-a4db-75ea69648195"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:53.487862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:53.492123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.493344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.493927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.510618 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] Creating event network-vif-plugged:3725126f-b6be-4f30-a4db-75ea69648195 for instance e6e562de-78e7-432d-ba83-ad3976ee3f59 on n-h2-858383-14 Oct 18 16:02:53.533984 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-43648856-5031-4335-acbc-ee8d9abf74c3 req-1b5d1385-37b3-459b-80d0-cba8f76795cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061654 Oct 18 16:02:53.540505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 296/578] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:53.549122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd2724af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:53.549804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1996908223", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "36cd9606-04bb-4353-9340-97cb35289c50"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:53.664964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.667064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.667799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.668839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.669761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.670358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.720175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.720877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.721484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.723354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.724301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.725230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.751151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] validate_networks() for [('36cd9606-04bb-4353-9340-97cb35289c50', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:53.824468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bec9b9e0-d2a7-4ccf-b630-cca7e96f02ff tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59?user_id=3cbe69ad68f4478fa4c9b83e1ac171a6" status: 200 len: 148 microversion: 2.57 time: 0.281247 Oct 18 16:02:53.826212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 297/579] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Oct 18 16:02:53 2022] PUT /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59?user_id=3cbe69ad68f4478fa4c9b83e1ac171a6 => generated 148 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:53.831494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9268ea0-c252-48aa-bd94-a3f4dac281cf", "tag": "ee1ea766-2f0d-42a0-b790-a492f22d879b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:53.846200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.847016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.848431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.861336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] Creating event network-changed:ee1ea766-2f0d-42a0-b790-a492f22d879b for instance b9268ea0-c252-48aa-bd94-a3f4dac281cf on n-h2-858383-14 Oct 18 16:02:53.873223 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c7ffe54a-922a-4cae-8b5c-26240b7835cf req-87b01895-ef08-4014-a706-e2a991f45187 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045344 Oct 18 16:02:53.874358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 298/580] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:53.879680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:53.881387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:53.889388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.890165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.890971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.891846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.892505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.893124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:54.232978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:54.252608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45ce353c-d5b8-404e-98e7-4dc58cf60570 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.376897 Oct 18 16:02:54.262073 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 299/581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:53 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:54.284673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-007a8015-e6be-4248-8633-b5945a305067 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:54.286209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-007a8015-e6be-4248-8633-b5945a305067 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:54.418473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-007a8015-e6be-4248-8633-b5945a305067 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:54.434902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-007a8015-e6be-4248-8633-b5945a305067 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1246 microversion: 2.1 time: 0.171824 Oct 18 16:02:54.435483 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 300/582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:54 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1246 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:54.441978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8958ba1-77f9-4ea0-9f80-d96b99289740 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Calling method '.version_select at 0x7f5fd24aa0d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.048888 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8958ba1-77f9-4ea0-9f80-d96b99289740 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59?user_id=3cbe69ad68f4478fa4c9b83e1ac171a6" status: 200 len: 190 microversion: 2.57 time: 0.610691 Oct 18 16:02:55.051552 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 301/583] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Oct 18 16:02:54 2022] GET /compute/v2.1/os-quota-sets/c02471b95dd04d82bcd2fef070fe1d59?user_id=3cbe69ad68f4478fa4c9b83e1ac171a6 => generated 190 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:02:55.077050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.077711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:55.087077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.087077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.087077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.087450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.087999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.088970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.417891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:55.437357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:55.440425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:55.443234 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80fa6b8d-6dd2-4cd5-b3a1-009c3f278d1b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 0.389406 Oct 18 16:02:55.446216 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 302/584] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:55 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:55.455548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d138dcc5-3c7e-4424-b2c9-b6419690c8e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd24fef70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.521780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d138dcc5-3c7e-4424-b2c9-b6419690c8e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.074199 Oct 18 16:02:55.522356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 303/585] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:55 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:55.530528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.537834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:55.555591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.556359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.556806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.557550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.559478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.559933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.890060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:55.891099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:55.891917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:55.892487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:55.893119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:55.924714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:55.946055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:55.948075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.948923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.949605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.950756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.953432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.954037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.964591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f4bb66d-62bf-4c3f-a285-4bcc774a6306 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 0.439357 Oct 18 16:02:55.982982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 304/586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:55 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:55.990538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.991919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:56.014227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.018151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.018811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.019829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.021295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:56.021738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.022298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.040623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for user ab2aa9c224654cfbbc1559ed58556ad5 and project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:56.096414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:56.107195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:56.215894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0b037cb-199c-4414-b4bc-0dc52b1689a9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982999 Oct 18 16:02:56.217784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 283/587] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:56.236306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:56.239037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:56.252953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.255112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.255921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.258015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.260376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.260986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.385567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.408676 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d17daeca-7ec3-4089-a0e3-0b06d22c7962 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.440046 Oct 18 16:02:56.413471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 305/588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:55 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:56.419875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc92267b-89ba-49a1-ae34-fe476d3ed670 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:56.421498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc92267b-89ba-49a1-ae34-fe476d3ed670 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:56.491081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc92267b-89ba-49a1-ae34-fe476d3ed670 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.501459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc92267b-89ba-49a1-ae34-fe476d3ed670 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1211 microversion: 2.1 time: 0.086593 Oct 18 16:02:56.502846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 306/589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:56.514086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.514675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:56.515791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:56.524190 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68565ed1-5caf-4824-9ae0-50790c573559 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1250 microversion: 2.1 time: 0.305156 Oct 18 16:02:56.531502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.532289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.535577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 284/590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1250 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:56.536683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.541380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.542043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.542658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.552441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-739d5012-40fe-4db4-9187-1c34c98c54ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd274f550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:56.696696 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-739d5012-40fe-4db4-9187-1c34c98c54ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.157269 Oct 18 16:02:56.697279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 285/591] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:56.874835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.895694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.898811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.900915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fde42ac-0bd4-4fad-b262-77c8abaac0f5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 0.394976 Oct 18 16:02:56.903039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 307/592] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:02:56.994606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:57.000707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:57.027899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:57.030639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:57.031738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:57.039774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:57.043110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:57.043797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:57.590494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-278423252", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:57.707843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:02:58.061900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:58.062651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:58.063505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:58.064133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:58.064923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:58.078535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.079371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.080176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.081259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.082517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.083287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.118356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:58.127042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for user e43668b02a784329b9c73993ed6a927e and project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:58.146821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:58.149644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:58.228159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6aa39df2-ff44-45bd-8595-9677821cdb31 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882386 Oct 18 16:02:58.230587 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 308/593] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:58.266931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:58.270979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:58.279831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.281156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.281839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.282934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.283621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.284265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.439033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:58.458131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4679704-3858-432d-bdce-3fac5ad30f75 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 1.470133 Oct 18 16:02:58.463765 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 286/594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:58.481555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:58.482479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:58.503390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.505668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.506510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.508109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.513209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.513973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.701145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:58.710769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a11b80e-faa1-42a0-8696-65b0cc4b8f0a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1263 microversion: 2.1 time: 0.245381 Oct 18 16:02:58.711806 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 287/595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:58 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1263 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:58.721293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:58.723677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:58.734247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.735028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.735836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.736749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:58.737419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:58.738501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:58.770260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:58.811649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:58.822705 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b079ceb-c97a-441b-9b60-8ec7a921810e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.590776 Oct 18 16:02:58.840328 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 309/596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:58 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:58.848917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21cfe2f0-e95d-432d-b859-cf573bc1a394 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd24fe430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:58.903955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:58.928393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88ef36f9-386f-4698-997d-2ad131ef6937 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1304 microversion: 2.1 time: 0.206541 Oct 18 16:02:58.986910 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 288/597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:58 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:59.008348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21cfe2f0-e95d-432d-b859-cf573bc1a394 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1411 microversion: 2.1 time: 0.161496 Oct 18 16:02:59.009029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 310/598] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:58 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:59.022921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:59.030722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:59.040768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1597469738", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:59.052009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:59.055838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:59.058497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:59.060051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:59.060685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:59.062434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:00.226972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:00.243931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:00.250961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:00.253369 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c5a34a7-6adb-4004-b85f-1cbebf5b5112 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1362 microversion: 2.25 time: 1.264956 Oct 18 16:03:00.254946 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 289/599] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:02:58 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1362 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:00.262729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5", "tag": "4c1297f6-db61-4459-a33f-8632816edf7d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:00.292762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:00.293208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:00.293647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:00.324679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] Creating event network-changed:4c1297f6-db61-4459-a33f-8632816edf7d for instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 on n-h1-858383-14 Oct 18 16:03:00.333765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2ceb89b6-4808-4c31-9bfa-faec4a9c70bf req-adb1cc21-91ac-4496-90b6-4263b9f82c29 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076213 Oct 18 16:03:00.337964 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 290/600] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:00.372372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "name": "network-vif-plugged", "status": "completed", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:00.402414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:00.403287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:00.405195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:00.422416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] Creating event network-vif-plugged:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h1-858383-14 Oct 18 16:03:00.447223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-eb4e48cb-da6f-4313-9209-4fdc0fab2dd1 req-419b9e65-3ab4-49f3-9507-ce51cf842789 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103379 Oct 18 16:03:00.448401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 291/601] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:00.469101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:00.473084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:00.502173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:00.502981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:00.503620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:00.504609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:00.505256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:00.505879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:01.504662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:01.515056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-92824dc6-c2cc-41f8-8d50-5e31e226ac70 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 1.064125 Oct 18 16:03:01.518302 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 292/602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:00 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:01.524931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:01.525774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:01.542323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:01.544536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:01.546792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:01.550347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:01.551328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:01.553746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:01.978565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:01.988575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b83ae83f-e568-4341-95c6-06b51d6ad240 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.467613 Oct 18 16:03:02.002685 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 293/603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:01 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:02.034338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:02.036357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:02.055629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:02.056553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:02.057273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:02.059596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:02.060369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:02.061028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:02.322174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:02.336014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-373e6b74-c592-4b84-9373-d3f78567480c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.316326 Oct 18 16:03:02.337495 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 294/604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:02 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:02.344385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:02.345459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:02.363214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:02.365170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:02.367175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:02.368313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:02.369024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:02.370597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:02.705712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:02.717518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce4598e7-bb20-4ee9-ae59-fa7021041bf7 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.376517 Oct 18 16:03:02.738754 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 295/605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:02 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:02.749755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9097442-6d87-4120-8909-899b02ad574d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd26e8d30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:05.977953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:06.064798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=34 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:08.094715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=13 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:08.140223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:08.816744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=20 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:09.127160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:10.499889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:10.521050 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9097442-6d87-4120-8909-899b02ad574d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1420 microversion: 2.1 time: 7.780032 Oct 18 16:03:10.524681 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 296/606] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:02 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1420 bytes in 7785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:10.534045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:10.535278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:10.548266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:10.549457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:10.550458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:10.552574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:10.553632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:10.554208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:10.807504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:10.825088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:10.827061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:10.828667 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-644a88fa-8884-48b3-b419-1dc7254163d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1559 microversion: 2.25 time: 0.302975 Oct 18 16:03:10.829809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 297/607] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:10 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1559 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:10.835657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:10.836659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:10.848769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:10.850850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:10.859791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:10.861668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:10.862410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:10.862931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:10.995787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:10.996666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:10.997312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:10.997918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:10.998569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:11.029816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.030728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.031529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.032580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.033296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.033906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.090435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:11.107131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for user e43668b02a784329b9c73993ed6a927e and project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:11.120247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:11.129773 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a4db8d7-0266-4803-95b5-5c077d05ac4b tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 0.298621 Oct 18 16:03:11.130671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 298/608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:10 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:11.142992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:11.147036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:11.156165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9268ea0-c252-48aa-bd94-a3f4dac281cf", "name": "network-vif-plugged", "status": "completed", "tag": "ee1ea766-2f0d-42a0-b790-a492f22d879b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:11.171465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.172224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.173011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.192536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] Creating event network-vif-plugged:ee1ea766-2f0d-42a0-b790-a492f22d879b for instance b9268ea0-c252-48aa-bd94-a3f4dac281cf on n-h2-858383-14 Oct 18 16:03:11.200235 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3240f41f-2aca-4e7a-a44d-e632b161578b req-d7702977-d4a8-48a0-974f-5384220222f8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050231 Oct 18 16:03:11.201122 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 299/609] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:11.208431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:11.209638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:11.219539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.220536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.221199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.223285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.224174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.225221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.264663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c9c5e67-a08a-4dfa-8b4d-bb0e4fb7a88a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.243485 Oct 18 16:03:11.270691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 311/610] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 12251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:11.276075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:11.280341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:11.294596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.297698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.298598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.299620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.302565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.303525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.554615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:11.556673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:11.568238 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b09d8991-ab56-40bd-ad3e-b74c5ce3141e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.295937 Oct 18 16:03:11.569020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-403a22bb-2629-42fe-87f9-6288bd37f171 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.366250 Oct 18 16:03:11.569387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 312/611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:11 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:11.575757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:11.576545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:11.584093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.584955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.585573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.587303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 300/612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:11 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:11.588381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.589161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.589976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.612805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac0edf-2592-4b08-bda0-7adb4880eb04", "tag": "149d8412-e966-4d73-af37-9b73ecb6c9cf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:11.648307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.648799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.649296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.668053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] Creating event network-changed:149d8412-e966-4d73-af37-9b73ecb6c9cf for instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 on n-h2-858383-14 Oct 18 16:03:11.692780 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-45048642-aadc-4975-8a85-e44e42a959b3 req-9628eb3c-3dab-4b82-a248-7e45355c8ac0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103623 Oct 18 16:03:11.694936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 301/613] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:11.860743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:11.876055 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f1e55eb-d608-4135-a57e-0c2687b17d79 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.304644 Oct 18 16:03:11.877929 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 313/614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:11 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:11.886549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:11.920961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:11.922934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:11.924473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:11.963071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] Creating event network-changed:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:03:11.978867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1bdb5522-5879-472f-a829-31b3057da78c req-c7945a57-1eab-4985-aa9f-d5b0366d22ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097307 Oct 18 16:03:11.981034 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 314/615] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:11.991675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27d5baeb-8c92-45ff-a7c7-a756f345b2a4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd24aaf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:12.045402 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cac28642-f074-4d85-9d9b-9e497638eb67 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.349151 Oct 18 16:03:12.046220 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 302/616] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:03:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 16:03:12.080177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27d5baeb-8c92-45ff-a7c7-a756f345b2a4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 200 len: 1420 microversion: 2.1 time: 0.094065 Oct 18 16:03:12.091075 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 315/617] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:11 2022] GET /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:12.091075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1161bc8c-71eb-4b80-9e19-64f0542f1045 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:12.091075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1161bc8c-71eb-4b80-9e19-64f0542f1045 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:12.170689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1161bc8c-71eb-4b80-9e19-64f0542f1045 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:12.182543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1161bc8c-71eb-4b80-9e19-64f0542f1045 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1214 microversion: 2.1 time: 0.097454 Oct 18 16:03:12.185436 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 316/618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:12 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:12.202152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-455bcc3f-0b0c-4763-a230-c2dabefb5789 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Calling method '.version_select at 0x7f5fd2c00310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:12.377346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-455bcc3f-0b0c-4763-a230-c2dabefb5789 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] HTTP exception thrown: Image not found. Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-455bcc3f-0b0c-4763-a230-c2dabefb5789 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Request method failure captured: Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs43N30JrRh-48Ke97BijGFFvKAmfRBeSvrWQ2Ozwtqcy-FET6A4OmRBAmennS2s2pu9Ns6qoo4M1bGcEZyaVoNlA8rNsLjDfYE580DJI4WJt9QhGjB4XsVK8nTWEzOlrn3XNk8nz308hPnnMzSUfva-h-2r2SfPepLRgmCsrZYSgeA Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:03:12.401042 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_902ac9b38b6047649a7da0d7238011df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}] Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 88f461717faa455195e73e6c5920951b Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '-1'} Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:12.402896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.403987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:12.405407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-455bcc3f-0b0c-4763-a230-c2dabefb5789 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:12.407142 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-455bcc3f-0b0c-4763-a230-c2dabefb5789 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.218793 Oct 18 16:03:12.410365 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 317/619] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:03:12 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:03:12.426989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbcaa660-77f6-44ba-8363-b42dda22952e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd24d1c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:12.449010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:12.450287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:12.462047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:12.473855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:12.475136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:12.477205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:12.479412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:12.480956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.072146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:13.116343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf2adda3-22b9-4f12-af93-8923beabe7c5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 2054 microversion: 2.25 time: 1.067454 Oct 18 16:03:13.118580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 303/620] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:12 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 2054 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:13.142774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.144440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:13.153121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.155127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.155951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.157481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.158935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.159950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.387607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:13.396297 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d37d0ec-5241-43fb-ac07-e01618787488 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 0.263364 Oct 18 16:03:13.397506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 304/621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:13 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:13.402149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e628b42b-aaba-4deb-b0a1-d4d4487644de tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Calling method '.version_select at 0x7f5fd274f9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.542397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbcaa660-77f6-44ba-8363-b42dda22952e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 204 len: 0 microversion: 2.1 time: 1.130890 Oct 18 16:03:13.542980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 318/622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:12 2022] DELETE /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:03:13.547503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.548442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:13.557593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.558186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.558799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.560086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.560795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.561351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.561989 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e628b42b-aaba-4deb-b0a1-d4d4487644de tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] HTTP exception thrown: Image not found. Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e628b42b-aaba-4deb-b0a1-d4d4487644de tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Request method failure captured: Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/1993c51a-1f20-40fe-adb9-110be670a63j HTTP/1.1 Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs43N30JrRh-48Ke97BijGFFvKAmfRBeSvrWQ2Ozwtqcy-FET6A4OmRBAmennS2s2pu9Ns6qoo4M1bGcEZyaVoNlA8rNsLjDfYE580DJI4WJt9QhGjB4XsVK8nTWEzOlrn3XNk8nz308hPnnMzSUfva-h-2r2SfPepLRgmCsrZYSgeA Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:03:13.566431 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_902ac9b38b6047649a7da0d7238011df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}] Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 88f461717faa455195e73e6c5920951b Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '1993c51a-1f20-40fe-adb9-110be670a63j'} Oct 18 16:03:13.567815 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1993c51a-1f20-40fe-adb9-110be670a63j to delete Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:13.568726 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1993c51a-1f20-40fe-adb9-110be670a63j could not be found. Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:13.569959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e628b42b-aaba-4deb-b0a1-d4d4487644de tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:13.572959 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e628b42b-aaba-4deb-b0a1-d4d4487644de tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/1993c51a-1f20-40fe-adb9-110be670a63j" status: 404 len: 62 microversion: 2.1 time: 0.169259 Oct 18 16:03:13.574111 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 305/623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:13 2022] DELETE /compute/v2.1/images/1993c51a-1f20-40fe-adb9-110be670a63j => generated 62 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:03:13.581691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.582583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:13.606347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.608197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.609872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.611809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.613327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.615579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.822042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:13.831210 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e17f9e1c-74ee-45c8-b546-57ea11ba8cb9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.287010 Oct 18 16:03:13.832124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 319/624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:13 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:13.849809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.850748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:13.857642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.858388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.859008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.859900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.860534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.861168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.920142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:13.931484 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-289fe8fa-ffdf-4b94-a91f-6ee0231a7f0a tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.361129 Oct 18 16:03:13.932649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 306/625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:13 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:13.943196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:13.943855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:13.950681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.951540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.951975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:13.952674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:13.953146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:13.953792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.009705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:14.017380 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7918737-4044-489a-8287-96f5f720d956 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.184044 Oct 18 16:03:14.019446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 320/626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:13 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:14.024702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.024863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:14.031243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.031736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.032301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.033016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.033463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.033884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.098454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:14.106581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5320f3e2-2d00-4d07-b7c8-f4f87d0be618 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1272 microversion: 2.1 time: 0.086066 Oct 18 16:03:14.107146 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 321/627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:14 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:14.113317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5", "name": "network-vif-plugged", "status": "completed", "tag": "4c1297f6-db61-4459-a33f-8632816edf7d"}, {"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-plugged", "status": "completed", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:14.123903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.124575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.124777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.137806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Creating event network-vif-plugged:4c1297f6-db61-4459-a33f-8632816edf7d for instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 on n-h1-858383-14 Oct 18 16:03:14.138317 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] Creating event network-vif-plugged:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:03:14.145235 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2efad900-9e2e-4c0c-8c8d-f614c88b10dc req-378a24de-fd5b-4664-b778-260e0ef4acc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036903 Oct 18 16:03:14.145825 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 322/628] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:14.153189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.153777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:14.160384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.160895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.161857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.162057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.162506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.162928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.188816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:03:14.194750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:14.209884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c827756e-2a18-4e14-8a1f-e3b598d784d3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 2054 microversion: 2.25 time: 0.275290 Oct 18 16:03:14.210575 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 307/629] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:13 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 2054 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:14.225847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fb565f0-d215-4927-aeb1-cd215f5e929e tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Calling method '.version_select at 0x7f5fd2fa1160>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.261795 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5fb565f0-d215-4927-aeb1-cd215f5e929e tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] HTTP exception thrown: Image not found. Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fb565f0-d215-4927-aeb1-cd215f5e929e tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Request method failure captured: Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/6e988d0b-e929-474c-a1b3-4b02206ece541 HTTP/1.1 Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs43N30JrRh-48Ke97BijGFFvKAmfRBeSvrWQ2Ozwtqcy-FET6A4OmRBAmennS2s2pu9Ns6qoo4M1bGcEZyaVoNlA8rNsLjDfYE580DJI4WJt9QhGjB4XsVK8nTWEzOlrn3XNk8nz308hPnnMzSUfva-h-2r2SfPepLRgmCsrZYSgeA Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:03:14.263874 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_902ac9b38b6047649a7da0d7238011df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}] Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 88f461717faa455195e73e6c5920951b Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6e988d0b-e929-474c-a1b3-4b02206ece541'} Oct 18 16:03:14.265476 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6e988d0b-e929-474c-a1b3-4b02206ece541 to delete Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.266404 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e988d0b-e929-474c-a1b3-4b02206ece541 could not be found. Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:14.267622 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fb565f0-d215-4927-aeb1-cd215f5e929e tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:14.269575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fb565f0-d215-4927-aeb1-cd215f5e929e tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/6e988d0b-e929-474c-a1b3-4b02206ece541" status: 404 len: 62 microversion: 2.1 time: 0.054863 Oct 18 16:03:14.272106 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 308/630] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:03:14 2022] DELETE /compute/v2.1/images/6e988d0b-e929-474c-a1b3-4b02206ece541 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:03:14.272699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f83e7cd-4f18-4d1c-bda4-2980657a36da", "tag": "1e1cbb5c-6cde-4417-b545-112b71dc740c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:14.300806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.301331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.301792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.322785 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] Creating event network-changed:1e1cbb5c-6cde-4417-b545-112b71dc740c for instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da on n-h2-858383-14 Oct 18 16:03:14.327037 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0ba1fe1-5062-4c11-bce9-f0667c7b8f8e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 204 len: 0 microversion: 2.1 time: 0.177718 Oct 18 16:03:14.327959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 323/631] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:03:14 2022] DELETE /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:03:14.328096 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d562cb8d-2be1-4718-9a33-efe56d3ad4a6 req-3d728437-5dee-46ad-8e29-031400ba07b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059226 Oct 18 16:03:14.328345 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 309/632] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:14.336216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a792543e-cc70-494b-a149-6dbc238445a6 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Calling method '.version_select at 0x7f5fd274f8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.345616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.354877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.358930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.359501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.361225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.364577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.365565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.369336 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a792543e-cc70-494b-a149-6dbc238445a6 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] HTTP exception thrown: Image not found. Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a792543e-cc70-494b-a149-6dbc238445a6 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Request method failure captured: Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/tempest-invalid-1685672593 HTTP/1.1 Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs43N30JrRh-48Ke97BijGFFvKAmfRBeSvrWQ2Ozwtqcy-FET6A4OmRBAmennS2s2pu9Ns6qoo4M1bGcEZyaVoNlA8rNsLjDfYE580DJI4WJt9QhGjB4XsVK8nTWEzOlrn3XNk8nz308hPnnMzSUfva-h-2r2SfPepLRgmCsrZYSgeA Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:03:14.371292 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_902ac9b38b6047649a7da0d7238011df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}] Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 88f461717faa455195e73e6c5920951b Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'tempest-invalid-1685672593'} Oct 18 16:03:14.372770 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1685672593 to delete Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.373652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1685672593 could not be found. Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:14.374973 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a792543e-cc70-494b-a149-6dbc238445a6 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:14.376484 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a792543e-cc70-494b-a149-6dbc238445a6 tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/tempest-invalid-1685672593" status: 404 len: 62 microversion: 2.1 time: 0.044022 Oct 18 16:03:14.377646 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 310/633] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:03:14 2022] DELETE /compute/v2.1/images/tempest-invalid-1685672593 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:03:14.385356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5989243-2501-4b09-84b2-4ea2cb9a7f6c tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Calling method '.version_select at 0x7f5fd274f9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.399404 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dd4663d-9022-4a43-b62f-a20d0b0c93b5 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.064490 Oct 18 16:03:14.400337 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 324/634] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 18 16:03:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:03:14.426994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-14", "block_migration": "auto"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:14.430309 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f5989243-2501-4b09-84b2-4ea2cb9a7f6c tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] HTTP exception thrown: Image not found. Oct 18 16:03:14.430838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5989243-2501-4b09-84b2-4ea2cb9a7f6c tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Request method failure captured: Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/de9723e5-244c-40bc-a0f0-5eb9183b5e49 HTTP/1.1 Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs43N30JrRh-48Ke97BijGFFvKAmfRBeSvrWQ2Ozwtqcy-FET6A4OmRBAmennS2s2pu9Ns6qoo4M1bGcEZyaVoNlA8rNsLjDfYE580DJI4WJt9QhGjB4XsVK8nTWEzOlrn3XNk8nz308hPnnMzSUfva-h-2r2SfPepLRgmCsrZYSgeA Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:03:14.432333 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_902ac9b38b6047649a7da0d7238011df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/902ac9b38b6047649a7da0d7238011df"}]}] Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 902ac9b38b6047649a7da0d7238011df Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122 Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 88f461717faa455195e73e6c5920951b Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1710958122-project Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'de9723e5-244c-40bc-a0f0-5eb9183b5e49'} Oct 18 16:03:14.433869 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image de9723e5-244c-40bc-a0f0-5eb9183b5e49 to delete Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.434823 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image de9723e5-244c-40bc-a0f0-5eb9183b5e49 could not be found. Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:14.436366 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5989243-2501-4b09-84b2-4ea2cb9a7f6c tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:14.439057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5989243-2501-4b09-84b2-4ea2cb9a7f6c tempest-ImagesDeleteNegativeTestJSON-1710958122 tempest-ImagesDeleteNegativeTestJSON-1710958122-project] 10.222.0.78 "DELETE /compute/v2.1/images/de9723e5-244c-40bc-a0f0-5eb9183b5e49" status: 404 len: 62 microversion: 2.1 time: 0.052722 Oct 18 16:03:14.440215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 311/635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:14 2022] DELETE /compute/v2.1/images/de9723e5-244c-40bc-a0f0-5eb9183b5e49 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:03:14.443329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.443920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.444474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.445321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.445882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.446404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.455356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:14.459418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:14.483326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'flavor' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:14.486181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.488647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.490774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.491705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:14.492552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:14.503034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Going to try to live migrate instance to n-h2-858383-14 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:03:14.503547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:14.808157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:14.824141 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee54231f-fd7a-4ca5-bb7d-512ba456c3ca tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1319 microversion: 2.1 time: 0.384941 Oct 18 16:03:14.837924 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 312/636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:14 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:14.852069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1590955069", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:14.963974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:15.513901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:15.514510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:15.514918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:15.515365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:15.516028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:15.526168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.526586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.527022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:15.527759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.528543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.529364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:15.547495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:15.553350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:15.574340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:15.576870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:15.628491 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7da38a76-66cc-490c-9f40-0984bf9be8e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787260 Oct 18 16:03:15.629346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 313/637] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:03:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:15.633901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:15.634588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:15.640974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.641549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.642139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:15.642943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.643566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.644583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:15.666834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:15.797701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:15.806969 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-633359d1-b2ae-4864-a31f-f3ca08dc5e63 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.176580 Oct 18 16:03:15.807536 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 314/638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:15 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:15.817301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:15.818069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:15.825543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.826449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.827079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:15.828799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:15.829554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:15.829980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.078998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:16.090353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c398f8b-4d39-42fb-a5cd-5ac8c578d1ad tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1388 microversion: 2.1 time: 0.280836 Oct 18 16:03:16.103665 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 315/639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:15 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:16.120725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:16.121837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:16.131019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.133178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.133830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.135115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.135780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.136507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.536776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:16.544311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19b69529-d6a2-4b97-b279-9999906cbf40 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.439351 Oct 18 16:03:16.544881 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 316/640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:16 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:16.566458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:16.567116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:16.572850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.573364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.573800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.574494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.574939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.575359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.812256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:16.820194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8accad2-a348-4394-b8a1-2ae1fefb7c5b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.261485 Oct 18 16:03:16.820758 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 317/641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:16 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:16.826877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:16.827479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:16.847035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.847680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.848200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.848909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.849397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.849818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.940034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:16.949189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-661b1295-2401-49ed-8ef0-d8f278e00a5e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1212 microversion: 2.1 time: 0.127350 Oct 18 16:03:16.949905 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 318/642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:16 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:16.965284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:16.966041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:16.972491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.972974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.973427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:16.974115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:16.974563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:16.975163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:17.173562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:17.181626 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0d49e17-9338-4ff5-ad4d-a6044b94a986 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1469 microversion: 2.1 time: 0.230869 Oct 18 16:03:17.182201 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 319/643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:16 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:17.186520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f83e7cd-4f18-4d1c-bda4-2980657a36da", "name": "network-vif-plugged", "status": "completed", "tag": "1e1cbb5c-6cde-4417-b545-112b71dc740c"}, {"server_uuid": "e6e562de-78e7-432d-ba83-ad3976ee3f59", "name": "network-vif-unplugged", "status": "completed", "tag": "3725126f-b6be-4f30-a4db-75ea69648195"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:17.196977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:17.197485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:17.197913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:17.211451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Creating event network-vif-plugged:1e1cbb5c-6cde-4417-b545-112b71dc740c for instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da on n-h2-858383-14 Oct 18 16:03:17.211979 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] Creating event network-vif-unplugged:3725126f-b6be-4f30-a4db-75ea69648195 for instance e6e562de-78e7-432d-ba83-ad3976ee3f59 on n-h2-858383-14 Oct 18 16:03:17.218844 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6cf7e27a-c415-41c2-83b4-9d07602de8e8 req-b525305f-213c-42de-9270-7631b1801a32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035549 Oct 18 16:03:17.219443 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 320/644] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:17.336175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1127583017", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:17.389151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:17.724687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:17.725382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:17.725625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:17.726027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:17.726436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:17.735385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:17.736156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:17.736293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:17.737020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:17.737587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:17.738027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:17.749853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:17.759058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Getting quotas for project fd26b2e375084d72a31f6e39b420da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:17.766164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Getting quotas for user 7f02637b1935426280f2ad6bcfa61b26 and project fd26b2e375084d72a31f6e39b420da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:17.811886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:17.820144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:17.875148 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94734223-6846-4f22-be11-214f90a7daf4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654529 Oct 18 16:03:17.876400 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 321/645] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:17.883418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:17.884474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:17.890866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:17.891348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:17.891777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:17.892459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:17.892907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:17.894308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.273658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:18.284142 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b28b0650-eacf-41fa-9b5e-7e0d6454b9f0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.406426 Oct 18 16:03:18.297056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 322/646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:17 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:18.300207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046845e7-8b97-4ca6-838b-e2f73534cc63", "tag": "95241f9a-e22e-4994-a98d-d571cb69616e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:18.314964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.316073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.316580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.334330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] Creating event network-changed:95241f9a-e22e-4994-a98d-d571cb69616e for instance 046845e7-8b97-4ca6-838b-e2f73534cc63 on n-h1-858383-14 Oct 18 16:03:18.339842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-dfc7b458-3a69-4bdc-aeb6-25ef939f30fc req-c003e218-7470-40f2-89b8-01353198d35b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049128 Oct 18 16:03:18.340449 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 323/647] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:18.349358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:18.350088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:18.356972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.357573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.358016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.358718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.359172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.359778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.508537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:18.516953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-04eae92b-47d2-4414-8ec5-f5914198fed5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1587 microversion: 2.1 time: 0.172596 Oct 18 16:03:18.517648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 324/648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:18 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1587 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:18.522966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:18.523579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:18.530783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.531351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.531858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.532642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.533227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.533722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.557126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lazy-loading 'flavor' on Instance uuid 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:18.665852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26ca39e5-ae9f-4757-877b-fbdfd2ded05f tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5/action" status: 202 len: 0 microversion: 2.1 time: 0.146924 Oct 18 16:03:18.669611 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 325/649] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:18 2022] POST /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:03:18.675893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:18.676550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:18.685216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.685704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.686139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.686835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.687283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.687704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.881533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:18.889953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e26004e-81da-4fa8-8761-6fbb1f8a6c98 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.218999 Oct 18 16:03:18.890520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 326/650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:18 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:18.895134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:18.895741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:18.901895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.902395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.902832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:18.903516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:18.904167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:18.904577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.033376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:19.041573 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af0c0750-2218-44b4-a33d-42a6e4e46de7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.150115 Oct 18 16:03:19.042126 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 327/651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:18 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:19.046356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.046952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.053177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.053653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.054082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.054757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.055207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.055624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.117669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:19.125110 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65bf522a-6f92-459a-8d2d-77413eb84529 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1213 microversion: 2.1 time: 0.082035 Oct 18 16:03:19.125664 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 328/652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:19.129979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.130645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.135997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.136462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.136887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.137578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.138019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.138434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.201639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:19.209365 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73948a74-c255-41f5-8e7b-8274fc208d03 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1260 microversion: 2.1 time: 0.082743 Oct 18 16:03:19.209919 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 329/653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:19.214295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.214772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.220222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.220692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.221154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.222438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.222962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.223380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.330588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1196ad1-a28f-46a9-a8cd-023d82a1fc04 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119609 Oct 18 16:03:19.331215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 330/654] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:19.335813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.336410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.342299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.342765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.343188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.343873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.344319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.344733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.477605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:19.481369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:19.486537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a57c806-3b66-4aac-91be-f32b5d4bab8a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1477 microversion: 2.1 time: 0.154370 Oct 18 16:03:19.487152 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 331/655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:19.491727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e562de-78e7-432d-ba83-ad3976ee3f59", "name": "network-vif-deleted", "tag": "3725126f-b6be-4f30-a4db-75ea69648195"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:19.502147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.502624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.503093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.515359 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] Creating event network-vif-deleted:3725126f-b6be-4f30-a4db-75ea69648195 for instance e6e562de-78e7-432d-ba83-ad3976ee3f59 on n-h2-858383-14 Oct 18 16:03:19.520794 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-27f41887-d2e6-4ba4-8904-d9fcb21fe426 req-2a9eb6e6-2677-4ece-91b4-ce3fc9c0428d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032543 Oct 18 16:03:19.521437 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 332/656] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:19.526458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.527151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.533351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.533831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.534965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.535734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.536187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.536609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.672736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:19.697585 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd9047d6-4c70-4b5a-b11b-7139471a095a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1311 microversion: 2.1 time: 0.174888 Oct 18 16:03:19.698177 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 333/657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:19.913439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:19.914072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:19.920171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.920585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.921041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:19.921736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:19.922189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:19.922611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.056833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.065939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e60e828d-fe21-4670-9c1e-cf170bd536b9 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.155789 Oct 18 16:03:20.066540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 334/658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:19 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:20.071561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.072174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:20.078467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.078958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.079389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.080095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.080542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.081622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.219939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.230708 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b10a6a47-1e7b-4263-be78-6f9052eeacbb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.162856 Oct 18 16:03:20.231399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 335/659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:20.235966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.236606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:20.242667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.243162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.243599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.244378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.244830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.245451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.311030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.318694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-80d41f16-68d2-4a21-8902-00fa127dc46e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1213 microversion: 2.1 time: 0.086375 Oct 18 16:03:20.319262 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 336/660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:20.323835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.325109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:20.334180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.335053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.335703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.337032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.337777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.338369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.422474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.430551 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f87abef-1766-4cd3-8d8e-6808d3efe464 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1260 microversion: 2.1 time: 0.110313 Oct 18 16:03:20.431125 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 337/661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1260 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:20.510386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.511151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:20.517355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.517972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.519291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.519932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.520482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.521096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.732599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.742037 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd29795f-a1f2-4490-891e-36d931118446 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1477 microversion: 2.1 time: 0.235750 Oct 18 16:03:20.745362 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 338/662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:20.750722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.751333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:20.758044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.758519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.759184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.759877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:20.760327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:20.760800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:20.979066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:20.987803 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b20968e-a0fe-4d6b-924b-e1a2199f96a9 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1587 microversion: 2.1 time: 0.241003 Oct 18 16:03:20.995637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 339/663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1587 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:20.995637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:20.995637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.010352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.010902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.011281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.012087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.012552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.012983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.158581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:21.168383 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99d0c6db-ba45-4452-926d-59de3f5ae30d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1494 microversion: 2.1 time: 0.178941 Oct 18 16:03:21.169485 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 340/664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:20 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:21.174515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:21.175549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.182646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.183136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.183568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.184262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.184715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.185251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.327760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:21.335977 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1ec62436-b208-485c-9080-fee03c7a74dd tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.165329 Oct 18 16:03:21.336750 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 341/665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:21 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:21.453348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:21.454177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.460843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.461412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.461845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.462528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.462977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.463397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.593205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-354abe4b-eb6c-4b4d-9321-6c71822b894e tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1647 microversion: 2.1 time: 0.255520 Oct 18 16:03:21.593779 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 342/666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:21 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1647 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:21.598633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:21.599251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.605622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.606115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.606563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.607262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.607717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.608155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.779885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:21.794728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-655c6901-c5c4-4e13-b2b3-cfd9377891ba tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.199663 Oct 18 16:03:21.795587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 343/667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:21 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:21.805368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:21.806274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.812496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.812977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.813615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.814471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.815114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.816302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.883175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:21.891339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e8620cd-52e1-4ec2-a7e0-f58ab3e2739b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1213 microversion: 2.1 time: 0.094507 Oct 18 16:03:21.891917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 344/668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:21 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:21.905150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:21.905150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:21.908771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.909439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.909887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:21.910577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:21.911034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:21.911464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:22.090038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:22.104009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc1edf4d-7e6f-47eb-a60e-283999a5cfa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1268 microversion: 2.1 time: 0.206467 Oct 18 16:03:22.108415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 345/669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:21 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:22.118652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9268ea0-c252-48aa-bd94-a3f4dac281cf", "tag": "ee1ea766-2f0d-42a0-b790-a492f22d879b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:22.149695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:22.150226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:22.150841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:22.175067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] Creating event network-changed:ee1ea766-2f0d-42a0-b790-a492f22d879b for instance b9268ea0-c252-48aa-bd94-a3f4dac281cf on n-h2-858383-14 Oct 18 16:03:22.176489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:22.186428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a82ce059-2e6a-4b2d-8684-01ea5bd02a31 req-c10305a7-bd17-448e-a8a8-1f97ca2618f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076663 Oct 18 16:03:22.187251 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 346/670] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:22.198766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:22.199480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:22.215431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:22.216205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:22.216340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:22.217136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:22.217720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:22.218199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:22.509785 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9baa0457-cdd5-412a-b71c-1e934b8ecb45 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1647 microversion: 2.1 time: 0.316720 Oct 18 16:03:22.525026 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 347/671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:22 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1647 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:22.525026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:22.525026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:22.527960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:22.528459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:22.531747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:22.531747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:22.531747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:22.532253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.203438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:23.215412 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ef9457f-8a20-429a-a9ab-0fb6c16b8016 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1460 microversion: 2.1 time: 0.702479 Oct 18 16:03:23.216569 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 348/672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:22 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1460 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:23.223500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:23.224356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:23.231154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.232445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.233589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.234317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.237557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.238317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.465492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:23.474714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:23.482788 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d1adbe1-c1bd-412c-bcce-d93cb8f865ca tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.264606 Oct 18 16:03:23.485012 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 349/673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:23 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:23.495953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:23.502442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.505892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.506053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.506939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.507187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.507613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.560532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa9bb6f0-3bdc-4e0e-8083-6541bdd0dd3d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.073549 Oct 18 16:03:23.568468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 350/674] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:03:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:23.569644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:23.570980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:23.578812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.580440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.580440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.582068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.582689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.583230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.662276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13690f10-fef6-4bf5-a042-ae242376bede tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9/action" status: 202 len: 0 microversion: 2.25 time: 9.247561 Oct 18 16:03:23.666518 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 325/675] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:03:14 2022] POST /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9/action => generated 0 bytes in 9254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:03:23.667886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:23.668500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:23.676362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.676861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.677317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.678024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.678476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.678903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.762680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:23.775665 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-43048405-34f5-4481-91c6-240eeef6e6dc tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1269 microversion: 2.1 time: 0.110785 Oct 18 16:03:23.776555 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 326/676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:23 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:23.793631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:23.794642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:23.803781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.804279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.805257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:23.805970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:23.806990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:23.807429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.025507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:24.034208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3151726d-aedc-4d55-9ff9-b508e49c3a01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.471317 Oct 18 16:03:24.034867 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 351/677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:23 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:24.039670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:24.040287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:24.046534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.047022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.047623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.048593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.049956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.050553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.067796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:24.089810 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c988fda-39a1-41bd-aa2e-38014b6b3526 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.302989 Oct 18 16:03:24.093706 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 327/678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:23 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:24.100426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:24.111340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:24.118510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.118995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.119436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.120136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.120586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.121097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.150168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lazy-loading 'flavor' on Instance uuid 1f83e7cd-4f18-4d1c-bda4-2980657a36da {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:24.164139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Going to try to live migrate instance to n-h1-858383-14 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:03:24.229077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:24.374093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:24.922193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cbc0f8bb-6246-4988-973e-e6ff2c525045 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1613 microversion: 2.1 time: 0.885973 Oct 18 16:03:24.923668 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 352/679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:24 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1613 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:24.947465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:24.948077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:24.964173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.965933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.966400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:24.970160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:24.970867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:24.971421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.297773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:25.307563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:25.309297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:25.310689 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c71d64b6-9a50-4314-a4b0-c64d4e17cbc0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.385808 Oct 18 16:03:25.311477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 353/680] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:24 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:25.316151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b03235a-5a55-4712-b3c5-0342b327d167", "tag": "1d1530b5-0549-4d3c-a032-50fd5b83bd41"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:25.327420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.328027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.328494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.345282 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] Creating event network-changed:1d1530b5-0549-4d3c-a032-50fd5b83bd41 for instance 2b03235a-5a55-4712-b3c5-0342b327d167 on n-h2-858383-14 Oct 18 16:03:25.351823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7b5ebc64-a962-403a-9eec-1cfd2ae4db81 req-d9cfd232-af6a-493a-a374-c8848f741d6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038826 Oct 18 16:03:25.352520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 354/681] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:25.358738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:25.359335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:25.366426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.366831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.367380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.368108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.368550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.369258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.612737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:25.631963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eff8e7fa-bba6-43a0-8f7d-a6747e91e9f0 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.277949 Oct 18 16:03:25.647635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 355/682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:25 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:25.660438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046845e7-8b97-4ca6-838b-e2f73534cc63", "name": "network-vif-plugged", "status": "completed", "tag": "95241f9a-e22e-4994-a98d-d571cb69616e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:25.670931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.671418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.671882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.683558 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] Creating event network-vif-plugged:95241f9a-e22e-4994-a98d-d571cb69616e for instance 046845e7-8b97-4ca6-838b-e2f73534cc63 on n-h1-858383-14 Oct 18 16:03:25.689882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-edfa448c-60ff-4d7b-92f4-360ac7661aa4 req-f52b148b-93b5-4b50-a302-51fe9947b211 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040542 Oct 18 16:03:25.691279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 356/683] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:25.696589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:25.697319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:25.703945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.704437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.704878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.706157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.706624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.707055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.923043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:25.944915 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9b7a453-7244-4fe1-9da6-9b3a3a5e7546 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.252246 Oct 18 16:03:25.945635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 357/684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:25 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:25.954727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:25.962364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.962994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.963640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.964497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:25.964959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:25.965656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:25.990223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc24e890-046a-4a3d-ae40-b82dda31c13d tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039191 Oct 18 16:03:25.990878 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 358/685] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:03:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:25.996864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:25.997715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.004492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.004975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.005435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.006154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.006607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.007024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.071163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7552ffc3-6f67-466d-8ca5-c4c734fd3359 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da/action" status: 202 len: 0 microversion: 2.1 time: 1.975924 Oct 18 16:03:26.071843 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 328/686] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:24 2022] POST /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da/action => generated 0 bytes in 1977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:03:26.076427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.077725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.086835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.087557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.088065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.088891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.089438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.089924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.148474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.157305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-739ada0a-e644-49f1-9780-da17c6dbb90d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.165214 Oct 18 16:03:26.172832 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 359/687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:25 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:26.178471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:26.181142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.187738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.188219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.188644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.189582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.190749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.191327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.241747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.249518 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56c7ba72-d390-478a-9746-65e7bbbd3292 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.176768 Oct 18 16:03:26.250166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 329/688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:26.255342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.256172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.262110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.262661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.263157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.263908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.264428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.265126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.272893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Lazy-loading 'flavor' on Instance uuid 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:26.286000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 while it is in vm_state suspended Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Request method failure captured: Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5/action HTTP/1.1 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 98 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4EG9ZsRoYYj459JkNd8oprDbNqqE6Gezuo6x6h8H3zf-hyywBDy3W44re313DD8TV7h_l0TAn8UsnAhGOnBRQ0F_iamCwQSx5iLMhhF3_UXLkE1dOuWIkedP8OsjULRaymms5B_LTCW7nkjNr2sJxu_5YNh9x44bT7iAMUirPa34s Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1b35ef71883643ecb60ab2adaf04d643 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:03:26.288070 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b35ef71883643ecb60ab2adaf04d643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b35ef71883643ecb60ab2adaf04d643"}]}] Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1b35ef71883643ecb60ab2adaf04d643 Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2029665077 Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-LiveMigrationNegativeTest-2029665077-project-admin Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c0fd25fdf6154d42a06be866e4d47712 Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-LiveMigrationNegativeTest-2029665077-project-admin Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: {"os-migrateLive": {"host": "n-h2-858383-14", "block_migration": true, "disk_over_commit": false}} Oct 18 16:03:26.289552 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'os-migrateLive' instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 while it is in vm_state suspended Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5', 'body': {'os-migrateLive': {'host': 'n-h2-858383-14', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 16:03:26.290275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:03:26.291328 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 while it is in vm_state suspended Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 while it is in vm_state suspended Oct 18 16:03:26.292487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:03:26.293519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 while it is in vm_state suspended {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:26.293519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3862db66-52dc-49ed-8f63-be4aec75dd93 tempest-LiveMigrationNegativeTest-2029665077 tempest-LiveMigrationNegativeTest-2029665077-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5/action" status: 409 len: 155 microversion: 2.1 time: 0.115298 Oct 18 16:03:26.293519 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 360/689] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:26 2022] POST /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5/action => generated 155 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:03:26.300106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.300605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.306535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.307023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.307462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.308157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.308609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.309051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.334665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:03:26.399201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.405992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:26.407393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3aa089e-d8a9-4b5e-ad22-67bf189c935b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.156101 Oct 18 16:03:26.408332 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 330/690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:26.412453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4d3fd3c-ef5f-4cf8-9788-aa921373c158 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 204 len: 0 microversion: 2.1 time: 0.116471 Oct 18 16:03:26.415921 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 361/691] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:03:26 2022] DELETE /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:03:26.416049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.416049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.420119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.420599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.421114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.421501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.422200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.422438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.423023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.423451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.429209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.429695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.430130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.430824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.431273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.431697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.557338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.565652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.565949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.567504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.568684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69d2f520-195f-4994-a0c0-cb317841763b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.159415 Oct 18 16:03:26.569279 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 331/692] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:26.574920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-523c1c82-aa68-4ab8-864f-5d4b5de45db1 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1466 microversion: 2.1 time: 0.157703 Oct 18 16:03:26.575470 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 362/693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:26.661121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.661648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.668136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.668619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.669085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.669774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.670230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.670656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.800349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:26.808059 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76514737-7274-4de8-8457-d1bbda3062af tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.151383 Oct 18 16:03:26.808629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 332/694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:26.969614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:26.970231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:26.977333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.977825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.978262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:26.978941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:26.979395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:26.979817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.113013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:27.120537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10b37aee-d60d-4217-a105-ff2c1f73ba77 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.154746 Oct 18 16:03:27.121109 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 363/695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:26 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:27.179761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:27.180370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:27.186830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.187249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.187683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.188371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.188823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.189339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.273551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:27.274164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:27.280128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.280610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.281078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.281774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.282230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.282655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.318301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:27.327523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bd70eb4-e4ac-465c-82e6-aa019c74f728 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.151518 Oct 18 16:03:27.328453 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 333/696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:27.371695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "name": "network-vif-unplugged", "status": "completed", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}, {"name": "network-changed", "server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:27.382577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.383057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.383634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.405134 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Creating event network-vif-unplugged:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h1-858383-14 Oct 18 16:03:27.405741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] Creating event network-changed:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h1-858383-14 Oct 18 16:03:27.412032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6a22bfe4-5c91-4c82-9655-9898202f43a8 req-a4423c34-2513-41d9-a12e-6e2b4f30281a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044177 Oct 18 16:03:27.412633 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 334/697] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:27.431787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:27.432486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:27.441157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.442763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.443402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.444527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.445040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.446191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.503609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:27.512079 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72cec48e-8b4b-47e0-a3c2-52cab587e9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.242303 Oct 18 16:03:27.517460 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 364/698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:27.594213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:27.594823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:27.601761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.602511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.602946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.603646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.604100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.604521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.680536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:27.688655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6f04ebf-c99f-4ee5-a96b-aad790094584 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.260986 Oct 18 16:03:27.700650 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 335/699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:27.709288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:27.710066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:27.716561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.717257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.717789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.719253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.719825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.720359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.796103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:27.946944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:27.957072 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fd12a2e-fbf3-490b-94d6-eb0319960c6c tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1466 microversion: 2.1 time: 0.251501 Oct 18 16:03:27.957433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 336/700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1466 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:27.963105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac0edf-2592-4b08-bda0-7adb4880eb04", "name": "network-vif-plugged", "status": "completed", "tag": "149d8412-e966-4d73-af37-9b73ecb6c9cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:27.974452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:27.975255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:27.975852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:27.987549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] Creating event network-vif-plugged:149d8412-e966-4d73-af37-9b73ecb6c9cf for instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 on n-h2-858383-14 Oct 18 16:03:27.992631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b7117988-9b9c-4963-ba8a-5b9b6d45b2b9 req-f905d03f-f4a0-4093-b47f-498cf8fcf853 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Oct 18 16:03:27.997534 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 337/701] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:28.003184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.003896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.010351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.010844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.011441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.012369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.012829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.013283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.056755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.075477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.076953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.078264 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b3a96f1-0e3c-4abc-baa4-d2dd5bf15f01 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.487894 Oct 18 16:03:28.078830 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 365/702] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:03:28.143688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.144355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.151652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.152139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.152568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.153298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.153930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.154350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.412734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.421023 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8dae6375-ecdc-45fc-9a91-36c47ebce26c tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.422214 Oct 18 16:03:28.422088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 338/703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:27 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:28.427222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.428015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.433389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.434649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.435296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.435996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.436950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.437599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.438109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.444589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b555d2a1-04c9-40a2-a70a-c0ad0b53eb54 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.305203 Oct 18 16:03:28.445523 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 366/704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:28 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:28.535111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.535820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.544871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.545708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.546378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.547293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.548083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.548736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.581510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:28.581797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.591351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4fb7b09-b9b0-4bea-8597-1b4d73837d94 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1314 microversion: 2.1 time: 0.168082 Oct 18 16:03:28.592202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 339/705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:28 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:28.602826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:28.613862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.614473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.614966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.626317 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] Creating event network-changed:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:03:28.633134 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-651b0756-2923-4334-a35d-ab39b9bb898c req-91a8743b-2f8e-4a2e-920c-bd50e0545efe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038880 Oct 18 16:03:28.634431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 340/706] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:28.714460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.715147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.721379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.721956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.722393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.723114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.723564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.724107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.729973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.739106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-055c44f5-34af-4cfa-b5d9-42ecc6215e31 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.207754 Oct 18 16:03:28.740008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 367/707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:28 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:28.868905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:28.877344 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8cf86734-5120-435d-ade5-ff165731a3ba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.166917 Oct 18 16:03:28.877940 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 341/708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:28 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:28.979722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:28.980592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:28.987400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.987882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.988346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:28.989061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:28.989515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:28.989930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.107357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.108156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.115897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.116597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.117179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.118033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.118601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.119161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.159504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.167217 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-560a9b0b-2d81-4fd9-afc1-35de21a3cedd tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1466 microversion: 2.1 time: 0.191326 Oct 18 16:03:29.167788 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 368/709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:28 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:29.249622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.257754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.259182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.260405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c9c9c3a-c912-47b6-b95a-1602f5767d12 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.158803 Oct 18 16:03:29.260878 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 342/710] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:29.443817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.444577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.451487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.451487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.451705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.452269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.452867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.453209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.467327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.468116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.475292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.475789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.476229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.476943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.477424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.477852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.619599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.628019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56357d94-255a-444b-b941-82d37865e719 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.164047 Oct 18 16:03:29.628597 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 343/711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:29.633382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.633993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.639901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.640390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.640830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.641550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.642013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.642517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.782451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.790310 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98c499e9-2eed-4d9e-a125-aac0b57e4b87 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1463 microversion: 2.1 time: 0.160444 Oct 18 16:03:29.790884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 344/712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:29.795376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.795971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.801898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.802372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.802799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.803478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.803921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.804338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.900531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.908734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e06fd86a-df60-443c-a8bb-a2ec24efe9a2 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1372 microversion: 2.1 time: 0.468846 Oct 18 16:03:29.921016 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 369/713] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1372 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:29.921016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.921016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.923090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.924857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.925566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.926501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.927309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.927827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.946460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:29.954842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b5d0aa6-ec21-4080-990e-dec66dd5ba75 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.162983 Oct 18 16:03:29.955587 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 345/714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:29.960381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:29.961263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:29.968918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.970453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.971485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:29.972293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:29.972818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:29.973380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.122528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.131455 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cad4cd42-d4fb-4ee2-9502-a9d9e7b5183d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.174634 Oct 18 16:03:30.132048 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 346/715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:30.191864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:30.192478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:30.198917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.199400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.199902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.200621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.201115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.201543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.206673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:30.339694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.348818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab674a82-2035-49d7-a2a3-635700e7d164 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1466 microversion: 2.1 time: 0.162401 Oct 18 16:03:30.349412 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 347/716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:30 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:30.363172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:30.364193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:30.370423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.370969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.371400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.372387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.373196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.373715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.406389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.416172 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dae0a3cb-622c-4255-a374-5b4f87c9d8a8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1461 microversion: 2.1 time: 0.505435 Oct 18 16:03:30.417607 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 370/717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:29 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1461 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:30.532248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.541582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.543154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.544453 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-efc89778-8942-45d2-accd-bcc639858259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.186082 Oct 18 16:03:30.545456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 348/718] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:30 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:30.600804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-822060071", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:30.651091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:30.651704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:30.656796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:30.658461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.660115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.660115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.660966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.661515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.662015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.796795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:30.813903 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a81c419-b08c-4b55-a59b-0c420c92ccfe tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.159901 Oct 18 16:03:30.814752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 349/719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:30 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:30.935066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:30.936685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:30.945278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:30.947832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.948333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.948773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:30.949691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:30.950167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:30.950590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.104046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:31.115342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee508864-2da8-46dc-b716-3c9c0b046745 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1557 microversion: 2.1 time: 0.184424 Oct 18 16:03:31.115932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 350/720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:30 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:31.125524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:31.126546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:31.134797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.135476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.136283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.137300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.139061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.139061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.285613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:31.293222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cdc82d6c-d3ab-4823-99bb-2235f8ba4c40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.176098 Oct 18 16:03:31.293831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 351/721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:31 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:31.298238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b03235a-5a55-4712-b3c5-0342b327d167", "name": "network-vif-plugged", "status": "completed", "tag": "1d1530b5-0549-4d3c-a032-50fd5b83bd41"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:31.309312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.309788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.310215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.322541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] Creating event network-vif-plugged:1d1530b5-0549-4d3c-a032-50fd5b83bd41 for instance 2b03235a-5a55-4712-b3c5-0342b327d167 on n-h2-858383-14 Oct 18 16:03:31.327371 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7a193309-a88a-445f-bf67-a046524eae11 req-2b620cf4-9b75-40dd-8f53-65d108950c40 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Oct 18 16:03:31.327996 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 352/722] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:31.334445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:31.335021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:31.340970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.341486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.341920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.342613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.343062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.343486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.427201 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd5cc9df-961c-4a3a-9551-f0843ee5267a tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097949 Oct 18 16:03:31.427844 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 353/723] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:03:31 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:31.436657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:31.440755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:31.451186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.451773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.452174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.452901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.453431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.453848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.788021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:31.798735 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d327e1dd-9da4-4984-a286-37655a48b0c9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.369788 Oct 18 16:03:31.799960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 354/724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:31 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:31.806112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:31.806926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:31.813661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.815662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.816311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.817255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.817876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.818466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.819547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:31.820011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:31.820445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:31.839636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:31.840169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:31.875203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.875698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.876130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.876878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.881794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.884114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.907288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:31.913768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Getting quotas for user e43668b02a784329b9c73993ed6a927e and project 6331acc801404531ad94b7ee7664bebe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:31.933241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:31.936746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:31.939351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:31.946454 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-649adc44-acc8-44f1-8a73-e4b8b1135a8d tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1424 microversion: 2.1 time: 0.144482 Oct 18 16:03:31.955526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 355/725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:31 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:31.971670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:31.972675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:31.983201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.983807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.984302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.995660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:31.996453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:31.997125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:31.997420 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1edfd986-31fd-46ca-9e87-2971ffbfb583 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400875 Oct 18 16:03:31.998602 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 371/726] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:32.003332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5", "name": "network-vif-deleted", "tag": "4c1297f6-db61-4459-a33f-8632816edf7d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:32.019614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.020528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.021338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.038268 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] Creating event network-vif-deleted:4c1297f6-db61-4459-a33f-8632816edf7d for instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 on n-h1-858383-14 Oct 18 16:03:32.044726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-28a46b95-d34d-437a-8610-937be86c21ad req-b4e047a4-311a-42fa-9269-dfdbc8f2301f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044139 Oct 18 16:03:32.045943 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 372/727] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:32.055389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.056436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.065787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.066965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.067645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.069147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.069887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.070571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.363075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.375261 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9fb2e7e-44f7-4767-96e5-b8412d451a94 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.327397 Oct 18 16:03:32.375687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.379468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 373/728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:32 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:32.384167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e42749ca-d727-4ada-a22a-b2439e65d893 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.384769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e42749ca-d727-4ada-a22a-b2439e65d893 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.392973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.398432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.403029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3784b188-d37e-4515-a365-757630a10642 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.444948 Oct 18 16:03:32.406407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 356/729] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:31 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:32.421331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.421994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.437487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.437986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.438575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.439344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.441065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.442081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.493172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e42749ca-d727-4ada-a22a-b2439e65d893 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.500098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e42749ca-d727-4ada-a22a-b2439e65d893 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1213 microversion: 2.1 time: 0.119494 Oct 18 16:03:32.501980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 374/730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:32 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:32.669429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:32.679027 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8751e379-5240-47b7-bcc2-ff2d325ef55a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.270844 Oct 18 16:03:32.680176 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 357/731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:32 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:32.830067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.831543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.841777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.842420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.842950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.844143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.845214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.847895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.976461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.977367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.991694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.993850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.994617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.995586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.996577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.998432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.066281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.066786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.067279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.067739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lazy-loading 'fault' on Instance uuid 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:33.074432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.086590 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a091b49e-15f0-4a58-8e0c-c30bcc235b2b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.263791 Oct 18 16:03:33.103876 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 375/732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:32 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:33.111432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac0edf-2592-4b08-bda0-7adb4880eb04", "tag": "149d8412-e966-4d73-af37-9b73ecb6c9cf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:33.117929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.126006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd0adbce-a240-491d-ba75-8b70a06ded25 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 200 len: 1309 microversion: 2.1 time: 0.155721 Oct 18 16:03:33.126606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.127218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.128120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.141641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 358/733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:32 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:33.142136 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] Creating event network-changed:149d8412-e966-4d73-af37-9b73ecb6c9cf for instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 on n-h2-858383-14 Oct 18 16:03:33.148574 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f7d72849-047f-4727-ae14-bb13067b58ce req-aaee5064-1ee4-4acd-a262-a8e8e899eda8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043323 Oct 18 16:03:33.149387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 376/734] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:33.403871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:33.404488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:33.411192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.411678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.412113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.412808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.413287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.413712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.434292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:33.434986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:33.441904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.442460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.442827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.443527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.443979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.444400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.555513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.565539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c4a7049-6dc9-4c58-b9fa-580ba82a6944 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.164895 Oct 18 16:03:33.566592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 359/735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:33 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:33.572223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:33.573831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:33.586623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.587677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.588358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.589095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.589584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.590316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.597881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.606686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.608403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.609762 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-959272ae-7a86-403e-82ba-14e219860b49 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.179881 Oct 18 16:03:33.621786 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 377/736] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:33 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:33.670933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.679986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c77ca5c1-80c8-4c45-989b-81fa8d0387bc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1265 microversion: 2.1 time: 0.111639 Oct 18 16:03:33.680910 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 360/737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:33 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:33.708698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:33.715058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:33.721043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.721632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.722069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.722763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:33.723219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:33.723650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:33.961302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:33.969013 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa121f19-994c-487a-a10c-1405d0e0c7a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.264273 Oct 18 16:03:33.969601 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 378/738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:33 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:34.093889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f83e7cd-4f18-4d1c-bda4-2980657a36da", "name": "network-vif-unplugged", "status": "completed", "tag": "1e1cbb5c-6cde-4417-b545-112b71dc740c"}, {"name": "network-changed", "server_uuid": "1f83e7cd-4f18-4d1c-bda4-2980657a36da", "tag": "1e1cbb5c-6cde-4417-b545-112b71dc740c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:34.107655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.108167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.108619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.115915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.116540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.122542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Creating event network-vif-unplugged:1e1cbb5c-6cde-4417-b545-112b71dc740c for instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da on n-h2-858383-14 Oct 18 16:03:34.122993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.123499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] Creating event network-changed:1e1cbb5c-6cde-4417-b545-112b71dc740c for instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da on n-h2-858383-14 Oct 18 16:03:34.123686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.124364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.125223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.125778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.126439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.130491 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7adef92d-0445-480a-b42d-8b488a5fb982 req-1b1eab45-c258-43a2-acc2-dbc40f6c2ed7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.040286 Oct 18 16:03:34.131466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 361/739] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:03:34.152446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.153604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.160983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.161486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.161925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.162630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.163114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.163537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.180933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] HTTP exception thrown: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Request method failure captured: Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 HTTP/1.1 Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4CVmqoyGBPFrkFysrk0HXHmY1luds6mlajd5FfxF3Q11nLN1XoOvtHwlPiQHQAUQsqkSIixlBgMYjsj8ZTtZHzybMF2tPxFcIbqlVhvbQeU11BANdltXWZCmWW2bSEo9CE6xz3ArEGMtAOsR72WURvC0ARfs-nnLeRQhUC_1k-6MM Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c1615e4a1ea345b4ac972f3a3cb08f2b Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:03:34.183057 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}] Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c1615e4a1ea345b4ac972f3a3cb08f2b Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationNegativeTest-2119298176-project Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0c29841aaaee47c8ac0bde44c50105dc Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationNegativeTest-2119298176-project Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. Oct 18 16:03:34.184432 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5'} Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:34.185253 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. Oct 18 16:03:34.186588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:34.189722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Returning 404 to user: Instance 9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:34.189722 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9851ad7-bdf9-47cf-9055-173992c12689 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5" status: 404 len: 111 microversion: 2.1 time: 0.036448 Oct 18 16:03:34.189722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 362/740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/9ad1fde6-7a2a-4dff-b4d0-6580c4eea5d5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:03:34.193544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.194037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.200237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.200742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.201347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.202057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.202700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.203128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.236128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:03:34.343300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.345285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed6e9c48-dd31-4cf9-a9e9-e1501453db40 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 204 len: 0 microversion: 2.1 time: 0.155354 Oct 18 16:03:34.346831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 363/741] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:03:34 2022] DELETE /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:03:34.356467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-771113d6-99c9-494f-9cb1-a9fa5dd5c2ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.249100 Oct 18 16:03:34.357071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.357215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 379/742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:34.357791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.367320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.367824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.368274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.369161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.369453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.369879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.374762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:34.538250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.548393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4be41e1d-8206-41b9-83af-c9c5e3df7409 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1475 microversion: 2.1 time: 0.197095 Oct 18 16:03:34.565632 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 364/743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:34.589927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.590646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.597784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.602410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.602897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.603813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.604454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.605349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.639406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.640143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.647050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.647538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.647968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.648690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.649188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.649818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.804847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.815886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.818070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.819243 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bac4d8cc-1afa-40dd-b2ad-627919b20dd8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.185009 Oct 18 16:03:34.819829 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 365/744] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:34.826693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:34.827524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:34.842077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.842593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.843022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.846605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:34.847268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:34.847879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:34.865685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:34.873668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b099a62e-9fb7-43bd-810c-b3fdcde4d4ad tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.287537 Oct 18 16:03:34.886892 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 380/745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:34.996877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:35.001957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:35.011109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.011851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.013542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.014588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.015254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.015820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.023232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:35.031697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5199582a-25d7-4196-956d-d09bdd70c720 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.210474 Oct 18 16:03:35.032300 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 366/746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:35.154695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:35.162599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6cb716a7-c08f-4a87-8aba-8eb4fb5de976 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.174294 Oct 18 16:03:35.163208 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 381/747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:34 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:35.380120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:35.380733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:35.386701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.387191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.387628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.388346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.388831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.389290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.519454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:35.527326 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0b86de3-507d-4856-8f46-79d405e5240a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.151585 Oct 18 16:03:35.527924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 367/748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:35 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:35.571642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:35.572253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:35.578160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.578637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.579066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.579746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.580832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.581279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.733464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:35.741635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2512ecf-66ca-4fcc-b5be-055f1279680a tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1475 microversion: 2.1 time: 0.173881 Oct 18 16:03:35.742199 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 382/749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:35 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1475 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:35.847126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:35.848291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:35.857956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.858565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.859055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.860502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.860967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.861423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.900145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:35.901052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:35.907605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.908475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.909041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:35.909754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:35.910373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:35.910958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.025268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.035510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.037200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.038680 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dda230f7-fc3c-4a20-9841-9a0438d63a53 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.196769 Oct 18 16:03:36.039383 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 368/750] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:35 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:03:36.055171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:36.055997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:36.062481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.063045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.063478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.064161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.065220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.065652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.203646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.212402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51eb6847-bb66-4e45-9aa5-c94bd9b1cf3b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.161048 Oct 18 16:03:36.212977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 369/751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:36 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:36.217505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:36.218144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:36.224404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.224894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.225369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.226049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.226505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.226928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.344551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.354953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58db939c-11b5-4f76-a8c6-52d3b86520d1 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.457343 Oct 18 16:03:36.356628 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 383/752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:35 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:36.368444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.376089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-785245dc-6730-46e7-9dbb-fabbb6abdbd0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1308 microversion: 2.1 time: 0.162132 Oct 18 16:03:36.376657 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 370/753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:36 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:36.552026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:36.552542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:36.558436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.558913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.559342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.560024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.560474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.560893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.765089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:36.765700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:36.772933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.773441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.773873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.774566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:36.775013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:36.775917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:36.920127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.930381 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-662624fc-f4db-48d9-8d81-f7daf55cf4b9 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1475 microversion: 2.1 time: 0.168993 Oct 18 16:03:36.931214 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 371/754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:36 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:36.942894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:36.956740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d069a73-1cf9-4dd5-9067-9375cb8e80b2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.409195 Oct 18 16:03:36.957809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 384/755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:36 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:37.067183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.067700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.073515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.074000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.074432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.075136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.075575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.076022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.225203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.235904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.236134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.237123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.238166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.239911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9dbab73-0c3d-4b0e-bb19-da932b99c8c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.177234 Oct 18 16:03:37.253019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 372/756] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:37.262474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.262965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.263609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.264319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.264776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.265226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.294817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-plugged", "status": "completed", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:37.305457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.305984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.306917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.322393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] Creating event network-vif-plugged:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:03:37.330697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ba7c2bfb-0081-4e2f-a9c2-2e82bbb7655b req-71c29919-81d1-468b-8c84-f7533452ba47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042610 Oct 18 16:03:37.331628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 373/757] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:03:37.382257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.382949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.389296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.389776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.390283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.390977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.391423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.391862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.543671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.551684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2f8894a-ea22-4b1f-8611-38aba7418e80 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.174397 Oct 18 16:03:37.552262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 374/758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:37.556954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.557504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.563188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.563668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.564100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.564942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.565444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.565857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.758783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.776241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67095632-ba05-4e39-bc60-4b62b5007f40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1488 microversion: 2.1 time: 0.222710 Oct 18 16:03:37.777924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 375/759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1488 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:37.802382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:37.807550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:37.811518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.812583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.813062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.819149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec9e002f-803b-40cd-affc-e143de9359e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.586598 Oct 18 16:03:37.819808 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 385/760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:37.895621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:03:37.946747 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71b5eeb2-b48c-454a-8ef2-207346584723 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167/action" status: 202 len: 0 microversion: 2.1 time: 0.146526 Oct 18 16:03:37.947353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 376/761] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:37 2022] POST /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:03:37.958613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.959532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.960697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:37.961452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:37.968022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.968268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.968517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.968947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.969189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.969498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.969673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.970199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:37.970323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.970689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:37.971631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:37.971795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.051790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.073913 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db3d07b4-2fd9-49dd-b735-26def9e628bb tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1433 microversion: 2.1 time: 0.118755 Oct 18 16:03:38.082486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 377/762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1433 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:38.082486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:38.082486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:38.090409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.091073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.091425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.092529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.093146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.093706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.250585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.261735 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c041aa6-b12b-47b6-9e4e-72cf5b6eb649 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.184039 Oct 18 16:03:38.274128 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 378/763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:38 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:38.279089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:38.279697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:38.287239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.287907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.288354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.289268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.289747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.290173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.512638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.524331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.525892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.527414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a991ac2-4d4c-4455-9b11-2c3e01082a97 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.252249 Oct 18 16:03:38.528037 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 379/764] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:38 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:38.548743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b986b879-56f0-4df2-b920-5190e7d66270", "name": "network-vif-deleted", "tag": "893ebe8b-1675-4ccf-8515-2b328c45464a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:38.560732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.561257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.561695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.585505 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] Creating event network-vif-deleted:893ebe8b-1675-4ccf-8515-2b328c45464a for instance b986b879-56f0-4df2-b920-5190e7d66270 on n-h1-858383-14 Oct 18 16:03:38.599550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8d1312fc-c4ca-44fa-9bae-7b4dccdf9ee5 req-fd8a3850-d278-4841-a799-33d1bb72ef56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067631 Oct 18 16:03:38.602185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 380/765] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:38.622624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:38.623402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:38.631145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.631631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.632065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.636568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.637131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.637585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.642547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:38.829890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.843575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a758cbb4-1b0e-486f-879d-9ecfa499263f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.890849 Oct 18 16:03:38.844779 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 386/766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:37 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:38.855880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:38.857712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:38.859488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:38.865232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.866146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.866728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.867666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:38.868136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:38.868627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:38.873882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:38.884547 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21e14b12-94f6-4e59-b077-9f93156005a7 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1317 microversion: 2.1 time: 0.280780 Oct 18 16:03:38.885322 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 381/767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:38 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:39.103958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.104737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.110833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.112031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.112596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.114233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.114800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.115321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.152070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.198678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7723d21f-f356-4ff6-a87f-1b2dc33f42ec tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.352156 Oct 18 16:03:39.202352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 387/768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:38 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:39.288068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.288782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.298107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.298603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.299484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.300239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.300756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.301482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.362325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.362910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.363411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.364027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lazy-loading 'fault' on Instance uuid b986b879-56f0-4df2-b920-5190e7d66270 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:39.416502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c29841aaaee47c8ac0bde44c50105dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.425640 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-edc7d540-0b50-47dd-809d-46c9c05f9352 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 200 len: 1309 microversion: 2.1 time: 0.326756 Oct 18 16:03:39.427013 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 382/769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:39.556566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.557208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.564683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.565199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.565651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.566900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.567585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.568220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.652437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.663166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bcbd1c58-2125-4fc2-8823-a11fc9b58a86 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.380195 Oct 18 16:03:39.665403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 388/770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:39.735268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.744518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.745990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.747158 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba78ad2c-d159-4a08-a349-a1f2f22e23d6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.194577 Oct 18 16:03:39.747719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 383/771] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:03:39.873373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.874141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.880321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.880808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.881267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.881953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.882408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.882827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.909766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.910364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.917393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.917871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.918304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.918993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.919445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.919865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.047144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.056604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddbf6d75-ddb4-4dfd-be84-c3d502fc8a06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.187751 Oct 18 16:03:40.075671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.079537 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 389/772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:40.088688 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3fc5c927-2053-4da8-a90d-966672637e78 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1467 microversion: 2.1 time: 0.183279 Oct 18 16:03:40.089594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 384/773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1467 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:40.113386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1165041120", "metadata": {"image_type": "test"}}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:40.116160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.122371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.122857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.123360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.124060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.124517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.124943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.162756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Getting quotas for project fd26b2e375084d72a31f6e39b420da8c. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:40.168428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Getting quotas for user 7f02637b1935426280f2ad6bcfa61b26 and project fd26b2e375084d72a31f6e39b420da8c. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:40.221350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.222021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.227958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.228449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.228887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.229621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.230343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.230774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.370026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.372439 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57c6438c-be6a-4a21-803c-93c049d8b19b tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "POST /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd/action" status: 202 len: 0 microversion: 2.1 time: 0.263215 Oct 18 16:03:40.373952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 390/774] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:40 2022] POST /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:03:40.384782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26e6a4f4-6418-4e9e-a5e1-d2f3d4c7e33b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.167312 Oct 18 16:03:40.385378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 385/775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:40.388547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e881e7ce-27ff-48b2-916d-b3aa31bb15a4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd266a8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.439621 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e881e7ce-27ff-48b2-916d-b3aa31bb15a4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.057497 Oct 18 16:03:40.440383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 391/776] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:40.451476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.452083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] [instance: b986b879-56f0-4df2-b920-5190e7d66270] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.459308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.459900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.460473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.461291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.461818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.462386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.478970 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] HTTP exception thrown: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Request method failure captured: Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 HTTP/1.1 Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4CVmqoyGBPFrkFysrk0HXHmY1luds6mlajd5FfxF3Q11nLN1XoOvtHwlPiQHQAUQsqkSIixlBgMYjsj8ZTtZHzybMF2tPxFcIbqlVhvbQeU11BANdltXWZCmWW2bSEo9CE6xz3ArEGMtAOsR72WURvC0ARfs-nnLeRQhUC_1k-6MM Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c1615e4a1ea345b4ac972f3a3cb08f2b Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:03:40.481064 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c1615e4a1ea345b4ac972f3a3cb08f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1615e4a1ea345b4ac972f3a3cb08f2b"}]}] Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c1615e4a1ea345b4ac972f3a3cb08f2b Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2119298176 Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationNegativeTest-2119298176-project Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0c29841aaaee47c8ac0bde44c50105dc Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationNegativeTest-2119298176-project Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. Oct 18 16:03:40.482334 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b986b879-56f0-4df2-b920-5190e7d66270'} Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:40.483196 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. Oct 18 16:03:40.484373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:03:40.485456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] Returning 404 to user: Instance b986b879-56f0-4df2-b920-5190e7d66270 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:40.485456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f101730-c143-47cb-ad65-83f6b9c89496 tempest-LiveMigrationNegativeTest-2119298176 tempest-LiveMigrationNegativeTest-2119298176-project] 10.222.0.78 "GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270" status: 404 len: 111 microversion: 2.1 time: 0.035434 Oct 18 16:03:40.486916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 386/777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/servers/b986b879-56f0-4df2-b920-5190e7d66270 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:03:40.686517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.687275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.694313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.694798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.695235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.695926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.696379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.696801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.728411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387f143c-8e59-42bf-97d5-b26e8a29ef79", "tag": "74e87467-c1f1-49ad-ae23-79657482bec0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:40.739954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.740816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.741524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.753707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] Creating event network-changed:74e87467-c1f1-49ad-ae23-79657482bec0 for instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 on n-h1-858383-14 Oct 18 16:03:40.758951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0c9d18fd-921e-47ef-a121-49b9aabf8a04 req-f29f57e4-99c6-486a-9dfa-19eea7372397 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034319 Oct 18 16:03:40.759643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 387/778] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:40.772952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.773954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.780256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.781018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.781460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.782466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.782929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.784240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.878746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.887633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6363d30d-2dfb-4877-b9f5-3068afe199b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.204933 Oct 18 16:03:40.888288 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 392/779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:40.951956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.961428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.962865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:40.964217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40645c4e-e3c7-48c2-bdf5-408b88a6158f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1569 microversion: 2.25 time: 0.196471 Oct 18 16:03:40.964919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 388/780] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:41.080295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:41.080904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:41.088683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.089364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.089940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.090893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.091735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.092482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.284728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:41.292828 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bdcfee7-2e07-47b4-b34d-65445467df74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.216444 Oct 18 16:03:41.310274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 393/781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:41 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:41.318131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "name": "network-vif-plugged", "status": "completed", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:41.329834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.331033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.331654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.358461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] Creating event network-vif-plugged:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h1-858383-14 Oct 18 16:03:41.365105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c1061ea9-d092-40c8-b440-fe29960229a3 req-1be11512-e719-42d1-bb5a-86f4c1d1bd01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051957 Oct 18 16:03:41.366006 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 389/782] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:41.409144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:41.409879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:41.416060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.416622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.417160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.417927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.418451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.419104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.458798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-668c5977-6ae0-4606-8540-c3d428435c23 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd241cdc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:41.529065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-668c5977-6ae0-4606-8540-c3d428435c23 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.076576 Oct 18 16:03:41.530051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 390/783] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:41 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:41.618040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:41.626561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-435c7dc3-7de6-4b88-9b3b-eb5a28873277 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.222480 Oct 18 16:03:41.627427 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 394/784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:41 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:41.911778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:41.912423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:41.919420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.919918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.920358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.921115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:41.921536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:41.921966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.995646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:41.995646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:41.997040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:42.003941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.004937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.005556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.006414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.007009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.007507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.063743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.073290 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-311a2153-8414-4bb9-a7e2-b04e8fe9f1b0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.166227 Oct 18 16:03:42.073866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 391/785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:41 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:42.153019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.162089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.163465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.164705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46586b6d-9bf6-4cf4-842f-0a294247d930 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1559 microversion: 2.25 time: 0.178416 Oct 18 16:03:42.165348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 395/786] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:41 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:42.189459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2a37369-f9bd-4823-b736-bae2e806044e tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '.version_select at 0x7f5fd29aa940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.193097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2a37369-f9bd-4823-b736-bae2e806044e tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.193588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2a37369-f9bd-4823-b736-bae2e806044e tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.194028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2a37369-f9bd-4823-b736-bae2e806044e tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.210601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2a37369-f9bd-4823-b736-bae2e806044e tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1352 microversion: 2.25 time: 0.024905 Oct 18 16:03:42.211211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 392/787] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/os-migrations => generated 1352 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:42.226026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.226645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:42.232889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.233412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.233851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.234537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.235115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.235545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.318234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.318946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:42.325851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.326580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.327012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.327711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.328397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.328822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.374019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:42.388820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-80a93315-7935-4bf9-8454-977c7560ae8a tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 2054 microversion: 2.25 time: 0.166458 Oct 18 16:03:42.389513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 396/788] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 2054 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:42.484733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.497059 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39b7da7b-184e-4984-adee-f446529e9aa9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.183770 Oct 18 16:03:42.497781 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 393/789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:42.546123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b64106f6-e553-49d9-b94e-63b16b48cc71 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2650670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.551865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:42.591414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1331053514", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "5102e26d-02ba-494b-a69e-fcb88c84af09"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:42.597117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b64106f6-e553-49d9-b94e-63b16b48cc71 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.054803 Oct 18 16:03:42.598133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 397/790] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:42.650073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.650702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:42.655216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] validate_networks() for [('5102e26d-02ba-494b-a69e-fcb88c84af09', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:42.658112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.658751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.659195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.659893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.671578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.672434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.842242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.854714 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-720d937c-8169-42f7-a60e-8e729f935db3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.206742 Oct 18 16:03:42.856136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 398/791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:43.095174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:43.096173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:43.096554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:43.096955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:43.097865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.098481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:43.099347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:43.108539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.109541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.110028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.110586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.111840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.112143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.112613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.113190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.114733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.115620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.117535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.118147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.136755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:43.145493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:43.147480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for user 19e2cb9474fb47a6b3f3793c7f162caf and project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:43.165292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:43.167857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:43.222906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac4442a4-ced1-4ae3-9e12-73b4f19373ae tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.636632 Oct 18 16:03:43.223806 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 394/792] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 16:03:43.243067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.243067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:43.302349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:43.310659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:43.312673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:43.313722 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd4c44b7-3b02-4788-82fe-396261a2006f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1262 microversion: 2.25 time: 0.081642 Oct 18 16:03:43.325777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 395/793] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:43.439914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:43.452982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69fe3ae3-efa3-4746-94ca-3b6ae9e723dd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.359513 Oct 18 16:03:43.459331 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 399/794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:43.520722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.521362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:43.532479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.533075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.533521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.535124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.535617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.536051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.539346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-608725289", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:43.637489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:43.769195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:43.777454 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87d69c6a-c8bc-4aed-8a12-d3b297fd2196 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.260532 Oct 18 16:03:43.778030 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 400/795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:43.792224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c778238e-5d63-4eab-a838-a5b05ad11c41 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd274fdc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.889278 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c778238e-5d63-4eab-a838-a5b05ad11c41 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.100666 Oct 18 16:03:43.889872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 401/796] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:43.895624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.899649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:43.911215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:43.915613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.917271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.918150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.919558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.920978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.921701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.074617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.082542 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2eff1514-e1ca-4429-8de2-8391bb7eb300 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.191466 Oct 18 16:03:44.083111 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 402/797] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:44.214880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:44.215401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:44.215783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:44.216184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:44.216587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:44.229199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.229676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.230361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.231111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.231556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.232163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.249624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Getting quotas for project 8df69999b99949399425279771c6b144. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:44.256008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Getting quotas for user 7053f2f36beb4afd87463bf4acb0502d and project 8df69999b99949399425279771c6b144. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:44.270719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:44.273939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:44.332535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c4bd5c7-99ee-4537-8c4e-651dd6860d58 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004030 Oct 18 16:03:44.333394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 396/798] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:44.344588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-957c479a-6c5d-4289-a68d-8d7b565c01b3 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:44.345139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:44.345664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-957c479a-6c5d-4289-a68d-8d7b565c01b3 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:44.347133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:44.354185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.355341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.359356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.360454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.363797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.363797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.406663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-957c479a-6c5d-4289-a68d-8d7b565c01b3 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.414938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-957c479a-6c5d-4289-a68d-8d7b565c01b3 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1222 microversion: 2.1 time: 0.074682 Oct 18 16:03:44.415723 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 397/799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:44 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:44.481831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:44.482549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:44.490999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.491837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.492350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.493168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.493705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.494324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.530486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.542753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.557671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.558869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fb6b674-87e3-406c-8294-913f7664ff92 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1258 microversion: 2.25 time: 0.221244 Oct 18 16:03:44.559825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 403/800] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:44 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:44.811012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:44.835077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:44.843292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:44.852601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb1c9bef-93cc-4330-8814-50c17c381760 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.375932 Oct 18 16:03:44.874706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.878345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 398/801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:44 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:44.886378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.887184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.888677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:44.889648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:44.891756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:44.912069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6a51866-8a18-4ba1-973a-209ba7e10971 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2747940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:44.968926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:45.006040 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6a51866-8a18-4ba1-973a-209ba7e10971 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.099892 Oct 18 16:03:45.015625 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 399/802] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:44 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:45.119213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:45.124428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:45.141380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.141989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.142587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.144592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.144592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.144592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.345714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.353652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.357219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a4e1c02-f1f3-4bf8-b403-3b195781ff01 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.254482 Oct 18 16:03:45.358031 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 400/803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:45 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:45.377366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bd0b49c-7a2c-448c-96d8-2d9fe320f6f7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.578287 Oct 18 16:03:45.393026 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 404/804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:44 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:45.409145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-plugged", "status": "completed", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:45.420348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.421208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.421645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.434070 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] Creating event network-vif-plugged:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:03:45.439980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-75f4d771-dadc-4307-8dc4-1bccf4b30918 req-f82284b7-b3b3-4624-ac9d-8a7cc7c905e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 Oct 18 16:03:45.440490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:45.440623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 401/805] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:45.441417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:45.449587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.450602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.451038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.451931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.452384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.453016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.559537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.569484 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc94f42b-673c-4122-99ab-d2def5051119 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1218 microversion: 2.1 time: 0.135937 Oct 18 16:03:45.570054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 405/806] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:45 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:45.587562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:45.588253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:45.594482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.594965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.595697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.596393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.596845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.597301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.667257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.680507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.682837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:45.684497 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2c7a654-c380-4b8e-81c3-73e86ba4f0a5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1314 microversion: 2.25 time: 0.100993 Oct 18 16:03:45.703301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 402/807] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:45 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1314 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:45.886314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:45.887035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:45.893058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.893544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.893984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:45.894665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:45.895117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:45.895540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.023662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.023822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba297844-eb13-4435-b1be-eb37b903a141 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2475ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:46.031901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-95d7fc4c-03f3-418d-afbc-77193decc8b8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.149636 Oct 18 16:03:46.032489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 406/808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:45 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:46.070808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba297844-eb13-4435-b1be-eb37b903a141 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.050837 Oct 18 16:03:46.071469 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 403/809] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:46 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:46.379590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:46.380430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:46.387384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.388097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.388606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.389477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.390010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.390540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.401723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:46.402343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:46.409659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.411335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.411795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.412506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.412958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.420787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.558554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.567361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-becda76a-4b67-45d6-bd31-e0de22346a56 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.169918 Oct 18 16:03:46.567949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 404/810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:46 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:46.593236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:46.594063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:46.601381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.602020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.602466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.603240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.603803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.604316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.669547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.671247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.677712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0566288-ea41-4d11-b3d0-8801f1bbe2a1 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1274 microversion: 2.1 time: 0.088430 Oct 18 16:03:46.678307 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 405/811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:46 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:46.680456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4761244e-69d9-4efb-a5e8-ccafdd851b7c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.304658 Oct 18 16:03:46.681220 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 407/812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:46 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:46.711392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:46.712012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:46.718071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.718556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.719001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.719693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:46.720151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:46.721184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:46.790842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.803991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.808221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:46.810686 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-191015d3-6275-47c9-981e-1d3de4b50786 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1320 microversion: 2.25 time: 0.103402 Oct 18 16:03:46.826959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 406/813] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:46 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1320 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:47.055419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.056140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:47.062486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.063100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.063616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.064953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.065477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.065935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.088086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ee735dc-58f0-458e-9131-ec972d2d2ce2 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd26ebaf0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.139809 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ee735dc-58f0-458e-9131-ec972d2d2ce2 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.056252 Oct 18 16:03:47.141493 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 407/814] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:47.460662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387f143c-8e59-42bf-97d5-b26e8a29ef79", "name": "network-vif-plugged", "status": "completed", "tag": "74e87467-c1f1-49ad-ae23-79657482bec0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:47.470642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.471290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.471652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.476304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:47.484486 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] Creating event network-vif-plugged:74e87467-c1f1-49ad-ae23-79657482bec0 for instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 on n-h1-858383-14 Oct 18 16:03:47.490413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ef8394e0-9f36-4fbd-bed1-36a5124d1c8b req-f00af04d-662b-411d-abed-806f1c66e048 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Oct 18 16:03:47.491005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 408/815] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:03:47.592256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.593247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:47.601397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.602954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.603607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.604928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.605666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.606150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.625629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:47.637755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc99df49-d70e-421c-809b-169eecae8109 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1504 microversion: 2.1 time: 0.586044 Oct 18 16:03:47.638864 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 408/816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:47.708909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.709675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:47.715670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.716230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.716945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.717895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.718590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.719496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.801125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:47.811709 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81a2a4a0-affa-4642-963e-331e7b8402ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.223907 Oct 18 16:03:47.812869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 409/817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:47.817571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.818258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:47.832441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.832859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.833325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.834036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.835161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.835161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.860797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:47.897199 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fcc7b3bb-ba6d-47c6-842e-30fd95e0140d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1280 microversion: 2.1 time: 0.192276 Oct 18 16:03:47.903017 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 409/818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:47.926367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:47.929615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:47.973780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.975888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.977548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:47.979152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:47.980375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:47.981504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:48.082856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:48.092746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ca28892-687c-497f-a6f7-aa2844f43f9f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.278346 Oct 18 16:03:48.093688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 410/819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:48.157463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac2d28a4-3e53-468a-913d-00fc838b7f8d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd25fa3a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:48.190821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:48.200263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:48.201988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:48.203146 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f60bd83-7705-4415-8c0e-94f6099cdfd5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.297831 Oct 18 16:03:48.203696 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 410/820] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:47 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:48.206376 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac2d28a4-3e53-468a-913d-00fc838b7f8d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.052510 Oct 18 16:03:48.206950 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 411/821] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:48 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:48.665144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:48.667630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:48.677482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:48.678465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:48.679368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:48.680301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:48.680976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:48.682357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:48.838345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:48.840731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:48.850045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:48.850719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:48.851887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:48.853815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:48.854607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:48.855459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.000354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:49.013635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-304392d5-ba0f-44b2-9b57-fe541e15a010 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1494 microversion: 2.1 time: 0.353083 Oct 18 16:03:49.022170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 411/822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:48 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1494 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:49.023082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:49.032635 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-700edc36-6c2b-4b1c-b192-227ed6390615 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.201160 Oct 18 16:03:49.040918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.044467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:49.045687 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 412/823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:48 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:49.056346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-054b9adc-f110-4710-86d8-ce5c923f4bb1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '.version_select at 0x7f5fd262e700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.060148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-054b9adc-f110-4710-86d8-ce5c923f4bb1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.060790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.061077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-054b9adc-f110-4710-86d8-ce5c923f4bb1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.061731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-054b9adc-f110-4710-86d8-ce5c923f4bb1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.062197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.062637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.063391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.067320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.067788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.071180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-054b9adc-f110-4710-86d8-ce5c923f4bb1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.024157 Oct 18 16:03:49.072270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 413/824] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:49.086379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.087261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:49.099466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.099892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.100345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.101076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.101538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.101966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.309021 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f543dd9c-6515-4ed7-8f86-f9644fb54466 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1647 microversion: 2.1 time: 0.226621 Oct 18 16:03:49.309612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 414/825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1647 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:49.326122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.327388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:49.341601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.346595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.347063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.347964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.348474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.348891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.433818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:49.444450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-730e2617-ad98-4c68-91fe-3d2d412fb88d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.420722 Oct 18 16:03:49.459328 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 412/826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:49.470352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fca2bc93-78d4-4f36-bb2b-a7f3963e345e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2a5df70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.539269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fca2bc93-78d4-4f36-bb2b-a7f3963e345e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.074872 Oct 18 16:03:49.561319 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 413/827] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:49.568442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:49.569677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:49.579313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.581696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.583250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.584611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:49.584976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:49.585992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:49.639138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:49.650183 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d333cfc-5355-401d-9357-688baea968ac tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1313 microversion: 2.1 time: 0.339492 Oct 18 16:03:49.651246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 415/828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:49.670106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-97472488", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "36cd9606-04bb-4353-9340-97cb35289c50"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:49.784201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] validate_networks() for [('36cd9606-04bb-4353-9340-97cb35289c50', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:03:50.029884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:50.042660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:50.046912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:50.050396 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81b275b3-981f-4572-83dc-30332261d667 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.485649 Oct 18 16:03:50.051934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 414/829] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:49 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:50.068795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:50.071258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:50.079022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.080845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.081520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.082449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.083097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.083675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.420141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:50.432766 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-348c9aac-9043-4856-8c8e-9ffd13173151 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.375392 Oct 18 16:03:50.435429 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 415/830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:50 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:50.445717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:50.473470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.474181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.474776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.487894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] Creating event network-changed:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h1-858383-14 Oct 18 16:03:50.494063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-95d476c7-facc-4350-8c4c-27eb382c34a7 req-5b007134-7cbe-4be5-af3a-6de05f596401 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051799 Oct 18 16:03:50.495346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 416/831] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:50.502442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:50.503400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:50.512441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.513221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.513819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.514863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.515476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.516089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.525174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:50.525737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:50.526293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:50.526803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:50.527315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:50.543228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.545556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.546123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.548129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.551842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.552418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.598326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:03:50.608077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for user ab2aa9c224654cfbbc1559ed58556ad5 and project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:03:50.628865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:03:50.631572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:03:50.699280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a8af784-878a-4344-ab41-c562994bbb7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046126 Oct 18 16:03:50.700551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 416/832] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:03:50.710872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c46060f1-395b-489f-840e-e45a59b9bd52 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2363a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:50.807347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c46060f1-395b-489f-840e-e45a59b9bd52 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.105365 Oct 18 16:03:50.807934 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 417/833] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:50 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:50.820104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:50.820725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:50.839581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.840076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.840516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:50.841264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:50.841722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:50.842303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.313265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.322933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09121776-c284-4f84-ba73-094f6c99ef45 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.826251 Oct 18 16:03:51.331902 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 417/834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:50 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:51.336892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64811675-3f52-4f10-8248-40c9d7c90e93 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:51.337660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64811675-3f52-4f10-8248-40c9d7c90e93 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:51.359057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.374480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9c69228-5690-4b98-9e15-d76184e984fe tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1462 microversion: 2.1 time: 0.558438 Oct 18 16:03:51.393239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 418/835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:50 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1462 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:51.409352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:51.412663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:51.432800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.433326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.436905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.440083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.440842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.446977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.529432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64811675-3f52-4f10-8248-40c9d7c90e93 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.541184 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64811675-3f52-4f10-8248-40c9d7c90e93 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1209 microversion: 2.1 time: 0.207839 Oct 18 16:03:51.560498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 418/836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:51 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1209 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:51.756057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.767812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.769794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:51.771533 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6481b09e-332c-4d17-9f7d-cf5e6418a715 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.376689 Oct 18 16:03:51.772517 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 419/837] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:51 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:51.779030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:51.779845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:51.786521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.787244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.787904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.789095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.789967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.790634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.821103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:51.838237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'deleted': False, 'project_id': '29b43f140cdf45e78f949164ff8db458'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:51.851962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.852898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.853947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.855297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:51.856166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:51.857851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:51.990085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4353ceae-ad3c-4756-9efc-5dc072c9c605 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.427744 Oct 18 16:03:52.005504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 419/838] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:03:51 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:03:52.014375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fe02c78-10e4-416c-85e4-652f9c3a46a6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2650550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:52.071260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fe02c78-10e4-416c-85e4-652f9c3a46a6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.064301 Oct 18 16:03:52.080248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 420/839] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:52 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:52.083090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:52.085804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:52.092370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'deleted': False} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:52.092899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41eba5c6-1249-4056-b9b4-61eb73f2614c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.318194 Oct 18 16:03:52.094154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 420/840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:51 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:52.098714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.099192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.099706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.100420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.100924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.101380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.219040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:03:52.358835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:52.359810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:52.366925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.367525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.368032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.369029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.369561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.370212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.542327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.543826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.544344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.545319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:52.559663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4fa6d937-6868-4d39-bd1e-6d1873a6c309 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.209769 Oct 18 16:03:52.573015 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 421/841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:52 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:52.573015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47cce31-7467-4dc8-bb86-54edbd457d87", "tag": "1da0bdbd-9348-4ee3-84e5-7897a45e7c08"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:52.576202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.576814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.577281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.610866 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] Creating event network-changed:1da0bdbd-9348-4ee3-84e5-7897a45e7c08 for instance c47cce31-7467-4dc8-bb86-54edbd457d87 on n-h1-858383-14 Oct 18 16:03:52.615993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c883cbe9-305d-4377-9f29-5a5433992865 req-558b28bc-8c4b-4cd9-873c-9a3b5a8414fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054058 Oct 18 16:03:52.617642 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 422/842] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:52.622677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:52.623384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:52.634802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.636265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.636907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.638202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.638673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.639637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.723133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:52.731771 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e6f63b97-57d5-4743-ac4c-7575abee871d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1261 microversion: 2.1 time: 0.113022 Oct 18 16:03:52.732976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 423/843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:52 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:52.799829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:52.800505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:52.818122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.819188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.819901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:52.820855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:52.821607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:52.822245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.045943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:53.063055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:53.064482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:53.072029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f855df87-9f39-44ee-9d52-d61dcdd905e6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.276631 Oct 18 16:03:53.089514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 424/844] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:52 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:53.094515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cb944f9-6cbd-4953-a5fe-cb920a482fcd tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd28289d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.173751 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cb944f9-6cbd-4953-a5fe-cb920a482fcd tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.083022 Oct 18 16:03:53.174995 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 425/845] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:53.181378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.182986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:53.190967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.191711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.192202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.197884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ab95de5-728e-4673-aeeb-c0c309589e7c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19397 microversion: 2.1 time: 1.116101 Oct 18 16:03:53.199326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 421/846] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 18 16:03:52 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19397 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:03:53.200242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.201425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.202316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.249350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.264279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'deleted': False, 'project_id': '29b43f140cdf45e78f949164ff8db458'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:53.271328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.272427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.273202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.274164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.274852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.276574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.321064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4f4abfa-f456-43fb-b1ec-bd1e62982e87 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?tenant_id=6331acc801404531ad94b7ee7664bebe" status: 200 len: 15 microversion: 2.1 time: 0.077781 Oct 18 16:03:53.335271 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 422/847] 10.222.0.78 () {58 vars in 1231 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/detail?tenant_id=6331acc801404531ad94b7ee7664bebe => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:03:53.351686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.372805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'tenant_id': '6331acc801404531ad94b7ee7664bebe', 'deleted': False} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:53.381512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.383292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.384624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.386631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.388969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.390066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.405114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:53.416603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-426a4c1c-eabb-4714-a2a2-aeec061029aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.239961 Oct 18 16:03:53.433728 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 426/848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:53.446734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:03:53.538039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.538947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.539599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.584175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.585088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:53.591917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.592625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.593411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.596977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.597932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.598890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.724012 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e9e8c64-00ac-46da-9202-fa569881bd4d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6331acc801404531ad94b7ee7664bebe" status: 200 len: 4828 microversion: 2.1 time: 0.380581 Oct 18 16:03:53.745701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 423/849] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6331acc801404531ad94b7ee7664bebe => generated 4828 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:53.759167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.760911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:53.776366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.781273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.782087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.783749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.784439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.785121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.800272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:53.811828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21c14430-fc8d-4af9-970b-47f8fe926648 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.232536 Oct 18 16:03:53.821062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 427/850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:53.833516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:53.840873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'tenant_id': '29b43f140cdf45e78f949164ff8db458', 'deleted': False} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:53.849108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.849583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.850035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.850885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:53.851314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:53.851809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:53.966967 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e18fc2ff-edd7-4c6b-9ec0-c0cca7625bc3 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29b43f140cdf45e78f949164ff8db458" status: 200 len: 15 microversion: 2.1 time: 0.152530 Oct 18 16:03:53.967875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 428/851] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29b43f140cdf45e78f949164ff8db458 => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:03:54.001946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-825867af-c30d-493f-8ff5-8c0f0db51afa tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.007877 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-825867af-c30d-493f-8ff5-8c0f0db51afa tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009680 Oct 18 16:03:54.009086 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 429/852] 10.222.0.78 () {58 vars in 1189 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:03:54.045254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:54.047380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.055189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.055682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.056116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.057161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.058740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.059366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.085200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.094379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:54.105699 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-548a8ee1-1733-4b18-929f-f754fca4ccc8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.350598 Oct 18 16:03:54.107109 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 424/853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:53 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:54.115688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.122198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.138600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.139347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.139978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.141492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.143237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.143947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.199996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:54.224148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a5804d1-b7a0-4b9c-b776-0d01fbfe8b76 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 0 microversion: 2.1 time: 0.188707 Oct 18 16:03:54.235238 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 430/854] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:54 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:03:54.237881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8db5742e-094a-4687-9175-2fa947324c6f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2475b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.295224 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8db5742e-094a-4687-9175-2fa947324c6f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.061861 Oct 18 16:03:54.296857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 431/855] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:54.307980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.324373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.325647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6331acc801404531ad94b7ee7664bebe'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:54.335017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:54.337015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.337498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.341786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.343266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.343935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.344524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.454686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.461574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:03:54.463761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.474660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.477486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d647ea9-5254-4a79-b525-b4e06defad2b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.368659 Oct 18 16:03:54.480751 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 425/856] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:54.495740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.497596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.519505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.520675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.521309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.522199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.522861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.523431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.625967 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15438898-97b8-4fc8-befb-585bd1bd8d6f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.327420 Oct 18 16:03:54.627314 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 432/857] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:54.638941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:54.641677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.652152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.653052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.653642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.654689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.655414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.655989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.771161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0fedf50-1ec3-4194-acc4-cc6ea87ebfdf tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 0 microversion: 2.1 time: 0.135901 Oct 18 16:03:54.775887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 433/858] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:54 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:03:54.785811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.786482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.793308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.793899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.794389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.795199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.795730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.796187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.943962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:54.956585 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cbee3305-d668-4138-b552-5dda43724da0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.468958 Oct 18 16:03:54.975543 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 426/859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:54.981159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:54.981774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:54.991376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.991752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.992285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.993017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:54.993463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:54.993889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:54.999398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce9da089-6dea-4ce2-af00-dcc213e825b5 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1614 microversion: 2.1 time: 0.218911 Oct 18 16:03:54.999398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 434/860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1614 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.023758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.024374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:55.036344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.036935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.038097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.038976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.039688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.039917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.205016 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4408950c-e909-4a5f-bcf8-b7202c8f256a tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1614 microversion: 2.1 time: 0.184486 Oct 18 16:03:55.205797 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 435/861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1614 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.225886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.226520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:55.233129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.233673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.234131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.234882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.235349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.235855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.393792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:55.404368 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26d5fb02-4520-40a7-84b3-cac42fd16573 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.197505 Oct 18 16:03:55.417721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:55.418153 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 436/862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.426397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.427073 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd95b674-273c-4028-9903-e42c9cc04334 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.450240 Oct 18 16:03:55.433440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'host': 'n-h1-858383-14', 'deleted': False} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:55.441904 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 427/863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:54 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.443429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.444202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.449579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-162ef796-7932-441f-9c71-e4d59ede914a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd26faee0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.450219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.451345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.451867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.452858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.505268 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-162ef796-7932-441f-9c71-e4d59ede914a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.061905 Oct 18 16:03:55.507305 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 428/864] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.512496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.513384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:55.521961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.522720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.523384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.524468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.525771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.526904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.582050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:03:55.653668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb8efffb-2e01-49ba-9496-5f5912ba4e3d tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=n-h1-858383-14&all_tenants=1" status: 200 len: 1982 microversion: 2.1 time: 0.233416 Oct 18 16:03:55.663056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 437/865] 10.222.0.78 () {58 vars in 1192 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/servers?host=n-h1-858383-14&all_tenants=1 => generated 1982 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:55.669262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:55.676972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:03:55.682209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.682885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.683556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.684749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.685048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.685522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.708345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd5fc8c2-2fd1-4ebe-9e61-4adbab75a94c tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043518 Oct 18 16:03:55.716753 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 438/866] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:03:55.722080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:55.724688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:55.731032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.731032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.731488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.738702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.739254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.739627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.830686 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6a0df49-2d4f-4ccc-b714-ce816426b9bb tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 0 microversion: 2.1 time: 0.112168 Oct 18 16:03:55.832582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 439/867] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:55 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:03:55.840983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:55.844932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:55.858833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.859630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.860344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.861140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:55.861795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:55.862297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:55.987892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:03:55.988320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:03:55.988798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:03:55.989256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:03:55.989671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:03:56.070118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:56.077492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.078138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.078857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.079597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.080401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.080860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.120566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28dac554-af5d-4294-afb9-798cb8f0ac8d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 1065 microversion: 2.1 time: 0.283554 Oct 18 16:03:56.122269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 440/868] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:03:55 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 1065 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:03:56.132388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.144795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:56.145341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.145472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:56.147061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.150372 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8171d99-7522-4b9b-bcae-b48bd77ead8f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.641821 Oct 18 16:03:56.152517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.153181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.153799 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 429/869] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:55 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:56.166595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.167158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:56.167990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:56.169590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.171010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.173022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.184656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.185182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.185621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.186327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.186779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.187203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.376356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.386778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5edc7575-170b-4508-9875-52fcba66f0f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.251220 Oct 18 16:03:56.401064 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 441/870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:56 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:56.430388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:56.431082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:56.440739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.441271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.441712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.442568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.444301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.444805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.507206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.522321 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa580d9e-7a34-489f-923b-6eb6c0aff38e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.367216 Oct 18 16:03:56.523817 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 430/871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:56 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:56.529795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:56.531118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:56.550700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.551220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.551921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.552838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.553510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.554163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.646169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.683818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-120dea20-492e-490a-b236-f5106c688faf tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.259235 Oct 18 16:03:56.684719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 442/872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:56 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:56.690003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8119dd60-6ba9-466e-b2e1-94d8892fc406", "tag": "f37100fb-faf4-45fe-a847-3cce12c7a10e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:56.705907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:56.706382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:56.706810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:56.719526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] Creating event network-changed:f37100fb-faf4-45fe-a847-3cce12c7a10e for instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 on n-h2-858383-14 Oct 18 16:03:56.725652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-affae206-4154-4583-8179-477a4b8866a8 req-745907bd-22cc-4021-8600-16c39f9b41b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039682 Oct 18 16:03:56.726690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 443/873] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:56.731977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f350d502-1063-47e0-b2e6-3645664857af tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd21964c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:56.791166 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f350d502-1063-47e0-b2e6-3645664857af tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.063250 Oct 18 16:03:56.799678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 444/874] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:56 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:56.830250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:56.842763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-335ae9ae-968c-4c59-b7d0-2ba5fa522d1d tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.317724 Oct 18 16:03:56.844552 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 431/875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:56 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:57.181130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.181860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:57.188251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.188770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.189240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.190150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.190613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.191151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.195962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:57.347615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.361408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.363106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.364222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e79d318-ec5b-4b07-b8a1-ded090cde53f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.188349 Oct 18 16:03:57.364985 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 445/876] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:03:57.411238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.412549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:57.418754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.419498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.420284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.420927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.421642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.422140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.551521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.552149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:57.559773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.561056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.561056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.561442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.561900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.562576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.587841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.599984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2161d688-5d29-4ea6-a3ab-9ae99febeedf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.192963 Oct 18 16:03:57.600592 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 432/877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:57.718094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.718993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:57.764717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.768101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.770881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.771941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.774014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.774733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.775369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.776465 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92287292-c368-42a5-ba2c-b65b28f89c12 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.228924 Oct 18 16:03:57.788824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 446/878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:57.807903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b839149e-a8b1-4257-8f9c-794e07acb36f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223b5e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.872420 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b839149e-a8b1-4257-8f9c-794e07acb36f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.068684 Oct 18 16:03:57.882298 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 447/879] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:57.891539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:57.893279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:57.899849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.900484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.901249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.902843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:57.903385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:57.903906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:57.958244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:57.971427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72462855-16e3-4d96-876a-54277f69212d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.260484 Oct 18 16:03:57.972033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 433/880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:58.079559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:58.088523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a59141ed-ac8e-445f-bfcb-32f6e157ba98 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.204841 Oct 18 16:03:58.095764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 448/881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:57 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:58.390057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:58.390671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:58.399413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.399898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.400335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.401068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.401529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.401956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.560511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:58.569470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:58.571391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:58.572754 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97424b58-70f9-4cf4-a830-d339b430161a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.187012 Oct 18 16:03:58.573540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 434/882] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:58 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:58.623643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:58.624346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:58.631352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.631838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.632292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.633059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.633514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.634361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.776289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:58.785839 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05c568f0-5b00-448a-8616-63fdbca59c77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.166069 Oct 18 16:03:58.786628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 449/883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:58 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:58.810504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:58.811900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:58.849576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.850033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.850890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.853355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:58.856282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:58.856801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:58.888179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-235ee3d8-fda2-49d1-8de7-c788275f8d0a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2475700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:58.976694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-235ee3d8-fda2-49d1-8de7-c788275f8d0a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.090221 Oct 18 16:03:58.990474 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 450/884] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:58 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:03:58.995889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:58.996512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:59.003453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.003959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.004397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.005998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.005998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.005998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.149353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.159639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-383a98f5-137c-42b0-ac7b-2e2de25ace73 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.357152 Oct 18 16:03:59.170928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 435/885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:58 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:59.184072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:59.185264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:59.202603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.204817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.206069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.209955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.210779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.211491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.356224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.367827 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-edc1ba80-a173-46b9-a96c-c560cbe42204 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.375937 Oct 18 16:03:59.368619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 451/886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:58 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:59.411613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "name": "network-vif-plugged", "status": "completed", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:59.427102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.427619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.428257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.446454 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] Creating event network-vif-plugged:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h1-858383-14 Oct 18 16:03:59.451739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b46a3cf3-8f2e-475a-a864-e17652f0fad5 req-3f3a33e7-9a92-4269-a6c7-ae71d0cc4a6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045554 Oct 18 16:03:59.453759 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 452/887] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:59.541283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.551605 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b2930e6-0b90-4811-bd25-9fbbcc319150 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.377173 Oct 18 16:03:59.568318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 436/888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:59 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:59.599673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:59.600374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:59.608190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.608682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.609153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.609859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.610335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.610772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.765042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.776414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.778304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.779040 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e62a317-dd57-4690-99a3-c037c78ab7d0 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.183644 Oct 18 16:03:59.793772 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 453/889] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:03:59 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:03:59.809788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:59.810399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:59.826033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.826522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.826952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.827671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:59.828122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:59.828540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:59.982036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:59.991089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bca69056-7972-4ec8-a32e-65f97cd404c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.185066 Oct 18 16:04:00.005031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01930e0a-0baa-47f5-ba7e-eb10cc17ed2a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223b040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:00.005848 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 437/890] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:59 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:00.070247 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01930e0a-0baa-47f5-ba7e-eb10cc17ed2a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.078804 Oct 18 16:04:00.086352 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 454/891] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:59 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:00.196251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:00.196852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:00.203274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.204097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.204785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.205882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.206653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.207307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.390807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:00.391425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:00.398187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.398676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.399113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.399810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.400265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.400689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.466597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:00.479843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf6b4cd3-900a-4f8b-8543-811a9ffe7af4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.287054 Oct 18 16:04:00.480430 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 438/892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:00 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:00.573213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:00.578687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:00.579624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:00.584437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-381304e9-221c-4b3c-9d5a-2887ab22c935 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.197399 Oct 18 16:04:00.585534 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 455/893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:00 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:00.591934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.592753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.593272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.594205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.595193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.595784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.807139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:00.808406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:00.810434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=22 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:00.817172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.817659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.818496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.818783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:00.819243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:00.819651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:00.854022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:00.867371 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ae644f2-836e-4b91-8d24-c81dc8ed7d00 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.292897 Oct 18 16:04:00.885424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 439/894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:00 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:01.017425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:01.018826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:01.026031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.026525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.026728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.026964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.027663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.033180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.033628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.036422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.037882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.039941 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24cfb718-bf6f-432f-a757-42d288eb4ead tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1362 microversion: 2.25 time: 0.236208 Oct 18 16:04:01.040515 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 456/895] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:00 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:01.088453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a0870b0-de04-4645-adef-c94e7c5ac974 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223b670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:01.158881 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a0870b0-de04-4645-adef-c94e7c5ac974 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1424 microversion: 2.1 time: 0.070677 Oct 18 16:04:01.168204 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 457/896] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:01 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:01.236818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.244963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2bc5f98-fe0f-4671-87e8-f7b863b2ba82 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.232509 Oct 18 16:04:01.261393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 440/897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:01 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:01.506689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:01.507394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:01.513571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.514052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.514501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.515192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.515808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.516231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.608641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:01.609289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:01.615892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.616381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.616816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.617537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.617993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.618418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.657058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.682658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d735554e-c3d0-402f-897c-a26da0ce23ef tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.180256 Oct 18 16:04:01.683136 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 458/898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:01 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:01.754814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:01.762548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca6bc67d-f81c-4f85-aa05-fd8fbc11ce36 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.157852 Oct 18 16:04:01.763116 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 441/899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:01 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:01.893510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:01.894108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:01.900432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.900905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.901371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:01.902049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:01.902501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:01.902919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.031221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.039134 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15df91df-b3e8-4a78-af2d-9a03118b1d61 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.150036 Oct 18 16:04:02.039705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 459/900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:01 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:02.068125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.068731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.074629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.075108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.075539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.076216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.076665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.077114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.096690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:02.176307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-333d705b-63cd-466d-b093-cf06ef3f8527 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223ba60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.211277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.219819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.221287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.221639 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-333d705b-63cd-466d-b093-cf06ef3f8527 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1433 microversion: 2.1 time: 0.049685 Oct 18 16:04:02.222226 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 460/901] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1433 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:02.222431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09b1e9e2-b70e-429e-b7e9-70cd2b152b63 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1558 microversion: 2.25 time: 0.158914 Oct 18 16:04:02.222973 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 442/902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:02.237263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50d99b6b-2ab3-4e6e-a318-3316dc577550 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd28283a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.247892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.248526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.255380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.255871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.256344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.257068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.257528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.257977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.281932 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50d99b6b-2ab3-4e6e-a318-3316dc577550 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 200 len: 1433 microversion: 2.1 time: 0.049106 Oct 18 16:04:02.282789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 461/903] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 1433 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:02.287441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.288222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.294784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.295274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.295710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.296580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.297314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.298257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.391327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:02.404387 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38505c18-ee2b-4ad9-876c-ff4d52ac976b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 2053 microversion: 2.25 time: 0.160546 Oct 18 16:04:02.404969 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 443/904] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 2053 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:02.409933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.410764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.417631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.418368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.418962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.419827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.420441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.421027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.452057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.459862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-532a86b0-bedd-466f-804f-0f87c95c9cea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.175750 Oct 18 16:04:02.460358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 462/905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:02.466583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.467432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.473773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.474335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.474844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.475616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.476148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.476651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.560041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.567795 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b83e6efb-c193-49cb-af18-fd57e500821a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1467 microversion: 2.1 time: 0.161836 Oct 18 16:04:02.568383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 444/906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:02.589925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37db524f-840c-4aba-8f90-0860def69e8a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd290c0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.604749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:02.618895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-080ebc3b-00af-415d-8a0a-9cdc0547ec23 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 2053 microversion: 2.25 time: 0.155730 Oct 18 16:04:02.619600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 463/907] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 2053 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:02.634831 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37db524f-840c-4aba-8f90-0860def69e8a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce" status: 200 len: 784 microversion: 2.1 time: 0.048273 Oct 18 16:04:02.635675 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 445/908] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce => generated 784 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:02.642638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.646311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.646790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.647225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.647956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.648404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.648843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.650735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dec43624-c0f8-44ed-bf06-e34f7fc12b50 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.658959 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dec43624-c0f8-44ed-bf06-e34f7fc12b50 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012128 Oct 18 16:04:02.659738 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 446/909] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:02.671075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed2fb676-b14b-4108-97dc-82665028d629 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd255ddc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.672503 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed9bf0e7-d8be-406a-871b-b75b2fa36945 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.033368 Oct 18 16:04:02.673736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 464/910] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:04:02.685817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:02.686341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.692543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.693041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.693474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.694164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.694614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.695031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.763537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a1d444a-fdef-489c-b756-868027137d28 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961/action" status: 202 len: 0 microversion: 2.25 time: 0.080984 Oct 18 16:04:02.767115 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 465/911] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:04:02 2022] POST /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:04:02.769659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.770296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.777254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.777864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.778179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.778875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.779544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.779788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.929613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:02.940200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95bbedaa-cc89-4617-86b5-796cab7b1284 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.174794 Oct 18 16:04:02.942291 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 466/912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:02.947322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:02.947928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:02.958548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.959027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.959466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:02.960152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:02.960598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:02.961210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.120250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:03.132458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:03.149273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b34007c-2ef5-4728-a8e3-44610ba75dc6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 2058 microversion: 2.25 time: 0.205538 Oct 18 16:04:03.149860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 467/913] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:02 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 2058 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:03.154446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.155258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:03.163044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.163947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.165071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.165970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.166626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.167234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.193888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed2fb676-b14b-4108-97dc-82665028d629 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "DELETE /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 204 len: 0 microversion: 2.1 time: 0.526250 Oct 18 16:04:03.194890 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 447/914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:02 2022] DELETE /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:04:03.200217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.201160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:03.208310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.209011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.209638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.210780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.211691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.212335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.316650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:03.325370 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c83c97ac-0348-4f79-9042-4950773baeae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.174306 Oct 18 16:04:03.326097 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 468/915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:03.331570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cce31-7467-4dc8-bb86-54edbd457d87", "name": "network-vif-plugged", "status": "completed", "tag": "1da0bdbd-9348-4ee3-84e5-7897a45e7c08"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:03.341950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.343140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.343140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.355352 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] Creating event network-vif-plugged:1da0bdbd-9348-4ee3-84e5-7897a45e7c08 for instance c47cce31-7467-4dc8-bb86-54edbd457d87 on n-h1-858383-14 Oct 18 16:04:03.361286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:03.361906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6f18484d-ae7d-45c3-b935-170d039f5152 req-eaac794b-6261-4951-af5b-59f732dfed02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Oct 18 16:04:03.362812 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 469/916] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:03.368713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50e46b91-6c37-4f93-b339-dda26828cbcb tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2137ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.371517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-378899c7-ef24-4377-8458-45053fe2bb85 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.174788 Oct 18 16:04:03.372215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 448/917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:03.400748 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-50e46b91-6c37-4f93-b339-dda26828cbcb tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] HTTP exception thrown: Image not found. Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50e46b91-6c37-4f93-b339-dda26828cbcb tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Request method failure captured: Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a HTTP/1.1 Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs5EotBrWa7wxO2v-Pl1pEBRRiPhZaMQDfCg1iGDUk3USd2-NsV721kZq8ivfwZSBixC6dMgozBRnIJeeWrccegIrKQp2m5CAVN5KZjNIBzi7B0RtNCOOvQOjMzTk02nAFyYKnUcFSYZupGTcyfi4Iv-wOIzLX6YIG4ViH2BmPbcCWM Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:04:03.403090 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}] Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7f02637b1935426280f2ad6bcfa61b26 Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a'} Oct 18 16:04:03.404582 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:04:03.405971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:04:03.414098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a could not be found. Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:04:03.416819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50e46b91-6c37-4f93-b339-dda26828cbcb tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:03.419118 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50e46b91-6c37-4f93-b339-dda26828cbcb tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 404 len: 62 microversion: 2.1 time: 0.040297 Oct 18 16:04:03.420450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 470/918] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:04:03.420967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-266587060"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:03.426398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:03.429170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:03.433167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.433656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.434087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.434866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.435324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.435747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.481829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.482802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:03.490796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.491707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.495282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.496027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.496493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.496923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.527715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:03.639355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:03.648790 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85533ca7-66d2-4ec2-b4ff-b1aa32302eb0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.170974 Oct 18 16:04:03.649396 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 471/919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:03.649638 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e54aa2d8-1f76-46a5-9a95-63ca05e46139 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "POST /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd/action" status: 202 len: 0 microversion: 2.1 time: 0.236800 Oct 18 16:04:03.650363 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 449/920] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:03 2022] POST /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:04:03.669912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-626e9691-77f6-4b79-b1f9-199dc41f8e96 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd21378b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.720311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-626e9691-77f6-4b79-b1f9-199dc41f8e96 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.053741 Oct 18 16:04:03.720968 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 472/921] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:03.966201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:03.966892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:03.973915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.974399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.974827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:03.975532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:03.975980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:03.976397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.110700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:04.118522 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e4382d4b-ba41-4e3a-86e8-e751c2e4a4de tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.156530 Oct 18 16:04:04.119236 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 450/922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:03 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:04.176390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:04.177028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:04.183128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.183611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.184048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.184737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.185272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.185644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.315461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:04.328264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7528c66a-a9a7-45df-8f5c-6e7ad6f0342b tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 2038 microversion: 2.25 time: 0.156574 Oct 18 16:04:04.328842 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 473/923] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:04 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 2038 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:04.349321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:04.350042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:04.353928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-14", "block_migration": "auto"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:04.356510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.356633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:04.357035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.357472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.358297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.358756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.359247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.362967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.363454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.363892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.364584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.365063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.365491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.392884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'flavor' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:04.405190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Going to try to live migrate instance to n-h2-858383-14 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:04:04.491096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:04.499002 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6bdfe09-2289-436e-9dd4-2c13b417d807 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.153562 Oct 18 16:04:04.499663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 451/924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:04 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:04.506535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:04.507377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:04.510493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:04.513980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.514487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.515090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.515790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.516379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.516733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.654397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:04.662569 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de97b17f-516c-412a-9d5a-48a4d8ca2b68 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.161805 Oct 18 16:04:04.663153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 452/925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:04 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:04.683395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:04.684013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:04.691008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.691491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.691928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.692646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:04.693192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:04.693635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:04.829465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:04.837339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-469e28c5-f141-46e9-b807-f45b6c4fd7f5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.157717 Oct 18 16:04:04.843497 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 453/926] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:04 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:04.849364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-791f0b1c-26ec-43ab-b7eb-20cb80151525 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd279c040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:04.895198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-791f0b1c-26ec-43ab-b7eb-20cb80151525 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.050531 Oct 18 16:04:04.895835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 454/927] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:04 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:05.142721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:05.143324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:05.149452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.149932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.150360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.151044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.151496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.151917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.294271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:05.302388 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36ba29e5-ba56-46be-b344-f4c98619603d tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1469 microversion: 2.1 time: 0.164164 Oct 18 16:04:05.303144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 455/928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:05 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:05.378511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8119dd60-6ba9-466e-b2e1-94d8892fc406", "name": "network-vif-plugged", "status": "completed", "tag": "f37100fb-faf4-45fe-a847-3cce12c7a10e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:05.387782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.388253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.388678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.399985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] Creating event network-vif-plugged:f37100fb-faf4-45fe-a847-3cce12c7a10e for instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 on n-h2-858383-14 Oct 18 16:04:05.404761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-234b0612-358b-4111-a96b-d3cb198bf826 req-cbd974c3-32c2-4e37-a3dc-d7f0ec604c85 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029902 Oct 18 16:04:05.405385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 456/929] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:05.524191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:05.524893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:05.531387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.531859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.532978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.533772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.534267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.534749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.700640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:05.708572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcebde8d-518f-45c7-8d39-a98811203add tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.188591 Oct 18 16:04:05.709179 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 457/930] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:05 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:05.713592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:05.714264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:05.720460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.720944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.721407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.722096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.722558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.722984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.854017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:05.862905 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e741bab9-d26f-49fb-b4cb-4c860baf866c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1322 microversion: 2.1 time: 0.152780 Oct 18 16:04:05.863466 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 458/931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:05 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:05.867920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:05.868521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:05.874052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.874531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.874963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:05.875645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:05.876152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:05.876577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.004382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:06.012221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a121391c-557f-460f-864e-b38409a7857e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.147810 Oct 18 16:04:06.012784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 459/932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:05 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:06.017617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58056829-acce-43e8-b51a-99486bb39bc8 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd274fdc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:06.061223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58056829-acce-43e8-b51a-99486bb39bc8 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.047374 Oct 18 16:04:06.061811 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 460/933] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:06 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:06.326894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:06.327524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:06.334307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.334789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.335224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.335913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.336370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.336799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.473032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:06.480972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-416f50c9-96da-4b4c-887a-8a82d6aec719 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1487 microversion: 2.1 time: 0.158428 Oct 18 16:04:06.489987 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 461/934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:06 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1487 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:06.731886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:06.732567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:06.739066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.739547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.739985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.740670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.741161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.741608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.868563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:06.877020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8227ac1e-75e0-465c-a77e-6f5794d0a63b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1309 microversion: 2.1 time: 0.149256 Oct 18 16:04:06.877579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 462/935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:06 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:06.885718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:06.886325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:06.892153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.892627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.893121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.893807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:06.894254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:06.894680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:06.898707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:07.024788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.033617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d5833eca-7fe9-48b8-9dbf-eb44c7c98ce0 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1472 microversion: 2.1 time: 0.151247 Oct 18 16:04:07.034187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 463/936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:06 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:07.038677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.039271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.044987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.045503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.045948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.046693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.047151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.047579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.185503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.195913 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8345e1f-957e-43a8-bee4-e27854751aa4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.160113 Oct 18 16:04:07.196638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 464/937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:07.201344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.201842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.208747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.209286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.210111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.210404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.210855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.211280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.236751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Request method failure captured: Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87/diagnostics HTTP/1.1 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs5ez_3szqECT7b2j0mE3-O0g5gaCFTbYCl8oDOWfgtz-FxjazQqZ_M0m9vvkB27tuPq9Wn_1lcNqjDyGXK2igLLGBnJ0fC5VnehnwvaVxQruHX4wKzDv1Z6TWLVsUnWCwvlnJiKbBAN-wqPkeE-11sv1QpVl0O_j6tiqIDFQLLa3bM Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 8df69999b99949399425279771c6b144 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:04:07.245238 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8df69999b99949399425279771c6b144"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8df69999b99949399425279771c6b144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8df69999b99949399425279771c6b144"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8df69999b99949399425279771c6b144"}]}] Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 8df69999b99949399425279771c6b144 Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiagnosticsNegativeTest-54347387-project Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7053f2f36beb4afd87463bf4acb0502d Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-54347387-project Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:04:07.246591 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': 'c47cce31-7467-4dc8-bb86-54edbd457d87'} Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:04:07.247342 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:07.249157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:07.250257 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b9259bd-82dd-4527-bccb-fda8096b814a tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.049240 Oct 18 16:04:07.250257 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 465/938] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87/diagnostics => generated 117 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:07.252067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eea85e39-712f-4e00-96ee-b81b6d54749f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd26501f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.297023 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eea85e39-712f-4e00-96ee-b81b6d54749f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.048767 Oct 18 16:04:07.298428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 466/939] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:07.303051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.303622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.310538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.311127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.311636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.312406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.312938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.313693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.338654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:04:07.417456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-baabab05-214f-49f3-b992-2d7469a9fdd6 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 204 len: 0 microversion: 2.1 time: 0.117607 Oct 18 16:04:07.418241 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 467/940] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:04:07 2022] DELETE /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:07.427097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.427774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.433748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.434202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.434647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.435345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.435799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.436226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.570770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.578564 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b10c5be-afa0-4035-9989-70875827cbf9 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1478 microversion: 2.1 time: 0.156237 Oct 18 16:04:07.579851 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 468/941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:07.584318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-unplugged", "status": "completed", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:07.594234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.595359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.595788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.607671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] Creating event network-vif-unplugged:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:04:07.613666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ca67e35d-1203-4fac-9869-75a99418ef38 req-0ddb218d-6989-43ad-acb6-a09ca4dea794 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032564 Oct 18 16:04:07.613828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-60046c68-04f0-48db-9ec5-e6e8f963b740 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961/action" status: 202 len: 0 microversion: 2.25 time: 3.263164 Oct 18 16:04:07.614533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 469/942] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:07.617951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 474/943] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:04:04 2022] POST /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961/action => generated 0 bytes in 3268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:04:07.621608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.622318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.622939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.623544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.628844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.629365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.629800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.630497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.630953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.631061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.631381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.631508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.631942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.632624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.633095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.633514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.770326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.770860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.778301 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73f5a841-ff02-4f7b-8856-eec196489a75 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.162624 Oct 18 16:04:07.778869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 470/944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:07.779127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.780574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:07.781766 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f8935b4-5c7e-42a9-b42d-4ff892895dff tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.162764 Oct 18 16:04:07.783260 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 475/945] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:07.898989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:07.899596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:07.905627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.906107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.906554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:07.907286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:07.907774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:07.908327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.039569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.047171 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88030ce8-8f80-4435-b0db-7e0e8bb8befc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1493 microversion: 2.1 time: 0.152045 Oct 18 16:04:08.047761 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 471/946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:07 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1493 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:08.069469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.070086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.076390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.076876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.077386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.078068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.078519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.079752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.205554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-31fbf58c-b8cd-402c-9e5e-d74d5eadefe2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1646 microversion: 2.1 time: 0.139601 Oct 18 16:04:08.206122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 476/947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1646 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:08.218088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.218705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.225209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.225712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.226130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.226818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.227345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.227609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.227823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.228216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.234587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.235575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.236110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.236891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.237464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.237895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.361939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.367240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08cab664-0950-4aae-8c0d-cf76aacd68e1 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1646 microversion: 2.1 time: 0.143180 Oct 18 16:04:08.367821 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 477/948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1646 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:08.369603 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca599f74-2adc-4208-ac2d-abac1de7d5e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.155282 Oct 18 16:04:08.370318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 472/949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:08.372281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee7cab58-94fc-4a59-982d-59c9aedac315 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd20e5040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.390692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.394474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.395038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.395532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.396350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.396867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.397373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.415691 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee7cab58-94fc-4a59-982d-59c9aedac315 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.046859 Oct 18 16:04:08.416577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 478/950] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:08.420475 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3cc0fb94-7d78-4101-a892-71fb377bed32 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.033500 Oct 18 16:04:08.421082 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 473/951] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:08.433447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:08.434034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.441121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.441610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.442050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.442738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.443198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.443632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.506887 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d9bd81c-95a0-488b-a028-cc8600bd2a61 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406/action" status: 202 len: 0 microversion: 2.1 time: 0.077300 Oct 18 16:04:08.507504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 479/952] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:08 2022] POST /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:04:08.515433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.516133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.522777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.523266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.523807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.524627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.525170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.525583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.606054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.606757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.614155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.614754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.615071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.615765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.616220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.616645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.655375 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce3e9a33-3e51-40de-b4bb-93d904ef219d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1651 microversion: 2.1 time: 0.143555 Oct 18 16:04:08.655873 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 474/953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1651 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:08.749344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.757257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94dc3c22-d7fc-497e-a507-272e95e9d067 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1478 microversion: 2.1 time: 0.155696 Oct 18 16:04:08.757828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 480/954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:08.803167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.803793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.808604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:08.809269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:08.812122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.812626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.813129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.813838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.814462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.814903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.815710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.816202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.816637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.817353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:08.817806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:08.818510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:08.946050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.954322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.954639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eff64acc-d948-43df-97ae-010c610071f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.154790 Oct 18 16:04:08.955427 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 475/955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:08.962616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.964355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:08.965527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08a7acdf-d003-49b4-a090-c697f6ff0785 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.161362 Oct 18 16:04:08.966096 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 481/956] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:08 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:09.394053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:09.394654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:09.400632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.401147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.401580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.402258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.402709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.403126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.431483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c2d41a6-b99f-479a-9b5e-ec5f77812313 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2105670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:09.484632 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c2d41a6-b99f-479a-9b5e-ec5f77812313 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.056820 Oct 18 16:04:09.485504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 482/957] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:09 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:09.551156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:09.558761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5435bad9-d339-4972-a513-343dc3bab304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1498 microversion: 2.1 time: 0.169455 Oct 18 16:04:09.559321 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 476/958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:09 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:09.679563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:09.680163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:09.687064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.687064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.687064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.687727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.688876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.689317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.781407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:09.783562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:09.790192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.791043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.791697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.792602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.793272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.793899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.823102 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6cb7cea-9bc4-44f9-acd1-69b57c42dc1d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1631 microversion: 2.1 time: 0.147211 Oct 18 16:04:09.823924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 483/959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:09 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1631 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:09.847622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:09.850530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:09.857177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.857669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.858118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.858818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.859271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.859749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.886198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lazy-loading 'flavor' on Instance uuid 8119dd60-6ba9-466e-b2e1-94d8892fc406 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:09.898945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Going to try to live migrate instance to n-h1-858383-14 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:04:09.920328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:09.937834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:09.946799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8425d8e8-2c27-4704-bf05-2bbac3a8d17c tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1478 microversion: 2.1 time: 0.170681 Oct 18 16:04:09.947489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 477/960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:09 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:09.978687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:09.980263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:09.988527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.989057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.989503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:09.990219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:09.990679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:09.991325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.138638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:10.147036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1717cb9-5052-4a6d-9526-c4d26a079bcb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.172503 Oct 18 16:04:10.147648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 478/961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:09 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:10.152553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:10.153307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:10.167759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.169001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.170165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.171174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.171972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.173553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.349710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:10.366123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:10.367697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:10.368855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a03d94d2-aba6-4136-b4d0-1645baac6ff2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.219955 Oct 18 16:04:10.369624 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 479/962] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:10 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:10.499653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-051dddb1-9a0f-4a68-b860-776464bddd21 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2a7ea60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:10.543643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-051dddb1-9a0f-4a68-b860-776464bddd21 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.047799 Oct 18 16:04:10.544204 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 480/963] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:10 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:10.582317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:10.582925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:10.589032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.589516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.589951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.590636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.591106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.591529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.758917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:10.762783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:10.770114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23fa5fa4-75ca-4860-b9be-1422321d8286 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 200 len: 1475 microversion: 2.1 time: 0.191520 Oct 18 16:04:10.770807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 481/964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:10 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:10.793669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-187451455"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:10.796095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:10.803456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.804509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.804961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:10.805711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:10.806683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:10.807271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:11.063456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e30e6b2-978b-4350-aec1-54abb268b253 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167/action" status: 202 len: 0 microversion: 2.1 time: 0.273529 Oct 18 16:04:11.068287 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 482/965] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:10 2022] POST /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 16:04:11.078112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:11.079618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:11.088506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:11.089295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:11.089860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:11.090851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:11.091992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:11.092867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:11.423660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:11.432854 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f38c68e5-4853-4372-be59-fc2b69c14843 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1478 microversion: 2.1 time: 0.362877 Oct 18 16:04:11.456716 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 483/966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:11 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:11.464896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-44f6ea92-cf81-4658-9cc9-ac9afdba3ac4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd290c820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:11.512379 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-44f6ea92-cf81-4658-9cc9-ac9afdba3ac4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.053273 Oct 18 16:04:11.513138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 484/967] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:11 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:11.525561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:11.526169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:11.533039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:11.533559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:11.533997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:11.534696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:11.535146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:11.535559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.165209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:12.173489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dbc18992-48a7-4474-8a57-d16778c41a22 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.651552 Oct 18 16:04:12.190317 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 485/968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:11 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:12.190317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-unplugged", "status": "completed", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:12.190317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.190317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.190694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.200669 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] Creating event network-vif-unplugged:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:04:12.205442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0e8983ff-bee4-4613-82e8-3a2c061df568 req-3b192b46-63e3-45ee-a1fd-aa565e73a9fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029758 Oct 18 16:04:12.206026 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 486/969] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:12.211759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:12.212485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:12.218543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.219086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.220063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.220792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.221310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.221817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.482950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:12.491709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:12.493165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:12.494409 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6451b0d8-e48f-4ae7-b062-07dcb4e26141 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.286634 Oct 18 16:04:12.494979 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 487/970] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:12 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:12.499277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb35a420-78eb-4e54-bbe2-936ed37994aa tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd29823a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:12.554627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb35a420-78eb-4e54-bbe2-936ed37994aa tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.058363 Oct 18 16:04:12.555193 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 488/971] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:12 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:12.561687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:12.565893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:12.573937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.574420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.574851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.576764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.577077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.577513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.654710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=16 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:12.713558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:12.725140 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7641ef1b-20cd-4156-9ae8-80ded46323d7 tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1436 microversion: 2.1 time: 0.166888 Oct 18 16:04:12.727329 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 489/972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:12 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1436 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:12.736244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ce4397e-bf09-466a-80e6-b08b31c072c7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd28c3ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:12.771214 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b7c1070-ad37-4a72-82bd-b130eef6921d tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406/action" status: 202 len: 0 microversion: 2.1 time: 2.928032 Oct 18 16:04:12.772494 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 484/973] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:09 2022] POST /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406/action => generated 0 bytes in 2931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:04:12.781544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:12.783092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:12.793770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ce4397e-bf09-466a-80e6-b08b31c072c7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.065335 Oct 18 16:04:12.795629 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 490/974] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:12 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:12.796287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.797195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.797893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.799931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.800862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.801824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.806087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cce31-7467-4dc8-bb86-54edbd457d87", "name": "network-vif-deleted", "tag": "1da0bdbd-9348-4ee3-84e5-7897a45e7c08"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:12.829439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:12.829887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:12.830331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:12.853544 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] Creating event network-vif-deleted:1da0bdbd-9348-4ee3-84e5-7897a45e7c08 for instance c47cce31-7467-4dc8-bb86-54edbd457d87 on n-h1-858383-14 Oct 18 16:04:12.860908 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ef1a193f-58ab-4fda-8946-9d26e376fb74 req-16deb8db-8a25-4db4-a23a-cdc7d888ee5e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057422 Oct 18 16:04:12.862945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 491/975] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:13.006975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:13.014650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5ad264e8-d775-430a-8a5d-52f6436d2b19 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.238162 Oct 18 16:04:13.015226 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 485/976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:12 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:13.198010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:13.199491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:13.205840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.206719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.207168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.208047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.208681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.209256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.520876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:13.521604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:13.528785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.529447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.529981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.530944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.531627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.533335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.536925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:13.546316 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-abe5b242-e10d-48a4-b31b-5b20a657888f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.352291 Oct 18 16:04:13.565315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 492/977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:13 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:13.573196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f63e237-0f03-42bc-8c2d-3267a63d961f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2a29af0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:13.627287 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f63e237-0f03-42bc-8c2d-3267a63d961f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.060389 Oct 18 16:04:13.628125 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 493/978] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:13 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:13.752447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:13.753203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:13.772149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:13.779194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.784286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.785332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.786554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:13.788214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:13.789456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.789950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.790179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-302d8a6e-b683-452b-9509-c89c6b7e34b3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.273574 Oct 18 16:04:13.790390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.797891 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 486/979] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:13 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:13.821078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73462c4b-5286-48f3-a381-d63ce82a9ca3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2111f70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:13.898746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73462c4b-5286-48f3-a381-d63ce82a9ca3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.090910 Oct 18 16:04:13.899577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 487/980] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:13 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:13.929625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:13.930180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:13.930634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:13.931099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lazy-loading 'fault' on Instance uuid c47cce31-7467-4dc8-bb86-54edbd457d87 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:14.015430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053f2f36beb4afd87463bf4acb0502d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df69999b99949399425279771c6b144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:14.023575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e07df285-8db1-4eec-ac4f-ce2ebc67704b tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 200 len: 1312 microversion: 2.1 time: 0.276415 Oct 18 16:04:14.037411 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 494/981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:13 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:14.042166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:14.044002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:14.051808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.052843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.053454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.054370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.054983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.055406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.224228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-plugged", "status": "completed", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}, {"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-plugged", "status": "completed", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:14.243741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.244515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.244959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.269446 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Creating event network-vif-plugged:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:04:14.270771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] Creating event network-vif-plugged:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:04:14.280330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1fc3a10e-e32b-49b3-b3b7-1bf630a4b227 req-87ba99d9-c0d8-4705-8c30-26e506f2a4a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062319 Oct 18 16:04:14.281163 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 495/982] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:14.295487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:14.312484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7505ea17-3218-4ce4-9ae2-001c54e61ee4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.277204 Oct 18 16:04:14.314525 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 488/983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:14 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:14.573059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:14.573922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:14.583172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.584071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.584807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.586013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.587712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.588324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.645143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62f5f2b0-60ed-4157-91c0-88bc2c32b475 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2151dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:14.705025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62f5f2b0-60ed-4157-91c0-88bc2c32b475 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.065152 Oct 18 16:04:14.705654 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 489/984] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:14 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:14.826198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:14.827626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:14.835535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:14.838058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.838954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.839679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.840427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.841215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.841794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.856550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:14.869238 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7390c83d-b49f-445b-86a0-1e7cbc11a693 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.299819 Oct 18 16:04:14.869825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 496/985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:14 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:14.899817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "name": "network-vif-unplugged", "status": "completed", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}, {"name": "network-changed", "server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:14.917485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:14.920545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:14.921011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:14.951213 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Creating event network-vif-unplugged:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h1-858383-14 Oct 18 16:04:14.951724 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] Creating event network-changed:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h1-858383-14 Oct 18 16:04:14.966240 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c59f9039-19f7-4dcc-b96b-b77d5f95db50 req-26b64f65-3503-4d7d-a083-63b217b9a99e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071008 Oct 18 16:04:14.966870 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 497/986] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:14.972114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-faaec3a5-a344-41c3-b5a7-3ae95836370a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd255d430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:15.030559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:15.039183 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-faaec3a5-a344-41c3-b5a7-3ae95836370a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.071116 Oct 18 16:04:15.041535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:15.044048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:15.046343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98357392-839e-4950-9edd-5b7bcd99e844 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.224375 Oct 18 16:04:15.048001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 490/987] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:14 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:15.049140 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 498/988] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:14 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:15.069661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:15.070397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] [instance: c47cce31-7467-4dc8-bb86-54edbd457d87] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:15.077297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.078003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.078657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:15.079531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.080143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.080863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:15.096213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] HTTP exception thrown: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Request method failure captured: Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 HTTP/1.1 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs5ez_3szqECT7b2j0mE3-O0g5gaCFTbYCl8oDOWfgtz-FxjazQqZ_M0m9vvkB27tuPq9Wn_1lcNqjDyGXK2igLLGBnJ0fC5VnehnwvaVxQruHX4wKzDv1Z6TWLVsUnWCwvlnJiKbBAN-wqPkeE-11sv1QpVl0O_j6tiqIDFQLLa3bM Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 8df69999b99949399425279771c6b144 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:04:15.098177 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8df69999b99949399425279771c6b144"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8df69999b99949399425279771c6b144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8df69999b99949399425279771c6b144"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8df69999b99949399425279771c6b144"}]}] Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 8df69999b99949399425279771c6b144 Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-54347387 Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerDiagnosticsNegativeTest-54347387-project Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7053f2f36beb4afd87463bf4acb0502d Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-54347387-project Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. Oct 18 16:04:15.099794 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c47cce31-7467-4dc8-bb86-54edbd457d87'} Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:15.100744 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. Oct 18 16:04:15.102281 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:15.104665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] Returning 404 to user: Instance c47cce31-7467-4dc8-bb86-54edbd457d87 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:15.106311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49bd568e-3330-4b30-b456-4c9f2357de9e tempest-ServerDiagnosticsNegativeTest-54347387 tempest-ServerDiagnosticsNegativeTest-54347387-project] 10.222.0.78 "GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87" status: 404 len: 111 microversion: 2.1 time: 0.040217 Oct 18 16:04:15.110545 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 491/989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:15 2022] GET /compute/v2.1/servers/c47cce31-7467-4dc8-bb86-54edbd457d87 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:15.339741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:15.340539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:15.349316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.349815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.350870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:15.354045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.354559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.355811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:15.723551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c12e8820-a824-467a-9160-faff3c5e0d6a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223b820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:15.755210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:15.770192 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a264b52-761a-40ca-8d8c-62b19c31d81b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.434244 Oct 18 16:04:15.771348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 499/990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:15 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:15.800299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c12e8820-a824-467a-9160-faff3c5e0d6a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.083001 Oct 18 16:04:15.801696 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 492/991] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:15 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:15.896841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:15.897577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:15.908441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.909311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.910152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:15.913446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:15.913999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:15.914994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:16.059772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-31307cd8-63f6-42f2-9e12-4c02514824ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2111940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:16.160739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-31307cd8-63f6-42f2-9e12-4c02514824ef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.105472 Oct 18 16:04:16.165183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 493/992] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:16 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:16.191801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:16.199419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:16.245556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:16.249801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:16.252104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:16.254804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:16.255522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:16.257368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:16.401187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:16.409985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae4a34d7-5561-4d20-8496-b6953b288517 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1475 microversion: 2.1 time: 0.516930 Oct 18 16:04:16.425628 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 500/993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:15 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1475 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:16.568619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:16.585651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:16.588088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:16.590662 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4461cdd-271d-4334-8a31-4e6954ca262f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.423897 Oct 18 16:04:16.591908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 494/994] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:16 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:16.799379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:16.800325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:16.810173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:16.818199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f038ee76-3bb7-4e80-a85a-8f67756daee9 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd223b310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:16.822317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:16.823889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:16.827256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:16.830260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:16.830921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:16.924794 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f038ee76-3bb7-4e80-a85a-8f67756daee9 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.111409 Oct 18 16:04:16.928663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 495/995] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:16 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:17.012785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8119dd60-6ba9-466e-b2e1-94d8892fc406", "name": "network-vif-unplugged", "status": "completed", "tag": "f37100fb-faf4-45fe-a847-3cce12c7a10e"}, {"name": "network-changed", "server_uuid": "8119dd60-6ba9-466e-b2e1-94d8892fc406", "tag": "f37100fb-faf4-45fe-a847-3cce12c7a10e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:17.031212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.032234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.032673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.054241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Creating event network-vif-unplugged:f37100fb-faf4-45fe-a847-3cce12c7a10e for instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 on n-h2-858383-14 Oct 18 16:04:17.054746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] Creating event network-changed:f37100fb-faf4-45fe-a847-3cce12c7a10e for instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 on n-h2-858383-14 Oct 18 16:04:17.075892 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-beb37660-65a8-4474-9a13-16b3b74312c9 req-d687b4c8-e65d-49c3-a679-3d99ac3e82da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.066514 Oct 18 16:04:17.077555 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 496/996] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:17.090114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:17.101586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c40dd3f-b581-4c81-ba89-782f6146fe30 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.307199 Oct 18 16:04:17.122763 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 501/997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:16 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:17.180466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-91acedd9-afe8-4d9c-a7c4-855432525066 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2828e50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:17.259897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-91acedd9-afe8-4d9c-a7c4-855432525066 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.086444 Oct 18 16:04:17.260582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 497/998] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:17 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:17.439203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:17.440187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:17.450631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.454893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.455483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.456333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.457805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.458556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.618466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:17.621652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:17.643787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.644228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.644627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.645412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.645881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.646317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.783449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:17.799951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eeef557f-035f-419a-a67d-3bd2e0736ea3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1461 microversion: 2.1 time: 0.364151 Oct 18 16:04:17.804138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 502/999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:17 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1461 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:17.826602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:17.827216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:17.834440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.834933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.835369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:17.836070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:17.836525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:17.836945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.030648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:18.046816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:18.050891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:18.052883 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6a79363-9876-4504-89e1-806336feacc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.439616 Oct 18 16:04:18.080262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 498/1000] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:17 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:18.089448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad1a6860-b082-41ef-9cbd-077deb03914e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd20e59d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:18.168362 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad1a6860-b082-41ef-9cbd-077deb03914e tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.084915 Oct 18 16:04:18.168933 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 499/1001] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:18 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:18.177211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b03235a-5a55-4712-b3c5-0342b327d167", "name": "network-vif-plugged", "status": "completed", "tag": "1d1530b5-0549-4d3c-a032-50fd5b83bd41"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:18.199167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.200055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.200704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.223189 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] Creating event network-vif-plugged:1d1530b5-0549-4d3c-a032-50fd5b83bd41 for instance 2b03235a-5a55-4712-b3c5-0342b327d167 on n-h2-858383-14 Oct 18 16:04:18.231650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-81ab21ac-19c2-46c5-8e27-cc3007c46686 req-d48afa9c-83ae-4b7c-87dd-610547de36c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061343 Oct 18 16:04:18.242012 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 500/1002] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:18.254315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:18.255470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:18.262735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.263457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.264059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.265979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.266692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.267276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.274774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:18.284263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1fa4a21-409a-4152-8b5a-6e6cfe9a5246 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1461 microversion: 2.1 time: 0.462502 Oct 18 16:04:18.287492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 503/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:17 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1461 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:18.296847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a887fed8-11f1-465e-a055-326e8a0a8333 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd290c8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:18.403378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a887fed8-11f1-465e-a055-326e8a0a8333 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.114567 Oct 18 16:04:18.413309 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 504/1004] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:18 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:18.416184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:18.420962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:18.425829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:18.438627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.439326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.440552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.441466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.442176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.442621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.479660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:18.552832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:18.563837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f3945ab-f58c-4c71-8881-6fbf037948e0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.318913 Oct 18 16:04:18.564584 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 501/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:18 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:18.582345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:18.583290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:18.583765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:18.584177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:18.584584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:18.674769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:18.679860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:18.686022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.687341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.688530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.689979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.691118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.692219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.744980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c409807c-cbb3-4082-b293-7456489272f7 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 1065 microversion: 2.1 time: 0.329540 Oct 18 16:04:18.746568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-705170fe-2b48-42c8-84f2-d83d2a4358b0 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:18.746926 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 505/1006] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:18 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 1065 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:04:18.757407 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-705170fe-2b48-42c8-84f2-d83d2a4358b0 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.187572 Oct 18 16:04:18.765042 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 502/1007] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:04:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:18.786666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:18.790011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:18.802654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.803241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.803744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.804511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:18.805058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:18.812021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:18.997525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:19.009106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4a30a283-ccb1-4a43-9f01-793c75adb1da tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.225073 Oct 18 16:04:19.010187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 506/1008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:18 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:19.086782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:19.088018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:19.097183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:19.097878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:19.098437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:19.099035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:19.099493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:19.099927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:19.186376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09abbd7b-c663-4fdc-a02a-845bb5c1e894 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd297a040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:19.276668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:19.287219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:19.288982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:19.293862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef52da44-274c-4b39-b878-2fe70c653221 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.212540 Oct 18 16:04:19.294759 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 503/1009] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:19 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:19.419920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f7d61d0-ecd3-4e7e-8b18-d66a22e76254 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2105280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:19.496753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09abbd7b-c663-4fdc-a02a-845bb5c1e894 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 0.315451 Oct 18 16:04:19.506352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 507/1010] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:19 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:19.506652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f7d61d0-ecd3-4e7e-8b18-d66a22e76254 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.087387 Oct 18 16:04:19.506652 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 504/1011] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:19 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:19.509476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1597825968", "imageRef": "6647811c-4260-4619-a291-d99471872b27", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:19.564629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:19.591281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:19.591894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:19.603288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:19.604690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:19.607611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:19.608509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:19.608982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:19.609437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:19.800334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:19.810305 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4de4c1d-82a9-4189-9843-a81924c92b66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1503 microversion: 2.1 time: 0.222831 Oct 18 16:04:19.811495 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 505/1012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:19 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:19.856923 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] Request method failure captured: Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 143 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs6CNm2g-Mg6ibUHMvfuA6MRL6BTeNZTHCoJdTYyWr3tP6wZ0NTgcwlmkZeOmWlSb1drTevaOc8DA6PPRrjyXetTEZNQUV0E7MwSywfzKWhIdMFz2pbvrhWcUk2z5t-FUnJBTzG4Bodp0GOziSbTu4Vpc87xEf7528jHrFuol73t708 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d2403e8edc2342558e73717f3775349f Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FlavorsV2NegativeTest-102276274 Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:04:19.860359 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d2403e8edc2342558e73717f3775349f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d2403e8edc2342558e73717f3775349f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d2403e8edc2342558e73717f3775349f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d2403e8edc2342558e73717f3775349f"}]}] Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FlavorsV2NegativeTest-102276274 Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d2403e8edc2342558e73717f3775349f Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-102276274 Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FlavorsV2NegativeTest-102276274-project Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e9c0f65996074f78b5f9b859c1282dbe Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FlavorsV2NegativeTest-102276274-project Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1597825968", "imageRef": "6647811c-4260-4619-a291-d99471872b27", "flavorRef": "452"}} Oct 18 16:04:19.862053 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: exception: Flavor's memory is too small for requested image. Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1597825968', 'imageRef': '6647811c-4260-4619-a291-d99471872b27', 'flavorRef': '452'}}} Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:19.862953 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:19.864456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09557304-6089-48e1-87c8-b4b37f4abb22 tempest-FlavorsV2NegativeTest-102276274 tempest-FlavorsV2NegativeTest-102276274-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.358560 Oct 18 16:04:19.866022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 508/1013] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:04:19 2022] POST /compute/v2.1/servers => generated 93 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:20.034591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:20.035443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:20.041914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:20.042471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:20.042966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:20.043900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:20.044412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:20.045083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:20.246681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:20.258551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cf2e93d3-1986-430d-a045-8193aa093887 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.228716 Oct 18 16:04:20.274900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 506/1014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:20 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:20.323715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:20.324320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:20.332144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:20.332628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:20.349274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:20.350201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:20.350688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:20.351125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:20.515557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa6c1b60-94cc-43c2-8288-32a63b14b36a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2111dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:20.694053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:20.710613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:20.715920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:20.717536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-533a2b32-1c9d-463a-a6ff-69fe1a9a80c5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1568 microversion: 2.25 time: 0.397879 Oct 18 16:04:20.737153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 509/1015] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:20 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1568 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:20.743528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0319d825-dfd4-40ce-a9e6-c3c1117248b9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2dd13a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.303815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa6c1b60-94cc-43c2-8288-32a63b14b36a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1428 microversion: 2.1 time: 6.792684 Oct 18 16:04:27.307517 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 507/1016] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:20 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1428 bytes in 6798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:27.312950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.313733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:27.320807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.321699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.322819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.323960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.324628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.325142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.494755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:27.508181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93d82ebc-d13f-4b67-8cce-73e82acee3ed tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1478 microversion: 2.1 time: 0.199494 Oct 18 16:04:27.509253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 508/1017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1478 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:27.516153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.517304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:27.526409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.527255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.527943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.528965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.529962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.531373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.587128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0319d825-dfd4-40ce-a9e6-c3c1117248b9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 6.846560 Oct 18 16:04:27.587835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 510/1018] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:20 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 6850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:27.595747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.596543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:27.603546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.604285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.605602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.606513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.607137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.607716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.761297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:27.773170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5fe8a08e-27a0-49c6-ae94-fc96431da882 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.261893 Oct 18 16:04:27.774435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 509/1019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:27.782078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "name": "network-vif-plugged", "status": "completed", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:27.796653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.798738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.800159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.825572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] Creating event network-vif-plugged:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h2-858383-14 Oct 18 16:04:27.835740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5841be63-35ba-4813-bc48-b1443ecc871a req-2bbb76e5-9d5e-454a-a124-fa9b194c9f95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059749 Oct 18 16:04:27.837094 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 510/1020] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:27.841943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:27.845520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26f98bc1-b585-4e1b-bf25-d06eb5b00d89 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '.version_select at 0x7f5fd2828940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.849611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26f98bc1-b585-4e1b-bf25-d06eb5b00d89 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.850471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26f98bc1-b585-4e1b-bf25-d06eb5b00d89 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.851143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26f98bc1-b585-4e1b-bf25-d06eb5b00d89 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.853800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:27.855558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:27.857299 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e961640f-3b05-4b17-ba82-a1e0dc529069 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1543 microversion: 2.25 time: 0.268308 Oct 18 16:04:27.858104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 511/1021] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1543 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:27.867138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26f98bc1-b585-4e1b-bf25-d06eb5b00d89 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.028523 Oct 18 16:04:27.867977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 511/1022] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:27.890372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f782ad9-9f26-4271-91a1-ea59f0452f63 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '.version_select at 0x7f5fd223a280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.892138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.892798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:27.895598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f782ad9-9f26-4271-91a1-ea59f0452f63 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.896287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f782ad9-9f26-4271-91a1-ea59f0452f63 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.896973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f782ad9-9f26-4271-91a1-ea59f0452f63 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.907376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.907565 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f782ad9-9f26-4271-91a1-ea59f0452f63 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1712 microversion: 2.25 time: 0.020830 Oct 18 16:04:27.907877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.908326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.909181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.909402 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 512/1023] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/os-migrations => generated 1712 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:27.910562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.910947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.925473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:27.926282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:27.934760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.935953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.938068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:27.939025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:27.939799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:27.940440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:28.103973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9624a66f-34e5-41af-af98-b283955195d5 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1631 microversion: 2.1 time: 0.223245 Oct 18 16:04:28.106457 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 512/1024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1631 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:28.112368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:28.116030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:28.129739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d4e2140-3f9d-45f0-86e9-0c0ddc81aa53 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 2038 microversion: 2.25 time: 0.209265 Oct 18 16:04:28.130967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 513/1025] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:27 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 2038 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:28.159722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85df76cb-d380-4720-a0e1-f83f604cb227 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: .version_select at 0x7f5fd297adc0>, body: {"keypair": {"name": "tempest-keypair-1320816053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkhUuR8l4+ElcWl+y0iLDTZMonir4f0lxq3jyiCAjjTYwuUdPxJrK8dbTxFxL+gEZn3gKOoKbnUUZuXfbUpQWQBERolZ2fT5roOQ+/EQojaNO9m9OPyjoCRXqHzk66vtQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:28.180023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5eccd39b-e52b-4e12-91d1-756519e1bffd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: .version_select at 0x7f5fd2105280>, body: {"keypair": {"name": "tempest-keypair-1442286090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4YzXDy0TrIeUjOQS/SPGD7bbQkTdhUJT2YS2HjoJpj4SJUO8+S3RUFkq7F21VSUiSz0bVPk7fmlos9306DhC3KZ1dN13TICAHZ0aI4bPFMQFdos4+65xeHcvi8yc2Ug=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:28.182178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-85df76cb-d380-4720-a0e1-f83f604cb227 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:28.193393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-85df76cb-d380-4720-a0e1-f83f604cb227 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for user ab2aa9c224654cfbbc1559ed58556ad5 and project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:28.199119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5eccd39b-e52b-4e12-91d1-756519e1bffd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for project c91c440777a0421c961411bafbc058ad. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:28.205074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5eccd39b-e52b-4e12-91d1-756519e1bffd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for user 19e2cb9474fb47a6b3f3793c7f162caf and project c91c440777a0421c961411bafbc058ad. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:28.235479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85df76cb-d380-4720-a0e1-f83f604cb227 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083353 Oct 18 16:04:28.237437 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 513/1026] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:04:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:28.250628 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5eccd39b-e52b-4e12-91d1-756519e1bffd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.076402 Oct 18 16:04:28.251684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 514/1027] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:04:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:04:28.255114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f4edf74-5917-4b43-b966-d27dddcf8cb4 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd26501f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:28.342301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18968daa-88de-4992-9e03-1b37bd00a509 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd21111f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:28.348668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f4edf74-5917-4b43-b966-d27dddcf8cb4 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902" status: 200 len: 637 microversion: 2.1 time: 0.103243 Oct 18 16:04:28.349770 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 514/1028] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:28 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902 => generated 637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:28.378209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b24ee17-ed9b-45be-97ab-02afe2f94272 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd274fdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:28.409933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18968daa-88de-4992-9e03-1b37bd00a509 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1437 microversion: 2.1 time: 0.092861 Oct 18 16:04:28.411007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 515/1029] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:28 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:28.429674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-161ddee6-f6ad-4010-ac54-a595222066fa tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd2137d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:28.534358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7b24ee17-ed9b-45be-97ab-02afe2f94272 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:28.540072 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-161ddee6-f6ad-4010-ac54-a595222066fa tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 200 len: 1437 microversion: 2.1 time: 0.115802 Oct 18 16:04:28.543575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 516/1030] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:28 2022] GET /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:28.549234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7b24ee17-ed9b-45be-97ab-02afe2f94272 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:28.565377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:28.567115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:28.596221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:28.596703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:28.597170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:28.599904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:28.603146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:28.603597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:28.909504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:28.919522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55939de8-a966-444e-a1c9-4d46305cc87f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1480 microversion: 2.1 time: 0.360174 Oct 18 16:04:28.922077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 517/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:28 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1480 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:28.939432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-147cf109-58c2-4a3c-8a4b-f23774880fa8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20e55e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:29.042355 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b24ee17-ed9b-45be-97ab-02afe2f94272 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.674379 Oct 18 16:04:29.042968 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 515/1032] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:28 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:29.051440 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-147cf109-58c2-4a3c-8a4b-f23774880fa8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.127808 Oct 18 16:04:29.054619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:29.055633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:29.060038 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 518/1033] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:28 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:29.063164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:29.063899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:29.064583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:29.065297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6b46ade-184a-48d0-9115-0a326e3e83ac tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd2105280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:29.065774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:29.066449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:29.067112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:29.334462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:29.344602 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c19dbab2-64ba-47c1-9958-239d44c1dbcc tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.293648 Oct 18 16:04:29.357056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 516/1034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:29 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:29.491900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6b46ade-184a-48d0-9115-0a326e3e83ac tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "DELETE /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.430658 Oct 18 16:04:29.493496 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 519/1035] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:04:29 2022] DELETE /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_version => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:29.501734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-589a846f-f084-4d45-b882-423d592c4cc1 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd297ae50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:29.571381 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-589a846f-f084-4d45-b882-423d592c4cc1 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 37 microversion: 2.1 time: 0.073700 Oct 18 16:04:29.571970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 517/1036] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:04:29 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 37 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:29.583509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4f373e5-5511-464b-b485-3c94f9693271 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd2151dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:29.642009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c4f373e5-5511-464b-b485-3c94f9693271 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:29.647979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c4f373e5-5511-464b-b485-3c94f9693271 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:29.952541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:29.953640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:29.961274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:29.961702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:29.963599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:29.964616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:29.965318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:29.966824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:30.027997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4f373e5-5511-464b-b485-3c94f9693271 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.448569 Oct 18 16:04:30.028603 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 520/1037] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:29 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:30.042572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd5601ce-57ee-4c44-a8f1-f866474d94f5 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd2137550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:30.097151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd5601ce-57ee-4c44-a8f1-f866474d94f5 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.062890 Oct 18 16:04:30.102062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 521/1038] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 18 16:04:30 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_distro => generated 33 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:04:30.111777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa910367-3364-4fc0-ad7d-c740323f7ed7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20e5160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:30.176536 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa910367-3364-4fc0-ad7d-c740323f7ed7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.069946 Oct 18 16:04:30.179541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 522/1039] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:30 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:30.184532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d966c8d-2600-407b-a081-a58823c09bb0 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd20a10d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:30.265109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9d966c8d-2600-407b-a081-a58823c09bb0 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:30.271863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9d966c8d-2600-407b-a081-a58823c09bb0 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:30.507504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d966c8d-2600-407b-a081-a58823c09bb0 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.326603 Oct 18 16:04:30.509186 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 523/1040] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:30 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:30.514318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:30.515232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:30.523123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:30.524168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:30.524831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:30.525841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:30.526537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:30.527186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:30.738678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:30.754777 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afe5bb47-d759-4e9f-8e9e-c4ca32d2a60f tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1467 microversion: 2.1 time: 0.812379 Oct 18 16:04:30.758131 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 518/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:29 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1467 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:30.773533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0ca17cd-d7e6-4357-9da0-be8a047c03a9 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd26fa4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:30.870723 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0ca17cd-d7e6-4357-9da0-be8a047c03a9 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.109922 Oct 18 16:04:30.870723 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 519/1042] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:04:30 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:30.877976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9d462a5-f49a-419b-8a67-1d101e2bcab2 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd27cad30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:30.935959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:30.959163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d144934-12e8-4066-af4f-1e78a01a9da8 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.448596 Oct 18 16:04:30.963980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 524/1043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:30 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:30.978624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1031059995", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "36cd9606-04bb-4353-9340-97cb35289c50"}], "security_groups": [{"name": "tempest-securitygroup--1291841650"}], "key_name": "tempest-keypair-1320816053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:31.438732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9d462a5-f49a-419b-8a67-1d101e2bcab2 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "DELETE /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442" status: 204 len: 0 microversion: 2.1 time: 0.566329 Oct 18 16:04:31.439584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 520/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:30 2022] DELETE /compute/v2.1/images/5aa4cdf4-0993-4c14-a9fb-e6894a792442 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:31.456514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32c3f233-bce3-4724-b046-4c0c491033ab tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd27caf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:31.543664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-32c3f233-bce3-4724-b046-4c0c491033ab tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:31.550926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-32c3f233-bce3-4724-b046-4c0c491033ab tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:31.585947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] validate_networks() for [('36cd9606-04bb-4353-9340-97cb35289c50', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:31.785855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32c3f233-bce3-4724-b046-4c0c491033ab tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.345036 Oct 18 16:04:31.787594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 521/1045] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:31 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:31.792780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1949755574", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "5102e26d-02ba-494b-a69e-fcb88c84af09"}], "security_groups": [{"name": "tempest-securitygroup--577692321"}], "key_name": "tempest-keypair-1442286090", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:31.912445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] validate_networks() for [('5102e26d-02ba-494b-a69e-fcb88c84af09', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:32.102657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:32.104291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:32.105418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:32.106033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:32.106691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:32.131230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.132440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.133231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.134958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.135851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.136877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.159354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:32.167150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for user ab2aa9c224654cfbbc1559ed58556ad5 and project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:32.181954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:04:32.184424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:04:32.238231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c8ea75f-9a87-4c8d-b4b3-822bc460b9be tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.273128 Oct 18 16:04:32.239210 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 525/1046] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:04:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:04:32.248887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-978212ea-44cd-46bb-86d8-4c28a1e18617 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2151ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:32.305532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-978212ea-44cd-46bb-86d8-4c28a1e18617 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.064727 Oct 18 16:04:32.315278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 526/1047] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:32 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:32.320766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca062d91-e739-423e-874e-a46a8f39e25a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '.version_select at 0x7f5fd20e5c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:32.346919 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ca062d91-e739-423e-874e-a46a8f39e25a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] HTTP exception thrown: Image not found. Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca062d91-e739-423e-874e-a46a8f39e25a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Request method failure captured: Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a HTTP/1.1 Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs5EotBrWa7wxO2v-Pl1pEBRRiPhZaMQDfCg1iGDUk3USd2-NsV721kZq8ivfwZSBixC6dMgozBRnIJeeWrccegIrKQp2m5CAVN5KZjNIBzi7B0RtNCOOvQOjMzTk02nAFyYKnUcFSYZupGTcyfi4Iv-wOIzLX6YIG4ViH2BmPbcCWM Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:04:32.349389 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}] Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7f02637b1935426280f2ad6bcfa61b26 Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a'} Oct 18 16:04:32.351043 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a to delete Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:32.352124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a could not be found. Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:32.353741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca062d91-e739-423e-874e-a46a8f39e25a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:32.355481 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca062d91-e739-423e-874e-a46a8f39e25a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "DELETE /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a" status: 404 len: 62 microversion: 2.1 time: 0.035104 Oct 18 16:04:32.357280 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 527/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:32 2022] DELETE /compute/v2.1/images/b7bd29aa-d3f4-4e9d-a20f-b7a8aff3869a => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:04:32.365235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e44f69d-c537-4c9d-8e0b-95052aa68acf tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd20a1160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:32.429494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3e44f69d-c537-4c9d-8e0b-95052aa68acf tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:32.435740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3e44f69d-c537-4c9d-8e0b-95052aa68acf tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:32.437027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:32.438210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:32.438622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:32.439087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:32.439496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:32.450109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.450593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.451806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.452599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.453270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.453700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.473366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:32.479479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for user 19e2cb9474fb47a6b3f3793c7f162caf and project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:32.494691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:04:32.499264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:04:32.563313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c80d0bad-4b05-4652-84f1-0b1ab959edd4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.774314 Oct 18 16:04:32.571202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 522/1049] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:04:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:04:32.579097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:32.579775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:32.587625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.588187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.588640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.589503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.589968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.590401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.892037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:32.904721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c2f463a1-e8fd-4c88-80d2-aca331fa5422 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.339177 Oct 18 16:04:32.905346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 523/1050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:32 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:32.925972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e44f69d-c537-4c9d-8e0b-95052aa68acf tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 64 microversion: 2.1 time: 0.567523 Oct 18 16:04:32.926466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:32.926884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 528/1051] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:32 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 64 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:32.938200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:32.944540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.944742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:32.945069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.945379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:32.945542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.946493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.946697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.947128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.969875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.977334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.978001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:32.978931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:32.979608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:32.980452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:33.038994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:04:33.041161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:33.049485 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-033a54a6-b053-4d35-804b-65075055de42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1239 microversion: 2.1 time: 0.142372 Oct 18 16:04:33.050868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 524/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:32 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1239 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:33.083244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:33.084106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:33.153794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:33.165196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:33.167231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:33.168803 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc1c52af-8769-46af-a89e-fdf7d544b226 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1286 microversion: 2.25 time: 0.116374 Oct 18 16:04:33.169633 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 525/1053] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:33 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:33.176582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c129b353-65a9-4d0a-98a3-0b4bae1f0e80 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd279c040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:33.277021 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bae6e065-2730-4f33-8673-049c89fa78e4 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 204 len: 0 microversion: 2.1 time: 0.345079 Oct 18 16:04:33.286824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 529/1054] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:04:32 2022] DELETE /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:33.294869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c129b353-65a9-4d0a-98a3-0b4bae1f0e80 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 64 microversion: 2.1 time: 0.122605 Oct 18 16:04:33.301304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:33.302938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:33.309431 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 526/1055] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:04:33 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 64 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:33.316187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:33.316187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:33.316187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:33.317335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:33.317829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:33.318288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:33.318715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a7ff6ee-4c1f-423f-b62c-fef4b3535719 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd2a29af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:33.380789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3a7ff6ee-4c1f-423f-b62c-fef4b3535719 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:33.386670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3a7ff6ee-4c1f-423f-b62c-fef4b3535719 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:33.494683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:33.503834 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e618ad0-e921-465b-8d61-775a308cdec3 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1473 microversion: 2.1 time: 0.213708 Oct 18 16:04:33.505814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 530/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:33 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:33.515136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1fdd6c72-c856-4600-9330-d740bbfae59d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd21960d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:33.785264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1fdd6c72-c856-4600-9330-d740bbfae59d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1411 microversion: 2.1 time: 0.277630 Oct 18 16:04:33.794285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 531/1057] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:33 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1411 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:33.801644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-unplugged", "status": "completed", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:33.813405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:33.813882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:33.814339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:33.825953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a7ff6ee-4c1f-423f-b62c-fef4b3535719 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.514612 Oct 18 16:04:33.826129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] Creating event network-vif-unplugged:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:04:33.827060 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 527/1058] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:33 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:33.831134 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3da8727a-124c-4865-8937-4f460810f754 req-ff63d33a-8ced-4aa7-8b3c-10eda6a8e29c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034278 Oct 18 16:04:33.831952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 532/1059] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:33.836483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d1bd684-49e4-480a-87b4-2f70bfd5a573 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update', calling method: .version_select at 0x7f5fd4327ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:33.897241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1d1bd684-49e4-480a-87b4-2f70bfd5a573 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:33.903246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1d1bd684-49e4-480a-87b4-2f70bfd5a573 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:33.932095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:33.932816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:33.939128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:33.942041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:33.942940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:33.943602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:33.945037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:33.945706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:33.946537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.088317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.096569 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef9d4ac4-5c82-4872-bacd-ad7112bf9c1c tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.169262 Oct 18 16:04:34.097166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 533/1060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:33 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:34.103981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.104589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:34.111203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.111742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.112264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.113070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.113750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.114303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.178816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.179336 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d1bd684-49e4-480a-87b4-2f70bfd5a573 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.346340 Oct 18 16:04:34.184562 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 528/1061] 10.222.0.78 () {60 vars in 1313 bytes} [Tue Oct 18 16:04:33 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata/os_version => generated 31 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:04:34.190514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1b9ec77-7b09-4661-a873-dc78a06def2c tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd279c0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.192792 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9981b51a-96a0-4915-a544-63404f66abdb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1287 microversion: 2.1 time: 0.094526 Oct 18 16:04:34.193641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 534/1062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:34.199620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.200246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:34.206426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.206940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.207377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.208044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.208563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.208899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.242618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1b9ec77-7b09-4661-a873-dc78a06def2c tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 58 microversion: 2.1 time: 0.056656 Oct 18 16:04:34.243218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 529/1063] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 58 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:04:34.253597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abeb5092-4996-4aec-98e1-a1c4dcd86e77 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'update_all', calling method: .version_select at 0x7f5fd290c8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:34.280298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.289497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.290930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.292024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d9c44b28-b0dd-42e9-a701-29b16d925a99 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1290 microversion: 2.25 time: 0.096479 Oct 18 16:04:34.292567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 535/1064] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:34.303822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-abeb5092-4996-4aec-98e1-a1c4dcd86e77 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:34.309362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-abeb5092-4996-4aec-98e1-a1c4dcd86e77 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:34.527656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.528334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:34.534843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.535333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.535775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.536469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:34.536926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:34.537383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:34.560173 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-abeb5092-4996-4aec-98e1-a1c4dcd86e77 tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 61 microversion: 2.1 time: 0.310488 Oct 18 16:04:34.560759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 530/1065] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:04:34 2022] PUT /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 61 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:04:34.570959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ea88c35-cef3-4299-8150-18268e60e36d tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Action: 'create', calling method: .version_select at 0x7f5fd2a7e790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:34.621640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0ea88c35-cef3-4299-8150-18268e60e36d tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:34.627719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0ea88c35-cef3-4299-8150-18268e60e36d tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Getting quotas for user 16753a3e3f3a4fd08bacb4fad50960cb and project 622e293fd27c4fefaefa16a297b82250. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:34.636454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:34.681348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:34.689420 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67a31bee-360e-4170-a91e-d9ecf8addb4a tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1473 microversion: 2.1 time: 0.165619 Oct 18 16:04:34.690168 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 536/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:34.802456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-855034b5-0f86-4a3c-8a51-39eb30bf1c36 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20b6d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.848283 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-855034b5-0f86-4a3c-8a51-39eb30bf1c36 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1420 microversion: 2.1 time: 0.050583 Oct 18 16:04:34.848892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 537/1067] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:34.862839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3918b9d1-cf86-47c8-a1f5-06ec52f07ad2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2151dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.907659 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3918b9d1-cf86-47c8-a1f5-06ec52f07ad2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 200 len: 1420 microversion: 2.1 time: 0.048699 Oct 18 16:04:34.908219 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 538/1068] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:34.922507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85f1b68c-cc33-411e-9b38-3eea4eec9939 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2828700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.924482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ea88c35-cef3-4299-8150-18268e60e36d tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "POST /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 85 microversion: 2.1 time: 0.357517 Oct 18 16:04:34.925094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 531/1069] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 18 16:04:34 2022] POST /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 85 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:04:34.934478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-861bf3ff-38d5-423e-baa4-e3e7c894973b tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] Calling method '.version_select at 0x7f5fd279c4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:34.974820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-861bf3ff-38d5-423e-baa4-e3e7c894973b tempest-ImagesMetadataTestJSON-2133760658 tempest-ImagesMetadataTestJSON-2133760658-project] 10.222.0.78 "GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata" status: 200 len: 85 microversion: 2.1 time: 0.044169 Oct 18 16:04:34.975388 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 532/1070] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:04:34 2022] GET /compute/v2.1/images/de32b38a-92eb-412c-b9c5-48de764b0902/metadata => generated 85 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:04:35.121060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:35.121908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:35.128693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.129158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.129764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.131439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.132110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.133343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.317489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.325951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2152f2da-5a8d-4d55-9391-540f98333e89 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.208843 Oct 18 16:04:35.326825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 533/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:35 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:35.332360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:35.333100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:35.339423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.340133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.340789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.341739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.342421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.342945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.412645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.421776 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50f11262-7c17-43d9-92bb-aae7c10c03c7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1287 microversion: 2.1 time: 0.093708 Oct 18 16:04:35.423353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 534/1072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:35 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:35.428119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:35.428810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:35.438489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.439241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.439921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.440809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.441300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.441929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.449396 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85f1b68c-cc33-411e-9b38-3eea4eec9939 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 204 len: 0 microversion: 2.1 time: 0.529818 Oct 18 16:04:35.451626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 539/1073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:34 2022] DELETE /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:04:35.461387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:35.463268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:35.471564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.472156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.473104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.474508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.475096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.475754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.504873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:04:35.508694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.519478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.521423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.522752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dc00033-077c-4c26-a995-be4f6d9bbb05 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1282 microversion: 2.25 time: 0.098284 Oct 18 16:04:35.525120 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 535/1074] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:35 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:35.585229 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c023a95-4b80-4ab1-a433-e4e6187686aa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 204 len: 0 microversion: 2.1 time: 0.128111 Oct 18 16:04:35.585976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 540/1075] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:04:35 2022] DELETE /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:35.713448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:35.714158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:35.720880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.721666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.722355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.723436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:35.724552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:35.725169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:35.776548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1167478065", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:35.832869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:35.925358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:35.950684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-764c5d17-98b9-4eed-a223-cec77c0f0c5d tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1473 microversion: 2.1 time: 0.241475 Oct 18 16:04:35.951511 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 536/1076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:35 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1473 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:36.233817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:36.234258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:36.234725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:36.235151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:36.235556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:36.249108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.249593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.250033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.250872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.251394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.251903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.269925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:36.275080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:36.287810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:04:36.290242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:04:36.341914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c2ce51b-228e-4d87-9fd3-3da555706e1f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569598 Oct 18 16:04:36.342584 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 541/1077] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:04:36.352698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:36.353356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:36.361268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5b8b26a-352e-4b8a-b463-0ad56d0f94a5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:36.361982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5b8b26a-352e-4b8a-b463-0ad56d0f94a5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:36.375457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.376265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.376923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.377818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.378437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.379023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.432931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5b8b26a-352e-4b8a-b463-0ad56d0f94a5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.441842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5b8b26a-352e-4b8a-b463-0ad56d0f94a5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1208 microversion: 2.1 time: 0.087091 Oct 18 16:04:36.442434 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 542/1078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:36 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1208 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:36.446854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:36.447462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:36.457812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.458966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.459760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.460625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.461266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.461909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.539866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.549224 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb57751c-94bb-4440-aeb1-d40c78f9b256 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1287 microversion: 2.1 time: 0.105639 Oct 18 16:04:36.549854 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 543/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:36 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:36.555946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:36.556702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:36.563755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.564293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.564633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.565536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.566045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.566420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.569821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.579135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-decc60b2-ebbb-4e0b-ae55-dc20412fffb6 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.232838 Oct 18 16:04:36.579916 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 537/1080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:36 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:36.646846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.657500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.659348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:36.660960 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1060df52-d7ed-4c21-b074-910c4afe3a16 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1282 microversion: 2.25 time: 0.109698 Oct 18 16:04:36.661928 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 544/1081] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:36 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:36.975553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:36.977599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:36.989085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.989762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.990502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:36.991291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:36.991865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:36.992444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.184378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:37.188968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:37.195917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-977e359e-1996-4b45-ac26-08190ccbd2e6 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1473 microversion: 2.1 time: 0.224109 Oct 18 16:04:37.196673 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 538/1082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:36 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:37.469767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:37.470448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:37.477400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.477886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.478344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.479047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.479491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.480201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.571977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:37.572829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:37.584383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.585160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.585884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.586810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.587360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.587854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.608243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:37.624218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d55f1e09-b112-42d0-96b4-3123c73e179a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1260 microversion: 2.1 time: 0.159819 Oct 18 16:04:37.626583 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 545/1083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:37 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:37.646101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:37.648221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:37.671367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.672183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.672802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.673780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.674502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.674929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.681734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:37.784728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:37.797362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df0e1f77-0aea-475f-a8d6-39abb1b6b5bc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1287 microversion: 2.1 time: 0.228314 Oct 18 16:04:37.818161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 539/1084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:37 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1287 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:37.824592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:37.825582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:37.833726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.834492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.835490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.836445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:37.837168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:37.837816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:37.913643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:37.924428 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5341aef5-9fa6-4148-87ab-0c724e6296ab tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.295485 Oct 18 16:04:37.925087 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 546/1085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:37 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:37.998028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:38.007764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:38.009186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:38.010321 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d6d280b-5a77-40e8-99ad-531b517ee6d3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1282 microversion: 2.25 time: 0.190700 Oct 18 16:04:38.022680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 540/1086] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:37 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:38.224856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:38.224856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:38.238769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.239279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.239878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.240592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.243233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.243684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.654431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:38.654741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:38.655214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:38.668714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.669268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.669717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.670437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.670900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.671460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.676858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0fa3e46-f65d-4a1d-875f-9f502ee973ea tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1473 microversion: 2.1 time: 0.458827 Oct 18 16:04:38.677923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 547/1087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:38 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:38.828138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:38.829901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:38.839659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.840883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.843171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.844536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:38.845410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:38.846337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:38.960238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:38.978580 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30be25e8-e857-4e56-a859-f02795eebbfa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1266 microversion: 2.1 time: 0.327860 Oct 18 16:04:38.980673 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 541/1088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:38 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:38.986106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:38.987098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:39.008315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.010415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.011064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.011972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.012593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.013271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.061305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.079402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f1f5a73-29ca-47c9-bdf2-9b4849a29359 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1293 microversion: 2.1 time: 0.257060 Oct 18 16:04:39.087501 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 548/1089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:38 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1293 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:39.098790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b03235a-5a55-4712-b3c5-0342b327d167", "name": "network-vif-deleted", "tag": "1d1530b5-0549-4d3c-a032-50fd5b83bd41"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:39.136633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.137512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.140564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.180838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] Creating event network-vif-deleted:1d1530b5-0549-4d3c-a032-50fd5b83bd41 for instance 2b03235a-5a55-4712-b3c5-0342b327d167 on n-h2-858383-14 Oct 18 16:04:39.195323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b6eeeff2-226a-4c12-a8dd-5424e57f160a req-de9fa2b1-9dbf-4010-9b50-0c077449f040 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106196 Oct 18 16:04:39.195949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 549/1090] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:39.221994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:39.222750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:39.248712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.250501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.253164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.259242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.260204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.260893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.528903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.540962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6230d1b-f810-4b9d-8222-70dd2a2e7f13 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.559161 Oct 18 16:04:39.550851 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 542/1091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:38 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:39.559636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.573369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.576792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.580398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d30b9bfd-7669-44aa-8675-de808b15b81e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1356 microversion: 2.25 time: 0.383319 Oct 18 16:04:39.581119 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 550/1092] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:39 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1356 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:39.708762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:39.709423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:39.722860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.723368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.723824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.724733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.725445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.725909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.801515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:39.802753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:39.803988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:39.805038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lazy-loading 'fault' on Instance uuid cbb8f6bb-432d-4274-85c4-41577cc468dd {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:39.900607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f02637b1935426280f2ad6bcfa61b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd26b2e375084d72a31f6e39b420da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:39.919900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-910d8bde-6dd9-4e73-8801-e9e83b5d5972 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 200 len: 1307 microversion: 2.1 time: 0.214891 Oct 18 16:04:39.920496 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 543/1093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:39 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:40.009808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:40.011144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:40.017766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.019362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.020037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.021040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.022001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.023215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.112224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:40.113569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:40.136251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.136709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.138508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.139503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.141854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.143191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.403236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:40.421991 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3837d274-2aa9-4a16-984d-a327ba2d42dc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1293 microversion: 2.1 time: 0.313503 Oct 18 16:04:40.437897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 544/1094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:40 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1293 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:40.573090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:40.574008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:40.582270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.583040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.583677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.584579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.585237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.585836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.808043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:40.827486 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc59b3ff-ec97-4280-8542-91ae3c2aba4e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.821580 Oct 18 16:04:40.830694 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 551/1095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:40 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:40.838894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:40.840142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:40.849605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.851112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.853915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:40.855511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:40.856275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:40.857810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.017083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:41.028926 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9a5277d-2903-4210-8b2b-a9af1b9830a2 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.459694 Oct 18 16:04:41.029898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 545/1096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:40 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:41.035389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:41.036330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] [instance: cbb8f6bb-432d-4274-85c4-41577cc468dd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:41.054887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.055455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.055898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.056616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.057095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.058649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.082732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] HTTP exception thrown: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Request method failure captured: Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd HTTP/1.1 Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs5EotBrWa7wxO2v-Pl1pEBRRiPhZaMQDfCg1iGDUk3USd2-NsV721kZq8ivfwZSBixC6dMgozBRnIJeeWrccegIrKQp2m5CAVN5KZjNIBzi7B0RtNCOOvQOjMzTk02nAFyYKnUcFSYZupGTcyfi4Iv-wOIzLX6YIG4ViH2BmPbcCWM Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:04:41.084779 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd26b2e375084d72a31f6e39b420da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd26b2e375084d72a31f6e39b420da8c"}]}] Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: fd26b2e375084d72a31f6e39b420da8c Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1970732376 Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7f02637b1935426280f2ad6bcfa61b26 Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerTestJSON-1970732376-project Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. Oct 18 16:04:41.086282 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'cbb8f6bb-432d-4274-85c4-41577cc468dd'} Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:41.088340 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. Oct 18 16:04:41.090394 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:41.092898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] Returning 404 to user: Instance cbb8f6bb-432d-4274-85c4-41577cc468dd could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:41.092898 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5ddeed3-853a-4f0c-a2ba-ef0a448a7f37 tempest-ImagesOneServerTestJSON-1970732376 tempest-ImagesOneServerTestJSON-1970732376-project] 10.222.0.78 "GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd" status: 404 len: 111 microversion: 2.1 time: 0.054667 Oct 18 16:04:41.092898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 546/1097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:41 2022] GET /compute/v2.1/servers/cbb8f6bb-432d-4274-85c4-41577cc468dd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:41.097184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:41.107336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:41.109884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:41.111331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ab4fd2c-3c97-4259-b2d7-10319c4bbadd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1344 microversion: 2.25 time: 0.279313 Oct 18 16:04:41.112803 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 552/1098] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:40 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1344 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:41.239111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb8f6bb-432d-4274-85c4-41577cc468dd", "name": "network-vif-deleted", "tag": "aabbf317-5df7-46f3-9842-fd71035b559f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:41.260584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.261019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.262013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.307705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] Creating event network-vif-deleted:aabbf317-5df7-46f3-9842-fd71035b559f for instance cbb8f6bb-432d-4274-85c4-41577cc468dd on n-h2-858383-14 Oct 18 16:04:41.316089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5929d02b-41ae-4b88-b280-ec15a5de76ba req-401ab909-bdc9-404e-90ef-7df72ead3879 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080670 Oct 18 16:04:41.322700 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 547/1099] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:41.448769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:41.451907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:41.461032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.463852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.464619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.472720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.473661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.475093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.856006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:41.859526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:41.871042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.871550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.871994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:41.872700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:41.873179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:41.873605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:42.146651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:42.156093 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac22647a-359f-419b-9fb5-f8cf5b5047e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.712486 Oct 18 16:04:42.162077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 553/1100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:41 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:42.167403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:42.177456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:42.186629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:42.189662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:42.190428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:42.191370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:42.192071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:42.192953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:42.209246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:42.218693 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1decd9fc-d2a5-4272-9e32-bf1a7545a864 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.369199 Oct 18 16:04:42.219804 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 548/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:41 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:42.240105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:42.241394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:42.251344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:42.252338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:42.254028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:42.255301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:42.256466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:42.257111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:42.451237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:42.461126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:42.462734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:42.463940 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98d40e21-3a07-4f76-b88f-bb720098d748 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.243141 Oct 18 16:04:42.464520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 549/1102] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:42 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:43.036063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:43.045053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-505bd850-ac76-428e-93ec-ad5aa318d41e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.881644 Oct 18 16:04:43.045965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 554/1103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:42 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:43.184925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:43.185911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:43.193826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:43.197259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.198041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.198578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.199395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.199962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.200660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.248567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:43.251802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:43.264440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.265524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.265986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.266699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.267160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.267593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.548447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:43.558696 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43e8e03b-843d-40c2-b058-e8e43b6f296a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.378629 Oct 18 16:04:43.559252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 550/1104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:43 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:43.581411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922e0f05-8b7b-479f-b4e4-5ffb5007ef3e", "tag": "8e0dc97e-de74-4496-8576-3e4b07b567c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:43.594044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.594648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.595149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.620101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] Creating event network-changed:8e0dc97e-de74-4496-8576-3e4b07b567c1 for instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e on n-h1-858383-14 Oct 18 16:04:43.625956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-67fa5293-e96a-4dcf-8e5e-ca8e25fdb4a2 req-ef50d6bd-be89-4298-add6-026a7fa3809a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064230 Oct 18 16:04:43.626807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 551/1105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:43.632169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:43.633075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:43.642955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.643448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.643935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.644873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:43.645500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:43.646082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:43.745857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:43.767569 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8cb9a688-591c-48cc-83cf-c798f8a07304 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.525451 Oct 18 16:04:43.768658 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 555/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:43 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:44.003810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:44.015515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:44.017143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:44.018461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c08860b-9937-49f9-a0ee-18ca19ac81cc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.390594 Oct 18 16:04:44.036671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 552/1107] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:43 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:44.071918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:44.073115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:44.086310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.087550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.088157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.089196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.089821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.090411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.376898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:44.386966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.387713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.388299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.413392 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] Creating event network-changed:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h2-858383-14 Oct 18 16:04:44.420917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ea2f36a6-c002-4f8c-ab80-6cbffe1b0f62 req-70f7bf29-4f06-4ce5-afd7-070bc63b1b57 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047669 Oct 18 16:04:44.422500 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 553/1108] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:04:44.503686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:44.516746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67969149-e28a-43c5-b0d0-2d9bc56e2511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.446884 Oct 18 16:04:44.546518 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 556/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:44 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:44.586600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:44.589712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:44.610716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.611910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.614945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.617653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.620168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.620864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.689593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:44.791707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:44.792642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:44.810783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.811525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.812653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:44.813763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:44.815298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:44.815920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:45.112176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:45.125513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df5e346c-55ee-4df9-80cf-eec3564cf3ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.544241 Oct 18 16:04:45.142922 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 554/1110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:44 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:45.150544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:45.151674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:45.161034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:45.161994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:45.163055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:45.164630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:45.165357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:45.165858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:45.497424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:45.509666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac2c5752-96ba-4729-b96e-dd7e255b1bef tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.722083 Oct 18 16:04:45.528317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 557/1111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:44 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:45.555598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:45.556642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:45.568637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:45.570893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:45.571506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:45.573370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:45.578356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:45.579118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.012644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:46.033382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:46.035661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:46.038215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ede6895e-4cb1-41c4-b8ee-5a44874406bd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.893030 Oct 18 16:04:46.040316 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 555/1112] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:45 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:46.082718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:46.099315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de96a37d-2fcd-496f-84aa-8639d612441f tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.548235 Oct 18 16:04:46.115123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 558/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:45 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:46.171019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:46.172576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:46.180760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:46.185788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:46.187178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.200885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:46.201789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:46.202550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.527525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:46.591978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:46.593683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=30 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:46.605877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:46.606370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:46.606811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.636972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] Creating event network-changed:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h2-858383-14 Oct 18 16:04:46.647517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2f79a0e7-dfe6-466e-af2b-993658161d84 req-2fe22429-0e3a-4106-851d-fbf6a3b6e439 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125159 Oct 18 16:04:46.648592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 559/1114] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:46.668137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:46.669054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:46.669992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:46.680415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:46.681464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:46.682102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.682368 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70bed7bb-7cc4-4b8c-a7d6-c75077b0dbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.528372 Oct 18 16:04:46.683152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:46.683884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:46.684504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:46.689147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 556/1115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:46 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:47.064131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:47.064778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:47.080196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.081265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.082088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:47.083241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.084816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.085493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:47.110581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:47.126097 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36970ccb-33cd-4a1f-953e-506532d59f02 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.462726 Oct 18 16:04:47.130156 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 560/1116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:46 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:47.137564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:47.138491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:47.150709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.151412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.152078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:47.152982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.153668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.154288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:47.376847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:47.383990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:47.397497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:47.399273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:47.400450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e1cfe14-03ec-4294-b84d-0530c32bd79e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.340538 Oct 18 16:04:47.404391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 557/1117] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:47 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:47.681208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:47.695468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f480649a-9ec2-40f5-9b0c-edea05ced9b5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.563808 Oct 18 16:04:47.696845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 561/1118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:47 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:47.706586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:47.707556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:47.732320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.734853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.736074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:47.738114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:47.742620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:47.743403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.141336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:48.155034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:48.156198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:48.167088 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f05990f5-1772-4332-b7e8-6b90b8593704 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.464643 Oct 18 16:04:48.178468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 558/1119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:47 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:48.180865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.181655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.183010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.185338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.185987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.187604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.431074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:48.440303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:48.460534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.461328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.464263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.465906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.470248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.471779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.793414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:48.803484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77b8a26c-36a4-411d-9ae8-21c68e55657a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.653588 Oct 18 16:04:48.809074 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 562/1120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:48 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:48.816811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:48.820521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:48.837067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.842209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.843627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.845655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.847645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.848863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.894387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:48.903934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:48.909096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:48.921151 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e070fab-e689-4412-afa0-53e6b6a44905 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.493960 Oct 18 16:04:48.921744 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 559/1121] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:48 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:48.950606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:48.951120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:48.980593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.981207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.981657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:48.982850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:48.983376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:48.983758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.044070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:04:49.241748 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23785e71-d99a-4845-865a-96b01d689384 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 204 len: 0 microversion: 2.1 time: 0.317687 Oct 18 16:04:49.244590 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 560/1122] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:04:48 2022] DELETE /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:04:49.259026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e0f05-8b7b-479f-b4e4-5ffb5007ef3e", "name": "network-vif-plugged", "status": "completed", "tag": "8e0dc97e-de74-4496-8576-3e4b07b567c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:49.284950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.290552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.291443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.319388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:49.320356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] Creating event network-vif-plugged:8e0dc97e-de74-4496-8576-3e4b07b567c1 for instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e on n-h1-858383-14 Oct 18 16:04:49.329817 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c026bd4e-5731-49a7-b371-1984b5473620 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.519023 Oct 18 16:04:49.331435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 563/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:48 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:49.334384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f7e52dde-4dfc-4a89-a72d-498b7761fe50 req-1d318be9-ce7c-49af-ac6c-26be723da85e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087119 Oct 18 16:04:49.335229 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 561/1124] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:49.352295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:49.362175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:49.367814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:49.368536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:49.378377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.378987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.379496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.382259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.382920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.384642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.405862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.406667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.407303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.408266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.408632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:49.409834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.410927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.596533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:49.607096 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ccdcdfd-63d4-4ef9-a4ca-c8acd36d7817 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.258564 Oct 18 16:04:49.607685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 564/1125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:49 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:49.793852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1039390762", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "ed8b21f0-69a7-466b-8da6-e7d27cbc1387"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:49.904089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:49.919332 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4de39cc-2a20-41e6-b060-78300190c036 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1712 microversion: 2.1 time: 0.553848 Oct 18 16:04:49.935967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 562/1126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:49 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1712 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:49.949330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] validate_networks() for [('ed8b21f0-69a7-466b-8da6-e7d27cbc1387', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:49.950127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:49.950748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:49.971320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.974749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.975448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:49.976391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:49.977395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:49.978261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.528242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:50.537343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c2ba14e-e923-40c9-9a21-d944d8f208ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.609604 Oct 18 16:04:50.537937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 563/1127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:49 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:50.542601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:50.546108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:50.557740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.558245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.558690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.559406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.559867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.560683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.758623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:50.759231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:50.760031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:50.760445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:50.761270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:50.776478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.777071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.777739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.778532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.779055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.779544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.803349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:50.813419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:50.815221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:50.816815 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8deb952-4575-4f67-b088-505c56aa83b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.277929 Oct 18 16:04:50.818470 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 564/1128] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:50 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:50.821335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Getting quotas for project 22e9d50ee0c04ad58b4f851a619b58c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:50.831672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Getting quotas for user e11f56c35f4845b181e465224cf05a84 and project 22e9d50ee0c04ad58b4f851a619b58c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:50.832595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:50.833461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:50.850879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.851553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.852090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.852777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.853387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.853888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.860154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:04:50.869244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:04:50.961495 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fb75f18-1bac-4d0a-bf2e-5d9ea85c1788 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341981 Oct 18 16:04:50.962156 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 565/1129] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:04:50.967278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:50.968306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:50.976976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.977730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.978316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:50.979195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:50.980087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:50.980668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.140700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:51.150273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45ca44e9-ccbc-43a3-90fd-64ad12ea3761 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.186922 Oct 18 16:04:51.151106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 566/1130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:50 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:51.163720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:51.168580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:51.169493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:51.177594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.178227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.178837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.179834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.180504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.181046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.183263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe1eebaf-5075-4163-aa48-e95071ed3741 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1470 microversion: 2.1 time: 0.358763 Oct 18 16:04:51.183896 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 565/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:50 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:51.209631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d3a9d84-aff4-4c15-abe7-8c5fb94c256a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:51.210254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d3a9d84-aff4-4c15-abe7-8c5fb94c256a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:51.350701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d3a9d84-aff4-4c15-abe7-8c5fb94c256a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:51.391330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d3a9d84-aff4-4c15-abe7-8c5fb94c256a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1216 microversion: 2.1 time: 0.192498 Oct 18 16:04:51.394480 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 566/1132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:51 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:51.417109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:51.431771 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40d18ad1-e7f7-43ec-acd3-644ed0f68fd5 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1712 microversion: 2.1 time: 0.279034 Oct 18 16:04:51.431960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 567/1133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:51 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1712 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:51.564248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:51.564864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:51.571473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.572251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.572933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.574094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.574774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.575465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.831410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:51.848669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:51.850956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:51.857415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:51.859761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c440d3f-e473-44bb-a06b-5bdf07499980 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1308 microversion: 2.1 time: 0.299657 Oct 18 16:04:51.860369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 567/1134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:51 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:51.884021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.884521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.884963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:51.885699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:51.886175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:51.886585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.155538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.165468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-362699827", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "f4d6f986-1c33-4cc8-a6ea-5bd8d2a4460e"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:52.186123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.189014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.190473 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-241511c0-1260-49c3-af37-a77e7b1aa0c2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.347065 Oct 18 16:04:52.205628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 568/1135] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:51 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:52.216430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:52.217071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:52.226023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.226761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.228284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.229204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.230806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.231409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.243736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] validate_networks() for [('f4d6f986-1c33-4cc8-a6ea-5bd8d2a4460e', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:04:52.435187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.456505 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd31dba5-c210-48d9-a668-5181f779e4c5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.249363 Oct 18 16:04:52.477750 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 569/1136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:52 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:52.483783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:52.484752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:52.491661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.492448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.493119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.494034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.494669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.495269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.696633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.709104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b402269b-2d02-46f2-8e77-825bc6e6abd9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1488 microversion: 2.1 time: 0.229675 Oct 18 16:04:52.710833 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 570/1137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:52 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1488 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:52.722293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:52.723196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:52.736699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.748506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.751209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.752948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.754079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.754703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.864947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:52.876924 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11d4a8c8-1962-4e09-949d-2f93d5aef613 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1220 microversion: 2.1 time: 0.160919 Oct 18 16:04:52.880440 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 571/1138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:52 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:52.895942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:52.896596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:52.902998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.903686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.904119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:52.904820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:52.905937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:52.906366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.072012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.082280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-743d827d-1839-4f56-a5b1-ad5311ad9e16 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1712 microversion: 2.1 time: 0.201074 Oct 18 16:04:53.082890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 572/1139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:52 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1712 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:53.090933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.096281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.103333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:04:53.104504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:04:53.105425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:04:53.106012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:04:53.106583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:04:53.110130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.110631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.111257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.111984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.112458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.112890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.117836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.118539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.119150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.120060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.120696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.121309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.144519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Getting quotas for project c0ce650ca228469c984583f0d0ae7b20. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:04:53.151442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Getting quotas for user 6ca1e616c6044c07b3985ab39407f204 and project c0ce650ca228469c984583f0d0ae7b20. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:04:53.172939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:04:53.175415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:04:53.238705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b53f384-d9ab-4395-9be3-bfd8f949b47c tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.181396 Oct 18 16:04:53.246711 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 568/1140] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:04:53.252768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.253679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.261841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.262683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.263302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.264258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.265446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.266302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.291342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.301895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a5b631b-5406-4fe2-81b4-9de3a13d92f2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1489 microversion: 2.1 time: 0.217720 Oct 18 16:04:53.303326 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 573/1141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1489 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:53.325211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.326202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.408903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.420522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.422973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.424404 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39826a43-7ed0-4fcf-9c36-91a88ba44007 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1258 microversion: 2.21 time: 0.119175 Oct 18 16:04:53.425591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 574/1142] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1258 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:53.437767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:53.438531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.468381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.470812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.471465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.473717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.475961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.476582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.521287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lazy-loading 'flavor' on Instance uuid 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:53.523699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.538738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.541342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.543361 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f03e0c2e-ebb3-4b67-a065-635064c0c48c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.295124 Oct 18 16:04:53.546197 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 569/1143] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:53.566165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.567351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.573907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:53.575979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.576596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.577946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.578829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.579626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.580209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.704872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-54383743-5996-4ae2-94a2-891b7ba114be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e/action" status: 202 len: 0 microversion: 2.1 time: 0.277201 Oct 18 16:04:53.706262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 575/1144] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:53 2022] POST /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:04:53.720450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.721302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.732859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.734254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.735295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.736081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.736778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.737781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.920002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:53.955265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5999210-8fb7-4383-866f-b181cdd67ffd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.407456 Oct 18 16:04:53.957255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 570/1145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:53.973084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:53.973084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:53.973084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.973084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.973870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:53.973870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:53.977854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:53.985118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.035033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.046121 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70c5ad16-e476-462c-a402-db5a216849c9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1497 microversion: 2.1 time: 0.335393 Oct 18 16:04:54.058090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 576/1146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:54.072986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:54.073910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:54.103307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.103809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.104452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.105635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.106257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.106847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.257942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.286462 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09edeab1-cc89-4c7c-bd77-5bdf21e77e95 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.327402 Oct 18 16:04:54.289356 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 571/1147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:53 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:54.298897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:54.304883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:54.321783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.322528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.323034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.324439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.343824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.344435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.354172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.366201 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9654af2-ef79-45c6-948f-f65b3aeaa3bf tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1220 microversion: 2.1 time: 0.306600 Oct 18 16:04:54.372595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 577/1148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:54 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1220 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:54.385202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "name": "network-vif-plugged", "status": "completed", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:54.405998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.410155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.412200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.462282 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] Creating event network-vif-plugged:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h2-858383-14 Oct 18 16:04:54.479451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c7728fdf-9e30-4ee6-bcd4-788be16cfc6f req-d3b3e342-1f3a-4325-894d-186df56b7890 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105053 Oct 18 16:04:54.487613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 578/1149] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:54.501956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:54.502681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:54.538827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.539453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.540125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.542593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.543246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.544003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.727962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.739990 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24435f0c-6d7b-465b-8f55-82b85c57d3bc tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1712 microversion: 2.1 time: 0.449386 Oct 18 16:04:54.746377 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 572/1150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:54 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1712 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:54.747779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.754301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:54.760241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.760402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:54.761815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.768290 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7093b463-9548-4898-a5a5-1c3b35dd1b1d tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1254 microversion: 2.21 time: 0.279229 Oct 18 16:04:54.768828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 579/1151] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:54 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1254 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:54.772850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.774115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.774920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.776942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.777682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.778329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.964579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.974194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.975628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:54.977127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d1782b5-2067-4d23-a82a-a78708400ec9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.229463 Oct 18 16:04:54.977682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 573/1152] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:54 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:54.981355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:54.982352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:54.992108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.995299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:54.995966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:54.998445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:54.999529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.001338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.087781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:55.088844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:55.101807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.101807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.102622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.103401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.103925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.104573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.297902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.306978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-265d0aa0-8688-401f-8f54-e0e73aca04cc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1497 microversion: 2.1 time: 0.222962 Oct 18 16:04:55.308759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 574/1153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:55.314035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:55.314797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:55.321516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.322387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.323059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.324042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.324670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.325142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.330356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:55.475033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.484086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-996b0ec0-2520-40d1-834e-23866a92d3c5 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.174244 Oct 18 16:04:55.484909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 575/1154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:55.490177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:55.491158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:55.497862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.498886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.499562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.500534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.501032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.501480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.573862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.583209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d18d5a0-b7bb-4118-8355-e419b20bec4b tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1268 microversion: 2.1 time: 0.096841 Oct 18 16:04:55.584112 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 576/1155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1268 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:55.661930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.670906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b2541e6-9110-48a9-9972-99114a898b09 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.694959 Oct 18 16:04:55.672018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 580/1156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:54 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:55.774242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:55.774859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:55.782147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.782729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.783248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.784035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.784504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.784930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.798908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:55.799546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:55.805841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.806437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.806909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.808086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:55.808191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:55.808621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:55.843371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:55.864867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.875724 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16a94503-2dfb-441a-9891-b4730de03333 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1645 microversion: 2.1 time: 0.105032 Oct 18 16:04:55.876325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 577/1157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1645 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:55.931044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.944026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.944884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:55.946855 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12382b39-6411-4946-beab-c404763f46ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1254 microversion: 2.21 time: 0.151702 Oct 18 16:04:55.947119 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 581/1158] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1254 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:04:56.004535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.005196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.011834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.012965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.013431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.015638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.016157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.018022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.268981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.288021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.289979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.291938 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5adfa69-11d0-48a4-8ae9-7e4181facc15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1411 microversion: 2.25 time: 0.292659 Oct 18 16:04:56.299251 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 578/1159] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:55 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1411 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:56.333355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.334167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.346919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9268ea0-c252-48aa-bd94-a3f4dac281cf", "name": "network-vif-deleted", "tag": "ee1ea766-2f0d-42a0-b790-a492f22d879b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:56.354086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.354598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.355292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.356376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.357025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.357461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.359957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.360640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.361313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.388035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] Creating event network-vif-deleted:ee1ea766-2f0d-42a0-b790-a492f22d879b for instance b9268ea0-c252-48aa-bd94-a3f4dac281cf on n-h2-858383-14 Oct 18 16:04:56.396618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-884c1494-fcff-4d62-948d-6549507ca9db req-8a84b3e9-3412-43a4-9a79-14d5b2905246 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053820 Oct 18 16:04:56.398973 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 579/1160] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:56.511499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.512557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.520552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.521496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.522216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.523219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.525168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.525766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.714833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.726617 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53e8d039-045e-4651-9240-f258c8908ab6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1497 microversion: 2.1 time: 0.398427 Oct 18 16:04:56.735851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.741790 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 582/1161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:56 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1497 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:56.751812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.752799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10c90d43-687f-4b35-8fad-3a077cebe3c4 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.247350 Oct 18 16:04:56.753250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.759756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.760486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.761119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.762674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.763464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.764054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.781512 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 580/1162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:56 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:56.789131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.789811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.798357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.798847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.799310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.800009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.800465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.801025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.862377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:56.874506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a467bfa-ce9a-426f-a668-6bd26cd5f5e4 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1274 microversion: 2.1 time: 0.131296 Oct 18 16:04:56.875128 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 583/1163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:56 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:56.883691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-unplugged", "status": "completed", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:56.898233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.898981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.899679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.936471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] Creating event network-vif-unplugged:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:04:56.948792 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ae72b518-1747-4235-919c-531633c5f915 req-abab2ad1-e0ea-4dbe-a80f-e73b47022664 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068667 Oct 18 16:04:56.950846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 584/1164] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:56.965498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:56.966515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:56.980960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.982708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.983774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.985513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:56.989888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:56.990437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:56.999333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.010014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05bacf76-4086-4e6a-8dea-e29717b3fbd6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.227140 Oct 18 16:04:57.011263 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 581/1165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:56 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:57.017064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:57.017682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:57.024288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.024786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.025256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.025963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.026427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.026857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.049801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.051519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.053522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.054221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lazy-loading 'fault' on Instance uuid b9268ea0-c252-48aa-bd94-a3f4dac281cf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:04:57.122845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.132757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.134953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.135853 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b32a6730-ea02-441e-addb-459ef8373719 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1310 microversion: 2.21 time: 0.123222 Oct 18 16:04:57.136840 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 582/1166] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:57 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1310 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:57.146016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afa642202234799a50a8460a3b6d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06acce18eb064040a95fb5c282c07109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.163179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1085db67-84eb-428b-b0ad-c25994f8da73 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 200 len: 1353 microversion: 2.1 time: 0.208724 Oct 18 16:04:57.164700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 585/1167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:56 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 1353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:57.326980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:57.328811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:57.337696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.338479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.339094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.339955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.341779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.343026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.548510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.570508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.574634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:57.578464 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-771b94e5-b127-4e39-ba04-de5cc95f6722 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1607 microversion: 2.25 time: 0.255753 Oct 18 16:04:57.605165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 583/1168] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:57 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1607 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:57.615191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:57.615936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:57.626709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.627411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.628035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.629379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.630090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.630687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.751745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:57.752846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:57.759842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.760330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.760766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.764035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.765367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.765816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.913323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-14943099-773d-4756-a266-f819b240312e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.302163 Oct 18 16:04:57.914233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 586/1169] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:04:57 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:04:57.918917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:57.919575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:57.977812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.978649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.979560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.980787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:57.981577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:57.983426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:57.998393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.007384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e07fbfa-55b1-4c6d-bf6c-db08866f374b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 200 len: 1480 microversion: 2.1 time: 0.260840 Oct 18 16:04:58.008212 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 584/1170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:57 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 1480 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:04:58.015897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:58.016707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:58.025265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.025973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.027014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.027896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.032243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.032874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.231341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.249745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ccde76c-cb52-4a56-af08-973c8d827e3f tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.239538 Oct 18 16:04:58.250638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 585/1171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:58 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:58.255525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-253846384"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:58.258193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:58.265909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.266644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.267258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.268134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.268753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.269370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.566425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08e61fd3-837e-4d00-bf7c-71574141d9e3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e/action" status: 202 len: 0 microversion: 2.1 time: 0.314352 Oct 18 16:04:58.577218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 586/1172] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:04:58 2022] POST /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:04:58.595459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:58.596572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:58.605193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.606373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.607185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.608690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.609402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.610947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.669863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.718813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dadbd953-2e3d-4b0a-9504-86ca1d849e8b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.803454 Oct 18 16:04:58.723405 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 587/1173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:57 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:58.736315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:58.737308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:58.758277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.761413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.762754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.765280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.765802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.766243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.898761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.907280 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db467d6a-2ac1-4a23-b2b7-62d2ff999e9f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.319237 Oct 18 16:04:58.908145 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 587/1174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:58 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:58.926409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:58.927094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:58.935281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.936312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.936763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.937419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.937871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:58.937975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:58.938379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:58.949594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.952316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:58.953927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4fbdb815-fd8c-43c0-bdcd-ff206668bac3 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1316 microversion: 2.21 time: 0.229486 Oct 18 16:04:58.954076 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf HTTP/1.1 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:04:58.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:04:58.967077 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9268ea0-c252-48aa-bd94-a3f4dac281cf'} Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:58.979920 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:04:58.982198 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:58.984513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:58.984513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2aa8ce60-fdad-48c0-81b6-07ee2b61585c tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 404 len: 111 microversion: 2.1 time: 0.039243 Oct 18 16:04:58.984513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 588/1175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:58 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:58.984513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dc49ca7-81cd-439f-949f-d57df990f4be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd290c8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:58.986896 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 588/1176] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:04:58 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:04:58.991678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "name": "network-vif-plugged", "status": "completed", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:04:59.004651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.005809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.007040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.028140 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dc49ca7-81cd-439f-949f-d57df990f4be tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.068772 Oct 18 16:04:59.029295 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 589/1177] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:58 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:59.035064 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] Creating event network-vif-plugged:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h2-858383-14 Oct 18 16:04:59.040825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-54a4d011-f3c5-4eb6-8ac7-31ea46556d07 req-83c9aad2-6225-4c52-a343-04747bd233e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053944 Oct 18 16:04:59.045178 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 589/1178] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:04:59.046185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.046911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:59.054822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.055454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.056166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.057015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.057686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.058224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.074127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 HTTP/1.1 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:04:59.075907 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.078073 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '661561e8-887f-41da-b4ab-de196e88e361'} Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:59.079004 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.080483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.082072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:59.082654 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbe0b5cd-ed31-4ec9-9103-06008d134d6e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 404 len: 111 microversion: 2.1 time: 0.041934 Oct 18 16:04:59.086462 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 590/1179] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:04:59 2022] DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:59.101721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.102679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:59.121297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.122355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.122840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.123685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.125850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.129225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.146787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 HTTP/1.1 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:04:59.148347 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.149940 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '661561e8-887f-41da-b4ab-de196e88e361'} Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:04:59.150774 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:04:59.152142 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:04:59.153474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:04:59.153474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c76ac938-03e3-4c14-a01f-05b8060fe53e tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 404 len: 111 microversion: 2.1 time: 0.059894 Oct 18 16:04:59.153474 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 590/1180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:59 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:59.160268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c0aa119-62cb-4c46-a87d-b73b0bd9d7ef tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '.version_select at 0x7f5fd2a144c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.184159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c0aa119-62cb-4c46-a87d-b73b0bd9d7ef tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466953210" status: 202 len: 0 microversion: 2.1 time: 0.027723 Oct 18 16:04:59.184935 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 591/1181] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466953210 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:04:59.275332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.276149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:59.283786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.284808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.285443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.286387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.287018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.287458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.752365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.754575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:59.762650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.763713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.764359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.765828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:04:59.766431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:04:59.767116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:04:59.962392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:59.965516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:04:59.971703 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3dd44df-6fc2-481e-a11c-53eb743e5999 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.226978 Oct 18 16:04:59.972735 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 592/1182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:59 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:59.986032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-607efe10-2517-424d-aed4-7fc0b526af42 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.703174 Oct 18 16:04:59.995484 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 591/1183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:59 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:04:59.995484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:04:59.996060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:04:59.996579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-226bef6d-4f6c-4f20-89b3-205086c5b7b5 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.002919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.003408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.003847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.004546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.005255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.005691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.017328 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-226bef6d-4f6c-4f20-89b3-205086c5b7b5 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1423448929" status: 202 len: 0 microversion: 2.1 time: 0.029606 Oct 18 16:05:00.018013 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 593/1184] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:04:59 2022] DELETE /compute/v2.1/flavors/1423448929 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:00.025961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.026672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:00.033033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.034222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.034752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.035520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.036052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.036550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.102894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:00.112590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:00.114222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:00.115488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20ccb5a3-814d-4fe6-9fb8-e5e7e15077f4 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1316 microversion: 2.21 time: 0.095878 Oct 18 16:05:00.116047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 594/1185] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:00.121085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ef5a08ea-f8b4-426b-a9e2-e3a3a1cd27f2 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.143900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ef5a08ea-f8b4-426b-a9e2-e3a3a1cd27f2 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.026661 Oct 18 16:05:00.144400 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 595/1186] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:00.149191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08215e02-ebe3-4555-aacd-2162c5e03891 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd297adc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.197506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08215e02-ebe3-4555-aacd-2162c5e03891 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.051795 Oct 18 16:05:00.205053 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 596/1187] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:00.205053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c3ae156-da59-4dfe-b3d5-f512ffdbdba1 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.221345 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c3ae156-da59-4dfe-b3d5-f512ffdbdba1 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1066535079" status: 202 len: 0 microversion: 2.1 time: 0.022094 Oct 18 16:05:00.221928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 597/1188] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:05:00 2022] DELETE /compute/v2.1/flavors/1066535079 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:00.229490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd91acb9-6ca9-435c-801a-9d3d803121a3 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.250827 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd91acb9-6ca9-435c-801a-9d3d803121a3 tempest-ServersWithSpecificFlavorTestJSON-1658215665 tempest-ServersWithSpecificFlavorTestJSON-1658215665-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024708 Oct 18 16:05:00.251422 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 598/1189] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:00.283576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.284184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:00.290693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.291188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.291636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.292338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.292802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.293264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.307943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf HTTP/1.1 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:00.309696 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.311044 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9268ea0-c252-48aa-bd94-a3f4dac281cf'} Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:00.311784 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.312972 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.314227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:00.314227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e45f55ae-bb49-466e-8f51-81e34bdb3c4b tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 404 len: 111 microversion: 2.1 time: 0.032043 Oct 18 16:05:00.314227 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 599/1190] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:00 2022] DELETE /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:00.319762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.320383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: b9268ea0-c252-48aa-bd94-a3f4dac281cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:00.326826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.327220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.327666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.328380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.328841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.329362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.333904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:00.346678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf HTTP/1.1 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:00.348228 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.349787 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9268ea0-c252-48aa-bd94-a3f4dac281cf'} Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:00.350684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. Oct 18 16:05:00.352066 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.359507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance b9268ea0-c252-48aa-bd94-a3f4dac281cf could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:00.361561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0261e38-334a-4820-8eff-1cc432e660d7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf" status: 404 len: 111 microversion: 2.1 time: 0.045136 Oct 18 16:05:00.362748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 600/1191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/servers/b9268ea0-c252-48aa-bd94-a3f4dac281cf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:05:00.372903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.374207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:00.386477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.387123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.388040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.389754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.390425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.391140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.409177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 HTTP/1.1 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:00.411212 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.412549 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '661561e8-887f-41da-b4ab-de196e88e361'} Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:00.413343 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.414506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.419221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:00.424135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:00.425383 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88d24056-1fc1-4ee4-af6b-2504f99a4bc7 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 404 len: 111 microversion: 2.1 time: 0.057876 Oct 18 16:05:00.426784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 601/1192] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:00 2022] DELETE /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:00.436810 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1833a268-275b-436c-967e-664487debdee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1361 microversion: 2.1 time: 0.444662 Oct 18 16:05:00.441278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:00.457461 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 592/1193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:04:59 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:00.459550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] [instance: 661561e8-887f-41da-b4ab-de196e88e361] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:00.465835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.466326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.466770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.468272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.468756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.469209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.485529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] HTTP exception thrown: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Request method failure captured: Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 HTTP/1.1 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs2p3OS6SO-PVgv1bxK_fl5INZTEX7c69j2VBdtgtjoJWWku1ywBKaT_a-VPVFZHscf_cqOyR0XFwURz7R8OR4RsBeXZvPy0QEQuCDQrkJ2Dbi-LFa-thtmlSfAFApvayqoC4HWZBLF5gSoGpGgQWJRNplZIBghEUR3ujlNlR11FPd4 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:00.487247 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06acce18eb064040a95fb5c282c07109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06acce18eb064040a95fb5c282c07109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06acce18eb064040a95fb5c282c07109"}]}] Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 06acce18eb064040a95fb5c282c07109 Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060 Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 2afa642202234799a50a8460a3b6d36c Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1978620060-project Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.488786 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '661561e8-887f-41da-b4ab-de196e88e361'} Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:00.489683 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. Oct 18 16:05:00.491322 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:00.493481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] Returning 404 to user: Instance 661561e8-887f-41da-b4ab-de196e88e361 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:00.493481 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b9f5d2a7-a0c2-4233-8895-925f1de4f386 tempest-ServersWithSpecificFlavorTestJSON-1978620060 tempest-ServersWithSpecificFlavorTestJSON-1978620060-project] 10.222.0.78 "GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361" status: 404 len: 111 microversion: 2.1 time: 0.057323 Oct 18 16:05:00.494153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 602/1194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/servers/661561e8-887f-41da-b4ab-de196e88e361 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:00.657584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f786776-02c3-4243-8908-80ea88e58e46", "tag": "1fcb767d-a858-4dc0-9eae-6f663aa5f975"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:00.677367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:00.678226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:00.678904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:00.692612 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] Creating event network-changed:1fcb767d-a858-4dc0-9eae-6f663aa5f975 for instance 5f786776-02c3-4243-8908-80ea88e58e46 on n-h2-858383-14 Oct 18 16:05:00.699697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-19a8a577-8ca1-457b-930f-1da11c6755ee req-fad5da55-e23b-4c3a-a89c-72390bbac8de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052813 Oct 18 16:05:00.701167 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 593/1195] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:00.998899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:01.000340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:01.000916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:01.008463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.008945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.009648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.010668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.011283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.011796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:01.012187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.012552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:01.032565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.033631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.034314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.035240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.035914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.037185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.305356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:01.315778 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4293510-f032-4190-b8d3-4ef7027896b6 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.321507 Oct 18 16:05:01.317176 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 603/1196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:01.322256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-plugged", "status": "completed", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:01.336384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.338033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.338703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.359590 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] Creating event network-vif-plugged:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:05:01.366353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7d606423-6945-462c-bdff-f0fc9d3334d6 req-e2200ac5-a7e5-4a26-8a37-6d1c05334384 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047340 Oct 18 16:05:01.367377 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 604/1197] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:01.372975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:01.374178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:01.381679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.382632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.383256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.384124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.384901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.385522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.426290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:01.441663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-906d6e64-d30c-4564-a8e7-462400cb7ac9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.442117 Oct 18 16:05:01.442549 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 594/1198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:00 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:01.447336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ece8b8a2-e83a-4292-9855-b196ab435d77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2020430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:01.534068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ece8b8a2-e83a-4292-9855-b196ab435d77 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.090138 Oct 18 16:05:01.545732 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 595/1199] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:01 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:01.557404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:01.558161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:01.564764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.565886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.566594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.567597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:01.567597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:01.567936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:01.789428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:01.804499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:01.807317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:01.809222 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-619cdc3d-367c-43d9-8e78-d2f4333cc886 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.440376 Oct 18 16:05:01.810263 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 605/1200] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:01 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:02.256167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:02.275445 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba0c9c81-95c5-4e88-9df1-9b87d43f4823 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1545 microversion: 2.1 time: 0.739725 Oct 18 16:05:02.276043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 596/1201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:01 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1545 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:02.304941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:02.306120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:02.312869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.313858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.314464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.315828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.316459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.317399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.347518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:02.348150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:02.370262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.371301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.373159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.374673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.375542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.380074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.563187 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b655777-0553-44c1-ab39-2e74067d9947 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262061 Oct 18 16:05:02.570757 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 606/1202] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:05:02 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:02.570757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:02.570757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:02.586900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.588120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.588120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.588818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.589316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.589754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.850787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:02.859852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40eec7a6-c863-4934-ad75-7aabca3394ec tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.520023 Oct 18 16:05:02.860444 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 597/1203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:02 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:02.872019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:02.883228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-532d993c-1273-4902-9a91-06c771b86f35 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1476 microversion: 2.1 time: 0.316584 Oct 18 16:05:02.888811 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 607/1204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:02 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:02.890315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27a0d8a7-c6ba-498b-922e-2e3ebea38063 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20cf040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:02.894600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}, {"name": "network-changed", "server_uuid": "39548bbf-63c8-4ffc-8de1-f662aba8ceb9", "tag": "bda4ba69-864a-4fbd-a72f-38ade302638e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:02.917265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:02.921167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:02.921781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:02.952873 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Creating event network-changed:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h2-858383-14 Oct 18 16:05:02.958651 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] Creating event network-changed:bda4ba69-864a-4fbd-a72f-38ade302638e for instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 on n-h2-858383-14 Oct 18 16:05:02.970918 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27a0d8a7-c6ba-498b-922e-2e3ebea38063 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.084976 Oct 18 16:05:02.971516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 598/1205] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:02 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:02.973303 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-142a3502-4b98-406d-aca4-cf16cee4a549 req-84e34b27-287a-45c1-9e8f-ede3b0cd5957 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082159 Oct 18 16:05:02.974043 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 608/1206] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:02.985638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:02.986232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:03.004314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.005943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.006413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:03.009373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.009881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.010321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:03.331197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:03.341100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:03.343632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:03.346927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-093028e2-8956-4931-95a8-a7d056aaca07 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.374437 Oct 18 16:05:03.357446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 599/1207] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:02 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:03.881078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:03.882550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:03.887374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:03.888404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:03.911127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:03.911996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:03.915438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.916874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.917568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:03.918682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.919508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.920828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:03.924756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:03.931236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.931752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.932205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:03.932934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:03.933421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:03.944349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.241105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:04.251862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ac163ea-7331-4fa0-a5bc-d8cfca8ba511 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1461 microversion: 2.1 time: 0.344332 Oct 18 16:05:04.252936 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 600/1208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:03 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1461 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:04.258376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eef93207-9201-4b9a-ba8e-39e80d65f835 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd223b1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:04.283467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:04.293062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93adf181-50ca-4b05-9d59-122b5274c61a tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.412919 Oct 18 16:05:04.300807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 609/1209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:03 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:04.316595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:04.319138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:04.327369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.328237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.328909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.329299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eef93207-9201-4b9a-ba8e-39e80d65f835 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.075201 Oct 18 16:05:04.331244 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 601/1210] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:04 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:04.338003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.338683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.339237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.375632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:04.376402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:04.386382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.387123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.393896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.397140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.397896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.398594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.506512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67dd3d0f-1b6c-4751-8edf-4cce8568c10f tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 0 microversion: 2.1 time: 0.210980 Oct 18 16:05:04.510136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 610/1211] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:05:04 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:04.527876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:04.528810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:04.539039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.540621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.541644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.542795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.543721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.544552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.602193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.603357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.603962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.605783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lazy-loading 'fault' on Instance uuid a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:04.906224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:04.923028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:04.925091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:04.926447 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97da7304-8b05-4b0a-ac35-7b28984cb8ee tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.555990 Oct 18 16:05:04.927462 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 602/1212] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:04 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:05:04.954966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e0f05-8b7b-479f-b4e4-5ffb5007ef3e", "name": "network-vif-plugged", "status": "completed", "tag": "8e0dc97e-de74-4496-8576-3e4b07b567c1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:04.964779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3632e3dc-d2c6-470c-9c9c-16ab38fab8d2 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1597 microversion: 2.1 time: 0.450875 Oct 18 16:05:04.980361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:04.988558 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 611/1213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:04 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1597 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:04.989348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:04.989957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:04.997448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:05.001408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:05.008182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.008692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.009234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.009942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.010480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.010990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.015724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] Creating event network-vif-plugged:8e0dc97e-de74-4496-8576-3e4b07b567c1 for instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e on n-h1-858383-14 Oct 18 16:05:05.031697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7f47d4c6-4449-4d38-9713-129d68850e2c req-a6447cba-531a-4d05-b268-1cb4b0a04d43 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080702 Oct 18 16:05:05.032661 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 603/1214] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:05.115484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:05.141607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.142471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.143340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.167495 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] Creating event network-changed:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h2-858383-14 Oct 18 16:05:05.178957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0f95048f-8082-4008-a7c1-6e33030bc7d6 req-4280e902-2114-4dc7-9c05-4547cc0f393a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067360 Oct 18 16:05:05.182360 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 604/1215] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:05.182962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f288e59f-9ee2-430d-8f69-bd8f78259ac8 tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action" status: 202 len: 0 microversion: 2.1 time: 0.191307 Oct 18 16:05:05.187083 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 612/1216] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:05:04 2022] POST /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:05.196958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:05.198695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:05.225995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.226832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.227509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.228442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.229175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.230074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.243433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:05.320426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:05.321187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:05.332281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.333135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.333352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.334267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.341565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.341565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.841702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:05.853219 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47cead58-81db-47c4-8770-3f0879a7eace tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.537464 Oct 18 16:05:05.869045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 613/1217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:05 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:05.880630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0df108f3-7955-4125-8cf9-af93a95776ea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd266a4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:05.887138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb2abc1d-a4fe-47d5-ae55-1f02d15d36fc tempest-ServersAdminTestJSON-657448554 tempest-ServersAdminTestJSON-657448554-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1614 microversion: 2.1 time: 0.698092 Oct 18 16:05:05.917724 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 605/1218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:05 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1614 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:05.958907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:05.968260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0df108f3-7955-4125-8cf9-af93a95776ea tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.097685 Oct 18 16:05:05.968829 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 614/1219] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:05 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:05.969429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:05.980266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:05.983774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.984432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.984876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:05.987579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:05.993404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:05.993903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:05.994528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.007298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.007826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.008246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.008960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.015028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.015486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.060825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:06.326517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eeeb0368-267f-48b4-a4b3-86e1b2d73c83 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "DELETE /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 204 len: 0 microversion: 2.1 time: 0.405759 Oct 18 16:05:06.327638 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 606/1220] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:05 2022] DELETE /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:06.343747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:06.347535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:06.366830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.368143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.368600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.369350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.369807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.370233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.711878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:06.740490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:06.746074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:06.750200 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f8bc5db-6a89-47c0-8f14-27953a55c2aa tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.774509 Oct 18 16:05:06.771940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 615/1221] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:05 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:06.878772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:06.879678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:06.883500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:06.892231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.892722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.896674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:06.898494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:06.902404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:06.903088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:07.272601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:07.287105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00ebbe2e-c9d4-4e6f-81f9-4b25f09ae66a tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1468 microversion: 2.1 time: 0.955329 Oct 18 16:05:07.295659 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 607/1222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:06 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1468 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:07.303026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-247fb991-42db-4979-834d-59371412c86e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2111160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:07.418841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-247fb991-42db-4979-834d-59371412c86e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.121717 Oct 18 16:05:07.422679 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 608/1223] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:07 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:07.464036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:07.474089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f24d519e-86c6-47c0-9af0-4a6467b2fb81 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.599085 Oct 18 16:05:07.475261 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 616/1224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:06 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:07.777908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:07.778830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:07.788637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:07.789433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:07.790059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:07.790980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:07.791623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:07.792247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.136577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:08.155189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:08.158074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:08.167170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab2800b0-1a0a-49db-a5ca-a30772cf860f tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.393650 Oct 18 16:05:08.181054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 609/1225] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:07 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:08.323333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:08.324344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:08.338814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:08.339514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:08.340140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.341054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:08.341663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:08.342652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.436276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0fb04880-a2fe-4171-958b-51ad3fb5a320 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20c5ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:08.541917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0fb04880-a2fe-4171-958b-51ad3fb5a320 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.111106 Oct 18 16:05:08.542480 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 610/1226] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:08 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:08.556297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:08.560366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:08.579462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:08.580366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:08.580979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.581874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:08.582493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:08.583079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.684885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:08.696861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4d1b6d0-03cf-4cfd-8d30-2be322abc7ad tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1468 microversion: 2.1 time: 0.385803 Oct 18 16:05:08.697670 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 617/1227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:08 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:08.801603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f786776-02c3-4243-8908-80ea88e58e46", "name": "network-vif-plugged", "status": "completed", "tag": "1fcb767d-a858-4dc0-9eae-6f663aa5f975"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:08.819154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:08.820840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:08.821517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:08.831973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:08.847296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] Creating event network-vif-plugged:1fcb767d-a858-4dc0-9eae-6f663aa5f975 for instance 5f786776-02c3-4243-8908-80ea88e58e46 on n-h2-858383-14 Oct 18 16:05:08.865668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e300b294-fae1-4b81-a2af-049abd414d6d req-4edc1b95-e093-4346-ac3d-d38581deba51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067666 Oct 18 16:05:08.866617 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 618/1228] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:08.891022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:08.901207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbd952e5-be5e-435f-94f7-5401df1d366e tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.354919 Oct 18 16:05:08.934262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 611/1229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:08 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:09.198012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:09.198714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:09.221299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.221809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.222255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.222982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.223435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.240049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.293732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387f143c-8e59-42bf-97d5-b26e8a29ef79", "name": "network-vif-deleted", "tag": "74e87467-c1f1-49ad-ae23-79657482bec0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:09.340902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.342788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.343228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.360170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] Creating event network-vif-deleted:74e87467-c1f1-49ad-ae23-79657482bec0 for instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 on n-h1-858383-14 Oct 18 16:05:09.366947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0bcffedc-1760-4376-b254-0a9dff2725d1 req-83d8ede3-38a3-47b8-a09c-b2a7b76f2579 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078401 Oct 18 16:05:09.368096 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 612/1230] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:09.559881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b82ea9e-c999-434f-8c38-f789a4bc2b2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2020af0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:09.611992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:09.629262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:09.637274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:09.641603 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-140ff1a4-d784-469c-a788-8dd240684f87 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.447999 Oct 18 16:05:09.643791 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 619/1231] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:09 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:09.677596 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b82ea9e-c999-434f-8c38-f789a4bc2b2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.122246 Oct 18 16:05:09.680077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 613/1232] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:09 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:09.723892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:09.729349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:09.744462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.753992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.755910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.757837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.761968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.763951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.837490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.838726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.839192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.839661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lazy-loading 'fault' on Instance uuid 387f143c-8e59-42bf-97d5-b26e8a29ef79 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:09.911082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:09.926052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e491ad02-0eb1-478e-9739-177935a5e5e9 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 200 len: 1303 microversion: 2.1 time: 0.205849 Oct 18 16:05:09.928898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 620/1233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:09 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:09.952617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:09.954435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:09.969012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.973357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.973850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:09.975854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:09.976454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:09.978032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:10.311399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:10.320518 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-813e7e5d-6ce4-4203-b86b-6d48643ba240 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.379969 Oct 18 16:05:10.337173 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 614/1234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:09 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:10.674060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:10.675168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:10.689458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:10.690524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:10.691852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:10.696064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:10.697923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:10.698983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:10.710027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2b6ccd1-53a9-4ee3-9ab7-74e627b3a501 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2058940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:10.780959 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2b6ccd1-53a9-4ee3-9ab7-74e627b3a501 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.074753 Oct 18 16:05:10.789985 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 615/1235] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:10 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:10.803735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff5b9eb0-57f2-4ff1-a36b-fc5c0aec9b6b"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:10.812804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:10.839986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:10.840502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:10.840947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:10.844573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:10.845076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:10.849307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:10.971724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:10.981958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:10.984543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:10.986123 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f12f025-87d3-4be1-9d77-57582cb5d5c2 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.318901 Oct 18 16:05:10.987649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 621/1236] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:10 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:10.994764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:10.995702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 387f143c-8e59-42bf-97d5-b26e8a29ef79] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:11.002674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.003837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.004525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.005523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.006248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.006886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.028823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] HTTP exception thrown: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Request method failure captured: Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 HTTP/1.1 Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4vMSrNJhyI3QHK3gGViP6kkE3IYGnS_9x2LlbMeDHiVILSbztyGgHHfMEKrOY-scqaZDM-f87UxTmi31j-PRZyKpiy7v1I8yWUdPQtISnS_lSjcq3OzX-rt_mUvFtHfR3wrP_x_ype2sYXwdTcAs2u1vwGTPXv84Kg0hKaXogwebg Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:11.033182 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6331acc801404531ad94b7ee7664bebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}] Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e43668b02a784329b9c73993ed6a927e Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. Oct 18 16:05:11.035061 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '387f143c-8e59-42bf-97d5-b26e8a29ef79'} Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:11.036065 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. Oct 18 16:05:11.037679 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:11.040608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Returning 404 to user: Instance 387f143c-8e59-42bf-97d5-b26e8a29ef79 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:11.042010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b57eb3ff-b4e1-48bc-a64f-54c86c645610 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79" status: 404 len: 111 microversion: 2.1 time: 0.053122 Oct 18 16:05:11.042947 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 622/1237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:10 2022] GET /compute/v2.1/servers/387f143c-8e59-42bf-97d5-b26e8a29ef79 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:11.062195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:11.062883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:11.077227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.079755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.080542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.083424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.084019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.084539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.140664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:11.325954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3acc759-4775-4b05-80d2-eb53d3da7387 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "DELETE /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 204 len: 0 microversion: 2.1 time: 0.275390 Oct 18 16:05:11.337934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 623/1238] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:11 2022] DELETE /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:11.344276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:11.345093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:11.362748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.363263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.363712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.364426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.364888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.365346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.647138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8999a1b-752c-478f-b4f0-9dc6d89c1af4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "POST /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847144 Oct 18 16:05:11.649455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 616/1239] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:05:10 2022] POST /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:11.663873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:11.671322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:11.710365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.711033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.711296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.728843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:11.729491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:11.732837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:11.773825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:11.788295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8064366-ebcc-42c1-9926-d381870a77d1 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1469 microversion: 2.1 time: 0.444538 Oct 18 16:05:11.815083 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 624/1240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:11 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:11.828675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-579304bb-b2ed-4138-89ad-7d0624104136 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2a57280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:11.949523 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-579304bb-b2ed-4138-89ad-7d0624104136 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.132861 Oct 18 16:05:11.950425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 625/1241] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:11 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:12.019486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:12.021295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:12.032550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:12.035336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:12.036006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:12.036926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:12.038521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:12.039335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:12.075518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:12.085509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc911245-748a-41b2-bd95-25bce2b01909 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1316 microversion: 2.1 time: 0.434289 Oct 18 16:05:12.102546 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 617/1242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:11 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:12.599755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:12.622780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:12.628103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:12.629948 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-daf7ae40-96bf-463e-bb90-0b5cdd5c36cf tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.616314 Oct 18 16:05:12.642474 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 626/1243] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:12 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:12.821266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:12.822075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:12.849856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:12.850348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:12.860286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:12.861081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:12.861561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:12.861997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:12.967728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-185758f9-e900-48a4-ba20-1b9629a21cb2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd274f310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:13.046639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-185758f9-e900-48a4-ba20-1b9629a21cb2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.083088 Oct 18 16:05:13.058535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 627/1244] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:12 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:13.120023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:13.124437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:13.153496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.154861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.155629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.156600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.159332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.160010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.246531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:13.254789 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1cbb022f-2375-445e-871f-89c127005bc3 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1469 microversion: 2.1 time: 0.437388 Oct 18 16:05:13.260871 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 618/1245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:12 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:13.632645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:13.645277 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b0f4ad58-5368-4b55-b336-af9b56e90379 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1504 microversion: 2.1 time: 0.535660 Oct 18 16:05:13.647516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 628/1246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:13 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:13.659222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:13.660225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:13.672121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.673560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.690472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:13.690853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.691872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.692558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.693357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:13.694182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.710409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.713843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.714697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.715629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:13.717353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:13.720043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:13.819269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:14.045192 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d15f6ea-72b1-43ba-9ebe-0df2fdc12d69 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 204 len: 0 microversion: 2.1 time: 0.375807 Oct 18 16:05:14.045782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 629/1247] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:13 2022] DELETE /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:14.075281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:14.078881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:14.090806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:14.091916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:14.093796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:14.094933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:14.095848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:14.096772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:14.195983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:14.226868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:14.228882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:14.231055 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2df9f2f7-bb51-4398-bbb7-2020963031cb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.578568 Oct 18 16:05:14.252827 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 619/1248] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:13 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:14.262771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88407c5d-cb1f-40c2-a937-5c994c309759 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd65364c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:14.378692 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88407c5d-cb1f-40c2-a937-5c994c309759 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.124232 Oct 18 16:05:14.383217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 620/1249] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:14 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:14.391104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:14.392024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:14.432855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:14.436246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:14.437114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:14.441529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:14.442696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:14.443479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:14.444076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:14.727149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:14.745485 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-934df111-c460-402a-94f5-736adb751f75 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1510 microversion: 2.1 time: 0.691512 Oct 18 16:05:14.751195 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 630/1250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:14 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1510 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:14.773597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046845e7-8b97-4ca6-838b-e2f73534cc63", "name": "network-vif-deleted", "tag": "95241f9a-e22e-4994-a98d-d571cb69616e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:14.836137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:14.850333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:14.851696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:14.892565 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] Creating event network-vif-deleted:95241f9a-e22e-4994-a98d-d571cb69616e for instance 046845e7-8b97-4ca6-838b-e2f73534cc63 on n-h1-858383-14 Oct 18 16:05:14.928449 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-74c27dfa-fe1f-4e2d-b392-66819cf8dc83 req-060755d5-c650-440e-a8cc-bf290e04d1ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172843 Oct 18 16:05:14.937575 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 631/1251] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:15.250676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:15.259428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:15.260141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:15.292822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:15.294088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbaf798d-361f-42e4-9413-648c5e2da0eb tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 200 len: 1427 microversion: 2.1 time: 0.908296 Oct 18 16:05:15.294897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:15.295921 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 621/1252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:14 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 1427 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:15.296040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:15.296922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:15.298215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:15.298859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:15.400717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc36ba05-77ec-4694-8183-ddb56e78d5ae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6536f70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:15.563312 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc36ba05-77ec-4694-8183-ddb56e78d5ae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.161402 Oct 18 16:05:15.563975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 622/1253] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:15 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:15.658901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39548bbf-63c8-4ffc-8de1-f662aba8ceb9", "name": "network-vif-plugged", "status": "completed", "tag": "bda4ba69-864a-4fbd-a72f-38ade302638e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:15.689549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:15.691449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:15.692709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:15.727089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] Creating event network-vif-plugged:bda4ba69-864a-4fbd-a72f-38ade302638e for instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 on n-h2-858383-14 Oct 18 16:05:15.758197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-916cba0f-e46d-4863-922f-5d629d127d7f req-523b2362-f75a-4cc6-a8c5-36feea06a632 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100808 Oct 18 16:05:15.761806 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 623/1254] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:15.787855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:15.793850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:15.796068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:15.800957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:15.803272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:15.804583 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cebb2bbf-961c-4a0e-a3b2-e0fb2124c0b8 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.550145 Oct 18 16:05:15.805076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:15.818342 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 632/1255] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:15 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:15.820201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:15.821108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:15.822141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:15.822760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:15.823359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.233770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:16.242738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62aede52-6cd3-41aa-805b-1d0451bf6232 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1510 microversion: 2.1 time: 0.467493 Oct 18 16:05:16.248317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 624/1256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:15 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:16.323778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:16.324676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: 046845e7-8b97-4ca6-838b-e2f73534cc63] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:16.345723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.346355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.346920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.347759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.348520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.349108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.389640 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] HTTP exception thrown: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Request method failure captured: Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 HTTP/1.1 Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4vMSrNJhyI3QHK3gGViP6kkE3IYGnS_9x2LlbMeDHiVILSbztyGgHHfMEKrOY-scqaZDM-f87UxTmi31j-PRZyKpiy7v1I8yWUdPQtISnS_lSjcq3OzX-rt_mUvFtHfR3wrP_x_ype2sYXwdTcAs2u1vwGTPXv84Kg0hKaXogwebg Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:16.393162 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6331acc801404531ad94b7ee7664bebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}] Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e43668b02a784329b9c73993ed6a927e Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. Oct 18 16:05:16.394512 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '046845e7-8b97-4ca6-838b-e2f73534cc63'} Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:16.395256 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. Oct 18 16:05:16.396552 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:16.400413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Returning 404 to user: Instance 046845e7-8b97-4ca6-838b-e2f73534cc63 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:16.401523 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4e03ee94-c7a1-404f-aaca-c56b36d4adaa tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63" status: 404 len: 111 microversion: 2.1 time: 0.083418 Oct 18 16:05:16.405913 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 633/1257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:16 2022] GET /compute/v2.1/servers/046845e7-8b97-4ca6-838b-e2f73534cc63 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:16.410618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:16.411114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:16.421633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.422130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.422567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.423270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.423721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.424147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.458935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:16.483915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:16.585981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-822a7b81-8075-47f7-b9f9-44d2e333c868 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2a7e790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:16.596620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f463debe-35ca-4118-afae-f7a3b43c2a06 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 204 len: 0 microversion: 2.1 time: 0.189618 Oct 18 16:05:16.598034 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 625/1258] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:16 2022] DELETE /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:16.625567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:16.628631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:16.642461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.643380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.646918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.649620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.653549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.654384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.668791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-822a7b81-8075-47f7-b9f9-44d2e333c868 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.094361 Oct 18 16:05:16.670396 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 634/1259] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:16 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:16.830718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:16.831341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:16.843338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.843826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.844275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:16.845010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:16.845477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:16.845906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:17.017735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:17.028633 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7514ce9c-06f4-4657-8828-399d35d16755 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1467 microversion: 2.1 time: 0.424062 Oct 18 16:05:17.030306 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 626/1260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:16 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1467 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:17.126226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:17.136029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:17.139973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:17.141338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-604c9961-496a-4dce-b07e-836f5617a1ce tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1358 microversion: 2.21 time: 0.315309 Oct 18 16:05:17.154706 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 635/1261] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:16 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:17.274763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:17.275450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:17.286775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:17.287237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f786776-02c3-4243-8908-80ea88e58e46", "name": "network-vif-deleted", "tag": "1fcb767d-a858-4dc0-9eae-6f663aa5f975"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:17.287978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:17.289289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:17.293270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:17.293958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:17.295196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:17.314422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:17.314821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:17.315254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:17.347996 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] Creating event network-vif-deleted:1fcb767d-a858-4dc0-9eae-6f663aa5f975 for instance 5f786776-02c3-4243-8908-80ea88e58e46 on n-h2-858383-14 Oct 18 16:05:17.356600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-25396e9c-a6ca-4bb2-b80d-dbddf59378ca req-83402e4e-a934-4b71-aac1-672c6ec387e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072858 Oct 18 16:05:17.359921 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 636/1262] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:17.438389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:17.448228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61d45e46-8a35-4e19-ba5e-5ba8a1adbdad tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1468 microversion: 2.1 time: 0.177221 Oct 18 16:05:17.450010 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 627/1263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:17 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:17.686439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb3d5487-9466-404c-9e65-b7119dad4f64 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd27ca5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:17.790838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb3d5487-9466-404c-9e65-b7119dad4f64 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.109306 Oct 18 16:05:17.791414 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 637/1264] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:17 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:18.056224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:18.056846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:18.119584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.120542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.125457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.128939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.133905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.134652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.169420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:18.170941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:18.190820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.192476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.193234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.195063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.196706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.198018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.236881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:18.457763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:18.474319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4d2c417-d04c-4162-93a7-103892968195 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1467 microversion: 2.1 time: 0.420010 Oct 18 16:05:18.477508 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 628/1265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:18 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:18.492444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:18.494242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:18.506451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.508074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.508912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.510233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.510938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.512636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.575987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:18.576927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:18.577496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:18.578191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lazy-loading 'fault' on Instance uuid 5f786776-02c3-4243-8908-80ea88e58e46 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:18.645525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11f56c35f4845b181e465224cf05a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e9d50ee0c04ad58b4f851a619b58c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:18.654443 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-46c8da81-1cba-4e70-b97b-1e883c0e4070 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 200 len: 1306 microversion: 2.1 time: 0.175425 Oct 18 16:05:18.672233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 629/1266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:18 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:18.807315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb4d8358-a20c-41b4-8749-7f851c8697fa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd65274c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:18.877529 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb4d8358-a20c-41b4-8749-7f851c8697fa tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.073854 Oct 18 16:05:18.891716 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 630/1267] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:18 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:19.087526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:19.102006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:19.105946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:19.111705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99f83e83-8d3e-4d7f-803d-3a044598f6bd tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1550 microversion: 2.21 time: 0.946233 Oct 18 16:05:19.125971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 638/1268] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:18 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1550 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:05:19.142665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:19.143163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:19.161122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.161626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.162074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.162786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.163242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.177198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.221963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:19.386838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a0079c7-5a73-4cec-853f-99b05742347a tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "DELETE /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 204 len: 0 microversion: 2.21 time: 0.248336 Oct 18 16:05:19.388088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 631/1269] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:05:19 2022] DELETE /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:05:19.399097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:19.400011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:19.407425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.408534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.409184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.410097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.410558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.411312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.504943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:19.505664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:19.514413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.515354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.517481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.518482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.519156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.520442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.636240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:19.650280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b598f085-172e-4a2d-81cf-57c4cbd5d98b tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1425 microversion: 2.1 time: 0.150107 Oct 18 16:05:19.651509 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 632/1270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:19 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1425 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:19.679122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:19.680145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:19.695048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.697585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.698211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.699225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.700007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.701324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.720084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 HTTP/1.1 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:19.722436 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.723964 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5f786776-02c3-4243-8908-80ea88e58e46'} Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:19.724820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.726138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.730302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:19.730944 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0f6277e-1408-476b-8aff-65b0076ccbac tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 404 len: 111 microversion: 2.1 time: 0.055784 Oct 18 16:05:19.731707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 633/1271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:19 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:05:19.740622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-537878305", "metadata": {"image_type": "test"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:19.746379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:19.754460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.755423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.756038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.758757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:19.759392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:19.760651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:19.788684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46/action HTTP/1.1 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 111 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:19.790902 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-537878305", "metadata": {"image_type": "test"}}} Oct 18 16:05:19.792251 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5f786776-02c3-4243-8908-80ea88e58e46', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-537878305', 'metadata': {'image_type': 'test'}}}} Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.793458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.796454 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.799144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.799144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:19.799144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:19.799144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:19.799144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.800723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:19.804868 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a84ddc55-4e01-41b0-8de6-d54753605325 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "POST /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46/action" status: 404 len: 111 microversion: 2.1 time: 0.068053 Oct 18 16:05:19.806193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 634/1272] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 18 16:05:19 2022] POST /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:19.819727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1408040169", "metadata": {"image_type": "test"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:19.824764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Failed to fetch instance by id tempest-invalid-1862118083 {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:05:19.826987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance tempest-invalid-1862118083 could not be found. Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/tempest-invalid-1862118083/action HTTP/1.1 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 112 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:19.829433 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1408040169", "metadata": {"image_type": "test"}}} Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:19.831031 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance tempest-invalid-1862118083 could not be found. Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'tempest-invalid-1862118083', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1408040169', 'metadata': {'image_type': 'test'}}}} Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1862118083 could not be found. Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.832584 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1862118083 could not be found. Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1862118083 could not be found. Oct 18 16:05:19.839448 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.842823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance tempest-invalid-1862118083 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:19.843928 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45238ee2-de1e-4f57-bb80-ba8b0444fcea tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "POST /compute/v2.1/servers/tempest-invalid-1862118083/action" status: 404 len: 101 microversion: 2.1 time: 0.028742 Oct 18 16:05:19.845156 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 635/1273] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:05:19 2022] POST /compute/v2.1/servers/tempest-invalid-1862118083/action => generated 101 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:05:19.859903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-267272417"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:19.864380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:05:19.865300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 56 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:19.868103 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "tempest-test-snap-267272417"}} Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:19.869745 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-267272417'}}} Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.870675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.871964 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.876113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:19.877269 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ac30cd6-0707-4d5c-bd4b-caaa2595d510 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023546 Oct 18 16:05:19.878270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 636/1274] 10.222.0.78 () {60 vars in 1275 bytes} [Tue Oct 18 16:05:19 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:19.893905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1942568029"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:19.908166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:05:19.908940 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 57 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:19.911854 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "tempest-test-snap-1942568029"}} Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:19.913566 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1942568029'}}} Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.914489 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 16:05:19.916274 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:19.922832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:19.923958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb600ef4-a572-4226-bb65-d46dc4e87dbd tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.034069 Oct 18 16:05:19.925572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 637/1275] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 18 16:05:19 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:19.981622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24906c08-660c-4d39-99fb-9b2138f99f0e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6527b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:20.091069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24906c08-660c-4d39-99fb-9b2138f99f0e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.164135 Oct 18 16:05:20.094653 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 638/1276] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:19 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:20.104520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:20.106443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:20.116325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.124589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.131529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:20.132977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.134017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.134737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.135398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.149775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:20.151401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:20.155087 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fb44841-9354-4e37-ba4c-e3b3d8d99888 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1556 microversion: 2.21 time: 0.758378 Oct 18 16:05:20.171254 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 639/1277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:19 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1556 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:20.185655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.188214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef", "name": "network-vif-deleted", "tag": "725eb508-8b23-4999-a9c5-97c1d3a75f7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 HTTP/1.1 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:20.191065 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.192817 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5f786776-02c3-4243-8908-80ea88e58e46'} Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:20.193741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.195213 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.202375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:20.211128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eef43df8-d770-498f-9c9c-3880b7445766 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 404 len: 111 microversion: 2.1 time: 0.114816 Oct 18 16:05:20.212028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 639/1278] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:20 2022] DELETE /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:20.222693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.223187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.223629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.223996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:20.224622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] [instance: 5f786776-02c3-4243-8908-80ea88e58e46] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:20.254760 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] Creating event network-vif-deleted:725eb508-8b23-4999-a9c5-97c1d3a75f7e for instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef on n-h1-858383-14 Oct 18 16:05:20.263490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6eb8c40c-9c56-4675-9f14-5d411cc58325 req-afc91f8d-b134-4842-9332-ea06a82af6a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090735 Oct 18 16:05:20.263763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.265341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.265822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.268861 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 640/1279] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:20.271683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.272483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.274427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.316512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] HTTP exception thrown: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Request method failure captured: Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 HTTP/1.1 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6hVfzboRNv83A4kPdob6_cY_ctuLCZYAuf68yVMrJZ6nTLzZeQd7OLDSXJJtckgv1aoVAzCB8xl6MhSBSPQJCL6J55XgDAJ5x2m1-0M1X375SIQQetpgm9MLl4IRx3JsL1fscRDAPpm4unXQ2BsoJyR21e7Zjl_VO3upnxNdRxF3Q Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:20.318333 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22e9d50ee0c04ad58b4f851a619b58c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22e9d50ee0c04ad58b4f851a619b58c1"}]}] Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22e9d50ee0c04ad58b4f851a619b58c1 Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-107623791 Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e11f56c35f4845b181e465224cf05a84 Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesNegativeTestJSON-107623791-project Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.319937 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5f786776-02c3-4243-8908-80ea88e58e46'} Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:20.320843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. Oct 18 16:05:20.322600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:20.325344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] Returning 404 to user: Instance 5f786776-02c3-4243-8908-80ea88e58e46 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:20.326542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70809ee9-47b6-407a-9a7f-4feefd2f57b2 tempest-ImagesNegativeTestJSON-107623791 tempest-ImagesNegativeTestJSON-107623791-project] 10.222.0.78 "GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46" status: 404 len: 111 microversion: 2.1 time: 0.110093 Oct 18 16:05:20.327601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 640/1280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:20 2022] GET /compute/v2.1/servers/5f786776-02c3-4243-8908-80ea88e58e46 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:20.676186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:20.677122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:20.685853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.686788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.687491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.688443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.689256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.689932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.757531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:20.758330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:20.758996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:20.759679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lazy-loading 'fault' on Instance uuid a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:20.907338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43668b02a784329b9c73993ed6a927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331acc801404531ad94b7ee7664bebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:20.919571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-665caf99-8591-4e52-9f53-33545acebb96 tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 200 len: 1303 microversion: 2.1 time: 0.247436 Oct 18 16:05:20.924354 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 641/1281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:20 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:21.111222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18d5bd8f-9643-4152-88b5-09c518cf421a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20cf4c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:21.189926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:21.192261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:21.194555 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18d5bd8f-9643-4152-88b5-09c518cf421a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.088144 Oct 18 16:05:21.197296 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 641/1282] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:21 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:21.207280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:21.208093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:21.209459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:21.212212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:21.212792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:21.217840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:21.508641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:21.532231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:21.535489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:21.540550 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da769085-b079-4cc0-a182-f6b2040404ed tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1556 microversion: 2.21 time: 0.357082 Oct 18 16:05:21.541406 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 642/1283] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:21 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1556 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:05:21.956556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:21.957301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] [instance: a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:21.965489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:21.971133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:21.971783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:21.972935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:21.973440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:21.973944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.020939 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] HTTP exception thrown: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Request method failure captured: Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef HTTP/1.1 Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4vMSrNJhyI3QHK3gGViP6kkE3IYGnS_9x2LlbMeDHiVILSbztyGgHHfMEKrOY-scqaZDM-f87UxTmi31j-PRZyKpiy7v1I8yWUdPQtISnS_lSjcq3OzX-rt_mUvFtHfR3wrP_x_ype2sYXwdTcAs2u1vwGTPXv84Kg0hKaXogwebg Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:22.026044 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6331acc801404531ad94b7ee7664bebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6331acc801404531ad94b7ee7664bebe"}]}] Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 6331acc801404531ad94b7ee7664bebe Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersAdminTestJSON-1406956675 Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e43668b02a784329b9c73993ed6a927e Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersAdminTestJSON-1406956675-project Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. Oct 18 16:05:22.027928 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef'} Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:22.028784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. Oct 18 16:05:22.030641 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:22.031719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] Returning 404 to user: Instance a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:22.031719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fae8af09-3331-4500-a6ba-564b6733831e tempest-ServersAdminTestJSON-1406956675 tempest-ServersAdminTestJSON-1406956675-project] 10.222.0.78 "GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef" status: 404 len: 111 microversion: 2.1 time: 0.085132 Oct 18 16:05:22.033877 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 642/1284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:21 2022] GET /compute/v2.1/servers/a01e095f-a9d1-4e3d-8ee6-f6d25907c0ef => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:22.055032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39548bbf-63c8-4ffc-8de1-f662aba8ceb9", "name": "network-vif-deleted", "tag": "bda4ba69-864a-4fbd-a72f-38ade302638e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:22.089656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.094028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.105422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.126584 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] Creating event network-vif-deleted:bda4ba69-864a-4fbd-a72f-38ade302638e for instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 on n-h2-858383-14 Oct 18 16:05:22.144321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3aee4149-c396-426f-9ed5-b3e74c1e62a7 req-c06e8e96-4350-4a86-80e6-e1360c237006 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108699 Oct 18 16:05:22.145315 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 643/1285] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.215349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e32b7df-1f19-4ddb-9af3-f2d651591914 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd65278b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.342037 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e32b7df-1f19-4ddb-9af3-f2d651591914 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.132498 Oct 18 16:05:22.351243 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 644/1286] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:22.430522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd2a144c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.443855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.444604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.445443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.489425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.489933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.490385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.557105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.558777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.559844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.572726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.573585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:22.574704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc877a06-6b74-44b9-9b2f-5cf6f93d60bf tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.620804 Oct 18 16:05:22.576778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 643/1287] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.591967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd2a298b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.593825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.594331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.594778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.595507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.595809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.597967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.600027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.600485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.601904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.629910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.630703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.631321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.650895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.651637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.652240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.662852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fb38e36-3c3e-444a-aae2-eaf0411e95aa tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.076808 Oct 18 16:05:22.675599 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 644/1288] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:22.684845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd279c040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.687280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.687997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.688601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.698370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.703563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.704239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.704896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lazy-loading 'fault' on Instance uuid 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:22.710635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.711348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.712897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.727523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.728267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.728872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.736823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e57a14b-9457-43a1-bae5-ba1eb5dfc0a6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.059816 Oct 18 16:05:22.743362 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 645/1289] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.749385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd2a31820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.756087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.756969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.757613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.772159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.772986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.773728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.785753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e3609ef-5c9b-482e-aaa9-4b218010c2f6 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.041036 Oct 18 16:05:22.786644 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 646/1290] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.803753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15a90463-3a58-49eb-8bd9-208977d7a627 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd44e8ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.806253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15a90463-3a58-49eb-8bd9-208977d7a627 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.807017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15a90463-3a58-49eb-8bd9-208977d7a627 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.807833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15a90463-3a58-49eb-8bd9-208977d7a627 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.826729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:22.837438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:22.843399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ca1e616c6044c07b3985ab39407f204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ce650ca228469c984583f0d0ae7b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:22.844856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02441dda-84ed-407f-b29e-9cb4478a0f36 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 200 len: 1348 microversion: 2.21 time: 0.276877 Oct 18 16:05:22.848199 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15a90463-3a58-49eb-8bd9-208977d7a627 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.048267 Oct 18 16:05:22.861133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 647/1291] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.867781 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 645/1292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 1348 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:05:22.872592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd279c0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.874848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.875541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.876194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.896131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.896940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.897571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.910516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.911296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.911900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.918688 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65d37fe1-75a4-4031-a696-c0531c69c472 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056164 Oct 18 16:05:22.925807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 648/1293] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:22.938756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd6527a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:22.941355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.942067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.942705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:22.986337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:22.996219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:22.999765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.021036 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-005b54d1-77df-4214-969a-d8632c19e717 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.093559 Oct 18 16:05:23.039180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd297a790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:23.042077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.043977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.045069 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 646/1294] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:05:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:23.045836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.063874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.064630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.065287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.078673 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-223620af-97da-4456-a90a-60171898ed81 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.043395 Oct 18 16:05:23.079622 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 649/1295] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:05:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:23.095537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Calling method '.version_select at 0x7f5fd6527160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:23.097603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.098089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.098779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.114378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.115178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.115780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.132163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.133537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.134279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.155636 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3a02747-ef75-4651-ae2c-2d1afd184352 tempest-HypervisorAdminTestJSON-1249826801 tempest-HypervisorAdminTestJSON-1249826801-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.064709 Oct 18 16:05:23.164388 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 647/1296] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:05:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:23.362534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e9581a1-d61b-4a32-96d3-fa83c14e8da7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2a293a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:23.457498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e9581a1-d61b-4a32-96d3-fa83c14e8da7 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.102625 Oct 18 16:05:23.468367 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 650/1297] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:23 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:23.879802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:23.880914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:23.905337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.908435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.909136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.913546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.914328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.914972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.945863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] HTTP exception thrown: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Request method failure captured: Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 HTTP/1.1 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6jg0mYFzLwolKge2KsOIHZ8tVxzLdaCuS5bAou5ngluO0akuhv1cf5SyOcWY7ee3g8L9HBQR9WGMgSkyt5qmbFVkRAbQQVQj04KgdVvl_BgCxNn_yZM-suCBqJklnjyKcm-59p3x1ePxY21tbsYoKNP5uUjXHRfyFmoNyBNBujFGc Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:23.947749 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}] Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6ca1e616c6044c07b3985ab39407f204 Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:23.949457 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '39548bbf-63c8-4ffc-8de1-f662aba8ceb9'} Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:23.950391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:23.952781 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:23.959672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Returning 404 to user: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:23.960781 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9a88887-1f87-431b-b885-85b529c16279 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 404 len: 111 microversion: 2.21 time: 0.085261 Oct 18 16:05:23.961572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 648/1298] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:23 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:05:23.971014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '.version_select at 0x7f5fd27ca790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:23.971937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:23.992640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.993431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.994076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:23.995970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:23.996651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:23.999703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:24.127094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16e1646f-c291-4191-802b-2d0b9f070bfb tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.161073 Oct 18 16:05:24.128366 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 651/1299] 10.222.0.78 () {60 vars in 1337 bytes} [Tue Oct 18 16:05:23 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9/os-instance-actions => generated 611 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:05:24.145223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:24.146406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:24.159135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:24.159955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:24.162011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:24.162978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:24.165122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:24.166603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:24.228079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] HTTP exception thrown: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Request method failure captured: Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 HTTP/1.1 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs6jg0mYFzLwolKge2KsOIHZ8tVxzLdaCuS5bAou5ngluO0akuhv1cf5SyOcWY7ee3g8L9HBQR9WGMgSkyt5qmbFVkRAbQQVQj04KgdVvl_BgCxNn_yZM-suCBqJklnjyKcm-59p3x1ePxY21tbsYoKNP5uUjXHRfyFmoNyBNBujFGc Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:05:24.231811 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}] Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6ca1e616c6044c07b3985ab39407f204 Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.233560 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '39548bbf-63c8-4ffc-8de1-f662aba8ceb9'} Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:24.234459 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.235917 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.240763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Returning 404 to user: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:24.244595 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ca43b3b-d961-410b-947c-5f9e495dd5a1 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "DELETE /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 404 len: 111 microversion: 2.21 time: 0.101775 Oct 18 16:05:24.245662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 649/1300] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:05:24 2022] DELETE /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:05:24.255776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:24.256403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] [instance: 39548bbf-63c8-4ffc-8de1-f662aba8ceb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:24.265818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:24.279637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:24.280402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:24.282863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:24.283715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:24.284270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:24.311107 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] HTTP exception thrown: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Request method failure captured: Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 HTTP/1.1 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs6jg0mYFzLwolKge2KsOIHZ8tVxzLdaCuS5bAou5ngluO0akuhv1cf5SyOcWY7ee3g8L9HBQR9WGMgSkyt5qmbFVkRAbQQVQj04KgdVvl_BgCxNn_yZM-suCBqJklnjyKcm-59p3x1ePxY21tbsYoKNP5uUjXHRfyFmoNyBNBujFGc Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:24.322259 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0ce650ca228469c984583f0d0ae7b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0ce650ca228469c984583f0d0ae7b20"}]}] Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c0ce650ca228469c984583f0d0ae7b20 Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-675958067 Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 6ca1e616c6044c07b3985ab39407f204 Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-InstanceActionsV221TestJSON-675958067-project Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.323769 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '39548bbf-63c8-4ffc-8de1-f662aba8ceb9'} Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:24.324526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. Oct 18 16:05:24.326456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:24.335167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] Returning 404 to user: Instance 39548bbf-63c8-4ffc-8de1-f662aba8ceb9 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:24.338242 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b040f8e2-e91e-42f5-93c9-b2ba4a5f6599 tempest-InstanceActionsV221TestJSON-675958067 tempest-InstanceActionsV221TestJSON-675958067-project] 10.222.0.78 "GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9" status: 404 len: 111 microversion: 2.21 time: 0.087667 Oct 18 16:05:24.345209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 652/1301] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:05:24 2022] GET /compute/v2.1/servers/39548bbf-63c8-4ffc-8de1-f662aba8ceb9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:05:24.476016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-755d9542-8357-4e6a-b346-f8eee5e7f0c5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd65390d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:24.553689 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-755d9542-8357-4e6a-b346-f8eee5e7f0c5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.082130 Oct 18 16:05:24.564619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 650/1302] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:24 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:25.576433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-379d05db-47ae-4b3c-9080-5999e66e7906 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2589a60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:25.748428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-379d05db-47ae-4b3c-9080-5999e66e7906 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.122227 Oct 18 16:05:25.749533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 653/1303] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:25 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:26.775633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e8bb0767-2ace-4834-bbae-ed11b5b7b299 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd65275e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:26.890636 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e8bb0767-2ace-4834-bbae-ed11b5b7b299 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1437 microversion: 2.1 time: 0.118904 Oct 18 16:05:26.891119 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 651/1304] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:26 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:27.908642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20a4ed48-1f9a-40e7-a508-cbbf1ef823cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2f40790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:28.004702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20a4ed48-1f9a-40e7-a508-cbbf1ef823cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1446 microversion: 2.1 time: 0.101575 Oct 18 16:05:28.005818 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 654/1305] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:27 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:28.023560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7147943a-33ae-4b0b-a9fa-11eb914630eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6514670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:28.123291 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7147943a-33ae-4b0b-a9fa-11eb914630eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 200 len: 1446 microversion: 2.1 time: 0.104950 Oct 18 16:05:28.124200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 652/1306] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:28 2022] GET /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:28.147884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe1fbcfe-7518-4472-86f6-5d05640dbe74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd266a5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.255159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.259100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.260550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.261220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.263678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.264338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.265870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.300803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-015672bc-e5c9-46c5-b571-6e93addebe06 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.371473 Oct 18 16:05:29.302201 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 653/1307] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:05:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:29.307137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.309686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:29.317613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.318562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.319752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.320752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.321444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.322125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.329563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe1fbcfe-7518-4472-86f6-5d05640dbe74 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 204 len: 0 microversion: 2.1 time: 1.188425 Oct 18 16:05:29.330645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 655/1308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:28 2022] DELETE /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:29.340672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.344859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.345589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.346200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.347193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.347795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.349242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.386580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56b20a15-7541-49ba-a9c3-25e3ae87d6b5 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083093 Oct 18 16:05:29.393364 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 654/1309] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:05:29 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:29.393364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.394276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:29.396062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d40c270d-51cc-474a-a2d6-1352dc69ae2a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.059039 Oct 18 16:05:29.396929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 656/1310] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:05:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:29.403297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.404977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:29.411804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.412288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.412720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.414001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.414504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.414949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.415686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.416410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.417049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.417486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.420882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.421421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.461976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:29.498065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:29.618718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3187192e-7cd3-43db-bf36-19e48bc82a2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 204 len: 0 microversion: 2.1 time: 0.228637 Oct 18 16:05:29.626338 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 655/1311] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:29 2022] DELETE /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:05:29.652736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.665731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.666267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.668653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.681269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.682649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.683334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.688809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lazy-loading 'services' on Instance uuid 4aac0edf-2592-4b08-bda0-7adb4880eb04 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:29.743215 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8eeb86ec-b404-42cf-8087-04e734ff92d7 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.106108 Oct 18 16:05:29.744297 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 656/1312] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:05:29 2022] GET /compute/v2.1/os-services => generated 949 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:29.765841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.781248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.782431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.784827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.787480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.788736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.790194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.846004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f257a6b7-d510-4b4f-937d-49b7885ebc58 tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-858383-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.090789 Oct 18 16:05:29.848624 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 657/1313] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Oct 18 16:05:29 2022] GET /compute/v2.1/os-services?host=n-d-858383-14&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:05:29.864479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-669739523", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:29.949043 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40862c01-002a-4fd5-bf92-a3f9ee1465ec tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments/ff5b9eb0-57f2-4ff1-a36b-fc5c0aec9b6b" status: 202 len: 0 microversion: 2.1 time: 0.550329 Oct 18 16:05:29.949885 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 657/1314] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:05:29 2022] DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments/ff5b9eb0-57f2-4ff1-a36b-fc5c0aec9b6b => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:29.952617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:05:29.978875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:29.987348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.989168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.989612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:29.991252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:29.991699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:29.995023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.087573 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61a3fcb1-dd6c-4323-92c4-3c68a17773ba tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.136133 Oct 18 16:05:30.088554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 658/1315] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:05:29 2022] GET /compute/v2.1/os-services => generated 949 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:30.119178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:30.124808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.125321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.125851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.126681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.127138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.127722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.164744 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c25375c-2942-49cd-aeaf-add3348e925a tempest-ServicesAdminNegativeTestJSON-626878929 tempest-ServicesAdminNegativeTestJSON-626878929-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.049095 Oct 18 16:05:30.176714 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 659/1316] 10.222.0.78 () {58 vars in 1198 bytes} [Tue Oct 18 16:05:30 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:05:30.478657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6421a3b8-54ef-4dea-8f57-bf7ad3756b3a tempest-ServicesAdminNegativeTestJSON-1178399079 tempest-ServicesAdminNegativeTestJSON-1178399079-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:30.483895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6421a3b8-54ef-4dea-8f57-bf7ad3756b3a tempest-ServicesAdminNegativeTestJSON-1178399079 tempest-ServicesAdminNegativeTestJSON-1178399079-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '16dfeb727c754cd0869ca992c7ef5b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2440a5a1224c7a9ed861701ad78722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6421a3b8-54ef-4dea-8f57-bf7ad3756b3a tempest-ServicesAdminNegativeTestJSON-1178399079 tempest-ServicesAdminNegativeTestJSON-1178399079-project] Request method failure captured: Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs7GneewzINZe0MIQeOMtD_Jb3BwWhT59sn9er530cIxIEcajKYw-anfX2EwMaCHzcflpcNxAff9uMls1tXGA9Bw-G46Xbr0y0zrkHqSUwDsH-0JFGtQvE6UEeG8yU-LjeG3iAqxn7h_B0EnZWvloN1Llt63K9j01OcuLNf8oG2FXpI Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7d2440a5a1224c7a9ed861701ad78722 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1178399079 Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:30.486210 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7d2440a5a1224c7a9ed861701ad78722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7d2440a5a1224c7a9ed861701ad78722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7d2440a5a1224c7a9ed861701ad78722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7d2440a5a1224c7a9ed861701ad78722"}]}] Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1178399079 Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7d2440a5a1224c7a9ed861701ad78722 Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1178399079 Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServicesAdminNegativeTestJSON-1178399079-project Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 16dfeb727c754cd0869ca992c7ef5b1e Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1178399079-project Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:05:30.487809 n-d-858383-14 devstack@n-api.service[120570]: action_args: {} Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 16:05:30.488806 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 16:05:30.490229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:30.492554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6421a3b8-54ef-4dea-8f57-bf7ad3756b3a tempest-ServicesAdminNegativeTestJSON-1178399079 tempest-ServicesAdminNegativeTestJSON-1178399079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:30.493611 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6421a3b8-54ef-4dea-8f57-bf7ad3756b3a tempest-ServicesAdminNegativeTestJSON-1178399079 tempest-ServicesAdminNegativeTestJSON-1178399079-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.309283 Oct 18 16:05:30.500815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 660/1317] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:05:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 320 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:30.629479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Calling method '.version_select at 0x7f5fd2284f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:30.633381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.633929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.634476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.655282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:30.662503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.663156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.663962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.680770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.681543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.682292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.691859 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8f9cc3c-a195-4f79-a92a-d6949c85a0e1 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.193249 Oct 18 16:05:30.693405 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 661/1318] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:30.714626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Calling method '.version_select at 0x7f5fd22bf4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:30.719850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.720616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.722274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.753037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.753604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.754034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.813812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.814222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.814848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.823210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8a2321c-4ca4-4217-bd5a-2089fde732fe tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-858383-14/servers" status: 200 len: 355 microversion: 2.1 time: 0.117157 Oct 18 16:05:30.824417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 662/1319] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:05:30 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-14/servers => generated 355 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:30.830623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e0f05-8b7b-479f-b4e4-5ffb5007ef3e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e0dc97e-de74-4496-8576-3e4b07b567c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:30.841986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.843130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.843860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.876378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] Creating event network-vif-unplugged:8e0dc97e-de74-4496-8576-3e4b07b567c1 for instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e on n-h1-858383-14 Oct 18 16:05:30.901294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e68e8a5c-4176-44fb-a71d-295e11669a66 req-261b1f76-c1f3-4c5a-8033-c8beef5cd0a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074509 Oct 18 16:05:30.902286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 663/1320] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:30.914813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Calling method '.version_select at 0x7f5fd22bfd30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:30.917965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.924972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.925811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:30.940421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:30.973276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:30.974752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:30.975840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.015784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:31.018935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:31.019389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.033463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bad5a8bc-041a-4b8c-807a-e72195433840 tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.129854 Oct 18 16:05:31.034079 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 664/1321] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:05:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:31.048951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Calling method '.version_select at 0x7f5fd22bf0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:31.052512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:31.053498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:31.054135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.089621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:31.092557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:31.093117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.113311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c00f81a6-0f90-4cdd-8348-aa415bb0265b tempest-HypervisorAdminUnderV252Test-773983960 tempest-HypervisorAdminUnderV252Test-773983960-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-858383-14/search" status: 200 len: 105 microversion: 2.1 time: 0.068902 Oct 18 16:05:31.113936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 665/1322] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 18 16:05:31 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-14/search => generated 105 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:31.436574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:05:31.437215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:05:31.437571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:05:31.437974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:05:31.438373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:05:31.460452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:31.461145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:31.462090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.468944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:31.469766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:31.471361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:31.521064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:05:31.543579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:05:31.581206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:05:31.586108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:05:31.746030 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6a71dbe-da59-4569-93a9-14f5da845408 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895906 Oct 18 16:05:31.757123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 658/1323] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:05:31.764858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68f1fc38-079b-4c7d-8980-517b29a1b718 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:31.780838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68f1fc38-079b-4c7d-8980-517b29a1b718 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:32.062059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68f1fc38-079b-4c7d-8980-517b29a1b718 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:32.077084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68f1fc38-079b-4c7d-8980-517b29a1b718 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1207 microversion: 2.1 time: 0.316497 Oct 18 16:05:32.092970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 666/1324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:31 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1207 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:33.102012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:33.102849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:33.125552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:33.126071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:33.126565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:33.137802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:33.142291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:33.143106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:33.273422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e0f05-8b7b-479f-b4e4-5ffb5007ef3e", "name": "network-vif-deleted", "tag": "8e0dc97e-de74-4496-8576-3e4b07b567c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:33.311666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:33.313496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:33.315684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:33.344476 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] Creating event network-vif-deleted:8e0dc97e-de74-4496-8576-3e4b07b567c1 for instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e on n-h1-858383-14 Oct 18 16:05:33.350550 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7155d3a2-b027-4488-92da-bea4e2ff7531 req-2ed52e39-3821-4339-9d84-3f673d942154 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095665 Oct 18 16:05:33.357199 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 667/1325] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:33.547550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:33.565301 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55029122-94be-4209-983a-7bac7f0d9a6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1203 microversion: 2.1 time: 0.462861 Oct 18 16:05:33.570485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 659/1326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:33 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1203 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:34.598417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:34.599407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:34.628457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:34.629134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:34.629861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:34.631993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:34.633310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:34.633855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:34.923666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:34.939801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac0b1ab2-937d-4880-9d54-3703e2c6b132 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1277 microversion: 2.1 time: 0.347690 Oct 18 16:05:34.941163 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 668/1327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:34 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:35.965251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:35.966920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:35.986252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:35.987963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:35.988489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:35.988969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:35.989848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:35.990303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:35.990721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:36.464796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:36.478715 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a691869d-7fc0-456b-b729-c5459cd33734 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.518644 Oct 18 16:05:36.480869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 660/1328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:35 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:37.504894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:37.506721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:37.529491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:37.531814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:37.533573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:37.536621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:37.538766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:37.540683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:38.281530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:38.290759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b6461f9-5e50-48ad-ae2c-cab3394fa39a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.790593 Oct 18 16:05:38.296450 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 669/1329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:37 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:38.794790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289d8c86-2298-4c02-b489-7a833838d365", "tag": "918a14b1-0bff-4008-b4ba-aee8b3527af9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:38.806505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:38.808107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:38.809098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:38.823375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] Creating event network-changed:918a14b1-0bff-4008-b4ba-aee8b3527af9 for instance 289d8c86-2298-4c02-b489-7a833838d365 on n-h1-858383-14 Oct 18 16:05:38.829810 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-700af0f8-bf22-4246-92d6-a240f25ef34d req-7bd57f40-d11f-4958-8e99-dc99872beb8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039009 Oct 18 16:05:38.831003 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 661/1330] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:39.084759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:39.087180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:39.094757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.095544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.096752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.097839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.098469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.099085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.159592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec8417c1-ea9d-4f1c-91bc-7478344d8742 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078325 Oct 18 16:05:39.166505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 670/1331] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:05:39 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:05:39.290553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:39.293435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:39.309868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.310528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.310977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.311706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.312170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.313958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.322902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:39.323971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:39.334805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.337930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.338569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.344822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.345525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.346124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.411346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8c6b834-cc75-416b-a122-e293b6d957d4 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120941 Oct 18 16:05:39.412295 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 662/1332] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:05:39 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:05:39.608441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:39.608936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:39.623249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.624052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.624626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.625586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.626205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.626820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.660027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:05:39.786713 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2de6794-be8e-430c-8e10-473351ec0919 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 204 len: 0 microversion: 2.1 time: 0.182445 Oct 18 16:05:39.790938 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 663/1333] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:05:39 2022] DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:05:39.803985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:39.805796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:39.821533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.822571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.823267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.824401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:39.826027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:39.826757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:39.910670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:39.970615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6da8120c-c632-4bc3-bf31-e7f06a07d4a2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.647135 Oct 18 16:05:39.971621 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 671/1334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:39 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:40.587107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:40.607358 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-695f0f34-511c-4b51-b291-b5ae5bc5a6a6 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1682 microversion: 2.1 time: 0.815257 Oct 18 16:05:40.609934 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 664/1335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:39 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1682 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:41.009866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:41.010779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:41.014449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:41.027173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:41.027678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:41.031110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:41.031919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:41.032563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:41.033177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:41.507947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:41.522644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1aa2f258-3e86-4472-a8ca-8a876eb77d6d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.521326 Oct 18 16:05:41.545038 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 672/1336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:40 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:41.638799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:41.639421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:41.646701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:41.655213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:41.657864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:41.658622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:41.659965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:41.660882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:41.674057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:41.674702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:42.553780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:42.555012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:42.557397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:42.568329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:42.571984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:42.572623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:42.575232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:42.575956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:42.582286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:42.666801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:42.680559 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fffd1e80-478c-4015-bd35-20efad12ce74 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1682 microversion: 2.1 time: 1.045293 Oct 18 16:05:42.682804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 665/1337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:41 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1682 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:43.279818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:43.290591 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30931906-60d0-4de8-8383-ddd0c1f42fa5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.742664 Oct 18 16:05:43.311211 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 673/1338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:42 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:43.707616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:43.708836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:43.720912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:43.728561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:43.729043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:43.733669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:43.734167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:43.734616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:44.012679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83ffaf9f-38ba-4135-8c57-91e08fac48fd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Action: 'create', calling method: .version_select at 0x7f5fd2284790>, body: {"keypair": {"name": "tempest-keypair-1519527623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrSsmPnCI8B7qEZp8ALujyEokM1GkdbFMvliG8zW050GNAcgpmk+/jHIn0LwfYtWB1WgNW6fzV86XnHKEJ/oKCcLrIDhug+wpOaDJW9cUUhtE96qmNfVTlZZVmjH3m+Rg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:44.061352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-83ffaf9f-38ba-4135-8c57-91e08fac48fd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Getting quotas for project 95688716e1614719bab0f4850aa70b2c. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:05:44.079436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-83ffaf9f-38ba-4135-8c57-91e08fac48fd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Getting quotas for user e46ff953364048d392e5adcdade2b256 and project 95688716e1614719bab0f4850aa70b2c. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:05:44.136717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83ffaf9f-38ba-4135-8c57-91e08fac48fd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279661 Oct 18 16:05:44.144024 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 674/1339] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:05:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:44.314976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:44.315657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:44.335566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:44.338491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:44.339307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:44.346647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:44.350037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:44.351235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:44.917074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:44.934288 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-163fcaf5-12b4-4df5-8e9c-043e624af36b tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1682 microversion: 2.1 time: 1.230542 Oct 18 16:05:44.938926 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 666/1340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:43 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1682 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:45.131079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:45.139486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8a970bd-d8ef-4348-b13c-bf887c4e2d63 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.830061 Oct 18 16:05:45.140060 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 675/1341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:44 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:45.966423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:45.968136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:45.982428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:45.986627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:45.990830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:45.992265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:45.995056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:45.995539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:46.164607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:46.166050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:46.184881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:46.185609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:46.189346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:46.190385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:46.190920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:46.201555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:46.812715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:46.822202 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a85608c-613a-492b-928b-678692044f91 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1614 microversion: 2.1 time: 0.861390 Oct 18 16:05:46.826579 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 667/1342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:45 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1614 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:46.924357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:46.946490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcd0224a-ff1f-4bb8-8e36-29d9cc966462 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.784643 Oct 18 16:05:46.957567 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 676/1343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:46 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:47.520428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac0edf-2592-4b08-bda0-7adb4880eb04", "name": "network-vif-deleted", "tag": "149d8412-e966-4d73-af37-9b73ecb6c9cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:47.542815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:47.543383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:47.549201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:47.566069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] Creating event network-vif-deleted:149d8412-e966-4d73-af37-9b73ecb6c9cf for instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 on n-h2-858383-14 Oct 18 16:05:47.572591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9ce449cd-c6ce-451a-82e8-141b994f20a1 req-35df37b2-bbb1-414b-a222-b355751b47ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056325 Oct 18 16:05:47.573911 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 668/1344] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:05:47.851959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:47.852595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:47.860462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:47.860964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:47.861461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:47.862243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:47.862716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:47.863133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:47.972495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:47.973361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:47.977152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:47.977898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:47.978567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:47.979222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lazy-loading 'fault' on Instance uuid 4aac0edf-2592-4b08-bda0-7adb4880eb04 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:05:47.987325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:47.989440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:47.990955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:47.995365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:48.000199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:48.002101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:48.158431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40da67f39f4d4a6fb25ea033b0f14071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb88ccffb014497b801541b53d8bb505', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:48.188957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a08eb7a8-c997-4387-9a31-1e47aad82307 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 200 len: 1332 microversion: 2.1 time: 0.341945 Oct 18 16:05:48.191244 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 677/1345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:47 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 1332 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:48.635635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:48.662273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f069e143-e55d-4a05-bb5d-ccebb98a4351 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.694026 Oct 18 16:05:48.671122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 669/1346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:47 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:49.217386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:49.218038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:49.231803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:49.239857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:49.240680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:49.243411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:49.247989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:49.255661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:49.282850 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] HTTP exception thrown: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Request method failure captured: Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 HTTP/1.1 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3nzJAeMPh6hiflMJSx9RvHFLJRMezOfNBOJSo9oxYOuWs9kGfwDfjsAT1Th6dRCjSPtX4jvfcshpkRscyr1k75wjHeZuHnl_ghTy7duZ5NZx4zXtkT4-1eX55pPbF4MEPmthTm8k9XR4JsZUnFC-oSmxsfuxl6RZ0ASvc_vT1bxec Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:05:49.284874 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eb88ccffb014497b801541b53d8bb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}] Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 40da67f39f4d4a6fb25ea033b0f14071 Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:05:49.286408 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '4aac0edf-2592-4b08-bda0-7adb4880eb04'} Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:05:49.287263 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:05:49.288604 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:05:49.291608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Returning 404 to user: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:05:49.294314 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdb1d266-009c-4bd0-95d9-bd6ab0dc9b69 tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 404 len: 111 microversion: 2.1 time: 0.079985 Oct 18 16:05:49.295392 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 678/1347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:49 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:49.303712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e62d2edc-d5c1-4bc3-be07-7c4c8c7787cc tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '.version_select at 0x7f5fd6536ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:49.359845 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e62d2edc-d5c1-4bc3-be07-7c4c8c7787cc tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585740191" status: 202 len: 0 microversion: 2.1 time: 0.060018 Oct 18 16:05:49.360562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 670/1348] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585740191 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:05:49.420718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1712063613", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "20cc4dfb-1c00-42b4-b2a3-8a140694b5c0"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:49.507054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] validate_networks() for [('20cc4dfb-1c00-42b4-b2a3-8a140694b5c0', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:05:49.698899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:49.700148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:49.718527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:49.719314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:49.719938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:49.721439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:49.722071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:49.722666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:50.071981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:50.085795 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d769a9d-7b9c-4fa1-853a-839695a13adb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.392062 Oct 18 16:05:50.087002 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 671/1349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:49 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:50.104269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f580b494-7493-4bf1-815a-b49687fefabc"}], "security_groups": [{"name": "tempest-securitygroup--744513759"}], "key_name": "tempest-keypair-1519527623", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:50.366607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:05:50.367150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:05:50.367486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:05:50.367894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:05:50.368316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:05:50.383536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:50.384041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:50.384483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:50.385278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:50.385767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:50.386170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:50.452827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Getting quotas for project 22a2495ec7094b82bf666a62e4ec149a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:05:50.459448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Getting quotas for user 6621970375db482299d3d8dde8558aa9 and project 22a2495ec7094b82bf666a62e4ec149a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:05:50.498364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Going to run 3 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:05:50.505711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:05:50.522998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] validate_networks() for [('f580b494-7493-4bf1-815a-b49687fefabc', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:05:50.603899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=378620cd-6bdb-47fd-b984-d74e1ff40ea2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:05:50.658813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=3828d9d7-01e5-4b1f-a2b5-47558733f3c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:05:50.780831 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb25eadb-c2d4-4b78-b685-a2e69c590a33 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444829 Oct 18 16:05:50.782156 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 679/1350] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:05:50.799265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:50.806376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:50.807625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:05:50.837444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:50.838306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:50.838926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:50.839834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:50.841324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:50.842099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:50.944986 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b39c910-956f-4ca2-a53e-434894506b65 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.151396 Oct 18 16:05:50.945659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 680/1351] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:05:50 2022] GET /compute/v2.1/servers => generated 1018 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:50.960592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25457f09-7179-4aeb-8cbc-4c06094c9136 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:50.961529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25457f09-7179-4aeb-8cbc-4c06094c9136 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:51.068759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-25457f09-7179-4aeb-8cbc-4c06094c9136 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:51.077570 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25457f09-7179-4aeb-8cbc-4c06094c9136 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1223 microversion: 2.1 time: 0.121538 Oct 18 16:05:51.080423 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 681/1352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:50 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:51.087781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289d8c86-2298-4c02-b489-7a833838d365", "name": "network-vif-plugged", "status": "completed", "tag": "918a14b1-0bff-4008-b4ba-aee8b3527af9"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:51.121022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:51.121932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:51.124681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:51.160984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] Creating event network-vif-plugged:918a14b1-0bff-4008-b4ba-aee8b3527af9 for instance 289d8c86-2298-4c02-b489-7a833838d365 on n-h1-858383-14 Oct 18 16:05:51.180979 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e940d5d8-bcba-4d5d-80de-c4b4c08f9929 req-9e60332f-1911-48ed-8503-b8562bf5bee8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098978 Oct 18 16:05:51.187860 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 682/1353] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:51.312109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-832a58fa-6724-4bf6-88bc-8235b12d109f tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Action: 'create', calling method: .version_select at 0x7f5fd22849d0>, body: {"pool": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:53.040829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:05:53.041474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:05:53.041675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:05:53.042076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:05:53.042493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:05:53.073729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:53.074340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:53.075758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:53.076515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:53.077084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:53.077509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:53.164928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Getting quotas for project 95688716e1614719bab0f4850aa70b2c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:05:53.179140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Getting quotas for user e46ff953364048d392e5adcdade2b256 and project 95688716e1614719bab0f4850aa70b2c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:05:53.213510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:05:53.216877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:05:53.376408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2831a01d-1655-41a1-99f5-b610d3372a7f tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.286474 Oct 18 16:05:53.380059 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 672/1354] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:05:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:05:53.394323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:53.395335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:53.406567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:53.409024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:53.409650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:53.411082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:53.413421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:53.413863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:53.513970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:54.150612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:54.201296 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-638c253e-4ec1-47ba-b649-9a8d460a1970 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1307 microversion: 2.1 time: 0.815959 Oct 18 16:05:54.222728 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 673/1355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:53 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1307 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:54.233547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:54.234504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:54.244552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:54.245405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:54.246110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:54.247085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:54.247811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:54.249417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:54.624596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:54.634133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87f9fe77-f4e0-4931-8c6f-6d352015cc1b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1219 microversion: 2.1 time: 0.408846 Oct 18 16:05:54.642303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 674/1356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:54 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1219 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:54.661086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:54.663417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:54.707146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:54.707665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:54.708111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:54.737591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:54.738448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:54.742953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:55.119366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:55.127765 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2682126d-7910-4730-b833-d3ce42a78ac7 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1230 microversion: 2.1 time: 0.484250 Oct 18 16:05:55.149749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 675/1357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:54 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1230 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:55.226208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:55.226888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:55.233847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:55.234411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:55.234804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:55.235517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:55.235977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:55.236405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:55.746130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:55.755681 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2afdc96-067e-4ff7-9f1f-57f592c4c18d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 200 len: 1487 microversion: 2.1 time: 0.534162 Oct 18 16:05:55.758140 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 676/1358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:55 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 1487 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:55.766495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:55.767910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:55.783256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:55.783514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:55.783941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:55.784651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:55.789462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:55.789837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:56.121606 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-832a58fa-6724-4bf6-88bc-8235b12d109f tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.932127 Oct 18 16:05:56.122185 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 683/1359] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:05:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:05:56.129215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-55303363"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:56.139215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:56.171552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:56.175880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:56.176345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:56.177123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:56.179931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:56.180384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:56.599483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:56.615520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16f8f294-5930-4f1c-857e-69b9693d425c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1293 microversion: 2.1 time: 0.854879 Oct 18 16:05:56.618378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 677/1360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:55 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1293 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:56.641628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d99a07c9-001b-43c3-ac57-d2f1aacbba0e tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Action: 'create', calling method: .version_select at 0x7f5fd64db700>, body: {"pool": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:05:56.813416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f84fa91-61c2-410e-b64b-31eaaa773996 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365/action" status: 202 len: 0 microversion: 2.1 time: 0.689897 Oct 18 16:05:56.818001 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 684/1361] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:05:56 2022] POST /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:05:56.835791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:56.838632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:56.857104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:56.857711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:56.858042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:56.858762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:56.859227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:56.859658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:57.157371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:57.179120 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4624dd26-e31f-42ec-aeb0-b707ddcedef9 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1284 microversion: 2.1 time: 0.358920 Oct 18 16:05:57.181039 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 685/1362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:56 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:57.191175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9559be9a-3fbf-493f-b465-3b29ea4e00d8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd22843a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:57.289251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9559be9a-3fbf-493f-b465-3b29ea4e00d8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.106472 Oct 18 16:05:57.291174 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 686/1363] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:57 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:57.648023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:57.649171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:57.665223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:57.666326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:57.666804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:57.669641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:57.670125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:57.671481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:57.847755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:57.852820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:57.863558 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0874547b-7d1c-431f-9997-e70c3df6306e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1281 microversion: 2.1 time: 0.220320 Oct 18 16:05:57.892854 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 687/1364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:57 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1281 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:05:58.227735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:58.239670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:58.263139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:58.263913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:58.264364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:58.279451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:58.280115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:58.280872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:58.604808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:58.618245 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3740f08-f6dd-49cd-9200-52e9609b7bbd tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1284 microversion: 2.1 time: 0.395947 Oct 18 16:05:58.623842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 688/1365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:58 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:58.632485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f83d6af8-ba10-4f6b-9987-6b98ae937815 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2250e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:58.719508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f83d6af8-ba10-4f6b-9987-6b98ae937815 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.094562 Oct 18 16:05:58.721306 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 689/1366] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:58 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:58.921942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:58.924228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:58.936929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:58.937741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:58.938366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:58.939346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:58.942673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:58.943363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:59.397315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:05:59.408984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a6135a8-32eb-415f-a5e5-fa90c3ed9deb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1281 microversion: 2.1 time: 0.494490 Oct 18 16:05:59.410125 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 690/1367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:58 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1281 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:05:59.674875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:05:59.675533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:05:59.687329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:59.689097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:59.689562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:05:59.691506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:05:59.691981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:05:59.695265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:00.561516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:00.573744 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5f3c296-8f94-4199-a103-3d92b4bc52ce tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.903913 Oct 18 16:06:00.575059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 691/1368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:05:59 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:00.612953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-250ce09c-47eb-46ee-9c2d-b58ed2414f09 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2238ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:00.694265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-250ce09c-47eb-46ee-9c2d-b58ed2414f09 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.103496 Oct 18 16:06:00.695185 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 692/1369] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:00 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:00.708430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:00.709073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:00.715069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:00.749361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:00.750276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:00.750884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:00.762470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:00.763330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:00.764179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:00.894638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:01.077545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:01.824764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:01.843772 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51c2fdfa-f390-4b7b-9323-9870771deede tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 1.147385 Oct 18 16:06:01.852622 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 693/1370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:00 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:01.877305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:01.877956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:01.899169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:01.899707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:01.900150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:01.900910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:01.901393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:01.901816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.389347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:02.401762 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9044c1b5-c1d8-4f9e-aea4-e352f3e34966 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.534242 Oct 18 16:06:02.403489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 694/1371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:01 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:02.409443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:02.410194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:02.419093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.419974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.420640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.421772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.422399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.423048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.455668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d99a07c9-001b-43c3-ac57-d2f1aacbba0e tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.835739 Oct 18 16:06:02.456606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 678/1372] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:05:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:02.462359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c7be4ad-da25-45d3-80df-87a0dd58cd43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd646ca60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:02.465084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] HTTP exception thrown: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Request method failure captured: Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 HTTP/1.1 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs3nzJAeMPh6hiflMJSx9RvHFLJRMezOfNBOJSo9oxYOuWs9kGfwDfjsAT1Th6dRCjSPtX4jvfcshpkRscyr1k75wjHeZuHnl_ghTy7duZ5NZx4zXtkT4-1eX55pPbF4MEPmthTm8k9XR4JsZUnFC-oSmxsfuxl6RZ0ASvc_vT1bxec Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:06:02.470354 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eb88ccffb014497b801541b53d8bb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}] Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 40da67f39f4d4a6fb25ea033b0f14071 Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.471864 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '4aac0edf-2592-4b08-bda0-7adb4880eb04'} Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:02.472724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.474092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.476848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Returning 404 to user: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:02.493555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea62c1e2-e36e-43b9-83d0-ea6b0b94172e tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 404 len: 111 microversion: 2.1 time: 0.088663 Oct 18 16:06:02.498469 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 695/1373] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:06:02 2022] DELETE /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:02.513197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14a8a676-1d33-4298-ad40-91a81026e8d9 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Action: 'create', calling method: .version_select at 0x7f5fd22bf5e0>, body: {"pool": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:02.577801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c7be4ad-da25-45d3-80df-87a0dd58cd43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.119037 Oct 18 16:06:02.578433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 679/1374] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:02 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:02.604240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:02.606486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] [instance: 4aac0edf-2592-4b08-bda0-7adb4880eb04] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:02.622877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.625649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.627216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.629302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.633371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.634280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.669556 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] HTTP exception thrown: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Request method failure captured: Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 HTTP/1.1 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs3nzJAeMPh6hiflMJSx9RvHFLJRMezOfNBOJSo9oxYOuWs9kGfwDfjsAT1Th6dRCjSPtX4jvfcshpkRscyr1k75wjHeZuHnl_ghTy7duZ5NZx4zXtkT4-1eX55pPbF4MEPmthTm8k9XR4JsZUnFC-oSmxsfuxl6RZ0ASvc_vT1bxec Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:02.671886 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eb88ccffb014497b801541b53d8bb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eb88ccffb014497b801541b53d8bb505"}]}] Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: eb88ccffb014497b801541b53d8bb505 Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-220852238 Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 40da67f39f4d4a6fb25ea033b0f14071 Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-220852238-project Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.673667 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4aac0edf-2592-4b08-bda0-7adb4880eb04'} Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:02.674601 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. Oct 18 16:06:02.676100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:02.678792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] Returning 404 to user: Instance 4aac0edf-2592-4b08-bda0-7adb4880eb04 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:02.679858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae3411eb-e7de-4d6f-acd4-4639734130cf tempest-AttachSCSIVolumeTestJSON-220852238 tempest-AttachSCSIVolumeTestJSON-220852238-project] 10.222.0.78 "GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04" status: 404 len: 111 microversion: 2.1 time: 0.097654 Oct 18 16:06:02.680929 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 680/1375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:02 2022] GET /compute/v2.1/servers/4aac0edf-2592-4b08-bda0-7adb4880eb04 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:02.880114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:02.880738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:02.895472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.896219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.896833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:02.897789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:02.898407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:02.899006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:03.114961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:03.196059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:03.688027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:03.747420 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa7dfcc3-1468-4779-bf8d-4b6ff2f54449 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.866215 Oct 18 16:06:03.769125 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 681/1376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:02 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:03.795961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:03.802885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:03.812181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:03.814751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:03.815394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:03.818528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:03.819661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:03.820301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:04.968911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:04.980849 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58a91842-cef0-4c9e-9659-d06bb3d32390 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 1.208908 Oct 18 16:06:04.982338 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 682/1377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:03 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:04.994588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289d8c86-2298-4c02-b489-7a833838d365", "name": "network-vif-plugged", "status": "completed", "tag": "918a14b1-0bff-4008-b4ba-aee8b3527af9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:05.022354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:05.022888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:05.023378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:05.045819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] Creating event network-vif-plugged:918a14b1-0bff-4008-b4ba-aee8b3527af9 for instance 289d8c86-2298-4c02-b489-7a833838d365 on n-h1-858383-14 Oct 18 16:06:05.057226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1b726f23-557d-4e66-8e12-0a19830f61cd req-cdfd2127-89c7-4aab-8736-54ced24b6162 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067620 Oct 18 16:06:05.061525 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 683/1378] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:05.069743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ead8dede-042f-4cf6-a4ac-0e4d3177e019 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd646cf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:05.166894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ead8dede-042f-4cf6-a4ac-0e4d3177e019 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.097047 Oct 18 16:06:05.168107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 684/1379] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:05 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:05.481316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f93a0b-c478-43db-859d-9ddf75183868", "tag": "6b379bf8-19d8-40bf-b6e3-92fe60848383"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:05.503370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:05.504130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:05.504833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:05.525485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] Creating event network-changed:6b379bf8-19d8-40bf-b6e3-92fe60848383 for instance 89f93a0b-c478-43db-859d-9ddf75183868 on n-h1-858383-14 Oct 18 16:06:05.532674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-434e9932-9445-44cc-846e-0942b63172d6 req-9f0901d7-3092-4431-a7a7-a94f817738dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353056 Oct 18 16:06:05.533948 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 685/1380] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:05.550121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:05.551213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:05.566113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:05.567637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:05.568309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:05.569268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:05.570019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:05.570651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:06.489561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:06.505704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-968af6bd-d4c9-47f6-9530-3d174c5454d7 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.970078 Oct 18 16:06:06.506292 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 686/1381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:05 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:06.690810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378620cd-6bdb-47fd-b984-d74e1ff40ea2", "tag": "5be6c27b-ed93-467d-9f40-103cb1925729"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:06.701305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:06.715572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:06.716635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:06.717279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:06.743209 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] Creating event network-changed:5be6c27b-ed93-467d-9f40-103cb1925729 for instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 on n-h2-858383-14 Oct 18 16:06:06.751617 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0b2926f4-d0fa-4c6c-a70b-839c212a1ae0 req-9f069af9-dada-481f-b925-ede17f4da160 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243726 Oct 18 16:06:06.754962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 687/1382] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:06.771474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:06.772787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:06.802842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:06.805897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:06.807712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:06.811812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:06.812565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:06.815466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:07.067339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:07.078209 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bacfa2c7-6d48-4922-9bed-ff3878d101c0 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.319480 Oct 18 16:06:07.080369 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 688/1383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:06 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:07.085695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-517fa94d-6061-4cca-b217-fe0c1ee6b53e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64a29d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:07.183581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-517fa94d-6061-4cca-b217-fe0c1ee6b53e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.100919 Oct 18 16:06:07.187064 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 689/1384] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:07 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:07.381558 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14a8a676-1d33-4298-ad40-91a81026e8d9 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.881551 Oct 18 16:06:07.382642 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 696/1385] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:06:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:07.398104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13b1b534-7c0a-4311-99c4-f3ce6c28a864 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Action: 'create', calling method: .version_select at 0x7f5fd202cb80>, body: {"pool": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:07.532964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:07.533543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:07.542959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:07.543462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:07.546091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:07.549071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:07.551513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:07.555184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:07.832363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:07.840144 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b38a7ed-9332-4520-b81c-49af2f73c542 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.311418 Oct 18 16:06:07.851413 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 697/1386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:07 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:07.991017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3828d9d7-01e5-4b1f-a2b5-47558733f3c1", "tag": "e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:08.013077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:08.013901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:08.014509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:08.036780 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] Creating event network-changed:e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c for instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 on n-h1-858383-14 Oct 18 16:06:08.042261 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-df6ed15b-15f4-4577-8b7a-a91385e8e702 req-29e8e98d-bd29-4a0b-9ae5-dd5a22dcd741 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055457 Oct 18 16:06:08.043446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 698/1387] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:06:08.112597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:08.113615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:08.132252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:08.135406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:08.138799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:08.145096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:08.146881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:08.148438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:08.653180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:08.663984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4cff06ea-832f-415c-9570-f58a794da898 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.556071 Oct 18 16:06:08.675408 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 699/1388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:08 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:08.700499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb5869c3-0515-4c73-b9b3-cf50e47cdfa6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd22bf5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:08.807397 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb5869c3-0515-4c73-b9b3-cf50e47cdfa6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.126928 Oct 18 16:06:08.808218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 700/1389] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:08 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:08.868586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:08.869241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:08.889411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:08.889966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:08.894364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:08.899663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:08.901226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:08.908030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:10.241412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:10.251604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a06ba410-daf0-4e68-b939-0ef440f0d75f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 1.387646 Oct 18 16:06:10.257295 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 701/1390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:08 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:10.269904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894cdb76-cbeb-47fb-a5fe-085798323468", "tag": "dba7bbb8-679e-476b-a8cb-a7571250141f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:10.299747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:10.305400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:10.306184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:10.334442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] Creating event network-changed:dba7bbb8-679e-476b-a8cb-a7571250141f for instance 894cdb76-cbeb-47fb-a5fe-085798323468 on n-h2-858383-14 Oct 18 16:06:10.347117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f199bd0c-1361-4cf8-abf4-c3d123c7388d req-7fa4496e-89da-474a-a464-ce11f45be180 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088137 Oct 18 16:06:10.350088 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 702/1391] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:10.366522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:10.368736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:10.389898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:10.391287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:10.395148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:10.396939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:10.399247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:10.401706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:10.923472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:10.955802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d156518-46fb-404c-9893-441396a6b5e1 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.601614 Oct 18 16:06:10.959952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 703/1392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:10 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:10.971739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe7f9cc4-7320-4a89-bff3-52427eb713b8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2238040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:11.047875 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe7f9cc4-7320-4a89-bff3-52427eb713b8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.084449 Oct 18 16:06:11.049815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 704/1393] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:10 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:11.170856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13b1b534-7c0a-4311-99c4-f3ce6c28a864 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.777470 Oct 18 16:06:11.172369 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 690/1394] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:06:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:11.187091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac873c95-6950-454b-8b3c-f797a22b79c3 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd21749d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:11.286568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:11.287925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:11.311341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:11.317049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:11.320482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:11.325738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:11.327119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:11.330622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:11.640014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac873c95-6950-454b-8b3c-f797a22b79c3 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/a9a952e8-9e8c-4078-abb5-adf31ed3dffc" status: 200 len: 142 microversion: 2.1 time: 0.458465 Oct 18 16:06:11.642050 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 705/1395] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:06:11 2022] GET /compute/v2.1/os-floating-ips/a9a952e8-9e8c-4078-abb5-adf31ed3dffc => generated 142 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:11.655666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-293192c4-3cfa-41e9-a40e-8ce31e0f5f53 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd2284040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:12.244616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:12.255325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe6ab65c-6bc6-4691-b3fa-5cc269101bca tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.975243 Oct 18 16:06:12.284210 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 691/1396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:11 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:12.304433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:12.308509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:12.320935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:12.326464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:12.327199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:12.328382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:12.329154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:12.329945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:13.970315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:13.988701 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53cbb33b-7ba7-44cd-b6a8-90b5bebe2742 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 1.702844 Oct 18 16:06:13.998708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 692/1397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:12 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:14.023296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a4ae023-7d95-4f37-a6a7-ec40751fc143 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64940d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:14.134631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a4ae023-7d95-4f37-a6a7-ec40751fc143 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.126227 Oct 18 16:06:14.146139 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 693/1398] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:13 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:14.164058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:14.168516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:14.184864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:14.185398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:14.187734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:14.188969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:14.190174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:14.190621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:14.705495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:14.720986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-432b4fa3-32f6-4246-812e-1528a0cd785b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.573518 Oct 18 16:06:14.724559 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 694/1399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:14 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:14.734728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f93a0b-c478-43db-859d-9ddf75183868", "name": "network-vif-plugged", "status": "completed", "tag": "6b379bf8-19d8-40bf-b6e3-92fe60848383"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:14.760766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:14.763101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:14.763574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:14.792162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] Creating event network-vif-plugged:6b379bf8-19d8-40bf-b6e3-92fe60848383 for instance 89f93a0b-c478-43db-859d-9ddf75183868 on n-h1-858383-14 Oct 18 16:06:14.804833 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-713f8b9c-bda7-4f41-8db6-7454168d5861 req-a9d70bff-54cb-4a10-9271-36b16205cf52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076841 Oct 18 16:06:14.808884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 695/1400] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:15.028127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:15.028839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:15.049546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:15.050051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:15.050498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:15.051212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:15.051670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:15.062561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:15.314243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:15.323012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3eaea409-3bc7-482a-a488-903d9405e41e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.306917 Oct 18 16:06:15.328606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 696/1401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:15 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:15.339659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41b6cc41-5ecf-4e12-be16-55e818d714c4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64ca8b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:15.414911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41b6cc41-5ecf-4e12-be16-55e818d714c4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.085130 Oct 18 16:06:15.425963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 697/1402] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:15 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:15.676664 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-293192c4-3cfa-41e9-a40e-8ce31e0f5f53 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/a9a952e8-9e8c-4078-abb5-adf31ed3dffc" status: 202 len: 0 microversion: 2.1 time: 4.025761 Oct 18 16:06:15.677878 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 706/1403] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:06:11 2022] DELETE /compute/v2.1/os-floating-ips/a9a952e8-9e8c-4078-abb5-adf31ed3dffc => generated 0 bytes in 4028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:06:15.688114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-463ee29e-2ac2-4d2b-ba4a-770979e5e509 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd64943a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:15.750710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:15.751884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:15.764695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:15.765238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:15.766259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:15.767193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:15.767659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:15.768092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:16.019921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:16.034178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adc23273-9934-4dbf-84b0-288b2f3e0fdb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.288192 Oct 18 16:06:16.035968 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 707/1404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:15 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:16.067162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-463ee29e-2ac2-4d2b-ba4a-770979e5e509 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.382980 Oct 18 16:06:16.069418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 698/1405] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 18 16:06:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:16.079816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2698b35f-68c7-42a0-9e82-1f4471d6adc6 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd2238160>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:16.352361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:16.352978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:16.373983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:16.374487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:16.382627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:16.387479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:16.392093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:16.397248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:16.677174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:16.682218 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2698b35f-68c7-42a0-9e82-1f4471d6adc6 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.606728 Oct 18 16:06:16.682898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 708/1406] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:06:16 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:06:16.695654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e15ee280-77d0-4ca2-9abc-403265564d2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd21749d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:16.701314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-387b1c4f-7be9-4fd7-abec-889465f016ed tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1351 microversion: 2.1 time: 0.354642 Oct 18 16:06:16.701914 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 699/1407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:16 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1351 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:16.729691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b0e2a04-6b55-48fa-8eeb-42b924cbd591 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd65223a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:16.773120 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e15ee280-77d0-4ca2-9abc-403265564d2e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.089124 Oct 18 16:06:16.774274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 709/1408] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:16 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:16.859263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:16.859918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:16.878637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:16.880079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:16.880765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:16.882016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:16.882822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:16.883406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:17.270082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:17.305443 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e012c939-d466-4e44-85b1-935449a3b03c tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 2346 microversion: 2.25 time: 0.453572 Oct 18 16:06:17.310405 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 710/1409] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:16 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 2346 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:17.318400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378620cd-6bdb-47fd-b984-d74e1ff40ea2", "name": "network-vif-plugged", "status": "completed", "tag": "5be6c27b-ed93-467d-9f40-103cb1925729"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:17.350798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:17.351546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:17.352216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:17.399335 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] Creating event network-vif-plugged:5be6c27b-ed93-467d-9f40-103cb1925729 for instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 on n-h2-858383-14 Oct 18 16:06:17.411340 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0448ee92-bf5f-40d5-92bd-80092805c2e7 req-6aa0482e-4250-44e0-8d39-cbc863527178 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097196 Oct 18 16:06:17.414698 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 711/1410] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:17.423322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:17.429721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:17.441750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:17.442257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:17.442701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:17.443434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:17.443895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:17.450075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.026019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:18.035999 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b71d3af7-6b16-4e9e-a10e-3e268d44e83e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 0.617912 Oct 18 16:06:18.036585 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 712/1411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:17 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:18.045915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:18.063291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.064060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.064671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.065601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.066250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.066838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.160087 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db8505e1-c46a-49c3-bdf7-a71246d9caab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.117923 Oct 18 16:06:18.181564 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 713/1412] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 18 16:06:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:06:18.186887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:18.193213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:18.205683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.209375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.210003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.210892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.211513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.215047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.659982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:18.670513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa7bf04f-cea0-481f-a9a8-07493f08798e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1541 microversion: 2.1 time: 0.487602 Oct 18 16:06:18.686220 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 714/1413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:18 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1541 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:18.697892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad197b66-25c8-44b3-8420-4ca336c3b2d1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2174310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:18.785696 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad197b66-25c8-44b3-8420-4ca336c3b2d1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.097336 Oct 18 16:06:18.786822 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 715/1414] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:18 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:18.795513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:18.796573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:18.804471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.805477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.806213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:18.807451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:18.810286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:18.811272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:19.044577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8bc48aa0-0ade-42a6-8ddf-a629c3dba671 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1816 microversion: 2.1 time: 0.255786 Oct 18 16:06:19.073801 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 716/1415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:18 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1816 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:19.084710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:19.085241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:19.110250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:19.114463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:19.115105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:19.115986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:19.116612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:19.117245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:19.171565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:19.317342 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a033d5b-f265-44fc-8d83-b922b2347476 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242194 Oct 18 16:06:19.318608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 717/1416] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:06:19 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:19.330457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:19.332500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:19.340219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:19.347813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:19.349397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:19.350418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:19.351045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:19.351664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:20.805753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:20.823898 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a3e4728-4ebe-4381-882e-94af00e9247c tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 1.503419 Oct 18 16:06:20.837569 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 718/1417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:19 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:20.842937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:20.874259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:20.874757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:20.884008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:20.891438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:20.892392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:20.893100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:20.987932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a602c152-384b-4305-8a3f-490cdfa2ffd2 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.148960 Oct 18 16:06:20.993849 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 719/1418] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:06:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:21.210269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cdb76-cbeb-47fb-a5fe-085798323468", "name": "network-vif-plugged", "status": "completed", "tag": "dba7bbb8-679e-476b-a8cb-a7571250141f"}, {"server_uuid": "3828d9d7-01e5-4b1f-a2b5-47558733f3c1", "name": "network-vif-plugged", "status": "completed", "tag": "e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:21.246078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:21.255683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:21.257755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:21.303021 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Creating event network-vif-plugged:dba7bbb8-679e-476b-a8cb-a7571250141f for instance 894cdb76-cbeb-47fb-a5fe-085798323468 on n-h2-858383-14 Oct 18 16:06:21.321679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] Creating event network-vif-plugged:e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c for instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 on n-h1-858383-14 Oct 18 16:06:21.382619 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9398f703-f38d-4382-8adb-1d922638fc86 req-b410c0d2-1894-426c-9967-5c88a0e26139 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.385514 Oct 18 16:06:21.383304 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 720/1419] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:21.399085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4777ce39-fd00-4722-a6c6-2cfd9aaafe48 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd22bf310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:21.524099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4777ce39-fd00-4722-a6c6-2cfd9aaafe48 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.139652 Oct 18 16:06:21.537265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 721/1420] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:21 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:21.594178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35fde538-4c48-4196-9420-c430e1fdb173", "device": "/dev/xvdb"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:21.597482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:21.614434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:21.617320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:21.618281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:21.619013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:21.621604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:21.624228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:21.881755 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b0e2a04-6b55-48fa-8eeb-42b924cbd591 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b1ded836-b3d1-4c0d-bd3d-c5b58f509138" status: 202 len: 0 microversion: 2.1 time: 5.178702 Oct 18 16:06:21.884535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 700/1421] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:06:16 2022] DELETE /compute/v2.1/os-floating-ips/b1ded836-b3d1-4c0d-bd3d-c5b58f509138 => generated 0 bytes in 5181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:06:21.899011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:21.900351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:21.927625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:21.929974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:21.934489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:21.935453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:21.940545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:21.942333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:22.894290 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6b4f5b1-5fab-41f6-95d8-19bbbc9e9207 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.299026 Oct 18 16:06:22.897544 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 722/1422] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Oct 18 16:06:21 2022] POST /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:06:22.899305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:22.920930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2bdaf0a-5c60-43ef-a382-76382bf35df5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1323 microversion: 2.1 time: 1.034301 Oct 18 16:06:22.932194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed6a9e29-6c4c-4525-9c12-2486c7e92720 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd2174dc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:22.932866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 701/1423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:21 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1323 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:22.940116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b14fe32-7909-4b62-8d90-d949e3595f01 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd202c820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:23.034877 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b14fe32-7909-4b62-8d90-d949e3595f01 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.100572 Oct 18 16:06:23.040041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 702/1424] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:22 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:23.954428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:23.955097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:23.975961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:23.989527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:23.992816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:23.999507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:24.000746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:24.012859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:24.143320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:24.850736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:24.864897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0c5fed0-354a-412e-8db8-87817e4b73ee tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1517 microversion: 2.1 time: 0.916973 Oct 18 16:06:24.868404 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 703/1425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:23 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1517 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:24.885980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83368f55-84b2-4f30-b84e-8a676b05c5e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64211f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:24.987434 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83368f55-84b2-4f30-b84e-8a676b05c5e4 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.115961 Oct 18 16:06:24.989268 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 704/1426] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:24 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:25.015512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:25.016773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:25.028517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:25.029413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:25.030111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:25.031067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:25.045363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:25.046484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:25.634232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:25.648092 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5baed5ca-11d2-4097-8a75-704b1c516ce9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 200 len: 1516 microversion: 2.1 time: 0.656177 Oct 18 16:06:25.651632 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 705/1427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:24 2022] GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 1516 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:25.662183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f93a0b-c478-43db-859d-9ddf75183868", "tag": "6b379bf8-19d8-40bf-b6e3-92fe60848383"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:25.690354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:25.691307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:25.691969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:25.719777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] Creating event network-changed:6b379bf8-19d8-40bf-b6e3-92fe60848383 for instance 89f93a0b-c478-43db-859d-9ddf75183868 on n-h1-858383-14 Oct 18 16:06:25.734654 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-dd165ded-9ab3-4f06-9889-ace1e100cabe req-54575383-7b36-487d-9aae-d176f6c7a6cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079166 Oct 18 16:06:25.735999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 706/1428] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:25.746765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672a060c-c131-4ca7-b3c1-526fa8859116", "device": "/dev/xvdb"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:25.754480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:25.771990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:25.774974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:25.775736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:25.778126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:25.790945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:25.799875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:26.063770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed6a9e29-6c4c-4525-9c12-2486c7e92720 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/05c77b07-1dd3-4295-b645-b8d25beb44a3" status: 202 len: 0 microversion: 2.1 time: 3.154431 Oct 18 16:06:26.064401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 723/1429] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:06:22 2022] DELETE /compute/v2.1/os-floating-ips/05c77b07-1dd3-4295-b645-b8d25beb44a3 => generated 0 bytes in 3158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:06:26.075314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:26.076218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:26.099206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:26.099704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:26.100139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:26.100847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:26.106921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:26.107614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:26.436226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b4a64a39-95fa-4174-8756-e9dfd049423e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696780 Oct 18 16:06:26.463256 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 707/1430] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:06:25 2022] POST /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:26.500978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2418b27d-406d-4fe5-bb3e-cf7484f8518d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6536670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:26.568063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:26.575430 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2418b27d-406d-4fe5-bb3e-cf7484f8518d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.103524 Oct 18 16:06:26.588400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 708/1431] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:26 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:26.592349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d198c82c-e9c5-4134-8c77-4b4a7cef5df7 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] Calling method '.version_select at 0x7f5fd64944c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:26.636707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-048f48ce-fe1b-4f8d-89b3-4164e2c57f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 200 len: 1517 microversion: 2.1 time: 0.571003 Oct 18 16:06:26.638368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 724/1432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:26 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 1517 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:26.671462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:26.671987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:26.710395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:26.732558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:26.733248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:26.734021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:26.734499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:26.747005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:26.868575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:06:27.067672 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21962a13-6c57-4343-b108-02976e676aae tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "DELETE /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 204 len: 0 microversion: 2.1 time: 0.404754 Oct 18 16:06:27.069367 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 725/1433] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:06:26 2022] DELETE /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:06:27.091211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:27.095575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:27.109054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:27.111447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:27.112174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:27.113198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:27.116004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:27.116678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:28.602125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:28.612106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1596383-822c-469d-a144-4bf8ce375f84 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 200 len: 1523 microversion: 2.1 time: 1.537580 Oct 18 16:06:28.619217 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 726/1434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:27 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 1523 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:28.637050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a1c2e26-d8c5-49d0-bfb9-0137b2ebe636 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2174940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:28.722871 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a1c2e26-d8c5-49d0-bfb9-0137b2ebe636 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.096958 Oct 18 16:06:28.728535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 727/1435] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:28 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:28.819339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d198c82c-e9c5-4134-8c77-4b4a7cef5df7 tempest-FloatingIPDetailsTestJSON-621500453 tempest-FloatingIPDetailsTestJSON-621500453-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b2ea83ab-8f20-4cf0-b6bc-abb0777a1734" status: 202 len: 0 microversion: 2.1 time: 2.236856 Oct 18 16:06:28.819929 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 709/1436] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:06:26 2022] DELETE /compute/v2.1/os-floating-ips/b2ea83ab-8f20-4cf0-b6bc-abb0777a1734 => generated 0 bytes in 2238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:06:29.648054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:29.649531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:29.662843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:29.663554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:29.664230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:29.667334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:29.668308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:29.668918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:29.746016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0256218b-3ef1-4b96-b6f2-a81918507260 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6536ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:29.825930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0256218b-3ef1-4b96-b6f2-a81918507260 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.085392 Oct 18 16:06:29.835061 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 710/1437] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:29 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:29.987870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:30.008561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc91e6d8-50d0-4a32-904b-2ad7da599c06 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 200 len: 1523 microversion: 2.1 time: 0.354241 Oct 18 16:06:30.015677 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 728/1438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:29 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:30.505246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378620cd-6bdb-47fd-b984-d74e1ff40ea2", "name": "network-vif-deleted", "tag": "5be6c27b-ed93-467d-9f40-103cb1925729"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:30.536816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:30.556750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:30.560779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:30.608917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] Creating event network-vif-deleted:5be6c27b-ed93-467d-9f40-103cb1925729 for instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 on n-h2-858383-14 Oct 18 16:06:30.628463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-abd3fbf2-a9ea-4d52-bbfc-65dedd735a0a req-4626e1e6-9503-4613-b491-2740c39bb1d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128585 Oct 18 16:06:30.640325 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 711/1439] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:06:30.843701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3772634-4361-4434-a03b-02f54896ac05 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20ed9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:30.928118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:30.953335 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3772634-4361-4434-a03b-02f54896ac05 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.115028 Oct 18 16:06:30.963671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 729/1440] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:30 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:31.046025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:31.047210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:31.064031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:31.065388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:31.066090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:31.068864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:31.070168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:31.075510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:31.175245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:31.177624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:31.178983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:31.181762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lazy-loading 'fault' on Instance uuid 378620cd-6bdb-47fd-b984-d74e1ff40ea2 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:31.402826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:31.420096 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72c5db66-7238-4c9e-b204-32593c9ceafe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 200 len: 1313 microversion: 2.1 time: 0.380236 Oct 18 16:06:31.426367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 712/1441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:31 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:31.969792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-351e24f9-1e5b-4e12-90dc-5f039807e7de tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd20e09d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:32.057841 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-351e24f9-1e5b-4e12-90dc-5f039807e7de tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1410 microversion: 2.1 time: 0.091720 Oct 18 16:06:32.069734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 730/1442] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:31 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1410 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:32.452252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:32.453589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:32.465839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.468956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.469787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.472404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.473802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.477359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.527547 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] HTTP exception thrown: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 HTTP/1.1 Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:32.529275 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:32.530966 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '378620cd-6bdb-47fd-b984-d74e1ff40ea2'} Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:32.531820 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:32.533288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.542099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 404 to user: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:32.543161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db8ceed6-6598-49d0-b7ea-8187bd1da473 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 404 len: 111 microversion: 2.1 time: 0.097482 Oct 18 16:06:32.550340 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 713/1443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:32 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:32.558255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:32.565997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:32.570722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:32.573307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:32.583449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.585316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.589964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.593941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.597746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.598318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.780030 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38ae8158-ed7b-45c6-b12c-c286626f0e37 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.228484 Oct 18 16:06:32.789564 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 731/1444] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:06:32 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:32.795123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cf8620-21f6-4ff1-9236-08e559d82eb0 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cf8620-21f6-4ff1-9236-08e559d82eb0 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:32.798933 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 16:06:32.800661 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:32.801694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:32.803589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cf8620-21f6-4ff1-9236-08e559d82eb0 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:32.805246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6cf8620-21f6-4ff1-9236-08e559d82eb0 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009267 Oct 18 16:06:32.805749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 714/1445] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 18 16:06:32 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:06:32.816900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:32.831397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:32.832346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:32.838907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.839666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.840311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.841259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:32.841903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:32.842518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:32.887071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:06:32.994283 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-929965be-246f-4276-96d7-fa44857f21e1 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.185826 Oct 18 16:06:32.996070 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 732/1446] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:06:32 2022] GET /compute/v2.1/servers => generated 683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:33.008100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.018134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:33.018742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.servers [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Removing options 'limit' from query {{(pid=120571) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 16:06:33.019516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:33.034169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.034600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.035258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:33.036451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.037285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.037896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:33.074493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f80efba-7bef-4af7-b349-8e72b0d47dde tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd22bfdc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.135964 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f80efba-7bef-4af7-b349-8e72b0d47dde tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1419 microversion: 2.1 time: 0.065567 Oct 18 16:06:33.145698 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 733/1447] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1419 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:33.150960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ea9c17a-bc22-42f0-8c1b-a7ec8d31e8d0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2238160>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.228691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:06:33.232422 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ea9c17a-bc22-42f0-8c1b-a7ec8d31e8d0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 200 len: 1419 microversion: 2.1 time: 0.085553 Oct 18 16:06:33.233208 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 734/1448] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 1419 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:33.313422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-831577e6-a13f-4601-8a33-488bc09611d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.309245 Oct 18 16:06:33.314591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 715/1449] 10.222.0.78 () {58 vars in 1144 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:33.328861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ac6cea1-e0fc-4340-93db-489239d62691 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ac6cea1-e0fc-4340-93db-489239d62691 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:06:33.339895 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 16:06:33.341651 n-d-858383-14 devstack@n-api.service[120570]: action_args: {} Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '-1' Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:33.342548 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.344955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ac6cea1-e0fc-4340-93db-489239d62691 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:33.347337 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ac6cea1-e0fc-4340-93db-489239d62691 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021751 Oct 18 16:06:33.348873 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 735/1450] 10.222.0.78 () {58 vars in 1142 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:06:33.359807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d15cb30c-d59b-4d9b-8728-b326a149dc5e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d15cb30c-d59b-4d9b-8728-b326a149dc5e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:33.367244 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 16:06:33.368686 n-d-858383-14 devstack@n-api.service[120571]: action_args: {} Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'testing' Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:33.371282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.372772 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d15cb30c-d59b-4d9b-8728-b326a149dc5e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:33.374044 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d15cb30c-d59b-4d9b-8728-b326a149dc5e tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.021275 Oct 18 16:06:33.376685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 716/1451] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:06:33.386148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05c6a3a5-62d2-44cf-8072-45fe0e14b9d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.399157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-05c6a3a5-62d2-44cf-8072-45fe0e14b9d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:33.399943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-05c6a3a5-62d2-44cf-8072-45fe0e14b9d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:33.407721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.servers [None req-05c6a3a5-62d2-44cf-8072-45fe0e14b9d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Flavor 'non_existing_flavor' could not be found {{(pid=120570) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 18 16:06:33.408770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05c6a3a5-62d2-44cf-8072-45fe0e14b9d5 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.028631 Oct 18 16:06:33.409802 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 736/1452] 10.222.0.78 () {58 vars in 1178 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:33.424000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.429466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:33.430229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-806770153", "imageRef": "95331a5e-9f9e-4f31-ae24-6e195c97ad92", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:33.430602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:33.443310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.444120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.444804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:33.446060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.447279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.448101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:33.498111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:06:33.639736 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b87d37d-9e17-4621-a235-2ee6e12c3f94 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.219707 Oct 18 16:06:33.652889 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 717/1453] 10.222.0.78 () {58 vars in 1174 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:33.661103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:33.667197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:33.668369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:33.675253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.675931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.676527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:33.677455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:33.678439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:33.679225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.163241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-665f991d-1b67-4007-adb2-bbf7aa946c9b tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.508783 Oct 18 16:06:34.163936 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 718/1454] 10.222.0.78 () {58 vars in 1184 bytes} [Tue Oct 18 16:06:33 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:34.177891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:34.183184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:34.191820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:34.197757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.198341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.198777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.199499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.199956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.200389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.203402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:34.205844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:34.206548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:34.206962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:34.207673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:34.231281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.231812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.233654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.235983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.236687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.238032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.251793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:06:34.293581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:34.310498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:34.346482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:34.349469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95331a5e-9f9e-4f31-ae24-6e195c97ad92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:34.452121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:34.465933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3641dcd1-c135-49dd-9c01-5c2caf963912 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037116 Oct 18 16:06:34.470818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.471715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.472406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.477205 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 737/1455] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:34.488854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c96bcb68-1c1b-4810-8a99-b0ee15a5c8dd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:34.491663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c96bcb68-1c1b-4810-8a99-b0ee15a5c8dd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:34.641552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c96bcb68-1c1b-4810-8a99-b0ee15a5c8dd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:34.656378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c96bcb68-1c1b-4810-8a99-b0ee15a5c8dd tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1207 microversion: 2.1 time: 0.177971 Oct 18 16:06:34.656976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 738/1456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:34 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1207 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:35.683650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:35.685738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:35.710892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.714285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.718990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:35.724333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.725326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.726175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:35.865222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15ccf8c2-f785-494e-a267-df0fcf6b80cb tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.691286 Oct 18 16:06:35.878052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 719/1457] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:06:34 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:35.895743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09a6eafa-fae4-4291-84d0-e397d6f156b4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:35.903806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-09a6eafa-fae4-4291-84d0-e397d6f156b4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:35.905580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09a6eafa-fae4-4291-84d0-e397d6f156b4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013857 Oct 18 16:06:35.918162 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 720/1458] 10.222.0.78 () {58 vars in 1178 bytes} [Tue Oct 18 16:06:35 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:06:35.930279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:35.939954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:35.940878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Searching by: {'deleted': False, 'project_id': '22a2495ec7094b82bf666a62e4ec149a'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:06:35.948244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.948841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.949522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:35.950616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.951251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.951850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.004335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:06:36.055028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec39be08-5997-486e-9638-c7c858db4bb4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.135132 Oct 18 16:06:36.055662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 721/1459] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:06:35 2022] GET /compute/v2.1/servers => generated 683 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:36.069565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.069565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.076796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.077279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.077754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.078620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.079289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.079962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.110193 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] HTTP exception thrown: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 HTTP/1.1 Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:36.112330 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.113964 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '378620cd-6bdb-47fd-b984-d74e1ff40ea2'} Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:36.114874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.116408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.118724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 404 to user: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:36.119762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52af99f6-05ed-4611-b7c6-ce29bf10bcdd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "DELETE /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 404 len: 111 microversion: 2.1 time: 0.054941 Oct 18 16:06:36.123689 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 722/1460] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:06:36 2022] DELETE /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:06:36.128816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.129522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.142143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.142804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.143420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.144369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.144966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.145564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.157533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:36.181079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:06:36.182858 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0778d621-c103-4be6-85bb-361c8475e54a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1259 microversion: 2.1 time: 0.501923 Oct 18 16:06:36.185123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 739/1461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:35 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1259 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:36.298446 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ce2b5a6-6c9f-4e31-89cf-55bbc004894f tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 204 len: 0 microversion: 2.1 time: 0.173140 Oct 18 16:06:36.299951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 723/1462] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:06:36 2022] DELETE /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:06:36.311589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.316710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.328522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.334002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.334834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.335605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.336315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.337093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.410448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:06:36.579340 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e36572b9-813a-4d7b-8420-f56faa7f1b7d tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "DELETE /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 204 len: 0 microversion: 2.1 time: 0.273332 Oct 18 16:06:36.582654 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 740/1463] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:06:36 2022] DELETE /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:06:36.595739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.596261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 378620cd-6bdb-47fd-b984-d74e1ff40ea2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.611161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.616538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.617522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.618483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.620791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.621973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.671463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] HTTP exception thrown: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 HTTP/1.1 Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:36.675505 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.677426 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '378620cd-6bdb-47fd-b984-d74e1ff40ea2'} Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:36.678256 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. Oct 18 16:06:36.681081 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:36.687203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 404 to user: Instance 378620cd-6bdb-47fd-b984-d74e1ff40ea2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:36.688484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e03423d6-140a-4e5e-aa7f-9858bdeb3a54 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2" status: 404 len: 111 microversion: 2.1 time: 0.100756 Oct 18 16:06:36.694899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 724/1464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:36 2022] GET /compute/v2.1/servers/378620cd-6bdb-47fd-b984-d74e1ff40ea2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:36.700904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.701793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.714943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.715327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.715761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.721111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.721690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.722132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:37.108601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:37.116548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30359a25-d85a-4bf5-a3aa-54269df960dd tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 200 len: 1522 microversion: 2.1 time: 0.421439 Oct 18 16:06:37.117149 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 741/1465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:36 2022] GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:37.215384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:37.216764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:37.219006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:37.232512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:37.233026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:37.236478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:37.237520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:37.238916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:37.239515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:37.414762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:37.426012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-557856e3-6af2-4f6d-84f9-99db23bd0659 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1267 microversion: 2.1 time: 0.218841 Oct 18 16:06:37.429720 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 725/1466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:37 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:38.144680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:38.146064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:38.155961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.156821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.157660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.158614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.159322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.159971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.204341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:38.459121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:38.460734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:38.473270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.474484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.480484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.482793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.483498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.484204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.823549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:38.826263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:38.836117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:38.845351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-583cf14e-5825-4b96-8026-653d7455c9f0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1265 microversion: 2.1 time: 0.391404 Oct 18 16:06:38.850299 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c15e2ec5-9b61-4638-8d8c-f7127c84feff tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 200 len: 1522 microversion: 2.1 time: 0.707028 Oct 18 16:06:38.851155 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 726/1467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:38 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:38.859933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 742/1468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:38 2022] GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 1522 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:38.872546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289d8c86-2298-4c02-b489-7a833838d365", "name": "network-vif-unplugged", "status": "completed", "tag": "918a14b1-0bff-4008-b4ba-aee8b3527af9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:38.926350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.927874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.929566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.979552 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] Creating event network-vif-unplugged:918a14b1-0bff-4008-b4ba-aee8b3527af9 for instance 289d8c86-2298-4c02-b489-7a833838d365 on n-h1-858383-14 Oct 18 16:06:39.000977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-87945e80-4ca8-4d5a-aa9e-143a13d01d1c req-db97d705-b940-475d-82dc-bfb7ae7fe6aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134463 Oct 18 16:06:39.006786 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 727/1469] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:39.879526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:39.880132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:39.890160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.893781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.895041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:39.896087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:39.896307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:39.897246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.899473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.901482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:39.913453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.916812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.917692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:39.918563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.920572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.921376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:40.220278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:40.247976 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-850fc5bf-1310-461c-b527-c407e76af2f9 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1265 microversion: 2.1 time: 0.372030 Oct 18 16:06:40.269726 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 743/1470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:39 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:40.848941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3828d9d7-01e5-4b1f-a2b5-47558733f3c1", "name": "network-vif-deleted", "tag": "e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:40.916860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:40.919672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:40.920394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:40.969980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] Creating event network-vif-deleted:e75c514b-0b9f-4ef9-a9e3-76bc205d7a0c for instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 on n-h1-858383-14 Oct 18 16:06:40.983799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-41df0718-6cbc-4e10-be2f-3bdb3a875439 req-5da98311-4108-48d1-b072-4de3c1c4846b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139385 Oct 18 16:06:40.993295 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 744/1471] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:41.298724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:41.299690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:41.312405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:41.313330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:41.315635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:41.318346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:41.321565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:41.322871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:41.642571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:41.677686 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e92d1d79-8449-4b71-8c32-a7cded9d76a3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1265 microversion: 2.1 time: 0.384236 Oct 18 16:06:41.680886 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 745/1472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:41 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:42.299503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:42.311916 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63409a48-c4bf-41d0-b9f3-2b950f6a45b9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 200 len: 1522 microversion: 2.1 time: 2.418715 Oct 18 16:06:42.325229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 728/1473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:39 2022] GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 1522 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:42.334144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cdb76-cbeb-47fb-a5fe-085798323468", "name": "network-vif-unplugged", "status": "completed", "tag": "dba7bbb8-679e-476b-a8cb-a7571250141f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:42.351388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:42.352390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:42.353180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:42.368928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] Creating event network-vif-unplugged:dba7bbb8-679e-476b-a8cb-a7571250141f for instance 894cdb76-cbeb-47fb-a5fe-085798323468 on n-h2-858383-14 Oct 18 16:06:42.378716 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-810cc8b6-c215-4457-b95a-e5b59e33f754 req-e61657d6-77b4-4cd2-9aa0-5750d9f69e7f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051944 Oct 18 16:06:42.380493 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 746/1474] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:42.707701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:42.708585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:42.732437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:42.733173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:42.733943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:42.734671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:42.735147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:42.735547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.256829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:43.271560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72cfa2c9-e4dd-4bbf-bd36-97e370c3c370 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1265 microversion: 2.1 time: 0.569734 Oct 18 16:06:43.281821 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 729/1475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:42 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1265 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:43.342134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:43.342851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 3828d9d7-01e5-4b1f-a2b5-47558733f3c1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:43.369629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.370243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.370698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.371792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.372298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.372723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.441142 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] HTTP exception thrown: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 HTTP/1.1 Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:06:43.456933 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. Oct 18 16:06:43.458695 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '3828d9d7-01e5-4b1f-a2b5-47558733f3c1'} Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:43.459629 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. Oct 18 16:06:43.461176 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:06:43.462577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 404 to user: Instance 3828d9d7-01e5-4b1f-a2b5-47558733f3c1 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:43.462577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-04838b7f-2126-44a0-980c-ff421bdd8be9 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1" status: 404 len: 111 microversion: 2.1 time: 0.123827 Oct 18 16:06:43.473784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:43.474402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:43.481297 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 747/1476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:43 2022] GET /compute/v2.1/servers/3828d9d7-01e5-4b1f-a2b5-47558733f3c1 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:43.485540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.485540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.485839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.488574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.489701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.490301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.692812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:43.713412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3d8ff9a-15c2-4567-b07b-48777b5f8be6 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1481 microversion: 2.1 time: 0.244285 Oct 18 16:06:43.716641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 730/1477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:43 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1481 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:43.877984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cdb76-cbeb-47fb-a5fe-085798323468", "name": "network-vif-deleted", "tag": "dba7bbb8-679e-476b-a8cb-a7571250141f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:43.897703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.899780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.903097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.958334 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] Creating event network-vif-deleted:dba7bbb8-679e-476b-a8cb-a7571250141f for instance 894cdb76-cbeb-47fb-a5fe-085798323468 on n-h2-858383-14 Oct 18 16:06:43.976890 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4624ce47-d1b9-4097-ab1d-c3e089b90e93 req-2d8a7793-289a-4190-9f6a-7f7843285aec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100311 Oct 18 16:06:43.980410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 748/1478] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:44.316399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:44.317920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:44.332727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.333250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.333696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.334412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.334869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.335294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.445915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.738041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:44.743365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:44.750847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:44.753346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.761443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.776710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9835eaf-e2dc-4bea-9a7f-a8b07cc7d9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.441092 Oct 18 16:06:44.781227 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 731/1479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:44 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:44.785094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.788811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.789299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.790029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.790486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.791520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.923353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.923853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.924309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.924768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lazy-loading 'fault' on Instance uuid 894cdb76-cbeb-47fb-a5fe-085798323468 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:45.091497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:45.111690 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2f9aa18-2ddb-430f-ab6f-1f9ddf4f26fe tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1313 microversion: 2.1 time: 0.372597 Oct 18 16:06:45.112957 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 749/1480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:44 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:45.806442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:45.808161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:45.820323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:45.821277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:45.825634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:45.826697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:45.827546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:45.828380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:45.959183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:46.138488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:46.139732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:46.156557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.157364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.158002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.159165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.159819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.160455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.264315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.265975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.270020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.270740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lazy-loading 'fault' on Instance uuid 894cdb76-cbeb-47fb-a5fe-085798323468 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:46.358662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:46.384138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee8ecbfb-fb8c-4c9a-ab80-f3b975e051dc tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.582194 Oct 18 16:06:46.394109 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 732/1481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:45 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:46.409300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32d5ccf7-d660-4c34-8f3f-61e0699c3240 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd31e3c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:46.580309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32d5ccf7-d660-4c34-8f3f-61e0699c3240 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a" status: 200 len: 662 microversion: 2.1 time: 0.184782 Oct 18 16:06:46.590090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 733/1482] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:46 2022] GET /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a => generated 662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:46.598807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:46.599231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6621970375db482299d3d8dde8558aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a2495ec7094b82bf666a62e4ec149a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:46.599428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:46.610836 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c38dba3-d769-4f0c-8039-483e632eb2dc tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 200 len: 1313 microversion: 2.1 time: 0.476167 Oct 18 16:06:46.627897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 750/1483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:46 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:46.640057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-542d284f-7dfa-4035-b6d9-aabcb46dd397 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20e01f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:46.656896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.679065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.679552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.681996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.687392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.690796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.756270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-542d284f-7dfa-4035-b6d9-aabcb46dd397 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a" status: 200 len: 662 microversion: 2.1 time: 0.127050 Oct 18 16:06:46.757162 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 751/1484] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:46 2022] GET /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a => generated 662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:47.263211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e65d4bd-ce68-4707-8d03-8ec132d2ead5", "tag": "d028de9a-9d4d-4230-83fd-1138175e5c30"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:47.287830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.288600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.289299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.320833 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] Creating event network-changed:d028de9a-9d4d-4230-83fd-1138175e5c30 for instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 on n-h2-858383-14 Oct 18 16:06:47.335401 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-80d131d8-9fc1-4908-99ab-77ea166d3481 req-7b760696-22f2-4efe-ad7d-0137451c119c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078197 Oct 18 16:06:47.336448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 752/1485] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:06:47.417298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:47.418501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:47.433482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.434369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.435014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.436091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.437669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.439773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.605304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:47.649558 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6acadd76-5b28-4118-a0c1-69dc0df2ddb3 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 2424 microversion: 2.25 time: 1.061939 Oct 18 16:06:47.656225 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 734/1486] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:46 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 2424 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:47.673247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:47.677997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] [instance: 894cdb76-cbeb-47fb-a5fe-085798323468] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:47.686453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:47.692236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.694972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.695671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.697971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.702347 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-41fa819e-99e4-41cb-abf8-d25bb2a6c89a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.285802 Oct 18 16:06:47.702819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.703319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.703986 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 753/1487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:47 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:47.711101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-14", "block_migration": "auto"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:47.727979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:47.734574 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] HTTP exception thrown: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Request method failure captured: Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 HTTP/1.1 Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs7dV-iDpkyqrefsIsFnW5MPZeWnSsgfp2jwydpewkyHD94Nd5sgoDTxRS2mioXz1KmEjkbEgmYdbxjmdIs_zjhKtV-yi7W_ahy1aNc5Po3byem-ZuMAA5F99x2OvGYg0Y5wSZPh0fNM_xbaXPYkChod4Z6b0hKr2YMFo6nE4C6bWFg Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:06:47.736784 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_22a2495ec7094b82bf666a62e4ec149a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/22a2495ec7094b82bf666a62e4ec149a"}]}] Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 22a2495ec7094b82bf666a62e4ec149a Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1058550203 Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6621970375db482299d3d8dde8558aa9 Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServersNegativeTestJSON-1058550203-project Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. Oct 18 16:06:47.738660 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '894cdb76-cbeb-47fb-a5fe-085798323468'} Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:06:47.739519 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. Oct 18 16:06:47.740891 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:06:47.743545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] Returning 404 to user: Instance 894cdb76-cbeb-47fb-a5fe-085798323468 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:06:47.744820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e93d4c38-36c3-46c0-85ab-99e6f5ea5ac4 tempest-ListServersNegativeTestJSON-1058550203 tempest-ListServersNegativeTestJSON-1058550203-project] 10.222.0.78 "GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468" status: 404 len: 111 microversion: 2.1 time: 0.087272 Oct 18 16:06:47.749374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 735/1488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:47 2022] GET /compute/v2.1/servers/894cdb76-cbeb-47fb-a5fe-085798323468 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:47.751632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.752431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.753152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.754112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.756264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.756962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.802664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'flavor' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:47.834027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Going to try to live migrate instance to n-h1-858383-14 {{(pid=120570) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:06:48.236921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1856683585", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:49.335568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:06:50.114141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:50.114569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:50.115051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:50.115462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:50.115882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:50.132125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.132624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.136479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.137399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.137889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.138333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.193267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:50.211058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:50.270607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:50.273011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:50.393543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c6eedc6-a3fe-4c66-abcd-6ceac977acb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.436255 Oct 18 16:06:50.405530 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 736/1489] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:50.411289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:50.412271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:50.422751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.423659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.424343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.425722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.426420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.427053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.453065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:51.462333 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03b60e0f-330a-424d-9cf4-e886c42eb5cb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 1.055291 Oct 18 16:06:51.477046 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 737/1490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:50 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:51.477046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-840ce35f-b147-4e66-b0be-025982fafb98 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20b6820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.513090 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-840ce35f-b147-4e66-b0be-025982fafb98 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae" status: 200 len: 661 microversion: 2.1 time: 0.048555 Oct 18 16:06:51.514365 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 738/1491] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae => generated 661 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:51.521104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.524967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:51.543387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.544227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.544859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.545607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.546066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.546547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.589137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22270641-1702-4146-b91a-49a1d431d581 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/action" status: 202 len: 0 microversion: 2.25 time: 3.883625 Oct 18 16:06:51.590769 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 754/1492] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:06:47 2022] POST /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/action => generated 0 bytes in 3886 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:06:51.667462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:51.688601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-19cfcf1e-e701-4eff-8461-1f69fab4c6f4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1221 microversion: 2.1 time: 0.172826 Oct 18 16:06:51.693750 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 739/1493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:51.724529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05f179ce-402c-4bea-a280-77f672dc9dba tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20b6b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.729340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1712213044", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "af7e4069-fdcb-430d-ac40-30851f540320"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:51.867960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] validate_networks() for [('af7e4069-fdcb-430d-ac40-30851f540320', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:06:51.904017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05f179ce-402c-4bea-a280-77f672dc9dba tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae" status: 200 len: 661 microversion: 2.1 time: 0.209164 Oct 18 16:06:51.907294 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 740/1494] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae => generated 661 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:51.914990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.918654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:51.956129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.968061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.972093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.975164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.978462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.989787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.679172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:52.707791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:52.726504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:52.735838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2b29d77-8c19-4170-a223-b3c87248641c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.827321 Oct 18 16:06:52.739828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 741/1495] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:52.760904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:52.763241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:52.789675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.793886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.797458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.798515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.800306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.800945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.562793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:53.570794 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4687a0f8-dfa2-4be8-b9be-adbe842a6a26 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.827135 Oct 18 16:06:53.571708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 742/1496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:52 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:53.593416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:53.594356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:53.615815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.617252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.617877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.620022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.620489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.621122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.711360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:53.723413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67df979a-a68c-46b7-83a3-5d00c8227a98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1275 microversion: 2.1 time: 0.135449 Oct 18 16:06:53.739058 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 743/1497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:53 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:53.739058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:53.739058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:53.748207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.748803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.749940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.751074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.752698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.753233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.012583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0886617d-4d8a-47e5-bb49-4e224f3ef800 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1862 microversion: 2.1 time: 0.285376 Oct 18 16:06:54.013202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 744/1498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:53 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1862 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:54.017013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:54.018015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:54.018690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:54.019258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:54.019845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:54.038110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5750ae1a-4d7d-4d84-826c-f512d6a47271 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd653f8b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.041440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.045412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.046094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.047779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.048834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.049544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.085718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5750ae1a-4d7d-4d84-826c-f512d6a47271 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad" status: 200 len: 661 microversion: 2.1 time: 0.057648 Oct 18 16:06:54.093660 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 745/1499] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad => generated 661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:54.093660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.093660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:54.100433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Getting quotas for project 1c415760996a4973a0e827f3da988200. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:54.101995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.102598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.103179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.104646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.105267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.105802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.108276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Getting quotas for user 65e262effe18496cbc3541d8b7ceedd7 and project 1c415760996a4973a0e827f3da988200. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:54.124828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:54.129378 n-d-858383-14 devstack@n-api.service[120570]: WARNING nova.utils [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1712213044 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-171221304 Oct 18 16:06:54.130343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:54.217847 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a0646bdb-221a-479e-a686-70c875d75b5b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.618886 Oct 18 16:06:54.220301 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 755/1500] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:54.239087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:54.262617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:54.284038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.284760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.286351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.287853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.289512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.291647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.356849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lazy-loading 'flavor' on Instance uuid b9c78166-21f2-4415-8634-a43361270c27 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:06:54.401618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Going to try to live migrate instance to n-h1-858383-14 {{(pid=120570) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:06:54.429558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.444609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.448900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.454952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e35583f-9920-4375-b511-5958154b28b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.365242 Oct 18 16:06:54.469785 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 746/1501] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:54.482110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9ad5af0-6a96-4712-9fd2-71227da0db9c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd653f3a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.563246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9ad5af0-6a96-4712-9fd2-71227da0db9c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad" status: 200 len: 661 microversion: 2.1 time: 0.091049 Oct 18 16:06:54.563857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 747/1502] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:54.590208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbb137f0-a34c-422a-9d3b-e2c98bc34632 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.590752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbb137f0-a34c-422a-9d3b-e2c98bc34632 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:54.704385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbb137f0-a34c-422a-9d3b-e2c98bc34632 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.727457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbb137f0-a34c-422a-9d3b-e2c98bc34632 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1232 microversion: 2.1 time: 0.141851 Oct 18 16:06:54.732967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 748/1503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1232 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:54.746142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.747420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:54.760538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.761086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.765534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.766374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.766854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.767353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.224784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:55.250492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5f04667-ce14-4c9c-81e7-240b4bb81c5a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.514294 Oct 18 16:06:55.267117 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 749/1504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:55.282581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:55.283222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:55.311804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.312423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.317858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.319578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.321595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.323917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.523142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:55.539402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61551e0f-5df4-44e2-94f2-ea1551dc4a9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1275 microversion: 2.1 time: 0.270375 Oct 18 16:06:55.540380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 750/1505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:55 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:55.588287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1728199140", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:55.722186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:06:56.798657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:56.799256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:56.799558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:56.800049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:56.800859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:56.825847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:56.826345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:56.826867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:56.827628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:56.828094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:56.828524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:56.848220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:56.886904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Getting quotas for project 11cf155786464a64826aadc055af9032. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:56.894591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Getting quotas for user 04fd432bad6740efad5a96720455b658 and project 11cf155786464a64826aadc055af9032. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:56.913317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:56.918683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:57.049490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e9371dd-2872-44f2-8bad-993aa8d40117 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496889 Oct 18 16:06:57.050738 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 751/1506] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:57.056699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:57.057828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:57.084204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.084914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.085501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.092864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.093530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.094254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.499046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:57.525031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:57.526954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:57.528390 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6afc6857-d01d-458c-960f-7275a2216535 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.476419 Oct 18 16:06:57.529460 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 752/1507] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:57 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:57.534366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:57.535199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:57.552384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.553140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.557648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.558733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.559414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.560017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.761037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:57.774240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7c91d5c-419a-4310-853e-cda77c809138 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1290 microversion: 2.1 time: 0.243510 Oct 18 16:06:57.774924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 753/1508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:57 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1290 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:57.799283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:57.803697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:57.817051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.818902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.823738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.825008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.825817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.829274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.032521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf5ecd3a-ce2a-462a-8635-2ad71b855dee tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/action" status: 202 len: 0 microversion: 2.1 time: 3.810246 Oct 18 16:06:58.034268 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 756/1509] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:06:54 2022] POST /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/action => generated 0 bytes in 3813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:06:58.044780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:58.047958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:58.074379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.075086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.075544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.076282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.076743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.077204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.127695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:58.136739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-993b4d2a-415d-4014-8914-57bde62381b2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.341935 Oct 18 16:06:58.140766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 754/1510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:57 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:58.151769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1203199160", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:58.251048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:06:58.693609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:58.694199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:58.694678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:58.695094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:58.695499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:58.716164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.716664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.717136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.717871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.718329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.720379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.749532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Getting quotas for project 11cf155786464a64826aadc055af9032. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:58.771189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Getting quotas for user 04fd432bad6740efad5a96720455b658 and project 11cf155786464a64826aadc055af9032. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:58.797900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:58.805246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:58.897925 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8364d83b-728d-48b8-a22c-3308097e8d50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755769 Oct 18 16:06:58.898580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 755/1511] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:58.905789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:58.905789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:58.988063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.988584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.989076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.989841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.993745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.994235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.254465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.269608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7aae8291-c338-489d-80c1-5614a53d12df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 1.232486 Oct 18 16:06:59.290118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 757/1512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:58 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:59.319011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:59.319628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:59.327711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.328211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.328652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.329394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.329852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.330276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.411789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.421250 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca056bbb-74ad-44c3-b90b-b39353857671 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.521583 Oct 18 16:06:59.424828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 756/1513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:58 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:59.440769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:59.441764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:59.450287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.451191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.452071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.453094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.453753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.454432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.748608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.768685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.771799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.776515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94a5c1b0-5de2-4aff-82d8-654a345cbe35 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.484632 Oct 18 16:06:59.789192 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 758/1514] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:06:59 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:06:59.799682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:59.810840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:59.824332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.828321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.833309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.834381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:59.838278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:59.839099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.885951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:00.032469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.045579 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-762aabb9-01c2-4810-82c5-29ddc5c40806 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1222 microversion: 2.1 time: 0.253469 Oct 18 16:07:00.061577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 759/1515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:59 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:00.061577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.072725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.073847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.088465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.088966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.089430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.090138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.090586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.091006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.092150 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc162256-b77b-4fe7-90ef-33e58970c028 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.664338 Oct 18 16:07:00.112729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 757/1516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:59 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:00.299833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.300378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.302325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:00.311603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.312102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.312550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.313319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.318873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.319848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.454255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.464616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c3bf7be-82eb-45f6-9b07-77302d506e40 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.413741 Oct 18 16:07:00.481843 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 760/1517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:00.487539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a", "tag": "50de8160-ec27-4fbf-9446-ab951137f8ca"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:00.499893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.500951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.501728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.518352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] Creating event network-changed:50de8160-ec27-4fbf-9446-ab951137f8ca for instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a on n-h1-858383-14 Oct 18 16:07:00.523998 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1a987a78-e5aa-4a58-8c5f-31b01d632be7 req-5c0aab33-aaf5-4b26-9b13-1b5f8fc97d91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040385 Oct 18 16:07:00.524856 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 761/1518] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:00.530201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.531794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.545341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.546151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.546829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.547768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.548455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.549161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.815773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.824568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-543cedf7-db8c-4791-93ca-2ae9f41932a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.528686 Oct 18 16:07:00.830154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 758/1519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:00.836536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e226031-0ad3-409c-9aa5-572c02367830", "tag": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:00.862969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.863797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.864592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.881025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] Creating event network-changed:fda4f53d-b983-490e-9e39-40f5cdbf8c4d for instance 5e226031-0ad3-409c-9aa5-572c02367830 on n-h1-858383-14 Oct 18 16:07:00.887759 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-83be8d35-73d5-42ac-902d-4fd8f44006a8 req-44aa1119-d97e-4484-b950-406984f594d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055489 Oct 18 16:07:00.889325 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 759/1520] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:00.895847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.896858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.906077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.906587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.907033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.907753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.908310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.909022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.956951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.972395 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02353f9b-f3b6-4731-ad71-8b78c8d4e2d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.446080 Oct 18 16:07:00.973179 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 762/1521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:01.074473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:01.075371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:01.081160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:01.083093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.084182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.084780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.085739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.086706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.088134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.232749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.243594 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e455208-8461-4738-8206-56ac8f6ee72e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1270 microversion: 2.1 time: 0.174684 Oct 18 16:07:01.246809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 763/1522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:01 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:01.264325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:01.267962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:01.277241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.278449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.280067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.281104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.281753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.282574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.530386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.545583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.547203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.549007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c74d1e2-fed0-40fd-8c4a-7b87b3532308 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.658030 Oct 18 16:07:01.565643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 760/1523] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:01.576609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:01.577557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:01.585648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.586422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.587749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.588744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.589409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.590012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.807210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.820156 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9f43948-4505-48b8-aefc-ea401883f808 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.566756 Oct 18 16:07:01.821141 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 764/1524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:01 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:01.853706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:01.854589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:01.874601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.876100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.876745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.877722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.878699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.879457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.879586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:01.890859 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3579f5d-6c19-462e-9cc5-b073339dd1ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.324017 Oct 18 16:07:01.896196 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 761/1525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:01 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:01.998453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:02.000281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:02.015638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.016406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.017174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.018151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.018856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.019522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.110854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.127905 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bcb73c46-7603-4886-81ac-784ec7f2b782 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.279678 Oct 18 16:07:02.148481 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 765/1526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:01 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:02.185044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e65d4bd-ce68-4707-8d03-8ec132d2ead5", "name": "network-vif-plugged", "status": "completed", "tag": "d028de9a-9d4d-4230-83fd-1138175e5c30"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:02.205901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.206680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.207288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.224078 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] Creating event network-vif-plugged:d028de9a-9d4d-4230-83fd-1138175e5c30 for instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 on n-h2-858383-14 Oct 18 16:07:02.230678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a6d82df0-959d-4d79-b61a-23581adf47c8 req-9e7caf45-dc05-4d46-b06d-8b551e1c4b4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053116 Oct 18 16:07:02.232056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 766/1527] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:07:02.272368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:02.273820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:02.281956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.282794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.283484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.284446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.285203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.285883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.353703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.362927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1aef592-21a0-4698-8065-cb14593a5195 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.369937 Oct 18 16:07:02.363519 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 762/1528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:01 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:02.383261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.391869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8f919a7-9792-4ecd-a203-f05ca193e294 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1276 microversion: 2.1 time: 0.123835 Oct 18 16:07:02.403292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 767/1529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:02 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:02.583316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:02.584046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:02.595111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.595780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.596614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.599057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.600709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.603741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.780518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.796657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.798352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:02.799827 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87b71b3b-ef6e-4910-9a9d-23e957dcadcd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.221547 Oct 18 16:07:02.800952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 763/1530] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:02 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:02.844540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:02.845389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:02.853302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.854785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.855402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.856906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.857408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.858550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.921529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:02.922949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:02.938193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.944976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.949233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:02.952321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:02.953261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:02.954642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.101385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:03.117637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-433d53dd-746a-4cec-bbd3-1eeb72618821 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.276696 Oct 18 16:07:03.118394 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 768/1531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:02 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:03.183182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:03.184923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:03.195054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.196094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.198386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.199483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.200265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.201190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.247487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:03.255086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34a89ed7-58d7-43e3-8a86-9c1c73f9bb1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1307 microversion: 2.1 time: 0.339135 Oct 18 16:07:03.255863 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 764/1532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:02 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:03.387273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:03.388735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:03.395226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.395861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.396396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.397259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.397965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.398463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.463536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:03.472113 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98216ad1-0d2b-41cf-a1e3-d7471c500dd6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.298786 Oct 18 16:07:03.472775 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 769/1533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:03 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:03.478239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:03.479468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:03.485675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.486423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.486929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.487692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.488209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.488696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.585446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:03.594315 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-955b729d-2f2a-4546-983e-4e00c484555e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1276 microversion: 2.1 time: 0.120159 Oct 18 16:07:03.595471 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 770/1534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:03 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:03.667883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:03.677601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbc4a51f-58d1-416b-821c-d213cb9cc8d5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.294247 Oct 18 16:07:03.694070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 765/1535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:03 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:03.826466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:03.827246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:03.837272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.838751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.841523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.851146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.852200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.856238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.946506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:03.963839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.967895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.968663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.989956 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] Creating event network-changed:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:07:03.996065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9db7544b-ef0f-438b-8275-f0c3bfa81001 req-ec7cf05c-d7c5-42a6-8464-1665fd360941 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053642 Oct 18 16:07:04.000649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 766/1536] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:07:04.068577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:04.117732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:04.144693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:04.145732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:04.167152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.167968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.168596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:04.169556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.170023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.170458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:04.283912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:04.295876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:04.297922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:04.299886 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20ad035d-54aa-4ebe-9d11-b8116beb1511 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.477304 Oct 18 16:07:04.301637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 771/1537] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:03 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:04.344284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:04.349161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:04.363948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.364910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.366264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:04.367582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.369186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.370020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:04.901244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:04.918826 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e1022f7-aa72-4e38-a468-c3be8fa1ea54 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1488 microversion: 2.1 time: 0.614534 Oct 18 16:07:04.919700 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 772/1538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:04 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1488 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:04.928238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:04.941248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:04.951082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.951723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.952343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:04.953194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:04.953753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:04.954290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.051897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.072372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec25ee95-12d6-4c7b-9463-328f0e80dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.929437 Oct 18 16:07:05.091901 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 767/1539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:04 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:05.094877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:05.097989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:05.106999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.107760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.108358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.109331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.109959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.110553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.224638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.248345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47fe03af-bd17-45ca-8e21-3f8d792a48af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1276 microversion: 2.1 time: 0.167010 Oct 18 16:07:05.249644 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 768/1540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:05 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:05.255586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:05.256362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:05.266693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.267572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.268281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.270138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.270853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.271506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.439563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.450537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8209a9c5-9587-44a3-bc99-0d06ba86deba tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.199484 Oct 18 16:07:05.451118 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 769/1541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:05 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:05.455860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:05.456557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:05.464449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.465218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.465866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.466803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.467414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.468042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.485311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:05.498254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:07:05.587415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09c783fb-3caa-4b59-92bd-86aa4f7e58f1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 204 len: 0 microversion: 2.1 time: 0.134838 Oct 18 16:07:05.588004 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 770/1542] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:07:05 2022] DELETE /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:05.593588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:05.594280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:05.601213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.601661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.602083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.602810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.603258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.603679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.638526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.654618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6fcf74a9-e539-45ee-b778-ab1c3ba599ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.733680 Oct 18 16:07:05.656102 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 773/1543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:04 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:05.682174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:05.683094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:05.693145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.694751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.695895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.698427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:05.699236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:05.699853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:05.761577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.771890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.773446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:05.775707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b2659a5-41fb-43e8-ae26-49c2da7e85de tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.186426 Oct 18 16:07:05.776752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 771/1544] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:05 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:06.098464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:06.100040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:06.108856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.109577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.113599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.119712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.125046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.125922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.127498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.131015 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43ee6bab-d2a6-4800-803b-165290d87fd8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1494 microversion: 2.1 time: 0.471616 Oct 18 16:07:06.133648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 774/1545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:05 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1494 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:06.277389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:06.278019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:06.284139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.284626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.285096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.285806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.286458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.286884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.320346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.329504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ef68729-990f-45ea-96ca-af629c5e95b8 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.234855 Oct 18 16:07:06.330090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 772/1546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:06 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:06.476818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:06.477540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:06.484827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.485653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.486096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.486980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.487443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.487874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.541489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.549511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65a07561-570c-4630-85ce-2c60d4afb8f6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.278365 Oct 18 16:07:06.550093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 775/1547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:06 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:06.634782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.644020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8106fa4-4c31-49ac-839f-7c8bf4e17f18 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.171540 Oct 18 16:07:06.644780 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 773/1548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:06 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:06.679752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:06.680404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:06.686859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.687370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.688044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.688923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.689608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.690039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.802296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:06.802941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:06.809171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.809652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.810089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.810788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:06.811241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:06.811672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:06.914445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.925437 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4b4c76c-c38e-4788-8ec8-561dcf252359 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.249708 Oct 18 16:07:06.925996 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 776/1549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:06 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:06.976402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.986379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.988120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:06.989551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70cf54a5-49dc-4269-934d-c212944c0fb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.191314 Oct 18 16:07:06.990566 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 774/1550] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:06 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:07.155569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:07.156213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:07.162917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.163401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.163834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.164528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.164985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.165938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.183866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:07.356272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:07.357501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:07.364911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.365700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.366139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.366905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.367360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.368584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.379909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:07.391171 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37c6d89a-5ca1-4740-a590-a095383561ab tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1494 microversion: 2.1 time: 0.239511 Oct 18 16:07:07.391972 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 777/1551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:07 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:07.559616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:07.570603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4aac2801-83c4-4323-bf96-6ad625b2f7c4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.218511 Oct 18 16:07:07.573248 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 775/1552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:07 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:07.575901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:07.576533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:07.583657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.584368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.585030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.585945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.586568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.587829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.668383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:07.669042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:07.675420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.676155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.676785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.677690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.678360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.678965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.862272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:07.877356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02f779fe-072c-450f-af32-e40d585fdb15 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.212793 Oct 18 16:07:07.878560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 776/1553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:07 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:07.919482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:07.944300 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c00bf2f-93b3-40cd-8848-db1a2a52e3ad tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.373936 Oct 18 16:07:07.945543 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 778/1554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:07 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:07.970369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:07.971330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:07.979777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.980655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.982714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:07.983810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:07.984525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:07.985372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.021090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:08.022083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:08.031964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.032493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.032937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.033692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.034429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.035140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.223095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:08.234542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7805b44c-15b4-4de8-b145-da0a0cbd817e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.267054 Oct 18 16:07:08.249426 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 777/1555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:07 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:08.416272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:08.416927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:08.427357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.427860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.428300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.429092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.434917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.435630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.736970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:08.785300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=20 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:08.797831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:08.809458 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1cc3498-e082-4912-bfed-ea40068e77c0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1494 microversion: 2.1 time: 0.397715 Oct 18 16:07:08.810266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 778/1556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:08 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1494 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:08.819736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:08.820745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:08.829872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.830569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.831141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.832325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.832325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.832641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.885556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:08.898954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:08.900437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:08.907552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58bac341-0fc0-4199-adb7-0dbb2989ec5b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.895281 Oct 18 16:07:08.915535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 779/1557] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:08 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:08.927633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a", "name": "network-vif-plugged", "status": "completed", "tag": "50de8160-ec27-4fbf-9446-ab951137f8ca"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:08.951829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:08.952678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:08.953305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:08.974956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] Creating event network-vif-plugged:50de8160-ec27-4fbf-9446-ab951137f8ca for instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a on n-h1-858383-14 Oct 18 16:07:08.985279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-bdbcc762-fdd1-426b-bf4c-accc586bec46 req-e48bcca9-ca9e-40e5-a91e-42a0e0efc4ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066039 Oct 18 16:07:08.986136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 780/1558] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:08.997431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:08.998478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:09.005897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.006514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.007285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.008357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.009203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.009918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.202239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:09.214635 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f8780fd-a4af-49bc-81a2-faefb1c0bdb0 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.398815 Oct 18 16:07:09.217505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 779/1559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:08 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:09.233651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:09.235423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:09.251385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.252190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.254364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.254682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.255270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.255864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.378940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:09.410438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e4c2c9f-f3bf-4749-8df5-f7641b6efff2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.422486 Oct 18 16:07:09.412002 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 781/1560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:08 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:09.420404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:09.437915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:09.453081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.454774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.455417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.457700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.458378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.459730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.716643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:09.725129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dce1fd5c-c53f-4859-826e-7efecc581b50 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.502610 Oct 18 16:07:09.725708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 780/1561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:09 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:09.817351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:09.828027 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3888c1b3-df91-4d98-897a-36a8c8252e77 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.411687 Oct 18 16:07:09.839265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 782/1562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:09 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:09.841636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:09.845896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:09.851614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.852642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.853216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.854752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.855499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.861285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.936906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:09.940683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:09.951909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.952789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.953479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:09.954433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:09.955051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:09.955704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.135867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.146926 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9dac87ac-64f0-48c9-ba32-3866126d6338 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1494 microversion: 2.1 time: 0.307732 Oct 18 16:07:10.149977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 781/1563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:09 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1494 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:10.241507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:10.242518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:10.251232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.251981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.252645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.255291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.256980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.257699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.550955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.581479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.587153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.591822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.596065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b60b007b-329a-4ad0-94e9-ea6301f0e557 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.358539 Oct 18 16:07:10.597446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 782/1564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:10 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:10.602144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385e121c-14e0-4739-8f89-0cd69ceb7b7e", "tag": "f447c56d-e7d3-4951-98af-dc5ebf3ba71a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:10.613700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.614544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.615246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-241de478-89b2-4721-8f22-23fc1e305469 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.666937 Oct 18 16:07:10.615391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.630479 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 783/1565] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:09 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:10.642333 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] Creating event network-changed:f447c56d-e7d3-4951-98af-dc5ebf3ba71a for instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e on n-h1-858383-14 Oct 18 16:07:10.647576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e65d4bd-ce68-4707-8d03-8ec132d2ead5", "name": "network-vif-deleted", "tag": "d028de9a-9d4d-4230-83fd-1138175e5c30"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:10.661639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.664131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.665125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.668603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-247bc4ea-2d42-41e6-9564-05814174d67a req-775fbffa-a874-42a7-970b-782bb8ddd401 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068397 Oct 18 16:07:10.671393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 783/1566] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:10.679613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] Creating event network-vif-deleted:d028de9a-9d4d-4230-83fd-1138175e5c30 for instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 on n-h2-858383-14 Oct 18 16:07:10.688724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:10.689121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e1476f08-8c2a-40e0-95b1-187a7399bc79 req-41b84978-3f9f-4833-afa3-9ad38bff801d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055642 Oct 18 16:07:10.689814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:10.692171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 784/1567] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:10.697238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.697720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.698206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.699109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.699894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.700329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.759881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:10.761299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:10.769364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.773038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.775708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.777204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:10.779308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:10.779959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:10.988963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:10.999913 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ffff5bff-25a0-4f14-a730-aec3aa289874 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.325057 Oct 18 16:07:11.000626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 784/1568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:10 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:11.007432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:11.008382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:11.016019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.016877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.017767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.018723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.019391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.020025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.221492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.242825 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae113bed-64ce-4e43-bad7-0ace45ce52fd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.497905 Oct 18 16:07:11.244042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 785/1569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:10 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:11.248683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:11.249336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:11.268575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.269437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.270047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.271008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.272051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.272671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.304257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.317582 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa770b72-e619-4c82-ab2e-eb4584c4cf30 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.312690 Oct 18 16:07:11.317920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.318408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.318543 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 785/1570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:11 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:11.319297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.319986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lazy-loading 'fault' on Instance uuid 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:11.347234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-plugged", "status": "completed", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:11.379739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.380188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.380638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.384193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:11.409405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.410343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] Creating event network-vif-plugged:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:07:11.418811 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-867c9839-7963-44d4-b0b8-4a3dbd35a06c req-30892dae-585c-401e-9bce-dbfbdf17b370 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075448 Oct 18 16:07:11.421616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 786/1571] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:11.442901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13e06299-28ec-4ab4-b068-5dd070c2bc43 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 200 len: 1297 microversion: 2.1 time: 0.197752 Oct 18 16:07:11.444238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 786/1572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:11 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:11.626885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52b0c9a0-b349-4088-88fe-b7279c8074b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: .version_select at 0x7f5fd3286160>, body: {"keypair": {"name": "tempest-keypair-1545137024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUbRPibIfJYL7Hmd41dTWSqXiEfAtNwv+0+qobSSRzEMH2d/m4ZvPmDvMzdaUTWa07nkElsnYJT/CRKsBZQ+u/yNpRKFKk+zT6BtDhITrSphQpioRoNV4XpLQP+sZ/iUg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:11.627957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:11.628836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:11.650389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.653374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.654545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.658629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.659088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.659552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.686176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-52b0c9a0-b349-4088-88fe-b7279c8074b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:11.693740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-52b0c9a0-b349-4088-88fe-b7279c8074b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:11.729609 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52b0c9a0-b349-4088-88fe-b7279c8074b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.305755 Oct 18 16:07:11.731604 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 787/1573] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:07:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:11.736954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:11.738763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:11.747147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.747881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.748837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.749961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:11.752397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:11.752397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:11.872081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.880223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6fdf3e6-a108-4568-ab39-b10815544255 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.263321 Oct 18 16:07:11.893830 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 787/1574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:11 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:11.982455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.993679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.995240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:11.996788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41c33247-4394-4003-9ed0-42d0321076e8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.263809 Oct 18 16:07:11.997775 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 788/1575] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:11 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:12.024365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.025766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:12.037208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.038165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.038559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.039309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.040426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.040830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.211066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:12.220247 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69cfc88b-4b18-493a-8780-fcc9c0f7000d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.200416 Oct 18 16:07:12.221420 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 788/1576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:12.268057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.268961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:12.276548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.277311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.277914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.279012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.279641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.280242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.340974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.341618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:12.348116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.348604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.349067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.349773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.350229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.350655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.437840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:12.446593 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97326597-50f8-4d5d-b1e6-d10c12555860 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.181806 Oct 18 16:07:12.447516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 789/1577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:12.468704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.469575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:12.475583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.476307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.476901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.478336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.479211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.479796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.494415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 HTTP/1.1 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:07:12.496392 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:07:12.498209 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1e65d4bd-ce68-4707-8d03-8ec132d2ead5'} Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:12.499220 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:07:12.500703 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:12.503054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:12.504110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af953a41-d7c0-4306-9810-704b952b1816 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 404 len: 111 microversion: 2.1 time: 0.039428 Oct 18 16:07:12.505240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 790/1578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:07:12.515232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44ee8493-440e-4339-a4a7-0b91cb9f35d2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd2828430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.639636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:12.650791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83ed56e1-ce9a-4c62-86e4-2880e8c1b3ab tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1317 microversion: 2.1 time: 0.312650 Oct 18 16:07:12.651696 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 789/1579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:12.907493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:12.909057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:12.921486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.922097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.922628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:12.924126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:12.924906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:12.929137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.433301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:13.450813 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d497f14-1f16-461d-b23b-1218f351fc86 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.547488 Oct 18 16:07:13.451450 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 790/1580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:13.472345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:13.473372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:13.493495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.495294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.495981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.497705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.499462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.501221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.531474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-44ee8493-440e-4339-a4a7-0b91cb9f35d2 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 204 len: 0 microversion: 2.1 time: 1.021613 Oct 18 16:07:13.536824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 791/1581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:12 2022] DELETE /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:13.542705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:13.543542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:13.560400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.571943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.572426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.573178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.573637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.574060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.892115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:13.907255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:13.908810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:13.911192 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9bf60bf9-066d-474d-92f2-8b11d6cd3c4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.456779 Oct 18 16:07:13.913631 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 791/1582] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:13 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:13.938403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:13.939328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:13.945797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.946539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.947138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.948019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:13.948638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:13.949259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:13.971232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:13.989481 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d009c26-f2c2-4439-afe4-7abb872d7fe3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.447883 Oct 18 16:07:13.992237 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 792/1583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:13 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:14.006402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "name": "network-vif-unplugged", "status": "completed", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:14.017705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.018348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.018824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.037102 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] Creating event network-vif-unplugged:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h2-858383-14 Oct 18 16:07:14.047540 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-63194dcf-bb0a-4ca4-b678-d0d1f58cd656 req-a107e34d-04e3-4ef2-a10a-4d164bf39691 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046183 Oct 18 16:07:14.050485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 793/1584] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:14.218793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:14.219386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:14.226130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.226618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.227589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.230076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.230758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.231394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.273574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:07:14.434922 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb292f9e-f406-4c16-a1e0-cdf2cd2fe8e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 204 len: 0 microversion: 2.1 time: 0.382871 Oct 18 16:07:14.435895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 794/1585] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:07:14 2022] DELETE /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:14.449786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:14.449786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:14.463444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.465150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.466791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.469255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.472081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.473655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.538381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:14.553863 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42dc4c5d-3ee5-48af-bc5e-3668f88611e6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.620543 Oct 18 16:07:14.558927 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 792/1586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:13 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:14.564771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e226031-0ad3-409c-9aa5-572c02367830", "name": "network-vif-plugged", "status": "completed", "tag": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:14.580769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.581642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.582407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.596747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] Creating event network-vif-plugged:fda4f53d-b983-490e-9e39-40f5cdbf8c4d for instance 5e226031-0ad3-409c-9aa5-572c02367830 on n-h1-858383-14 Oct 18 16:07:14.602728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-20623315-2cb8-4e15-9860-81de615d29d3 req-6fc63a93-1a2d-4b89-9aab-381a75cce860 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041817 Oct 18 16:07:14.603511 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 793/1587] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:14.610590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:14.611440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:14.621383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.622261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.623200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.624376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:14.625279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:14.626147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:14.795015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:14.803041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3fe2e97-fccb-49ca-9405-6c068363e618 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.197603 Oct 18 16:07:14.803940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 794/1588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:14 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:14.809125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1957460557", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c1270b22-ba97-4621-a927-cf6313636663"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:14.811168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:14.819629 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-22df67c5-2f75-4033-9bc3-c7946cfa9051 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1467 microversion: 2.1 time: 0.382433 Oct 18 16:07:14.820208 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 795/1589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:14 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:14.835040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-635734030", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4a50421-5452-4e65-84ea-78b361222489"}], "security_groups": [{"name": "tempest-securitygroup--339860438"}], "key_name": "tempest-keypair-1545137024", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:14.894377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] validate_networks() for [('c1270b22-ba97-4621-a927-cf6313636663', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:07:14.972205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] validate_networks() for [('b4a50421-5452-4e65-84ea-78b361222489', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:07:15.406597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:07:15.407195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:07:15.407667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:07:15.408429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:07:15.408851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:07:15.423955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.424520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.425544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.426317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.426881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.427643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.453031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:15.458541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Getting quotas for user 3ffc4db9f1d64b4e864915e980af84f4 and project 9c2404823fb54cc2bcee162756e6ef79. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:15.473496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:07:15.475831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:15.528600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7067b7d0-1750-40d3-b684-018889c7b2f8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723294 Oct 18 16:07:15.530125 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 795/1590] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:07:15.557806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:07:15.558299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:07:15.558850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:07:15.559327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:07:15.559804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:07:15.562150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:15.572625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.573019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.573709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.574812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.575553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.576148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.599143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:15.605617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:15.620264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:07:15.622806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:15.673637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:15.674493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:15.677635 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7dd56733-0366-4b99-a14b-f25daa8d1706 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.856067 Oct 18 16:07:15.682125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.682772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.683287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.684071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.684862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.685384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.685538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 796/1591] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:07:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:07:15.690116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:15.691007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:15.691835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:15.700912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.701497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.701936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.703731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.703731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.704045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.875878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:15.906133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:15.907608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:15.908865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb504209-8a54-4e29-aab3-775170bb48e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.222283 Oct 18 16:07:15.912114 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 797/1592] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:15 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:15.936831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:15.938593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:15.947231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.947980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.948619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:15.949619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:15.950303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:15.950951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.184117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1bebbac-5bdf-4010-a39f-f79e8a6f1143 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1620 microversion: 2.1 time: 0.651080 Oct 18 16:07:16.187025 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 796/1593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:15 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1620 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.198537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:16.199613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:16.207783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.208849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.209641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.211031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.211860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.212531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.240689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:16.249800 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1043b78e-bea9-471a-9b59-27cddd998526 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.322980 Oct 18 16:07:16.261050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 798/1594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:15 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.261050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:16.261050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:16.264651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.265362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.265998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.266867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.267489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.268082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.297418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:16.306285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36f3f08f-9519-42bc-8da9-ce20a4f373a8 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1212 microversion: 2.1 time: 0.116636 Oct 18 16:07:16.306886 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 797/1595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:16 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1212 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.315043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-693d37e5-398d-47d0-9338-c6e2378c15de tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:16.316180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-693d37e5-398d-47d0-9338-c6e2378c15de tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:16.371743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-693d37e5-398d-47d0-9338-c6e2378c15de tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:16.378907 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-693d37e5-398d-47d0-9338-c6e2378c15de tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1238 microversion: 2.1 time: 0.070873 Oct 18 16:07:16.379494 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 798/1596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:16 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.384474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:16.385118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:16.391709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.392199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.392702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.393436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.393894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.394328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.415970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:16.423625 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-edc01f4c-e4ea-44b6-88cd-87bd9669d399 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.171834 Oct 18 16:07:16.424379 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 799/1597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:16 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.429107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:16.439485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.439969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.440409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.451704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] Creating event network-changed:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h2-858383-14 Oct 18 16:07:16.456572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6c6dc250-d942-4f22-807a-7da81445a2a0 req-921e61b4-5765-414a-97dd-17043f6e8fac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031089 Oct 18 16:07:16.457193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 800/1598] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:16.462167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: .version_select at 0x7f5fd2828670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-814889505", "policies": ["affinity"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:16.480199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:16.485491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:16.531161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:16.536906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:16.538793 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5715c42-5e4a-4cb7-ac02-0911e036e8b4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.158344 Oct 18 16:07:16.540298 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 799/1599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:16 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:16.543575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:16.556651 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8d5bf70-99e5-4b2f-8fd1-5afbe697ba92 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.098356 Oct 18 16:07:16.557366 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 801/1600] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:07:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:16.657847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-700556818", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "78da005f-bbb3-449d-a36b-e739ec0e46f8"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:16.711133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:07:16.941089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:16.941899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:16.952874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.959241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.960111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:16.961075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:16.962255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:16.969516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.009993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:07:17.010415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:07:17.010880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:07:17.011482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:07:17.011927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:07:17.045187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.045666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.046534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.046798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.047336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.047832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.070812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:17.073090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:17.077279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:17.096260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 2 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:07:17.098494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:17.149897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120570) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 16:07:17.176519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:17.185648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:17.232355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.233891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:17.239561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:17.241989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.243958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.245335 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29fbcbc4-69ad-4cd1-bccd-17908768bec2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.309009 Oct 18 16:07:17.246383 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 802/1601] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:16 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:17.258001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=a192fb0b-72e9-4208-a1bd-2306f5cfc96b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:17.275867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.276496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.283734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.284449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.284887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.285663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.286297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.286737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.323095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:17.330068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:17.366431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:17.372418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:17.407545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c50daa02-3bf3-4dae-924c-4953ed614598 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.754037 Oct 18 16:07:17.408466 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 800/1602] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:07:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:07:17.413259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.413877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.420433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.420919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.421399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.422257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.422547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.422973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.443791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.453466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f57776e6-0ba5-48a9-9970-6677613ebbc5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.182126 Oct 18 16:07:17.454542 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 803/1603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.478094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.478827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.485481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.486421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.486520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.487340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.488048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.488666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.503076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.511563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b02a1e84-1123-4501-ad47-8b2a9375ed67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1260 microversion: 2.1 time: 0.102063 Oct 18 16:07:17.512336 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 801/1604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1260 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.517565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.522718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.523644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Searching by: {'deleted': False, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:07:17.542072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.542580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.543001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.543724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.544175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.544593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.560948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.570271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e58a5835-d943-456e-9e88-077572ebab85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1234 microversion: 2.1 time: 0.114297 Oct 18 16:07:17.571600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 804/1605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1234 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.573180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:07:17.577714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.578621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.584627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.585548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.586603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.587491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.587950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.588383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.611485 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4201b8f6-8780-4516-8406-e7e2d6eb9625 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.097847 Oct 18 16:07:17.612093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 802/1606] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers => generated 1002 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.616765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.617414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.637644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.638304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.638758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.639488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:17.639942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:17.640425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:17.821158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.833313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a10ab50e-e556-4903-bf01-52f9ed3a6739 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.219982 Oct 18 16:07:17.836117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 803/1607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.845431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba8f1424-0eff-4af1-8156-f9dddfc9e3a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:17.846587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba8f1424-0eff-4af1-8156-f9dddfc9e3a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:17.922759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba8f1424-0eff-4af1-8156-f9dddfc9e3a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.929589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba8f1424-0eff-4af1-8156-f9dddfc9e3a7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1218 microversion: 2.1 time: 0.091659 Oct 18 16:07:17.930230 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 804/1608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:17.977135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:17.990038 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6265a97b-cd44-47b8-9650-3f1908f258da tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.416819 Oct 18 16:07:17.990629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 805/1609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:17 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:18.272032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.272640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.280605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.281247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.281911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.282814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.283493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.284126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.422902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.432040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.433555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.434721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c964b47-b004-47b2-821c-a9835e163dda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.166823 Oct 18 16:07:18.435286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 805/1610] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:18.476398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.478070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.486406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.487122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.487739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.488463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.488927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.489396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.535681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.536647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.544723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.545515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.546035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.546958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.547834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.548492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.716633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.728095 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c01520a3-7fd0-4444-aa89-1a053f589ca0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.254685 Oct 18 16:07:18.729973 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 806/1611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:18.735152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.736110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.744299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.745391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.746048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.747001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.747785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.749542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.795232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:18.797821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.816099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dc15fec-2ea1-4088-addc-5a9c7fada995 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.284079 Oct 18 16:07:18.816702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 806/1612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:18.861895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.862743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.870116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.870616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.871055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.872005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.872642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.873095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.889113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.903412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c5eaee3-035e-44c7-b52f-cae976366d79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1298 microversion: 2.1 time: 0.172085 Oct 18 16:07:18.904312 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 807/1613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:18.958699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.959497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.967159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.967880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.968537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.969468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.970203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.970690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.156243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.169431 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbf70db5-3259-418e-937c-92fc03ea19e1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1214 microversion: 2.1 time: 0.217242 Oct 18 16:07:19.170643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 808/1614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:19.175537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:19.176151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:19.183212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.183978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.184603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.185527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.186143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.186737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.428396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.437652 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32171314-c565-41d0-8e49-083d2a4022d5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.579493 Oct 18 16:07:19.438468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 807/1615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:19.461247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:19.462565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:19.468450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.469049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.469535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.470287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.470803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.471294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.545856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.553294 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c9ce2dc-0ab1-42f6-adaf-bc990e71acce tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.381378 Oct 18 16:07:19.553871 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 809/1616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:19 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:19.603012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.611776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.613221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.614375 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b12298f0-18f3-4788-b917-fee92ca08160 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.157289 Oct 18 16:07:19.614926 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 808/1617] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:19 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:19.752219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:19.753395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:19.760865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.761726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.762340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.763373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.763830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.764254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.842585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:19.843770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:19.851815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.853067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.854894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.856807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.857508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.858232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.052550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:20.060703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:20.065926 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a90b5429-d3e2-4398-ba17-535589fd73ec tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.228173 Oct 18 16:07:20.069226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a832ad8f-08e9-429f-96ec-d21bb8b9a80a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.321119 Oct 18 16:07:20.069830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 810/1618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:19 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:20.084110 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 809/1619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:19 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:20.094667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.095287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.122552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.123059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.123504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.124230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.124690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.125151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.199389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.200295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.220083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.223432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.224204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.226563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.229685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.230253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.265421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:20.273232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be703c3e-6982-4be0-9222-0959a52e6668 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1296 microversion: 2.1 time: 0.182331 Oct 18 16:07:20.274129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 811/1620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:20.302762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:20.312061 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e436321-f10d-452b-be05-eae8fb90d92e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1270 microversion: 2.1 time: 0.118226 Oct 18 16:07:20.312632 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 810/1621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:20.462167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.463646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.470395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.471719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.472397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.473305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.473998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.474721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.578951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.580135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.586979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.588370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.588970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.589857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.590413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.591098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.856076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:20.868011 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6348bdc-e380-4963-a7cc-ad15d6f8039e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.295013 Oct 18 16:07:20.868978 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 811/1622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:20.883514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.884574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.897580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.907641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.908412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.911867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.913504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.915045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.049880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.062017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06c34ce3-7c8b-4497-a27f-36f35edd2bd4 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1332 microversion: 2.1 time: 0.604572 Oct 18 16:07:21.075191 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 812/1623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1332 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:21.105107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421675d0-550a-4e64-99ca-b13a3c79fd68", "tag": "7bcd8b19-92ac-4700-9939-053c8c8526dc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:21.127123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.127788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.128497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.156366 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] Creating event network-changed:7bcd8b19-92ac-4700-9939-053c8c8526dc for instance 421675d0-550a-4e64-99ca-b13a3c79fd68 on n-h2-858383-14 Oct 18 16:07:21.162929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2544e881-a5ff-49c3-bf06-07384dbff2b5 req-be364d65-0853-4d33-b63f-825b39c3fa19 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086156 Oct 18 16:07:21.165140 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 813/1624] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:21.172333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:21.189595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:21.208796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.210794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.212731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.214451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.215150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.215841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.307996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.317915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.319902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.322217 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36e5619b-42fc-4838-b8c3-cd9210a45855 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.451694 Oct 18 16:07:21.323554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 812/1625] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:21.330384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:21.331479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:21.349538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.350270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.351128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.351645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.352397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.352890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.762302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.782435 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58e41929-cd8a-468b-9d2e-805c8cb38cce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.456941 Oct 18 16:07:21.783473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 813/1626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:21 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:21.792016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:21.793122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:21.811529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.812503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.813363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.814357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.815045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.815692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.983900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.994982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-262cf14a-5eb8-413e-884a-46970c2b9cbf tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.828104 Oct 18 16:07:22.001600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 814/1627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:21 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:22.006559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.007393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.014083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.014799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.015405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.016310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.017036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.017646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.122793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:22.131479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6828c754-bb5c-45a2-aefe-46cb57a58cca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.346187 Oct 18 16:07:22.132453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 814/1628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:21 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:22.136986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385e121c-14e0-4739-8f89-0cd69ceb7b7e", "name": "network-vif-plugged", "status": "completed", "tag": "f447c56d-e7d3-4951-98af-dc5ebf3ba71a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:22.152695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.153561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.154383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.158711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:22.168174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] Creating event network-vif-plugged:f447c56d-e7d3-4951-98af-dc5ebf3ba71a for instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e on n-h1-858383-14 Oct 18 16:07:22.173146 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ab2b6ea5-8eed-4200-b953-c241f16032d2 req-e47cdca9-5233-4bbb-89c9-14d83965b71d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039605 Oct 18 16:07:22.173753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 815/1629] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:22.180260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.181425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.186155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:22.188630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.189593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.190293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.191716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.192348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.192949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.200864 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f36d732-ea40-43e4-a2a4-6445826d143d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1276 microversion: 2.1 time: 0.197856 Oct 18 16:07:22.213034 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 815/1630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:22.220440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.221569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.229865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.230363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.232145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.232890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.233505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.233951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.451312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:22.470599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b84755a-ef17-4262-8503-2916bafe3637 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.293567 Oct 18 16:07:22.473933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 816/1631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:22.479511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.480247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.504435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.505298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.506274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.507235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.508467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.509134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.834993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:22.860836 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-148366ba-a41b-4dd1-9be2-a34b5bf2da08 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1537 microversion: 2.1 time: 0.656234 Oct 18 16:07:22.866999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 816/1632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1537 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:22.873832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.874790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.881942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.882589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.883226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.884089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.884653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.885228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.166454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.177699 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f10ebfe-c2cc-4124-88c7-d7e1e04f8811 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.309217 Oct 18 16:07:23.178608 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 817/1633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:23.184118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c51e032-0faf-4e06-9711-1b03a52b3b57 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'create', calling method: .version_select at 0x7f5fd20a1d30>, body: {"pool": "e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:23.208865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.219690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.221602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.223382 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b944e15c-9539-48c9-ab95-013ba78690c8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.747879 Oct 18 16:07:23.224625 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 817/1634] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:23.230196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:23.231082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:23.234360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:23.238541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.239021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.239460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.240385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.240767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.241242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.470047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.480117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-898b9b72-3b02-4ac9-a80b-373c57cf8f11 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.254238 Oct 18 16:07:23.481368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 818/1635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:23 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:23.486630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:23.487456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:23.497521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.498280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.498959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.499671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.500133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.500565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.659458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.667956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82af0860-9396-438e-a379-ddb8d58c2fec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.185119 Oct 18 16:07:23.668537 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 819/1636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:23 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:23.674500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:23.675012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:23.682700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.683550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.684004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.684772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.685260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.685718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.824204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.832254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8a5ca1f-2c62-4f12-97b6-dfb9a965e5ce tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.162622 Oct 18 16:07:23.832816 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 820/1637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:23 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:23.837270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289d8c86-2298-4c02-b489-7a833838d365", "name": "network-vif-deleted", "tag": "918a14b1-0bff-4008-b4ba-aee8b3527af9"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:23.846486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.846957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.847381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.858312 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] Creating event network-vif-deleted:918a14b1-0bff-4008-b4ba-aee8b3527af9 for instance 289d8c86-2298-4c02-b489-7a833838d365 on n-h1-858383-14 Oct 18 16:07:23.863124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d75a9a10-2c64-4392-a50b-e63d860151d4 req-e7552847-53e4-4347-bf06-cc2d15752248 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029126 Oct 18 16:07:23.863709 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 821/1638] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:23.869138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a192fb0b-72e9-4208-a1bd-2306f5cfc96b", "tag": "52334bcf-eb3f-4076-9742-38fa03058235"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:23.878405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.878804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.879229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.890237 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] Creating event network-changed:52334bcf-eb3f-4076-9742-38fa03058235 for instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b on n-h2-858383-14 Oct 18 16:07:23.894815 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-64ca38d4-6388-4efe-8cc5-a826d72ff511 req-a06d95a0-caf1-4396-846d-5b0d2bd18073 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029885 Oct 18 16:07:23.895393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 822/1639] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:23.900586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:23.901420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:23.907385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.907932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.908350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.909061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.909512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.909933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.047986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.056412 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0151684a-559a-487a-b0f4-1198bfc6181d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1318 microversion: 2.1 time: 0.159902 Oct 18 16:07:24.057255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 823/1640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:23 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:24.202465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.203099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.209071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.209988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.209988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.210668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.211196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.212175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.357144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.365495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4cf67af-1b5e-4ec0-ae5c-29b614939a32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.167055 Oct 18 16:07:24.366101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 824/1641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:24.371869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.372781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.379470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.380269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.380986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.382185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.383710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.384824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.540079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.559679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c51e032-0faf-4e06-9711-1b03a52b3b57 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.379805 Oct 18 16:07:24.560405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.560845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 818/1642] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:07:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:24.562789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.564111 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7bee5ba-71f6-4d9d-a18c-ac1c4510271e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.196965 Oct 18 16:07:24.564660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 825/1643] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:24.568367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.569305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.576918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.577702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.578205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.579138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.579904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.580398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.589227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: .version_select at 0x7f5fd3ed4700>, body: {"addFloatingIp": {"address": "172.25.2.87"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:24.592161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.599221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.599652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.600178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.600912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.601598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.602544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.671354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:07:24.671758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquired lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:07:24.719141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.727009 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ce26e4c-6adf-4c0e-8363-997546dc882f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.163464 Oct 18 16:07:24.727609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 819/1644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:24.732659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.733520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.739537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.740232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.740839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.741739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.742796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.743481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.885862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.894399 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0359dca-9831-4e82-8a99-c6066cd0a824 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.165585 Oct 18 16:07:24.894972 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 820/1645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:24.900094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.900817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.906776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.907207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.907914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.908615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.909104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.909537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.051108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:25.060002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1beea198-ed99-43dd-add7-484d681be44e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.164047 Oct 18 16:07:25.060590 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 821/1646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:25.078999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:25.079610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.085469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.086624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.087353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.087791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.088255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.089089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.233900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:25.243951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-760986aa-1036-4925-a12f-67a3ff521255 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1468 microversion: 2.1 time: 0.168597 Oct 18 16:07:25.244561 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 822/1647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:25 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:25.267800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:25.268417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.274858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.275342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.275884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.276592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.277060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.277483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.422537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:25.431343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ecc4213-dd0a-4326-ac67-d9debba4f7e3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1467 microversion: 2.1 time: 0.168337 Oct 18 16:07:25.432506 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 823/1648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:25 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1467 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:25.449431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:25.451401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.456411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.456979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.457898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.458720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.459333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.459837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.590669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:25.812137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:25.827347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c545810f-f613-4112-821e-11a8fe72a85d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.384199 Oct 18 16:07:25.849850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 824/1649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:25 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:25.863213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1685169472"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:25.868073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.876821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.877558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.878195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.879120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.880324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.881324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.939746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:26.174340 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f3bdaaa7-7934-4344-b2f8-d85de29b736d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "POST /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1/action" status: 202 len: 0 microversion: 2.1 time: 0.319960 Oct 18 16:07:26.176264 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 825/1650] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:25 2022] POST /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:07:26.198611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:26.204724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:26.226469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.227180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.227771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.228497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.229240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.229680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.501714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:26.516797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:26.518317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:26.519545 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1521b5ee-5944-481d-927d-ff1c3812f58e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.341917 Oct 18 16:07:26.520476 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 826/1651] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:26 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:26.526108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:26.526731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:26.533357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.533633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.534060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.534763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.535224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.535652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.551503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=18 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:26.740701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:26.751083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d356bbed-42d1-47ab-b523-e746512a99e6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.229498 Oct 18 16:07:26.765028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 827/1652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:26 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:26.765028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:26.767172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:26.770913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.770913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.770913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.786348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] Creating event network-changed:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:07:26.793895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1890dfad-5e7b-4388-8c9c-8c9f70f88a51 req-97eabab0-6a92-4571-acd7-f5a66654696e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040510 Oct 18 16:07:26.798597 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 828/1653] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:26.806611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:26.807356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:26.816584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.817175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.817625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.818334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.818899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.819334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.962667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Building network info cache for instance {{(pid=120570) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:07:27.372787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:27.381611 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb049efe-5b36-4123-8341-e38ca8782ef1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.580858 Oct 18 16:07:27.382400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 829/1654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:26 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:27.391002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:27.391622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:27.400352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.400846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.401358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.402072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.402521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.402942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.552193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:27.575312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:27.588135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1848d270-22d5-48e9-b2f1-66226ee626fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.200901 Oct 18 16:07:27.596634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 830/1655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:27 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:27.602462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39b20f0b-192b-41ea-b7de-26ab254e2d0c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20cddc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:27.659721 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39b20f0b-192b-41ea-b7de-26ab254e2d0c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.061659 Oct 18 16:07:27.668735 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 831/1656] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:27 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:27.674018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:27.674633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:27.681085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.681582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.682023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.682729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.683245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.683674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.854922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:27.864206 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02ddf0e3-d294-4d9d-a77c-5c574a0a42e2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.194128 Oct 18 16:07:27.868450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 832/1657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:27 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:27.872611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e226031-0ad3-409c-9aa5-572c02367830", "tag": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:27.883561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.884474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.884950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.903768 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] Creating event network-changed:fda4f53d-b983-490e-9e39-40f5cdbf8c4d for instance 5e226031-0ad3-409c-9aa5-572c02367830 on n-h1-858383-14 Oct 18 16:07:27.911955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-354601fe-e2d7-4f36-b9cf-9b46eeab8112 req-e34094ce-bfe5-4aef-89fb-0d4d34a092f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045637 Oct 18 16:07:27.912880 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 833/1658] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:27.919430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:27.920601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:27.927754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.927754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.934740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.934970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=32 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:27.935182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.935182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.935182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.079891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Updating instance_info_cache with network_info: [{"id": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d", "address": "fa:16:3e:f8:18:4b", "network": {"id": "af7e4069-fdcb-430d-ac40-30851f540320", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1674208955-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1c415760996a4973a0e827f3da988200", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfda4f53d-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:07:28.097199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Releasing lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:07:28.098131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e55dc44-3be0-4213-8928-1959500838eb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 202 len: 0 microversion: 2.1 time: 3.515129 Oct 18 16:07:28.098743 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 826/1659] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:24 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 0 bytes in 3516 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:07:28.104704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.105366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.117857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.118664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.119097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.119810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.120267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.120691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.188462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.198792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.205073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.206955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c64f6d78-86af-4fe0-b219-005b6f8be012 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.292945 Oct 18 16:07:28.209031 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 834/1660] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:27 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:28.228260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c503ea98-82a1-4ba1-825b-4c389eb44af1 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'create', calling method: .version_select at 0x7f5fd202c3a0>, body: {"pool": "e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5"} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:28.277625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.287167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-671b20e4-f627-4716-afa6-e48b9f75c63e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.187074 Oct 18 16:07:28.287740 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 827/1661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:28.409009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.409651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.417639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.418126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.418567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.419263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.419719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.421154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.563208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.571164 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-621338b6-6c6e-4baa-82b6-0d2f6b86e5ba tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.165942 Oct 18 16:07:28.571751 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 828/1662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:28.613716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.614333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.622077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.622574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.623165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.624017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.624638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.625105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.774570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.785129 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-724f2944-fe62-4b57-8537-d06478b5dd35 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.175012 Oct 18 16:07:28.797315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 829/1663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:28.797315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b150d00-ef61-4bc1-9ffc-948d00b26c2f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20a41f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.845162 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b150d00-ef61-4bc1-9ffc-948d00b26c2f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.058278 Oct 18 16:07:28.845976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 830/1664] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:28.890016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.890962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.897499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.898344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.898963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.899852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.900470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.901144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.285842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.295744 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7fa11a7a-8d79-4da8-b94a-b807c21bcce1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.409606 Oct 18 16:07:29.296571 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 831/1665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:29.301990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421675d0-550a-4e64-99ca-b13a3c79fd68", "name": "network-vif-plugged", "status": "completed", "tag": "7bcd8b19-92ac-4700-9939-053c8c8526dc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:29.313438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.314072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.314807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.334677 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] Creating event network-vif-plugged:7bcd8b19-92ac-4700-9939-053c8c8526dc for instance 421675d0-550a-4e64-99ca-b13a3c79fd68 on n-h2-858383-14 Oct 18 16:07:29.340006 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-34acbeea-6a28-47be-878a-6e83aab8ffc2 req-53add42d-f6ac-463e-81f7-0e4390d9742d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041531 Oct 18 16:07:29.341266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 832/1666] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:29.346622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.347324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.354724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.355242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.355687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.356395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.356855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.357317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.588461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.597170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.598608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.599908 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2fd6aca7-eea9-4ac1-aea2-ec2a9f22fac3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.257354 Oct 18 16:07:29.601124 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 833/1667] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:29 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:29.606169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.606987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.613244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.613897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.614490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.615351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.615963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.616531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.900899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.903234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:29.911039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7a0d83a3-00f3-4a76-aa81-c6f98b24f163 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.308570 Oct 18 16:07:29.911898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 834/1668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:29 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:29.917389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.918003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.919851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c503ea98-82a1-4ba1-825b-4c389eb44af1 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.708976 Oct 18 16:07:29.921030 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 835/1669] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:07:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:29.926207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.926824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.934765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.935196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.935638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.936349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.936800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.937254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.938528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.939363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.940056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.940979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.941625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.942245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.077074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.084884 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e38e2e1-0422-48dc-8e9d-ec751fd18f0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.162656 Oct 18 16:07:30.085478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 836/1670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:29 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.090272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f645a83b-550d-43f7-bf4f-29aaea384f65 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20cd0d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.136681 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f645a83b-550d-43f7-bf4f-29aaea384f65 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.050179 Oct 18 16:07:30.137308 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 837/1671] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.142039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: .version_select at 0x7f5fd3ecfdc0>, body: {"addFloatingIp": {"address": "172.25.2.38"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:30.142953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.144421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.151027 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e636ad7d-5f7f-45ca-9357-60d438518f55 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.238330 Oct 18 16:07:30.151322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.151613 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 835/1672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:29 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.151809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.152257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.152960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.153444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.153872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.155933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea765be0-6de8-49ee-9575-a167c38fcbca", "tag": "57c5b00d-5992-4e55-9b6d-82d86bc3a75b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:30.165810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.166381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.166810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.177325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] Creating event network-changed:57c5b00d-5992-4e55-9b6d-82d86bc3a75b for instance ea765be0-6de8-49ee-9575-a167c38fcbca on n-h2-858383-14 Oct 18 16:07:30.182798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4fe9ad6b-6d3c-408c-83bf-f80fcaecad24 req-ad23b3c5-d8c9-4cc3-b6bb-451f89564101 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030070 Oct 18 16:07:30.183504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 836/1673] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:30.219033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:07:30.219440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquired lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:07:30.322561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.323252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.329503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.329985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.330418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.331110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.331562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.331983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.468531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.477437 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a936b0e3-9c9e-4a8d-a4f3-b9e1c4d1389d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.159006 Oct 18 16:07:30.478005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 837/1674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.627926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.628442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.635188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.635669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.636106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.636792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.637270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.637691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.680711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5.", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:07:30.681653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Releasing lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:07:30.682195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.682195 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Request method failure captured: Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action HTTP/1.1 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 45 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8ah2j_xy2AVx3ikzwJzzzGc_OcfiV6BZGBEn5BdjttNtHe6V_YkZCma0rWjvpOKhq-bZd28hk2YIZqWRAFr4hPcHoUK1xkWK8eyfR-VY7OHDThoetXo_XOXfS7tWIaT55QTQFvQzmIvRCkpwq65sPjuSpd5wYCtAmOq2GnhF2vta0 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:07:30.684385 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c415760996a4973a0e827f3da988200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c415760996a4973a0e827f3da988200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}] Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 65e262effe18496cbc3541d8b7ceedd7 Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: {"addFloatingIp": {"address": "172.25.2.38"}} Oct 18 16:07:30.686104 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: exception: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5e226031-0ad3-409c-9aa5-572c02367830', 'body': {'addFloatingIp': {'address': '172.25.2.38'}}} Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.687007 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:07:30.688622 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.689979 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.691321 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Returning 400 to user: Cannot associate floating IP 172.25.2.38 (9627b295-f1ac-402b-8567-b45804c2afa4) with port fda4f53d-b983-490e-9e39-40f5cdbf8c4d using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e122af0d-ca5e-4e9b-b66f-e8ac9e05a4f5. Oct 18 16:07:30.692940 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-760197b3-5b73-4a64-89e3-612d0715e9dc'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:30.693907 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6c82fc3-6865-47e0-b326-2bfed58bf89d tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 400 len: 381 microversion: 2.1 time: 0.547640 Oct 18 16:07:30.693907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 838/1675] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:30 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 381 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:07:30.698286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40659863-90c1-43fe-82b3-b9219f1891d9 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '.version_select at 0x7f5fd64855e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.773530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.783439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.784960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.786461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b7ac10b-9794-429e-b4f9-a620b03bdec4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.162277 Oct 18 16:07:30.787732 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 838/1676] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:30.937091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.937922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.944061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.944775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.945703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.946687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.947307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.947896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.091011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.098742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-baa6bc07-ed25-4fd5-873e-9ddbf9875901 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.167422 Oct 18 16:07:31.099311 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 839/1677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:31.107794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.108550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.114881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.115488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.116057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.117446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.117989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.118496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.250719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.258934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-527500f0-c7bd-4cdb-8c64-22e3175bb37c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.155041 Oct 18 16:07:31.259507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 840/1678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:31.264076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7a7012cf-aeb3-47c7-9e10-7f893083d9ff tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1fde550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.308031 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7a7012cf-aeb3-47c7-9e10-7f893083d9ff tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.047499 Oct 18 16:07:31.308612 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 841/1679] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:31.313277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.313883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.319860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.321161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.321601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.322379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.322839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.323378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.461965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40659863-90c1-43fe-82b3-b9219f1891d9 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/9627b295-f1ac-402b-8567-b45804c2afa4" status: 202 len: 0 microversion: 2.1 time: 0.769764 Oct 18 16:07:31.462616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 839/1680] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:07:30 2022] DELETE /compute/v2.1/os-floating-ips/9627b295-f1ac-402b-8567-b45804c2afa4 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:07:31.470972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: .version_select at 0x7f5fd3ecff70>, body: {"removeFloatingIp": {"address": "172.25.2.87"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:31.475368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.484597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ecd2684-86ec-4003-8acf-c0780d751557 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.174770 Oct 18 16:07:31.501092 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 842/1681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:31.501354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.501970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.508684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.509383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.509862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.510582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.511044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.511477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.630409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.638053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.638657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.639189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.640134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.640665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.641249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.643865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.653099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f122134-639c-4cc1-a529-d6cdb9cc61d8 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.155805 Oct 18 16:07:31.653678 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 843/1682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:31.813099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.813879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.820322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.821048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.821740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.822621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.823074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.823686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.867254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:07:31.867740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquired lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:07:31.986322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.996064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.997627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.998899 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3a8e882-aeef-4238-8989-d4b61a6f6278 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.189650 Oct 18 16:07:31.999545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 844/1683] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:07:32.122567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.123176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:32.130157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.130650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.131095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.131838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.132296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.133274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.313397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:32.324663 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa537ae7-69e6-4ae4-953e-4dd5b3dbe76f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.205910 Oct 18 16:07:32.328907 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 845/1684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:32.333979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.334611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:32.343291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.343927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.344500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.345367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.345958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.346476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.653325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:32.666968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6aec5b6-d5f5-4339-b93c-4ca23ba38f1f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.336028 Oct 18 16:07:32.675177 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 846/1685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:32.680681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f2fbc69-46f2-4e6b-a28b-f79f04110469 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20a4e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.727479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f2fbc69-46f2-4e6b-a28b-f79f04110469 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.051593 Oct 18 16:07:32.728105 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 847/1686] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:32.733631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.734293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:32.740354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.740843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.741316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.742504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.742967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.743395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.881865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:32.890588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1bd2d150-d21a-4b02-be5e-b459a66f5b7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.161498 Oct 18 16:07:32.891254 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 848/1687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:32.895899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.896617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:32.902821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.903421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.903932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.904697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.905349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.905858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.106647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.118823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f17bc501-242b-4d60-bd5d-cc3001214e5b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.226251 Oct 18 16:07:33.122136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 849/1688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:33.238440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:33.239136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:33.246260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.246742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.247174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.247885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.248334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.248875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.389504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.399477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.401204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.402467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6edc5f65-60db-4f32-8fe0-2f995eaaadee tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1813 microversion: 2.25 time: 0.277430 Oct 18 16:07:33.403407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 850/1689] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:33 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1813 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:33.416431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Building network info cache for instance {{(pid=120571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:07:33.437118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-plugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:33.448125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.448621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.449067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.463705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] Creating event network-vif-plugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:07:33.469332 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-87409b7f-04ee-4631-a0b5-b0d6bf69ef4a req-e9599083-098a-4974-8c6c-189e5f0a3214 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036276 Oct 18 16:07:33.470103 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 851/1690] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:33.474995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:33.475810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:33.483500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.484245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.484853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.485881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.486797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.487392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.629477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.638062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f3a03ef-6517-4c3b-979b-f1436ab45f7a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.166909 Oct 18 16:07:33.638645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 852/1691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:33 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:33.643296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e226031-0ad3-409c-9aa5-572c02367830", "tag": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:33.653425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.654191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.654622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.668067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] Creating event network-changed:fda4f53d-b983-490e-9e39-40f5cdbf8c4d for instance 5e226031-0ad3-409c-9aa5-572c02367830 on n-h1-858383-14 Oct 18 16:07:33.673774 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-adea60f6-7bde-42d8-b4b6-c8ccc5ec07ef req-91bff64c-db56-4e4d-ac8a-53ae79d472d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 Oct 18 16:07:33.674931 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 853/1692] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:33.691653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:33.692543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:33.700249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.701043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.701368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.703501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.703969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.704413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.870825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.879721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1c53f48-e501-47b6-adc6-18efb7ac77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.192749 Oct 18 16:07:33.880612 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 854/1693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:33 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:33.885563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd69f9a5-4f9e-4eca-9f44-45d30365ac10 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd21748b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:33.948576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd69f9a5-4f9e-4eca-9f44-45d30365ac10 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.066648 Oct 18 16:07:33.949954 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 855/1694] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:33 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:33.962757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:33.964512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:33.971616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.972218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.972861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.973749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:33.974288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:33.974799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.996256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:34.208442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.226085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9686fa47-1a20-40db-a013-1003316c39b3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.262224 Oct 18 16:07:34.234316 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 856/1695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:33 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:34.241366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.243415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:34.251358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.251934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.252608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.253452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.254029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.254671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.441658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.453326 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b2f06dc-ca39-46b2-9d99-e5f0a113b620 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.217362 Oct 18 16:07:34.454051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 857/1696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:34.458843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.459450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:34.465970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.466452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.467153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.468094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.468761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.469309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.633525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.642806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.644369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.645541 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c471e16-1145-4161-be1e-fe692cdd81b2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1803 microversion: 2.25 time: 0.190387 Oct 18 16:07:34.646449 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 858/1697] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1803 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:34.667467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.668522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:34.677200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.677826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.678437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.679103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.679597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.680037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.715777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Updating instance_info_cache with network_info: [{"id": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d", "address": "fa:16:3e:f8:18:4b", "network": {"id": "af7e4069-fdcb-430d-ac40-30851f540320", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1674208955-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1c415760996a4973a0e827f3da988200", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfda4f53d-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:07:34.734741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Releasing lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:07:34.736011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63edc484-aa3e-404b-a7e5-fd8d2a161a4e tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 202 len: 0 microversion: 2.1 time: 3.269117 Oct 18 16:07:34.740889 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 840/1698] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:31 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 0 bytes in 3274 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 18 16:07:34.747180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eaf94f76-24c2-48a0-9707-ef0ecfacf2c7 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '.version_select at 0x7f5fd241c040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.750996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaf94f76-24c2-48a0-9707-ef0ecfacf2c7 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.751322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaf94f76-24c2-48a0-9707-ef0ecfacf2c7 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.751968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaf94f76-24c2-48a0-9707-ef0ecfacf2c7 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.764109 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eaf94f76-24c2-48a0-9707-ef0ecfacf2c7 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3047 microversion: 2.25 time: 0.020763 Oct 18 16:07:34.773816 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 841/1699] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/os-migrations => generated 3047 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:34.779695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a22cd92-da5e-4ca5-9f8d-ba9def855093 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '.version_select at 0x7f5fd64dbdc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.827945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.840492 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6068c505-3262-4707-8ed5-8e52a3fc24d3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.177558 Oct 18 16:07:34.841130 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 859/1700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:34.845902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.846519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:34.855998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.856627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.857221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.858131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.858925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.859620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.994316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:35.008211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f113800-6397-41f3-a801-6ef11d873670 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 2424 microversion: 2.25 time: 0.165930 Oct 18 16:07:35.021200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 860/1701] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 2424 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:35.029110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.029929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.036555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.037208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.037760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.038588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.039661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.040182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.202864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:35.212170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2fce4c23-6145-4fc3-bc91-a99c5ae6c09a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.188487 Oct 18 16:07:35.212869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 861/1702] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:35.217268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16e3344c-836d-44ce-bdc2-b363dcc80cf7 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd2238a60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.264843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16e3344c-836d-44ce-bdc2-b363dcc80cf7 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.050931 Oct 18 16:07:35.265459 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 862/1703] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:35.269955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.271181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.278638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.279089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.279807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.280657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.281393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.281893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.432394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:35.448189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b55d44d-c4b0-4983-9007-a8e3a9cbacac tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 2424 microversion: 2.25 time: 0.181780 Oct 18 16:07:35.463611 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 863/1704] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 2424 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:07:35.473805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.475323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.483523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.484031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.484518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.485331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.485784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.486224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.640635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:35.649085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72d2b919-3f6a-4cf0-ba0f-f4065c86a984 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.186017 Oct 18 16:07:35.649679 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 864/1705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:35.649887 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a22cd92-da5e-4ca5-9f8d-ba9def855093 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/876aee5e-46d9-4b6a-98de-95ed966cab32" status: 202 len: 0 microversion: 2.1 time: 0.874306 Oct 18 16:07:35.650491 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 842/1706] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:07:34 2022] DELETE /compute/v2.1/os-floating-ips/876aee5e-46d9-4b6a-98de-95ed966cab32 => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:07:35.654266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.654879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.656075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.657052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.661444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.661933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.662370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.663200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.663924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.664310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.665057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.665547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.665991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.666818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.667284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.667710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.798398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:35.801143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'services' on Instance uuid 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:35.807214 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8fa1b46-ca33-4617-9e1d-e40639f117f3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.156572 Oct 18 16:07:35.807899 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 865/1707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:35.812420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce743afa-9c34-4cbb-ade5-5adf5c77ce45 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce743afa-9c34-4cbb-ade5-5adf5c77ce45 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Request method failure captured: Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action HTTP/1.1 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 34 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8ah2j_xy2AVx3ikzwJzzzGc_OcfiV6BZGBEn5BdjttNtHe6V_YkZCma0rWjvpOKhq-bZd28hk2YIZqWRAFr4hPcHoUK1xkWK8eyfR-VY7OHDThoetXo_XOXfS7tWIaT55QTQFvQzmIvRCkpwq65sPjuSpd5wYCtAmOq2GnhF2vta0 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:07:35.816355 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c415760996a4973a0e827f3da988200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c415760996a4973a0e827f3da988200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}] Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 65e262effe18496cbc3541d8b7ceedd7 Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: {"addFloatingIp": {"address": ""}} Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:07:35.817888 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5e226031-0ad3-409c-9aa5-572c02367830', 'body': {'addFloatingIp': {'address': ''}}} Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '' Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:35.818821 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:07:35.821297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:07:35.822790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 16:07:35.822790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.822790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce743afa-9c34-4cbb-ade5-5adf5c77ce45 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:35.822790 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce743afa-9c34-4cbb-ade5-5adf5c77ce45 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 400 len: 142 microversion: 2.1 time: 0.008989 Oct 18 16:07:35.822790 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 866/1708] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:35 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 142 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:07:35.828793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:35.831303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.838592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.839164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.839662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.840368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.840824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.841278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.866091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:07:35.866491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquired lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:07:35.916506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-924d9c7d-2cf4-4987-a35b-26822ff5779e tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments/35fde538-4c48-4196-9420-c430e1fdb173" status: 202 len: 0 microversion: 2.25 time: 0.264185 Oct 18 16:07:35.917389 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 843/1709] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Oct 18 16:07:35 2022] DELETE /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments/35fde538-4c48-4196-9420-c430e1fdb173 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:35.922530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.923232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.931297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.932030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.933085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.934424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.935310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.935973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.972190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Releasing lock "refresh_cache-5e226031-0ad3-409c-9aa5-572c02367830" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:07:35.972879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] HTTP exception thrown: floating IP not found Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Request method failure captured: Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action HTTP/1.1 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 41 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8ah2j_xy2AVx3ikzwJzzzGc_OcfiV6BZGBEn5BdjttNtHe6V_YkZCma0rWjvpOKhq-bZd28hk2YIZqWRAFr4hPcHoUK1xkWK8eyfR-VY7OHDThoetXo_XOXfS7tWIaT55QTQFvQzmIvRCkpwq65sPjuSpd5wYCtAmOq2GnhF2vta0 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:07:35.976677 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c415760996a4973a0e827f3da988200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c415760996a4973a0e827f3da988200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}] Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 65e262effe18496cbc3541d8b7ceedd7 Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:07:35.978586 n-d-858383-14 devstack@n-api.service[120570]: exception: floating IP not found Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5e226031-0ad3-409c-9aa5-572c02367830', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:35.979759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 18 16:07:35.981118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:35.982553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Returning 404 to user: floating IP not found {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:35.982553 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eccf86ba-a15b-4538-a718-042918153236 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 404 len: 67 microversion: 2.1 time: 0.153390 Oct 18 16:07:35.985273 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 867/1710] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:35 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 67 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:07:35.990353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.993411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.999395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.999870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.000303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.001002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.001494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.001913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.039096 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b43ec6af-0a4f-48e1-9c74-2f6dd88472b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052159 Oct 18 16:07:36.039680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 868/1711] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:36.044374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2862e15-f3d7-499b-b6e5-2b710d563c18 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Action: 'action', calling method: .version_select at 0x7f5fd3ed4a60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:36.085448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.091966 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a2862e15-f3d7-499b-b6e5-2b710d563c18 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2862e15-f3d7-499b-b6e5-2b710d563c18 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Request method failure captured: Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action HTTP/1.1 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 44 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8ah2j_xy2AVx3ikzwJzzzGc_OcfiV6BZGBEn5BdjttNtHe6V_YkZCma0rWjvpOKhq-bZd28hk2YIZqWRAFr4hPcHoUK1xkWK8eyfR-VY7OHDThoetXo_XOXfS7tWIaT55QTQFvQzmIvRCkpwq65sPjuSpd5wYCtAmOq2GnhF2vta0 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:07:36.093582 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c415760996a4973a0e827f3da988200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c415760996a4973a0e827f3da988200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}] Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 65e262effe18496cbc3541d8b7ceedd7 Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:07:36.095280 n-d-858383-14 devstack@n-api.service[120570]: exception: Floating IP not found for address 0.0.0.0. Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5e226031-0ad3-409c-9aa5-572c02367830', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:36.096229 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 18 16:07:36.097581 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:36.099241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4452faa8-4c92-40bf-9dd8-8bd79f533083 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1308 microversion: 2.1 time: 0.175326 Oct 18 16:07:36.099344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2862e15-f3d7-499b-b6e5-2b710d563c18 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:36.099450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 844/1712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:36.100360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2862e15-f3d7-499b-b6e5-2b710d563c18 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action" status: 404 len: 88 microversion: 2.1 time: 0.054374 Oct 18 16:07:36.101504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 869/1713] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:36 2022] POST /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830/action => generated 88 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:07:36.110710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.111277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.117896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.118375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.118813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.119499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.119949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.120370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.145061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:07:36.178436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:36.222659 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d7d08db-278d-4312-8472-60a4eb05341c tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 204 len: 0 microversion: 2.1 time: 0.115458 Oct 18 16:07:36.223233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 845/1714] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:07:36 2022] DELETE /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:07:36.232650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.233294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.234903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.235612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.240301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.240781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.241258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.242675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.243082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.243191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.243609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.243728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.244001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.244698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.245185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.245609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.375433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.383582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.384520 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-854d0182-b041-4285-82da-c03906a42781 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1543 microversion: 2.1 time: 0.156478 Oct 18 16:07:36.385322 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 870/1715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1543 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:36.389610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72a2b765-7fbc-477b-919c-fbf0042463aa tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd26e8e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.391734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0871ad0-d2f5-4f7e-9248-01e986145c98 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.160882 Oct 18 16:07:36.392456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 846/1716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:36.448593 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72a2b765-7fbc-477b-919c-fbf0042463aa tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.062324 Oct 18 16:07:36.449771 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 871/1717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:36.671696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.672416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.679226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.680146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.680626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.681361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.681811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.682237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.817314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.825559 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-669558e2-abb7-4b6b-b300-e6e33a0c29fd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.157708 Oct 18 16:07:36.826149 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 847/1718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:36.836932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.837839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.843860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.844337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.844771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.845517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.845969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.846390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.982436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.994263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca839e4a-aead-4d39-b442-0e88ada4352f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.162249 Oct 18 16:07:36.995224 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 872/1719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:37.051934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.054209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.061165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.061650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.062091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.062783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.063239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.063674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.094612 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c46af8f-479a-4450-b911-ab6d6e67c3fe tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046632 Oct 18 16:07:37.095190 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 848/1720] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:37.117997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.118670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.124767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.125319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.125760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.126511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.126969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.127397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.293750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:37.301477 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46442bcb-cf1e-435f-8637-8a7ae8e36d1a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1489 microversion: 2.1 time: 0.187918 Oct 18 16:07:37.302064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 873/1721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1489 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:37.325065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1985379552"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:37.327319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.333252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.333733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.334466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.335804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.335804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.336607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.409646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.410436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.416977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.417487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.417923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.418612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.419063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.419544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.543485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc37d3ba-4910-4354-a834-f66cc7026071 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "POST /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68/action" status: 202 len: 0 microversion: 2.1 time: 0.222968 Oct 18 16:07:37.544136 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 849/1722] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:37 2022] POST /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:07:37.549384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.550077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.556787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.557297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.557604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:37.558072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.558486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.558942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.559369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.565305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f85687df-dd3f-46ee-a325-2445ab6265fb tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1543 microversion: 2.1 time: 0.159477 Oct 18 16:07:37.570851 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 874/1723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1543 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:37.571129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bde4473-d61f-459b-b9e9-fa642294ab3e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20ed430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.614932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bde4473-d61f-459b-b9e9-fa642294ab3e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.047720 Oct 18 16:07:37.615518 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 875/1724] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:37.620542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afe05d4c-54a5-4386-b3ef-397b859bc680 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd1fb4ee0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.669872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afe05d4c-54a5-4386-b3ef-397b859bc680 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8" status: 200 len: 1412 microversion: 2.1 time: 0.053049 Oct 18 16:07:37.670635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 876/1725] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:37.684185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6e65556-a5dc-49e9-91dc-eb0f55344f08 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd1fb2f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.708215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:37.718186 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08b01ba3-ec2a-463c-a434-a2606b56a017 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.172732 Oct 18 16:07:37.718608 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 850/1726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:37.729364 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6e65556-a5dc-49e9-91dc-eb0f55344f08 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8" status: 200 len: 1412 microversion: 2.1 time: 0.048578 Oct 18 16:07:37.739177 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 877/1727] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 => generated 1412 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:37.746134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1e5ed15-498e-4340-893f-a0491387b82c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64219d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.853507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.855092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.867548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.868234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.868572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.869377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.869866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.870734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.912980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1e5ed15-498e-4340-893f-a0491387b82c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8" status: 204 len: 0 microversion: 2.1 time: 0.171650 Oct 18 16:07:37.913775 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 851/1728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] DELETE /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:37.922286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e2304a1-c43d-4773-a74e-ecb4a567f011 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd6527940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.942779 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8e2304a1-c43d-4773-a74e-ecb4a567f011 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e2304a1-c43d-4773-a74e-ecb4a567f011 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 HTTP/1.1 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:07:37.945264 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '23e691ac-2f15-4a2c-a338-b14f4a4dbfa8'} Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:37.947063 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 Oct 18 16:07:37.948186 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:07:37.950477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 could not be found. Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:07:37.953096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e2304a1-c43d-4773-a74e-ecb4a567f011 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:37.954777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e2304a1-c43d-4773-a74e-ecb4a567f011 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8" status: 404 len: 62 microversion: 2.1 time: 0.028390 Oct 18 16:07:37.956158 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 852/1729] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:07:37.956158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.956158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.962982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.963471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.963909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.964609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.965113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.965535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.010689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:38.019260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c0947e4-833a-42d5-92b3-e1ddb8534ee9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.173499 Oct 18 16:07:38.019839 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 878/1730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:38.025851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:38.026671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:38.029921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:38.034542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.035405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.035851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.036778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.037272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.037701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.113270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:38.121351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51669149-13c2-4fad-adc7-d20c68d49aae tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1501 microversion: 2.1 time: 0.169815 Oct 18 16:07:38.125423 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 853/1731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:38.130333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:38.133423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:38.140119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.140733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.141273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.142287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.142946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.143383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.176426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ea0ecf4-c52f-4603-b4d6-2d1d8b26f6a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049803 Oct 18 16:07:38.177029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 854/1732] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:38 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:38.183032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:38.185380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:38.193080 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc587235-871d-4073-94f5-8421057b8e7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.171979 Oct 18 16:07:38.193750 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 879/1733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:38 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:38.588817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:38.589718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:38.596437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.596922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.597637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.598409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.598870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.599337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.633700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4298409a-461f-4a37-99bc-a21535ad5eed tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd657d4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:38.697091 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4298409a-461f-4a37-99bc-a21535ad5eed tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.069752 Oct 18 16:07:38.702352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 880/1734] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:38 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:38.713469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-plugged", "status": "completed", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:38.727400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.728178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.729608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.743056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] Creating event network-vif-plugged:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:07:38.748976 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-833f6136-d826-461f-a343-56c7a4beb1c6 req-40899fd2-2940-4eac-807b-83720b1e7fb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045034 Oct 18 16:07:38.750119 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 881/1735] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:38.772811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:38.775031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:38.776914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:38.784714 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ea56740-15b7-4220-81e1-6d0cea79305b tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1543 microversion: 2.1 time: 0.199222 Oct 18 16:07:38.786276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.786766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.787203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.787341 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 855/1736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:38 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1543 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:38.788688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:38.789348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:38.789941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:38.963222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:38.973274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdd84133-0065-49ec-84c2-7628a02421e9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.221647 Oct 18 16:07:38.973954 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 882/1737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:38 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:39.045450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.046179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.056050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.056681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.057436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.058600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.059306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.059881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.150283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.150954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.157420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.157899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.158342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.159132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.159775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.160371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.280726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:39.289911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afe24283-de96-412d-b384-e7c922ab4728 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1363 microversion: 2.1 time: 0.249318 Oct 18 16:07:39.292953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 856/1738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:39.301148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.303693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.320529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:39.324032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.330556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ed6d57a-4dae-4249-86c3-72cc2ac4a110 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1501 microversion: 2.1 time: 0.184390 Oct 18 16:07:39.331142 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 883/1739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:39.336539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.337183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.337716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.338167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.338897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.339354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.339777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.343573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.344078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.344522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.345256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.345858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.346297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.381478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fde55a3-efc0-4a2c-9035-bf3c5fad33c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084011 Oct 18 16:07:39.387089 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 857/1740] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:39.502829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:39.512473 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6bda83c4-50e6-46c3-be1c-955768c88b6d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.180276 Oct 18 16:07:39.526601 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 884/1741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:39.593620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e226031-0ad3-409c-9aa5-572c02367830", "name": "network-vif-deleted", "tag": "fda4f53d-b983-490e-9e39-40f5cdbf8c4d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:39.607189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.607811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.608338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.623413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] Creating event network-vif-deleted:fda4f53d-b983-490e-9e39-40f5cdbf8c4d for instance 5e226031-0ad3-409c-9aa5-572c02367830 on n-h1-858383-14 Oct 18 16:07:39.633504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-64b7d33a-4208-4461-b6ad-1b48411f1042 req-13c86a16-b3d8-4799-981c-c866e3724ec5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044813 Oct 18 16:07:39.635022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 858/1742] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:39.714832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b26fda42-27ca-43aa-953d-c7b2240b9952 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd26e8ee0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.793248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b26fda42-27ca-43aa-953d-c7b2240b9952 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.084970 Oct 18 16:07:39.802892 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 885/1743] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:39.817094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.818697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.826258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.827018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.827693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.829282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.829809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.830458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.876345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.877122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.877786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.878458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lazy-loading 'fault' on Instance uuid 5e226031-0ad3-409c-9aa5-572c02367830 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:39.952071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:39.952426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:39.954998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:39.961513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad00aa00-f1f3-42ec-8a4b-e2e23fc4b86a tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1322 microversion: 2.1 time: 0.151433 Oct 18 16:07:39.963279 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 859/1744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:39.989963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.990465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.990912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:39.991635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:39.992365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:39.992932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.000117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.001194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.009621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.010344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.010801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.011689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.012232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.012704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.036979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:07:40.184697 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5315b5e-7331-41b3-94e0-0e3c205e7e5e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "DELETE /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 204 len: 0 microversion: 2.1 time: 0.240757 Oct 18 16:07:40.185707 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 886/1745] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:07:39 2022] DELETE /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:40.197146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.198169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.204887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.205717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.206740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.207967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.208656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.209377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.229227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:40.239003 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5fd65b41-8a51-40a8-8cb2-21d65399a1fb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.244298 Oct 18 16:07:40.239926 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 860/1746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:39 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:40.319225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.321514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.328299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.329204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.329866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.330804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.331526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.332176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.481700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:40.489677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c38af8d-9418-4b38-af2b-1b79a15168cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1550 microversion: 2.1 time: 0.174211 Oct 18 16:07:40.490248 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 861/1747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:40.495703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.496535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.503529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.504178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.504782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.505733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.506385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.507137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.560300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:40.569135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2541007c-762d-486f-99c2-64010118680b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1666 microversion: 2.1 time: 0.378016 Oct 18 16:07:40.570516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 887/1748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1666 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:40.581990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.584565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.591613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.592286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.592924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.593878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.594370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.594882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.628857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a5b1153-221d-43fe-8ca4-dd2b1a6094f6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051522 Oct 18 16:07:40.634432 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 888/1749] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:40.634808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.635308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.641126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.641613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.642044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.642734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.643184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.643604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.660462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:40.667127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:40.669808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16e52598-d22a-4fb4-baa1-ce019cfbe24f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1501 microversion: 2.1 time: 0.178409 Oct 18 16:07:40.673114 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 862/1750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:40.675418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.676031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.683383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.683878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.686209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.686209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.686209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.686209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.732000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62ac46ca-cbe1-44fe-bfae-d56fcb3ec594 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101453 Oct 18 16:07:40.732770 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 889/1751] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:40.785300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a192fb0b-72e9-4208-a1bd-2306f5cfc96b", "name": "network-vif-plugged", "status": "completed", "tag": "52334bcf-eb3f-4076-9742-38fa03058235"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:40.796670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.797553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.798243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.817494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] Creating event network-vif-plugged:52334bcf-eb3f-4076-9742-38fa03058235 for instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b on n-h2-858383-14 Oct 18 16:07:40.824270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-dc5c83ad-5282-4f34-b454-7644f8451d00 req-656cb5b0-b42c-4b85-918e-3ec44e36758a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042229 Oct 18 16:07:40.825640 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 890/1752] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:40.832274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e73f748-2591-44cc-90dc-8cbc66ae9dac tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1fb24c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.867361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:40.873970 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ab3e3cb-71b0-4cf5-8d3d-5bdea9deff23 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.201950 Oct 18 16:07:40.875669 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 863/1753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:40.902650 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e73f748-2591-44cc-90dc-8cbc66ae9dac tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.075284 Oct 18 16:07:40.903437 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 891/1754] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:40.986681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:40.987510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:40.995746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.996369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.996814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:40.997590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:40.998039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:40.998461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.032496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.032971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.033427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.033870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lazy-loading 'fault' on Instance uuid 5e226031-0ad3-409c-9aa5-572c02367830 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:41.091071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:41.099194 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23d26eb2-0498-43f9-b29c-b446726ddba3 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1322 microversion: 2.1 time: 0.116490 Oct 18 16:07:41.108771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 864/1755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:40 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1322 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:41.262590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.263884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.273691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.274504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.275183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.276181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.276863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.277539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.575628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:41.587556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5e26367-0c44-48ba-a90e-3851d226021d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.330227 Oct 18 16:07:41.588643 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 892/1756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:41.608290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.609653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.616070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.616885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.617590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.618537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.619215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.619860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.642694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.645688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.653964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.654188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.654671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.655529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.655997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.656489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.698121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5324e152-3e35-476d-adb4-07b9dfdf888d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059891 Oct 18 16:07:41.702782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 893/1757] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:07:41.703806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.704451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.712114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.712724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.713194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.714084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.714546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.714973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.828680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:41.840516 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2184fd5-dc17-4d1b-979a-19414ccac972 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1666 microversion: 2.1 time: 0.241796 Oct 18 16:07:41.841782 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 865/1758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:41.904451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.907749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.919009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.921417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.923183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.924458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.925378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.926263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.021010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:42.029785 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0121f040-7eff-4a4b-8d71-2d3c12c06fb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1507 microversion: 2.1 time: 0.329521 Oct 18 16:07:42.036276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 894/1759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:42.043124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87d8cce4-df0f-4635-8394-45dc1d9cf08b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd2a144c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:42.123009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:42.134434 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87d8cce4-df0f-4635-8394-45dc1d9cf08b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.096706 Oct 18 16:07:42.134790 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-052e9d9d-793c-4af8-baeb-b79a3df18c59 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.236357 Oct 18 16:07:42.142352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 895/1760] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:42 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:42.142819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:42.143843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:42.144972 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 866/1761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:42.156946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.157224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.157526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.162148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.162641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.163081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.211450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.212818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.213533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.214180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lazy-loading 'fault' on Instance uuid 5e226031-0ad3-409c-9aa5-572c02367830 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:42.400191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e262effe18496cbc3541d8b7ceedd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c415760996a4973a0e827f3da988200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:42.409754 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a2f348a-7eb8-4c83-905d-4676f1108f76 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 200 len: 1322 microversion: 2.1 time: 0.273655 Oct 18 16:07:42.431840 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 896/1762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:42 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:42.616428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:42.617753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:42.631378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.636773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.637512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.640193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.640888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.642533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.711531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:42.719937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:42.737820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.741947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.742687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.743528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.744118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.745511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.829295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-880b58b6-4db3-4dda-a416-414566c32979 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122414 Oct 18 16:07:42.838982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 897/1763] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:42 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:42.852001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea765be0-6de8-49ee-9575-a167c38fcbca", "name": "network-vif-plugged", "status": "completed", "tag": "57c5b00d-5992-4e55-9b6d-82d86bc3a75b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:42.879798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.880524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.884895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.913252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] Creating event network-vif-plugged:57c5b00d-5992-4e55-9b6d-82d86bc3a75b for instance ea765be0-6de8-49ee-9575-a167c38fcbca on n-h2-858383-14 Oct 18 16:07:42.924451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-18a9e56a-b258-4b98-a7c8-1679d708efdd req-113c3a46-d09c-47f5-ae62-81853ab230b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079618 Oct 18 16:07:42.929782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 898/1764] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:07:42.939064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:42.940935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:42.964107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.964763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.965462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:42.966268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:42.967148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:42.967678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.404206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:43.420559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10491476-21ea-4972-ab16-7abe9aa78f83 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1666 microversion: 2.1 time: 0.488515 Oct 18 16:07:43.434504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 899/1765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:42 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1666 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:43.456361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:43.482731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:43.486426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.488376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.489984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.495797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52b9b856-06e3-4211-82ab-a105e5ccfda4 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.885134 Oct 18 16:07:43.500031 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 867/1766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:42 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:43.511072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:43.514595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:43.530793 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] Creating event network-changed:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:07:43.534872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.539356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.540443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.545485 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-55313ec2-dfd2-42cf-919c-e9f6376bbc9c req-b51cbb79-69ea-4f65-a6e1-7420589db694 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098368 Oct 18 16:07:43.547507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.547943 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 900/1767] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:43.549264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.550948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.562145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b979f92-fd16-42db-bba0-2e7f36f7970a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd65849d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:43.693229 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b979f92-fd16-42db-bba0-2e7f36f7970a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.143694 Oct 18 16:07:43.694114 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 901/1768] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:43 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:43.704277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:43.707555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:43.723228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.723920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.724456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.732478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.733260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.733921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.790036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:44.150389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:44.159656 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c701f191-1abd-41ac-ba34-fd12f9a5d85f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.463968 Oct 18 16:07:44.161248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 902/1769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:43 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:44.168129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:44.169470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] [instance: 5e226031-0ad3-409c-9aa5-572c02367830] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:44.178868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.179603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.180226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.181268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.181894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.182324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.208723 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] HTTP exception thrown: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Request method failure captured: Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 HTTP/1.1 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8ah2j_xy2AVx3ikzwJzzzGc_OcfiV6BZGBEn5BdjttNtHe6V_YkZCma0rWjvpOKhq-bZd28hk2YIZqWRAFr4hPcHoUK1xkWK8eyfR-VY7OHDThoetXo_XOXfS7tWIaT55QTQFvQzmIvRCkpwq65sPjuSpd5wYCtAmOq2GnhF2vta0 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:07:44.212524 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c415760996a4973a0e827f3da988200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c415760996a4973a0e827f3da988200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c415760996a4973a0e827f3da988200"}]}] Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1c415760996a4973a0e827f3da988200 Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951 Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 65e262effe18496cbc3541d8b7ceedd7 Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:07:44.214392 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5e226031-0ad3-409c-9aa5-572c02367830'} Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:44.215312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. Oct 18 16:07:44.217063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:44.218618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] Returning 404 to user: Instance 5e226031-0ad3-409c-9aa5-572c02367830 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:44.218618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d5565b3-c73e-4ad0-94cc-30dded7cd2a5 tempest-FloatingIPsAssociationNegativeTestJSON-808807951 tempest-FloatingIPsAssociationNegativeTestJSON-808807951-project] 10.222.0.78 "GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830" status: 404 len: 111 microversion: 2.1 time: 0.052174 Oct 18 16:07:44.218618 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 903/1770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:44 2022] GET /compute/v2.1/servers/5e226031-0ad3-409c-9aa5-572c02367830 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:07:44.239907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:44.245497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:44.255570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.256276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.257452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.258446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.259068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.259700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.301559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f1b07c0-3251-4074-b830-525e2581f4c3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.084247 Oct 18 16:07:44.302498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 904/1771] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:07:44 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:44.452673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:44.453285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:44.462841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.466822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.467641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.468412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.471612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.472300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.640542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:44.648427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdb3d485-ce16-400a-8ebd-7f1019b0f14e tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1599 microversion: 2.1 time: 0.200264 Oct 18 16:07:44.649248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 905/1772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:44 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:44.667422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:44.668056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:44.692884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.693381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.693852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.704712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.705268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.705834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.982274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:44.998405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-162ec6d1-1de0-484d-b2a7-b078ed4223af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1507 microversion: 2.1 time: 1.496776 Oct 18 16:07:45.005946 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 868/1773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:43 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1507 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:45.021384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f49ca91-1405-47c8-8382-b5b33ffeb91a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd19abaf0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:45.119278 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f49ca91-1405-47c8-8382-b5b33ffeb91a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.112007 Oct 18 16:07:45.120709 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 869/1774] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:45 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:45.185770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:45.187205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:45.208869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.212707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.213204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.214051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.214672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.215246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.408583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:45.415531 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e131397-e860-4d50-8292-6ec89e07c3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1318 microversion: 2.1 time: 0.765463 Oct 18 16:07:45.416187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 906/1775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:44 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1318 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:45.471842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f93a0b-c478-43db-859d-9ddf75183868", "name": "network-vif-deleted", "tag": "6b379bf8-19d8-40bf-b6e3-92fe60848383"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:45.512155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.512654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.535790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.599412 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] Creating event network-vif-deleted:6b379bf8-19d8-40bf-b6e3-92fe60848383 for instance 89f93a0b-c478-43db-859d-9ddf75183868 on n-h1-858383-14 Oct 18 16:07:45.614851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8982e420-faf2-499c-81c8-b4d575e8007d req-226ebaf3-a35a-4d21-ad14-cf47c8dbdc26 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169069 Oct 18 16:07:45.617952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 907/1776] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:45.676765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:45.677596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:45.687093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.688034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.688034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.688736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.689235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.689664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.829890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.830783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.831729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.833302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lazy-loading 'fault' on Instance uuid 89f93a0b-c478-43db-859d-9ddf75183868 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:45.908642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ff953364048d392e5adcdade2b256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95688716e1614719bab0f4850aa70b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:45.926614 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cd222bb-740e-4fa1-ae68-142471bd98ba tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 200 len: 1316 microversion: 2.1 time: 0.254453 Oct 18 16:07:45.931057 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 908/1777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:45 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:45.956712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:45.970528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5f5d085-75bb-4f60-af2a-6d8f0c95d63c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.789920 Oct 18 16:07:45.974509 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 870/1778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:45 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:46.036219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:46.036902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:46.049005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.049408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.050061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:46.051599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.052896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.053547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:46.145157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8c24365-7602-4199-b564-41566c470a5b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd20a1d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:46.271664 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8c24365-7602-4199-b564-41566c470a5b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1455 microversion: 2.1 time: 0.139817 Oct 18 16:07:46.281253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 871/1779] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:46 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:46.437937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:46.438676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:46.450649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.457721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.458849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:46.466297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.469630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.471199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:46.988709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:47.000869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55997a29-ef7b-417d-93d9-2d123e446d67 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1507 microversion: 2.1 time: 0.968729 Oct 18 16:07:47.037030 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 909/1780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:46 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1507 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:47.049686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:47.054843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] [instance: 89f93a0b-c478-43db-859d-9ddf75183868] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:47.078880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.079799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.080609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.087032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.091103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.091900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.149251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] HTTP exception thrown: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Request method failure captured: Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 HTTP/1.1 Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs7XhozoWT6pe7BqlPANNk8sUCGKMjj6b-rvuJputPYswxplI_p8HruOVF7Qo7RpvIXcMzuE6yOvY7szxJYSuwzxZkXyzjlHZIetlBFxBSs7QiSMCrqVMeXBIztemh6Lfk372QuJrHOhxIMJpeCkYZt4-itEBmeKsDUUYeWVsrzPtrE Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95688716e1614719bab0f4850aa70b2c Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestFqdnHostnames-1499202592 Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:07:47.153747 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95688716e1614719bab0f4850aa70b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95688716e1614719bab0f4850aa70b2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95688716e1614719bab0f4850aa70b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95688716e1614719bab0f4850aa70b2c"}]}] Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestFqdnHostnames-1499202592 Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95688716e1614719bab0f4850aa70b2c Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1499202592 Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestFqdnHostnames-1499202592-project Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e46ff953364048d392e5adcdade2b256 Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestFqdnHostnames-1499202592-project Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. Oct 18 16:07:47.155303 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '89f93a0b-c478-43db-859d-9ddf75183868'} Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:47.156255 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. Oct 18 16:07:47.158724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:07:47.161768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Returning 404 to user: Instance 89f93a0b-c478-43db-859d-9ddf75183868 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:47.161768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be39797e-c763-4e89-bd0c-0c0e87157f4b tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868" status: 404 len: 111 microversion: 2.1 time: 0.118875 Oct 18 16:07:47.161768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 910/1781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:47 2022] GET /compute/v2.1/servers/89f93a0b-c478-43db-859d-9ddf75183868 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:07:47.186948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:47.187594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:47.222067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.223153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:47.225961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.226665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.231812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.233502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.236793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41eefcb6-cdb2-475b-b72d-52763551bbec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1468 microversion: 2.1 time: 0.802588 Oct 18 16:07:47.237188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.254305 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 872/1782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:46 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1468 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:47.265472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c337938-5112-4160-8c1a-232e97330e91 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] Calling method '.version_select at 0x7f5fd2111ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:47.365489 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c337938-5112-4160-8c1a-232e97330e91 tempest-ServersTestFqdnHostnames-1499202592 tempest-ServersTestFqdnHostnames-1499202592-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519527623" status: 202 len: 0 microversion: 2.1 time: 0.104780 Oct 18 16:07:47.373251 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 873/1783] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:07:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519527623 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:07:47.412031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:47.412820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:47.437791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.442558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.458578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.459687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:47.470819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:47.472030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:48.513131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:48.521667 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d1a2df7e-1575-453b-b17a-2151ae92cccc tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 1.345442 Oct 18 16:07:48.522252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 911/1784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:47 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:48.532986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5dc318a0-a2d6-4f67-9eef-8e5da02b7157 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd279c4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:48.551981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:48.568486 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5fb7aab0-29ec-432f-8cfa-2f82d654586f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 200 len: 1468 microversion: 2.1 time: 1.193323 Oct 18 16:07:48.585213 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 874/1785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:47 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 1468 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:48.585213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421675d0-550a-4e64-99ca-b13a3c79fd68", "name": "network-vif-plugged", "status": "completed", "tag": "7bcd8b19-92ac-4700-9939-053c8c8526dc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:48.615039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:48.615560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:48.615992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:48.651049 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] Creating event network-vif-plugged:7bcd8b19-92ac-4700-9939-053c8c8526dc for instance 421675d0-550a-4e64-99ca-b13a3c79fd68 on n-h2-858383-14 Oct 18 16:07:48.664676 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0a266517-b34c-4b55-a475-c0cd728381f6 req-811b0e3e-a3cb-4787-8f83-1e9ba31200e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090591 Oct 18 16:07:48.670320 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 875/1786] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:48.682650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:48.686104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:48.725019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:48.727922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:48.729971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:48.730952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:48.733150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:48.737414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:49.145529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:49.156313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89f2a34a-14d2-4d18-8576-3691212cb595 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1502 microversion: 2.1 time: 0.484469 Oct 18 16:07:49.175274 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 876/1787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:48 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1502 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:49.190432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:49.209877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:49.212218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Searching by: {'reservation_id': 'r-yf2t4m5t', 'deleted': False, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:07:49.233464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:49.237258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:49.240884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:49.248888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:49.251980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:49.252481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:49.474952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:07:49.631464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:49.640313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:49.641196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:49.653820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.066426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7363486b-14cf-4f19-b517-86f8050e2ec7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-yf2t4m5t" status: 200 len: 2929 microversion: 2.1 time: 0.889549 Oct 18 16:07:50.067420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 877/1788] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 18 16:07:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yf2t4m5t => generated 2929 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:50.123399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:50.126844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:50.141303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:50.145824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:50.150453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.151274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:50.151934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:50.152376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.743222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:50.771535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f85d8bfb-326b-4fc9-b1b6-a2c32df20a11 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.675888 Oct 18 16:07:50.772136 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 878/1789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:50 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:50.815148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:50.915962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_groups [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Querying cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) for 2 instances {{(pid=120571) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 16:07:50.917268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:50.917961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:50.918523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.988929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f1d3e10-48e9-47ea-ac4f-e75ff87740a1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/78da005f-bbb3-449d-a36b-e739ec0e46f8" status: 200 len: 265 microversion: 2.1 time: 0.186996 Oct 18 16:07:50.990023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 879/1790] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:07:50 2022] GET /compute/v2.1/os-server-groups/78da005f-bbb3-449d-a36b-e739ec0e46f8 => generated 265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:50.999752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:51.001734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:51.016393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:51.020006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.026006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.026847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.027869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.028592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.029310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.383739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:51.396460 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d0139e1-cb04-4fd3-81a5-d68676c3d568 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1502 microversion: 2.1 time: 0.405254 Oct 18 16:07:51.398961 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 880/1791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:50 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:51.410816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:51.411430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:51.448054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.451152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.455007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.455007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.455007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.455526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:52.778300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-79dd110b-da7c-478c-a1b6-15fd97633798 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 200 len: 1621 microversion: 2.1 time: 1.377840 Oct 18 16:07:52.798529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 881/1792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:51 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 1621 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:52.805322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:52.807153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:52.827701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:52.829647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:52.831247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:52.832411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:52.834492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:52.835906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:52.888624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:53.956067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:53.971854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc95322f-d6d4-4f63-a295-6f629e233657 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 1.170226 Oct 18 16:07:53.974469 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 882/1793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:52 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:53.984500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:53.985559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:53.995891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:53.996692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:53.997351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:53.998135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:53.998944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:53.999715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:54.766356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:54.782444 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52a2795c-57b9-454f-a470-790e28f6713a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1502 microversion: 2.1 time: 0.804387 Oct 18 16:07:54.786328 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 883/1794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:53 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1502 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:54.796685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:54.797751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:54.818190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:54.820001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:54.822362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:54.825091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:54.827600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:54.830135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:55.315521 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63feb26e-907a-4b26-b2cc-510574850631 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 200 len: 1621 microversion: 2.1 time: 0.526092 Oct 18 16:07:55.329055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 884/1795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:54 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 1621 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:55.363405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:55.364421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:55.376058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:55.377115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:55.378069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:55.379345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:55.379972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:55.380572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:55.944756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:55.960508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d22523db-2386-4bba-8021-70adf5d5ec29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.636707 Oct 18 16:07:55.967123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 885/1796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:55 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:55.977993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: .version_select at 0x7f5fd19aae50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2018323471", "policies": ["anti-affinity"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:56.049686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:56.070970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:56.188806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:56.208776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:56.250098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13a41cd0-5663-4a8e-bfbf-8cf71a7eac13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.281804 Oct 18 16:07:56.254382 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 886/1797] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:07:55 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:56.277272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:56.280851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:56.290797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:56.293486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:56.294832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:56.300185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:56.300899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:56.302786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:56.558910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:56.574734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e278887e-cac6-4ccb-8564-209704eb909b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1502 microversion: 2.1 time: 0.317203 Oct 18 16:07:56.575896 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 887/1798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:56 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:56.915397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3124c6d-93ee-4cc3-b3b9-8dfe73f3a3a1 tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] Calling method '.version_select at 0x7f5fd18c3670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:57.218732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:58.521567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=47 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:59.366739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:03.753736 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5dc318a0-a2d6-4f67-9eef-8e5da02b7157 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1464 microversion: 2.1 time: 15.230126 Oct 18 16:08:03.754522 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 912/1799] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:48 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1464 bytes in 15232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:03.767407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-766521442", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8dd23bdc-168a-4a69-9366-6a4accc85d13"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:03.771383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3124c6d-93ee-4cc3-b3b9-8dfe73f3a3a1 tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] 10.222.0.78 "GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce" status: 200 len: 784 microversion: 2.1 time: 7.193738 Oct 18 16:08:03.785405 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 888/1800] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:56 2022] GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce => generated 784 bytes in 7209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:03.810867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:03.812448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:03.832799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:03.833619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:03.834469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:03.835573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:03.837569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:03.841421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:03.865587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:08:04.153259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:08:04.154117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:08:04.154397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:08:04.154768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:08:04.155367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:08:04.174560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.175378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.176015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.176955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.177849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.179089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.204827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:04.212045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:04.229359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 2 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:08:04.232040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:04.310427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:04.316701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:04.406615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:04.421196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:04.424043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:04.445496 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32f7f57e-3e10-4963-872c-8f307d160980 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.658567 Oct 18 16:08:04.447616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 889/1801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:03 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:04.456246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:04.457413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:04.458946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=53fff94e-a07e-4e96-8001-e765d4c2aab1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:04.467672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.468775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.470341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.471547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.472263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.473268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.568003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:04.578320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:04.642436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:04.653213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:04.721788 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9826b557-06f0-4043-892c-67dfb29900ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.959495 Oct 18 16:08:04.723150 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 913/1802] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:08:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:08:04.729282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6ce8be0-ebb3-4fa0-a616-68fea0cadd07 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd658b1f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:04.810204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6ce8be0-ebb3-4fa0-a616-68fea0cadd07 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 200 len: 1464 microversion: 2.1 time: 0.085529 Oct 18 16:08:04.812621 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 914/1803] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:04 2022] GET /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:04.818754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-033ec866-94d7-41a0-af74-11941a498be4 tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] Calling method '.version_select at 0x7f5fd658b940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:04.830690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:04.838779 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1fa5789e-c3cd-4f34-915b-d47562b4aa0d tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1489 microversion: 2.1 time: 0.389867 Oct 18 16:08:04.871307 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 890/1804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:04 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1489 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:04.882172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "name": "network-vif-unplugged", "status": "completed", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:04.902234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.902724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.907031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.937801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] Creating event network-vif-unplugged:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h2-858383-14 Oct 18 16:08:04.951091 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-699e9820-9d28-4cf7-a5fc-5c291b6c5d70 req-57ae39df-0f1f-4906-af15-37aa9f16babb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078398 Oct 18 16:08:04.952041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 891/1805] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:04.962623 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-033ec866-94d7-41a0-af74-11941a498be4 tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] 10.222.0.78 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.148611 Oct 18 16:08:04.964981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:04.972599 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 915/1806] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:04 2022] GET /compute/v2.1/images => generated 445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:04.979206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:04.979705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:04.980071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:04.980853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Searching by: {'deleted': False, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:08:04.988443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.988666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.988971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:04.989733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:04.990202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:04.990871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.016619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.021564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.021898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.023263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.023733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.024520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.091320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:08:05.165646 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5484e1ee-8b9a-4207-8e58-4c6571af58df tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.211959 Oct 18 16:08:05.170641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 892/1807] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:08:04 2022] GET /compute/v2.1/servers => generated 1662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:05.192312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:05.193306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:05.210025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.210494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.210899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.211633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.212094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.212570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.312279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:08:05.491100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea55c0de-19fa-49a3-b646-8061a3b1b9a6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 204 len: 0 microversion: 2.1 time: 0.304734 Oct 18 16:08:05.493207 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 893/1808] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:05 2022] DELETE /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:05.508019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cdca90c4-8226-45d4-a45c-9ea197506a7f tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] Calling method '.version_select at 0x7f5fd64dba60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:05.615316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cdca90c4-8226-45d4-a45c-9ea197506a7f tempest-ListImagesTestJSON-1095582375 tempest-ListImagesTestJSON-1095582375-project] 10.222.0.78 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.120767 Oct 18 16:08:05.615969 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 894/1809] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:08:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:05.632616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a28dc54-5974-460e-b067-5493cf79a760 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:05.633527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5a28dc54-5974-460e-b067-5493cf79a760 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:05.853071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a28dc54-5974-460e-b067-5493cf79a760 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:05.864278 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a28dc54-5974-460e-b067-5493cf79a760 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1218 microversion: 2.1 time: 0.246092 Oct 18 16:08:05.866706 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 895/1810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:05 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:05.885178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:05.886183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:05.906199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:05.908288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.911468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.916518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.918182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:05.918827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:05.921789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:05.926805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfcb5bf4-9ced-41cc-8134-44c4ffe01a81 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1467 microversion: 2.1 time: 0.953053 Oct 18 16:08:05.941269 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 916/1811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:04 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1467 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:05.952037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6ad9de0-a8d1-42c8-a83f-0e1ae920db53 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd657d430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:05.998044 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f6ad9de0-a8d1-42c8-a83f-0e1ae920db53 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6ad9de0-a8d1-42c8-a83f-0e1ae920db53 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 HTTP/1.1 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:08:06.002312 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '23e691ac-2f15-4a2c-a338-b14f4a4dbfa8'} Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:06.004122 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 to delete Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.005494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 could not be found. Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:06.007467 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6ad9de0-a8d1-42c8-a83f-0e1ae920db53 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6ad9de0-a8d1-42c8-a83f-0e1ae920db53 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8" status: 404 len: 62 microversion: 2.1 time: 0.061547 Oct 18 16:08:06.011046 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 917/1812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:05 2022] DELETE /compute/v2.1/images/23e691ac-2f15-4a2c-a338-b14f4a4dbfa8 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:08:06.017949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-4797208"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:06.033889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:06.054815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.055329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.055780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.056507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.056982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.062403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.588638 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-797a87e6-3012-40c0-af51-2ce216ea8447 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "POST /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e/action" status: 202 len: 0 microversion: 2.1 time: 0.578290 Oct 18 16:08:06.589330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 918/1813] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:08:06 2022] POST /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:08:06.602217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:06.603154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:06.611577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.612325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.612911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.613816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.614432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.615016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.657285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:06.668947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f6f089a-8287-43f2-b89c-09648b190d8e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.800622 Oct 18 16:08:06.669584 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 896/1814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:05 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:06.674066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7d05d21-1b24-4ddf-ada2-0069470badcb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1865f70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:06.698970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:08:06.756879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7d05d21-1b24-4ddf-ada2-0069470badcb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.085325 Oct 18 16:08:06.759228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 897/1815] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:06 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:06.821215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Instance is already in deleting state, ignoring this request Oct 18 16:08:06.822625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f297d0a-c8ae-4b72-965e-7e782a314f5b tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 204 len: 0 microversion: 2.1 time: 0.226588 Oct 18 16:08:06.824093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 919/1816] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:06 2022] DELETE /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:06.831689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:06.832560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:06.848112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.848625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.849102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.850072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.851569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.852788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.888582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:06.889363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:06.898335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.898847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.899288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.900011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.900528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.900903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:07.092678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:07.107465 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-811db2b9-03b7-4df1-a447-4670af46268f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1222 microversion: 2.1 time: 0.222685 Oct 18 16:08:07.109726 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 920/1817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:06 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:07.135477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:07.173075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:07.184000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:07.184802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:07.226147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] Creating event network-changed:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h2-858383-14 Oct 18 16:08:07.232003 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c6871d58-4885-44ba-b909-29701492a0c7 req-9c47fa9f-4e53-4503-b09a-b014771ca259 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114127 Oct 18 16:08:07.233899 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 921/1818] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:07.267763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:07.279868 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fff669b2-6a44-409d-aa64-8f543819b648 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1495 microversion: 2.1 time: 0.452006 Oct 18 16:08:07.285409 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 898/1819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:06 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1495 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:07.596474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-unplugged", "status": "completed", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:07.646658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:07.647684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:07.648217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:07.683784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] Creating event network-vif-unplugged:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:08:07.696483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:07.697388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:07.708674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-275b1eef-906d-4c5f-930c-5382579bfd24 req-02fb9210-f2e1-49ca-a4a1-1947bebfd5b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112328 Oct 18 16:08:07.711263 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 922/1820] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:07.711721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:07.713379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:07.713983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:07.714860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:07.715927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:07.716600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:07.778942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12088545-9fde-457c-9821-cfea7bd5710f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd201cb80>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:07.920200 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12088545-9fde-457c-9821-cfea7bd5710f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.147851 Oct 18 16:08:07.930426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 923/1821] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:07 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:08.133039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:08.133944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:08.155790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:08.156302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:08.156736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:08.157496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:08.157951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:08.158381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:08.282421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:08.294846 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b24d6fb-9cda-4099-8177-e495c35afa0e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1270 microversion: 2.1 time: 0.167827 Oct 18 16:08:08.318128 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 924/1822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:08 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:08.336865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:08.338776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:08.357831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:08.358318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:08.358771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:08.359552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:08.363570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:08.363570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:08.537195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:08.557702 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-010add74-bb83-4e75-a003-c4153c162a7b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.864964 Oct 18 16:08:08.558716 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 899/1823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:07 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:08.629406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:08.643612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff021f52-1fe2-4766-bf23-98053b2cdbb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1495 microversion: 2.1 time: 0.322111 Oct 18 16:08:08.645022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 925/1824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:08 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1495 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:08.937895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25fcca56-c3f9-47e3-bdfd-c81ef95e789a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd18655e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:09.004890 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25fcca56-c3f9-47e3-bdfd-c81ef95e789a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.072340 Oct 18 16:08:09.016946 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 900/1825] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:08 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:09.321320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:09.323281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:09.338307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.338806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.339245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:09.339956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.347289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.347922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:09.481357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:09.490201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5813c0ca-9e43-4238-b5a6-981df159476c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1270 microversion: 2.1 time: 0.174461 Oct 18 16:08:09.512110 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 926/1826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:09 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:09.592928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:09.606295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:09.632787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.633642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.635095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:09.638819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.641866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.645100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:09.679671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:09.680728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:09.722528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.730228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.733014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:09.734632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:09.735460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:09.736967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:10.319300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:10.340668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f75f069-d2d6-4d48-af93-758e87a47972 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.758314 Oct 18 16:08:10.360846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 901/1827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:09 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:10.383899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421675d0-550a-4e64-99ca-b13a3c79fd68", "name": "network-vif-unplugged", "status": "completed", "tag": "7bcd8b19-92ac-4700-9939-053c8c8526dc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:10.409903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:10.410828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:10.411713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:10.443907 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] Creating event network-vif-unplugged:7bcd8b19-92ac-4700-9939-053c8c8526dc for instance 421675d0-550a-4e64-99ca-b13a3c79fd68 on n-h2-858383-14 Oct 18 16:08:10.458818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-493a29a1-5509-4f01-b545-f3d7db144166 req-d42e534d-89ad-4d81-99ea-daf290bf4f5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096505 Oct 18 16:08:10.461559 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 902/1828] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:10.478834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66b840af-39a8-4678-8992-9be0e253d334 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd18cef70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:10.554410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:10.569495 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66b840af-39a8-4678-8992-9be0e253d334 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.104552 Oct 18 16:08:10.571640 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 903/1829] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:10 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:10.580618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9add76a-50ea-4381-8add-a4c84df2b7eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1495 microversion: 2.1 time: 0.907704 Oct 18 16:08:10.582920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 927/1830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:09 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1495 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:10.584814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:10.586425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:10.608145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:10.609458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:10.609582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:10.610518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:10.614141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:10.616941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:10.941137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:10.971968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d62e2c1b-7b8e-45d8-af0b-97d7d1d49e88 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1270 microversion: 2.1 time: 0.398929 Oct 18 16:08:11.010950 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 904/1831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:10 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1270 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:11.386469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:11.387091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:11.418139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:11.422333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:11.429460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:11.430275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:11.430989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:11.431311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:11.817737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-789726143", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "235c5aca-4dc6-4f11-a4f7-844fb7eeb607"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:11.950808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] validate_networks() for [('235c5aca-4dc6-4f11-a4f7-844fb7eeb607', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:08:12.285697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:12.305843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc209d63-793b-46c6-b114-b5f24be38688 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.924239 Oct 18 16:08:12.306777 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 928/1832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:11 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:12.320536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a024e6b-7fb7-4a70-a700-3ba55d2e2610 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd201c430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:12.420643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a024e6b-7fb7-4a70-a700-3ba55d2e2610 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.112506 Oct 18 16:08:12.428390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 929/1833] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:12 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:12.428390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:12.432538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:12.454856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:12.456030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:12.457152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:12.462819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:12.463604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:12.464262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:12.879171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:12.903108 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7fd9d022-1cb9-4809-b361-ad7a6831f4eb tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1495 microversion: 2.1 time: 0.480348 Oct 18 16:08:12.910681 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 930/1834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:12 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1495 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:12.929934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:12.931361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:12.960488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:12.962492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:12.966933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:12.969878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:12.971419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:12.974516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:13.313329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:13.327686 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4db349c-40ab-4461-917c-03b238e0c0e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1276 microversion: 2.1 time: 0.414745 Oct 18 16:08:13.331119 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 931/1835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:12 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1276 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:13.339235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:13.340438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:13.348233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:13.349276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:13.351378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:13.352544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:13.357369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:13.358282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.190917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:14.379039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:14.400588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc4b2643-c785-4129-8a19-4e8159320800 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 1.063130 Oct 18 16:08:14.404372 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 932/1836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:13 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:14.419731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:08:14.420273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:08:14.420800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:08:14.421342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:08:14.421875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:08:14.427123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f98bd5ff-d299-4c1f-9d8b-3b3c5724a059 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1fb2dc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:14.444978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.451608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.452469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.458316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.461651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.463236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.516759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f98bd5ff-d299-4c1f-9d8b-3b3c5724a059 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.110867 Oct 18 16:08:14.529350 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 933/1837] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:14 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:14.551405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fff94e-a07e-4e96-8001-e765d4c2aab1", "tag": "0becb27d-d227-4e3c-98bf-51b87e0f6c42"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:14.556717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Getting quotas for project d2282f5ad29c4ff8b49ab1d29fdc4331. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:14.583179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Getting quotas for user be17681a7d5e42d1a134801c65fa65b0 and project d2282f5ad29c4ff8b49ab1d29fdc4331. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:14.588477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:14.597829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.604048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.605050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.661142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:08:14.666186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:14.681188 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] Creating event network-changed:0becb27d-d227-4e3c-98bf-51b87e0f6c42 for instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 on n-h1-858383-14 Oct 18 16:08:14.691057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=22 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:14.701322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-29648980-caf8-4b0d-b1c2-ebf0ecabe2d7 req-72ed4a6d-bb00-49bc-99e1-06b858f7ff9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168849 Oct 18 16:08:14.705327 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 934/1838] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:14.710745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:14.711596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:14.745092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.745601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.751033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.751881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.752366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.752812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.817643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:14.833777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01d45aa2-97ae-4cd0-8692-bb770a4bbdb4 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.328965 Oct 18 16:08:14.839057 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 905/1839] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:08:14.855553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.856074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.856520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.857002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lazy-loading 'fault' on Instance uuid 421675d0-550a-4e64-99ca-b13a3c79fd68 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:14.862394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:14.867828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:14.923008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.923516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.931196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.932037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:14.932532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:14.932973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:14.942787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:14.991030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffc4db9f1d64b4e864915e980af84f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2404823fb54cc2bcee162756e6ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:15.004967 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87f021bd-b184-48fd-8d9b-f7dd70cd62c1 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 200 len: 1298 microversion: 2.1 time: 0.298358 Oct 18 16:08:15.009735 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 935/1840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:14 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 1298 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:15.017818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385e121c-14e0-4739-8f89-0cd69ceb7b7e", "name": "network-vif-plugged", "status": "completed", "tag": "f447c56d-e7d3-4951-98af-dc5ebf3ba71a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:15.089417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:15.090305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:15.091260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:15.127264 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] Creating event network-vif-plugged:f447c56d-e7d3-4951-98af-dc5ebf3ba71a for instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e on n-h1-858383-14 Oct 18 16:08:15.141733 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b2af1737-5559-4c75-947b-803c70e02be4 req-516e6d58-7a1e-4058-974a-9582413bbed2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126895 Oct 18 16:08:15.142283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:15.143452 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 936/1841] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:15.151717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b8df6dbd-d63c-439d-a134-c4dd9467a81f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:15.152420 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2ae8c96-d20f-4a56-b50a-b45556d28475 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1276 microversion: 2.1 time: 0.304069 Oct 18 16:08:15.164575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 906/1842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:14 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:15.168591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b8df6dbd-d63c-439d-a134-c4dd9467a81f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:15.368307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8df6dbd-d63c-439d-a134-c4dd9467a81f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:15.387681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b8df6dbd-d63c-439d-a134-c4dd9467a81f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1215 microversion: 2.1 time: 0.239754 Oct 18 16:08:15.407493 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 937/1843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:15 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:15.432622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:15.433539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:15.447577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:15.448987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:15.449936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:15.451994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:15.454048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:15.454947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:15.544843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d9f159c-cc3d-4d35-b1d7-5db3f10aa8dd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd65988b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:15.700863 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d9f159c-cc3d-4d35-b1d7-5db3f10aa8dd tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.156553 Oct 18 16:08:15.703927 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 938/1844] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:15 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:15.892391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:15.907793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75703672-7ec3-42aa-b47b-47109b8ede4a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.479621 Oct 18 16:08:15.910529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 907/1845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:15 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:16.035469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.036130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 421675d0-550a-4e64-99ca-b13a3c79fd68] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.053527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.054030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.054474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.055734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.056254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.057515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.093366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 HTTP/1.1 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:08:16.095559 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. Oct 18 16:08:16.097103 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '421675d0-550a-4e64-99ca-b13a3c79fd68'} Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:16.098311 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. Oct 18 16:08:16.100153 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.102208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 421675d0-550a-4e64-99ca-b13a3c79fd68 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:16.102208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09718eba-e2ba-4457-af5c-2d8bba08dd78 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68" status: 404 len: 111 microversion: 2.1 time: 0.068857 Oct 18 16:08:16.102208 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 939/1846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:16 2022] GET /compute/v2.1/servers/421675d0-550a-4e64-99ca-b13a3c79fd68 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:16.113458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.116847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.127111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.127949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.128652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.129741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.130539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.144800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.185797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.187278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.187915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 HTTP/1.1 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:16.189559 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.191127 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1e65d4bd-ce68-4707-8d03-8ec132d2ead5'} Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:16.192120 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.196356 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.203122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.204163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.204672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.205500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.206384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.206986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.220299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:16.221997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5a06914-9f0b-404f-9d47-b0943b182cb6 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 404 len: 111 microversion: 2.1 time: 0.116773 Oct 18 16:08:16.226103 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 908/1847] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:16 2022] DELETE /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:16.238838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.240272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 1e65d4bd-ce68-4707-8d03-8ec132d2ead5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.248497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.250268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.251120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.272713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.273781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.276294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.315650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 HTTP/1.1 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:16.319601 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.323032 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1e65d4bd-ce68-4707-8d03-8ec132d2ead5'} Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:16.324690 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. Oct 18 16:08:16.328739 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.341931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 1e65d4bd-ce68-4707-8d03-8ec132d2ead5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:16.343232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3b7593a-aca3-4753-b5a1-518ab25af96a tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5" status: 404 len: 111 microversion: 2.1 time: 0.111985 Oct 18 16:08:16.345912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 909/1848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:16 2022] GET /compute/v2.1/servers/1e65d4bd-ce68-4707-8d03-8ec132d2ead5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:16.365314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a82edff-c86c-468e-9759-1a591e9edfd5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd182a700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.480191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1a82edff-c86c-468e-9759-1a591e9edfd5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a82edff-c86c-468e-9759-1a591e9edfd5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 HTTP/1.1 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:16.488041 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '95331a5e-9f9e-4f31-ae24-6e195c97ad92'} Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:16.490843 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 95331a5e-9f9e-4f31-ae24-6e195c97ad92 to delete Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.491941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95331a5e-9f9e-4f31-ae24-6e195c97ad92 could not be found. Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:16.494089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:08:16.497647 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.501244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a82edff-c86c-468e-9759-1a591e9edfd5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:16.503803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a82edff-c86c-468e-9759-1a591e9edfd5 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92" status: 404 len: 62 microversion: 2.1 time: 0.149823 Oct 18 16:08:16.510016 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 910/1849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:16 2022] DELETE /compute/v2.1/images/95331a5e-9f9e-4f31-ae24-6e195c97ad92 => generated 62 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:08:16.521262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.522627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.549265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.549827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.550260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.554073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.554751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.556886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.773528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:16.784942 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-978f141c-dca8-484f-8fb1-e56c811627cc tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1219 microversion: 2.1 time: 0.272761 Oct 18 16:08:16.786335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 911/1850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:16 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1219 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:16.799795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.803984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:16.823452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.823974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.824440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.830159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.830583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.831078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:16.861357 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 HTTP/1.1 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:16.865536 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:16.867485 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '289d8c86-2298-4c02-b489-7a833838d365'} Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:16.868339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:16.871204 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:16.878451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:16.883589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:16.890015 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ade236d-3f46-4ece-af5b-c076544cd9ad tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 404 len: 111 microversion: 2.1 time: 0.099867 Oct 18 16:08:16.899542 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 912/1851] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:16 2022] DELETE /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:16.900955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-210a9dd4-2017-455e-a697-924ad2226722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.715721 Oct 18 16:08:16.906387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 940/1852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:16 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:16.954334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421675d0-550a-4e64-99ca-b13a3c79fd68", "name": "network-vif-deleted", "tag": "7bcd8b19-92ac-4700-9939-053c8c8526dc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:16.958253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3be16e82-a057-42f0-a653-d847c2f60134 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64dbc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:16.985524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:16.986433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:16.995239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.012623 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] Creating event network-vif-deleted:7bcd8b19-92ac-4700-9939-053c8c8526dc for instance 421675d0-550a-4e64-99ca-b13a3c79fd68 on n-h2-858383-14 Oct 18 16:08:17.022277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3be16e82-a057-42f0-a653-d847c2f60134 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.119528 Oct 18 16:08:17.023475 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 913/1853] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:16 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:17.024444 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c1b39627-dcc0-479b-88f0-a5370f7f63d5 req-33bfcd44-dee2-4e98-9378-8ef1a1402e5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073696 Oct 18 16:08:17.030671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 941/1854] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:17.033812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.034444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 289d8c86-2298-4c02-b489-7a833838d365] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.039334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:17.044297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.044679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.045133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.045851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.046330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.046917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.052491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.054419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.063111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.064010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.064686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.065819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.066514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.067180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.070550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 HTTP/1.1 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.086918 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:17.088614 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '289d8c86-2298-4c02-b489-7a833838d365'} Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.089504 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. Oct 18 16:08:17.091054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.093450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 289d8c86-2298-4c02-b489-7a833838d365 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.094323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f11a845-0a82-41f9-8fd9-644d0d19964e tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365" status: 404 len: 111 microversion: 2.1 time: 0.068847 Oct 18 16:08:17.094881 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 914/1855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/289d8c86-2298-4c02-b489-7a833838d365 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.105948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b463583-2e55-497b-96e7-fdc3141df6db tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd64dbc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.135728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3b463583-2e55-497b-96e7-fdc3141df6db tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b463583-2e55-497b-96e7-fdc3141df6db tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 HTTP/1.1 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.138807 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1'} Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.140346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 to delete Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.141409 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 could not be found. Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.142723 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:08:17.147149 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.150344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b463583-2e55-497b-96e7-fdc3141df6db tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.151506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b463583-2e55-497b-96e7-fdc3141df6db tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1" status: 404 len: 62 microversion: 2.1 time: 0.050961 Oct 18 16:08:17.155405 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 915/1856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/images/b3e9c5f3-f5aa-4bbd-b039-4afa4dc9f3f1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:08:17.162443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.163043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.170691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.171191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.171638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.172346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.172808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.173264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.193313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e HTTP/1.1 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.196058 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.197888 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '922e0f05-8b7b-479f-b4e4-5ffb5007ef3e'} Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.199661 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.201371 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.205732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.206787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69c92af6-70d4-4992-b7ea-9ddf850092af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 404 len: 111 microversion: 2.1 time: 0.050153 Oct 18 16:08:17.207550 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 916/1857] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.216060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.217376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.223680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.224164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.227458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.229140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.229838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.230511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.246360 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e HTTP/1.1 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.248321 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.249942 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '922e0f05-8b7b-479f-b4e4-5ffb5007ef3e'} Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.250793 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. Oct 18 16:08:17.256714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.259532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 922e0f05-8b7b-479f-b4e4-5ffb5007ef3e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.259532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-867bc66e-4519-4e95-831b-9083ead02842 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e" status: 404 len: 111 microversion: 2.1 time: 0.038365 Oct 18 16:08:17.259532 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 917/1858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/922e0f05-8b7b-479f-b4e4-5ffb5007ef3e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:08:17.263566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-259b8f42-7dfe-4017-a2d0-6d92e119ff2f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd19aa670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.294073 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-259b8f42-7dfe-4017-a2d0-6d92e119ff2f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-259b8f42-7dfe-4017-a2d0-6d92e119ff2f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa HTTP/1.1 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.298965 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a5389850-d9d8-46df-b673-d5eae026dfaa'} Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.300543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a5389850-d9d8-46df-b673-d5eae026dfaa to delete Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.301705 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5389850-d9d8-46df-b673-d5eae026dfaa could not be found. Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.303643 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-259b8f42-7dfe-4017-a2d0-6d92e119ff2f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-259b8f42-7dfe-4017-a2d0-6d92e119ff2f tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa" status: 404 len: 62 microversion: 2.1 time: 0.043738 Oct 18 16:08:17.306433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 918/1859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/images/a5389850-d9d8-46df-b673-d5eae026dfaa => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:08:17.313752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.314548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.322984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.323947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.324645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.325627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.326321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.327109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.346395 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 HTTP/1.1 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.348784 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.351505 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2b03235a-5a55-4712-b3c5-0342b327d167'} Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.352358 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.355842 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.361346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.362506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a01bcf1-0734-4c11-ba67-9c148bb48cf3 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 404 len: 111 microversion: 2.1 time: 0.054565 Oct 18 16:08:17.363596 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 919/1860] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.372472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.373467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: 2b03235a-5a55-4712-b3c5-0342b327d167] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.382319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.383167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.383842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.385155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.385836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.386509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.403098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 HTTP/1.1 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.405460 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.407136 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2b03235a-5a55-4712-b3c5-0342b327d167'} Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.408099 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. Oct 18 16:08:17.411146 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.416254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance 2b03235a-5a55-4712-b3c5-0342b327d167 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.417603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcdb1dc4-046d-4fb9-ba9d-9b774512cf06 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167" status: 404 len: 111 microversion: 2.1 time: 0.049484 Oct 18 16:08:17.418787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 920/1861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/2b03235a-5a55-4712-b3c5-0342b327d167 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.427861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a607f120-37e3-47ee-b7bb-471b03b093e0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '.version_select at 0x7f5fd18ce9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.455083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a607f120-37e3-47ee-b7bb-471b03b093e0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Image not found. Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a607f120-37e3-47ee-b7bb-471b03b093e0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 HTTP/1.1 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.458596 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '06834732-b049-499f-83c8-1c94947bcab9'} Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.461214 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06834732-b049-499f-83c8-1c94947bcab9 to delete Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.462205 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06834732-b049-499f-83c8-1c94947bcab9 could not be found. Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.465466 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:08:17.468330 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.473231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a607f120-37e3-47ee-b7bb-471b03b093e0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.474380 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a607f120-37e3-47ee-b7bb-471b03b093e0 tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9" status: 404 len: 62 microversion: 2.1 time: 0.051430 Oct 18 16:08:17.476203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 921/1862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/images/06834732-b049-499f-83c8-1c94947bcab9 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:08:17.486176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.487270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.490762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:17.496307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.496816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.497331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.498042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.498496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.498921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.499091 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f91b2cbc-00c1-4522-a293-216bb517ffbe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.463803 Oct 18 16:08:17.510076 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 942/1863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:17.513357 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 HTTP/1.1 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:17.515416 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.516936 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e6e562de-78e7-432d-ba83-ad3976ee3f59'} Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.517851 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.519326 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.520810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.520810 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5cd6c9c-153e-4e25-ad95-34c370e7e7af tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 404 len: 111 microversion: 2.1 time: 0.034715 Oct 18 16:08:17.526556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.527178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] [instance: e6e562de-78e7-432d-ba83-ad3976ee3f59] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.530243 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 922/1864] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:17 2022] DELETE /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.533419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.533978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.534784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.535521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.535977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.536459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.557791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] HTTP exception thrown: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Request method failure captured: Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 HTTP/1.1 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4DFzPWYtoE2Cs4NnIisof0VtRnTjXt3LDcAFhAV79F052YSAZMX5bf3jUE1m92Bfvxn0Djf1M7iJiS_MGAqM1Z1WgILg1A92huIdPa6J2vQ86AVbu36vzRWl_2qb2aZ0VH3eOnrCMqiprTkXqaqjy5EPr30Q-1JhLZG46I4UQg_Nk Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:08:17.559455 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c2404823fb54cc2bcee162756e6ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c2404823fb54cc2bcee162756e6ef79"}]}] Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9c2404823fb54cc2bcee162756e6ef79 Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesTestJSON-783300427 Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3ffc4db9f1d64b4e864915e980af84f4 Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesTestJSON-783300427-project Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.561058 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e6e562de-78e7-432d-ba83-ad3976ee3f59'} Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:17.561970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. Oct 18 16:08:17.563389 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:17.564645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] Returning 404 to user: Instance e6e562de-78e7-432d-ba83-ad3976ee3f59 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:17.564645 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbf579b6-71b8-46f5-b9cb-9b81da392d3c tempest-ImagesTestJSON-783300427 tempest-ImagesTestJSON-783300427-project] 10.222.0.78 "GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59" status: 404 len: 111 microversion: 2.1 time: 0.039399 Oct 18 16:08:17.564971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 943/1865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/e6e562de-78e7-432d-ba83-ad3976ee3f59 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:17.817667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.819551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.833494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.834797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.835295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.839961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.840500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.841838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.947502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:17.948832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:17.958287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.959839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.960732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:17.962721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:17.963603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:17.964333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:18.057490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:18.070549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f769d38b-cfd6-4e66-b57a-74725ee155c2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1219 microversion: 2.1 time: 0.257022 Oct 18 16:08:18.073461 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 923/1866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1219 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:18.078262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db8f9c81-77b7-4f6f-bbec-300cba1741f1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd182aee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:18.171865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db8f9c81-77b7-4f6f-bbec-300cba1741f1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.097292 Oct 18 16:08:18.172443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 924/1867] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:18 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:18.264015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:18.272965 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4080075d-8787-47ea-8910-ef791202f5af tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.344760 Oct 18 16:08:18.276865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 944/1868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:17 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:18.359882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27db667c-7280-4fa8-99da-3d6b005ddff1", "tag": "9604d31f-3fa8-48fb-b16b-87e7031a4452"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:18.386951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:18.387842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:18.391413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:18.417482 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] Creating event network-changed:9604d31f-3fa8-48fb-b16b-87e7031a4452 for instance 27db667c-7280-4fa8-99da-3d6b005ddff1 on n-h2-858383-14 Oct 18 16:08:18.423508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b43bb119-bf37-412e-9060-4e167027ed99 req-baa97cbe-9104-48d1-94fa-9ea004dcbeb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067392 Oct 18 16:08:18.424861 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 925/1869] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:18.536347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:18.538248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:18.553606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:18.554389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:18.557185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:18.559411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:18.561963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:18.564473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:18.828355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-983060533", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5102e26d-02ba-494b-a69e-fcb88c84af09"}], "block_device_mapping_v2": [{"uuid": "97e7e7ba-38ee-41d0-ba27-427343e58d0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:19.009693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] validate_networks() for [('5102e26d-02ba-494b-a69e-fcb88c84af09', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:08:19.170342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:19.185112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-371fdbdf-5583-4bd6-b859-d70d8a1c0f2e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.651530 Oct 18 16:08:19.186427 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 945/1870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:18 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:19.200452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:19.201528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:19.220335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:19.222106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:19.223827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:19.227770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:19.228372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:19.229238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:19.420052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:19.435719 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-197e8a9d-d7b8-4d9d-8b8b-4aa47ac75dd0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1267 microversion: 2.1 time: 0.243085 Oct 18 16:08:19.436695 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 946/1871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:19 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:19.446597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-098a609f-e0fa-430b-847f-df0f8c8e7f63 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd659da60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:19.550305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-098a609f-e0fa-430b-847f-df0f8c8e7f63 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.112178 Oct 18 16:08:19.551372 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 947/1872] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:19 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:19.562253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:19.562943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:19.576445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:19.577342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:19.578542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:19.580156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:19.582043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:19.582680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:19.994631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:20.004247 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33fb90ef-954e-4be4-a312-da68a21e1a54 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.451654 Oct 18 16:08:20.008759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 948/1873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:19 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:20.217349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:20.218705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:20.241418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:20.248003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:20.248783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:20.252082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:20.254575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:20.261312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:20.865893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:20.877942 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b67dd04-726b-436c-9bc6-ff2fb673dcfd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.666736 Oct 18 16:08:20.881862 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 949/1874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:20 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:20.909549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:20.913993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:20.945426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:20.946321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:20.946989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:20.947957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:20.948893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:20.949593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:21.089566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:08:21.090531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:08:21.091203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:08:21.091960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:08:21.092560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:08:21.098980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=19 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:21.120462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:21.129765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:21.130234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:21.131328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:21.131836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:21.134792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:21.177731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:21.190073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Getting quotas for user 19e2cb9474fb47a6b3f3793c7f162caf and project c91c440777a0421c961411bafbc058ad. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:21.299272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:08:21.302118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e7e7ba-38ee-41d0-ba27-427343e58d0d',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:21.605096 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-022c8bb6-539a-44b4-a0ad-abcbe3c53a73 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.781178 Oct 18 16:08:21.605764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 926/1875] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 16:08:21.624920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7541335-16d5-4bcf-91fa-4071fb7c5bbb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd19aa8b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:21.781781 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7541335-16d5-4bcf-91fa-4071fb7c5bbb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.164395 Oct 18 16:08:21.787894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 927/1876] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:21 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:21.817173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:21.818005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:21.843651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:21.847591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:21.855488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:21.860903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:21.862166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:21.863612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:21.874139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:21.917081 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec320a1c-0826-49d3-8af5-fab699d1e492 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 1.031271 Oct 18 16:08:21.932915 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 950/1877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:20 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:21.977563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:21.979372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:22.301996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:22.312980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:22.319200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:22.327397 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6788eb80-2344-4635-805b-30dbc3265975 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1103 microversion: 2.25 time: 0.392956 Oct 18 16:08:22.328236 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 951/1878] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:21 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1103 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:22.336676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:22.340577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:22.362913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:22.364032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:22.364767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:22.366777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:22.371177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:22.374124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:22.894871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:22.912544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0266c662-f780-4959-a0a1-ad4a9d46eb13 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 1.122609 Oct 18 16:08:22.919043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 928/1879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:21 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:22.955833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7e3ea6c-8142-4f06-83f2-275ce596d2b8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1878b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:23.094780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7e3ea6c-8142-4f06-83f2-275ce596d2b8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.172708 Oct 18 16:08:23.097635 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 929/1880] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:22 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:23.112087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:23.120041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:23.139003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:23.139889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:23.140498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:23.141506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:23.142151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:23.144212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:23.538025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:23.561051 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14211e3a-28f5-4b81-a213-1ce86ecea51d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 1.231367 Oct 18 16:08:23.562449 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 952/1881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:22 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:23.569272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fff94e-a07e-4e96-8001-e765d4c2aab1", "name": "network-vif-plugged", "status": "completed", "tag": "0becb27d-d227-4e3c-98bf-51b87e0f6c42"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:23.610812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:23.616385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:23.619066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:23.662519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] Creating event network-vif-plugged:0becb27d-d227-4e3c-98bf-51b87e0f6c42 for instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 on n-h1-858383-14 Oct 18 16:08:23.683123 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7c090c24-f5df-490e-879a-477a8fd6c7b9 req-8e2f3550-e378-4aaf-8f38-cfdd933a2dad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119206 Oct 18 16:08:23.683730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 953/1882] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:23.698615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:23.705241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:23.732435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:23.735488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:23.738083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:23.739037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:23.742565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:23.743126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:24.104264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:24.120138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:24.124574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:24.127233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f66f3ee-c181-4ad4-9b66-014f721fb51c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1176 microversion: 2.25 time: 0.435246 Oct 18 16:08:24.128381 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 954/1883] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:23 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1176 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:24.153604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:24.154727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:24.163802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:24.164916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:24.168255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:24.169271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:24.175045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:24.175939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:24.304394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:24.313019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d3b102f2-7e9d-43a0-aaf7-e71023e152c0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 1.214112 Oct 18 16:08:24.313601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 930/1884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:23 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:24.348330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-868a0e00-d27c-4078-8962-42c5b3f6f5fb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd6532f70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:24.438302 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-868a0e00-d27c-4078-8962-42c5b3f6f5fb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.111206 Oct 18 16:08:24.438914 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 931/1885] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:24 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:24.504037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:24.514766 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4dae10f-c522-4174-8cd0-b7414b088caf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.384778 Oct 18 16:08:24.521812 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 955/1886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:24 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:24.596634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:24.598549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:24.618430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:24.618972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:24.619436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:24.620184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:24.620650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:24.621148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.156071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:25.157850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:25.180456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.183796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.184653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.188488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.191662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.195998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.437525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:25.452976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:25.454895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:25.458218 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7d38682-1a2b-445d-a972-f038ed22de6f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1250 microversion: 2.25 time: 0.306212 Oct 18 16:08:25.481840 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 956/1887] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:25 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1250 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:08:25.492313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01b8f38-b61b-498c-8ccc-fadba3172511", "tag": "9411f477-95b5-4e5b-97f9-08c6f1ed9595"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:25.522316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:25.533896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.534603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.535226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.565161 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] Creating event network-changed:9411f477-95b5-4e5b-97f9-08c6f1ed9595 for instance c01b8f38-b61b-498c-8ccc-fadba3172511 on n-h1-858383-14 Oct 18 16:08:25.589104 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-07893ad1-84e7-42bc-87e7-ea4b3c58b1b8 req-360a6f48-1c97-48c1-a3b1-3780cae8590d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105379 Oct 18 16:08:25.590232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 957/1888] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:25.595673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:25.601529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:25.604040 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fb9b732-f1dd-4348-ac2c-df9c85a2d489 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 1.011994 Oct 18 16:08:25.604709 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 932/1889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:24 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:25.629584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e73d1d-6c55-46fd-9599-0ef327e02c97 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd188bee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:25.637343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.640171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.643045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.643998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.645165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.647514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.752793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9e73d1d-6c55-46fd-9599-0ef327e02c97 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.146762 Oct 18 16:08:25.758882 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 933/1890] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:25 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:25.766179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:25.767122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:25.782615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.783667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.785443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:25.800199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:25.805413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:25.809134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:26.342704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:26.356962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6419cda8-92cc-4744-b6ab-58fa5f35f9e9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.765155 Oct 18 16:08:26.363187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 958/1891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:25 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:26.502399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:26.503407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:26.519155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:26.537393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:26.538259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:26.539026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:26.539509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:26.544287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:26.727996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:26.732269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:26.755288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:26.757588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:26.768099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b8cfedf8-bcb7-4aa4-9088-9c015a3ad66d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1250 microversion: 2.25 time: 0.271715 Oct 18 16:08:26.769776 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 959/1892] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:26 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1250 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:08:26.776499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:26.777941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:26.788056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:26.788871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:26.789557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:26.790622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:26.791268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:26.791856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:27.015892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:27.035031 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c41e715-6b40-43e4-a5e5-952a93c0104e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 1.273736 Oct 18 16:08:27.035641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 934/1893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:25 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:27.072358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-049e9f92-8a9e-4a89-95f3-17d38b9df617 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd646cc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:27.234508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-049e9f92-8a9e-4a89-95f3-17d38b9df617 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.187295 Oct 18 16:08:27.243570 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 935/1894] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:27 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:27.386777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:27.387614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:27.402245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:27.406004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:27.410220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:27.414194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:27.418622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:27.422256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:27.545292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:27.562769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c32c84e7-791c-47d1-b40b-9047d561628a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.791554 Oct 18 16:08:27.593826 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 960/1895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:26 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:27.812134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:27.812912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:27.837026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:27.837779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:27.841586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:27.847034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:27.850796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:27.854948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:28.729527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:28.749440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:28.754820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:28.759241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-416cf86c-b493-4da8-9b8d-025bf39abd4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1292 microversion: 2.25 time: 0.952995 Oct 18 16:08:28.769451 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 961/1896] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:27 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1292 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:28.787048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:28.791701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:28.816268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:28.820581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:28.820913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:28.824019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:28.824922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:28.825856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:29.310831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:29.320792 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c45bdba-f6db-4721-9abf-601ec208ca6c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.549850 Oct 18 16:08:29.325538 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 962/1897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:28 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:29.343977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19a1f723-58ef-421e-8036-0876fba9a782 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd659d550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:29.417262 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19a1f723-58ef-421e-8036-0876fba9a782 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.090284 Oct 18 16:08:29.418027 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 963/1898] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:29 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:29.429130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:29.441951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:29.452450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:29.453160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:29.453705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:29.454585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:29.455174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:29.455714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:29.585512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:29.604592 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-199a524b-a62e-454e-88be-117b8b822397 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 2.217061 Oct 18 16:08:29.605350 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 936/1899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:27 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:29.624417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27db667c-7280-4fa8-99da-3d6b005ddff1", "name": "network-vif-plugged", "status": "completed", "tag": "9604d31f-3fa8-48fb-b16b-87e7031a4452"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:29.655168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:29.655995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:29.656490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:29.677842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] Creating event network-vif-plugged:9604d31f-3fa8-48fb-b16b-87e7031a4452 for instance 27db667c-7280-4fa8-99da-3d6b005ddff1 on n-h2-858383-14 Oct 18 16:08:29.690619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8f16a3ef-a021-4a7a-bcfb-08803b6fd5b4 req-3de74328-75b7-4c89-b616-21c2bbee3035 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075767 Oct 18 16:08:29.691324 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 937/1900] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:29.782253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Calling method '.version_select at 0x7f5fd182a820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:29.841185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:08:29.842083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Neutron security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:08:29.842852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] HTTP exception thrown: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.842852 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Request method failure captured: Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-security-groups/3414619b-8ed6-4393-9d43-27fbacb3fba0 HTTP/1.1 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs98ZM11M6NcUk6XM0TKwZ4hWyoXFfB8tfF_jzlb0t1al4GHxQN10TamdHtW6udaTXa_DjE_Uw_woSVVobruKWjfsMOtS6XYtAgT65Huf_14p_CClZoOR2DhSb7GND_aoPcutLnFnTG60i8j-ERXwfqnSUAI-tQq-05ErQKqg-u_e2Y Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:29.885033 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}] Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 973a6e472ee344b79a0c17c498fd944a Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.886902 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3414619b-8ed6-4393-9d43-27fbacb3fba0'} Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:29.888009 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:08:29.889610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.891134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] Oct 18 16:08:29.892846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:29.896650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Returning 404 to user: Security group 3414619b-8ed6-4393-9d43-27fbacb3fba0 does not exist Oct 18 16:08:29.896650 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-e4f93f3e-3342-472b-bf6f-083a904dee16'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:29.897950 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64410b32-6047-4cb3-aecc-594750441f6c tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/3414619b-8ed6-4393-9d43-27fbacb3fba0" status: 404 len: 194 microversion: 2.1 time: 0.203904 Oct 18 16:08:29.898708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 938/1901] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:08:29 2022] DELETE /compute/v2.1/os-security-groups/3414619b-8ed6-4393-9d43-27fbacb3fba0 => generated 194 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:29.905285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:29.906299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:29.923247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:29.927083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:29.934874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:29.938469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:29.941277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:29.941277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:30.392233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:30.412832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d057391-5228-44a6-9bab-dc5e5642832b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.986504 Oct 18 16:08:30.433292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 964/1902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:29 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:30.439228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46243a47-6685-458f-aa73-e10c805fb1c5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004474 Oct 18 16:08:30.440970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 965/1903] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 18 16:08:30 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 16:08:30.453258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:30.454200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:30.464109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:30.465670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:30.467015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:30.467980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:30.468612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:30.469251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:30.540258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:30.566688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:30.572586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:30.573816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b3f89e68-f81b-406b-95c0-947a3674bb80 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1292 microversion: 2.25 time: 0.673978 Oct 18 16:08:30.574923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 939/1904] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:29 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1292 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:30.579869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb33cdf7-d247-41e5-86d0-ea54e5d40f59 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd19ab3a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:30.649824 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb33cdf7-d247-41e5-86d0-ea54e5d40f59 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.073737 Oct 18 16:08:30.651103 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 940/1905] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:30 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:30.656593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45020e62-4ed0-4aa9-ba9d-777265de59a9 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Calling method '.version_select at 0x7f5fd182f940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:30.851512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:30.867013 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af61870e-ba1d-4530-8de2-07bf85d06c41 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.423824 Oct 18 16:08:30.887150 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 966/1906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:30 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:30.901373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:30.902088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:30.919471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:30.920142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:30.925917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:30.927303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:30.928566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:30.942016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.165647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:31.191081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:31.207408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-506e6215-0485-4584-8f27-725d5fc22c82 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.312491 Oct 18 16:08:31.208032 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 967/1907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:30 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:31.225691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:31.259924 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45020e62-4ed0-4aa9-ba9d-777265de59a9 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.607606 Oct 18 16:08:31.269446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 941/1908] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:08:30 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:31.279251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Calling method '.version_select at 0x7f5fd658d4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:31.439286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:31.439909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:31.468626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:31.471442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:31.472939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.475844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:31.476694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:31.479400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.632236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:08:31.637449 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 18 16:08:31.637449 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Request method failure captured: Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/d4804a52-b391-4764-bea8-c47b5c148140 HTTP/1.1 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs98ZM11M6NcUk6XM0TKwZ4hWyoXFfB8tfF_jzlb0t1al4GHxQN10TamdHtW6udaTXa_DjE_Uw_woSVVobruKWjfsMOtS6XYtAgT65Huf_14p_CClZoOR2DhSb7GND_aoPcutLnFnTG60i8j-ERXwfqnSUAI-tQq-05ErQKqg-u_e2Y Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:08:31.642280 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}] Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 973a6e472ee344b79a0c17c498fd944a Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: exception: Insufficient rights for removing default security group. Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.644238 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'd4804a52-b391-4764-bea8-c47b5c148140'} Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:31.645429 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 18 16:08:31.648693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:31.650399 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] Oct 18 16:08:31.652895 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:31.657020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 18 16:08:31.657020 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5315a049-51fe-4541-a1d1-f634a1fab05f'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:31.657020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aca1b477-2612-4bc5-aeff-eca1834bb500 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d4804a52-b391-4764-bea8-c47b5c148140" status: 400 len: 182 microversion: 2.1 time: 0.385895 Oct 18 16:08:31.657020 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 968/1909] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:08:31 2022] DELETE /compute/v2.1/os-security-groups/d4804a52-b391-4764-bea8-c47b5c148140 => generated 182 bytes in 387 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:08:31.668288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e05c9da-0090-4e3c-8989-7a5fd5235061", "tag": "682a0667-46e4-499f-a988-6326eff8cb7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:31.697468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:31.699670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:31.700312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.759972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] Creating event network-changed:682a0667-46e4-499f-a988-6326eff8cb7e for instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 on n-h2-858383-14 Oct 18 16:08:31.773935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4dc94623-b86d-46bd-ada7-d7b4ce674014 req-c5d56b83-e4df-4e2d-ad1b-7978e141bec3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114648 Oct 18 16:08:31.783007 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 969/1910] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:31.806863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:31.807889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:31.818140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:31.819488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:31.821027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.822814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:31.823486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:31.824343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:31.831481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:31.842323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7f64ac3-a623-4118-9b5d-f5a032fe0933 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.407045 Oct 18 16:08:31.850394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 942/1911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:31 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:31.856236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56100649-95b3-46a9-b9fa-6ab2d217979e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd18c3c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:31.930570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56100649-95b3-46a9-b9fa-6ab2d217979e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.078987 Oct 18 16:08:31.931378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 943/1912] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:31 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:31.954432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Calling method '.version_select at 0x7f5fd19abca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.015600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:08:32.016268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Neutron security group e2b119a9-dc8f-4270-baed-6496c4a9c040 not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:08:32.016836 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] HTTP exception thrown: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.016836 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Request method failure captured: Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-security-groups/e2b119a9-dc8f-4270-baed-6496c4a9c040 HTTP/1.1 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs98ZM11M6NcUk6XM0TKwZ4hWyoXFfB8tfF_jzlb0t1al4GHxQN10TamdHtW6udaTXa_DjE_Uw_woSVVobruKWjfsMOtS6XYtAgT65Huf_14p_CClZoOR2DhSb7GND_aoPcutLnFnTG60i8j-ERXwfqnSUAI-tQq-05ErQKqg-u_e2Y Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:32.019194 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}] Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 973a6e472ee344b79a0c17c498fd944a Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.021949 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e2b119a9-dc8f-4270-baed-6496c4a9c040'} Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.023096 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:08:32.024745 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.026171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Returning 404 to user: Security group e2b119a9-dc8f-4270-baed-6496c4a9c040 does not exist Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-8d23eb74-b1e1-446b-8213-42aaefb1db2c'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e60075a9-4341-4cfb-ad6d-ecdcc3096bc5 tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/e2b119a9-dc8f-4270-baed-6496c4a9c040" status: 404 len: 194 microversion: 2.1 time: 0.088094 Oct 18 16:08:32.027920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 944/1913] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:08:31 2022] GET /compute/v2.1/os-security-groups/e2b119a9-dc8f-4270-baed-6496c4a9c040 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:32.031859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.032484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:32.041939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.046430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.047392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.048490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.049164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.049925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.291151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:32.303946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:32.309492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:32.316691 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72dd7ecf-c7b7-4311-9cb9-7c9276c419d1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1292 microversion: 2.25 time: 0.528590 Oct 18 16:08:32.318999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 970/1914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:31 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1292 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:32.351875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Action: 'update', calling method: .version_select at 0x7f5fd6522550>, body: {"security_group": {"name": "tempest-sg-569457257", "description": "tempest-description-1801420642"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:32.361082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:32.394275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:32.408439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fafc6614-6c48-43e2-9335-1a738d2c2c86 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1318 microversion: 2.1 time: 0.381255 Oct 18 16:08:32.412947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:08:32.413840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 945/1915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:32 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:32.414012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Neutron security group a88e9010-ec42-4833-a7b0-1167bf8968ac not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:08:32.414722 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] HTTP exception thrown: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.414722 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Request method failure captured: Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/os-security-groups/a88e9010-ec42-4833-a7b0-1167bf8968ac HTTP/1.1 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 101 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs98ZM11M6NcUk6XM0TKwZ4hWyoXFfB8tfF_jzlb0t1al4GHxQN10TamdHtW6udaTXa_DjE_Uw_woSVVobruKWjfsMOtS6XYtAgT65Huf_14p_CClZoOR2DhSb7GND_aoPcutLnFnTG60i8j-ERXwfqnSUAI-tQq-05ErQKqg-u_e2Y Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:08:32.417255 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31663cc3c74c4d71a66fc5569ef0e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31663cc3c74c4d71a66fc5569ef0e178"}]}] Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 31663cc3c74c4d71a66fc5569ef0e178 Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-694168569 Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 973a6e472ee344b79a0c17c498fd944a Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-694168569-project Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: {"security_group": {"name": "tempest-sg-569457257", "description": "tempest-description-1801420642"}} Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:08:32.419050 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a88e9010-ec42-4833-a7b0-1167bf8968ac', 'body': {'security_group': {'name': 'tempest-sg-569457257', 'description': 'tempest-description-1801420642'}}} Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:08:32.420162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:08:32.421738 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.423422 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] Oct 18 16:08:32.425165 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:08:32.427176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] Returning 404 to user: Security group a88e9010-ec42-4833-a7b0-1167bf8968ac does not exist Oct 18 16:08:32.427176 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-a1bcb63e-91c7-4964-967b-c159fca4955d'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:32.428430 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-04b99b2e-c6c8-463c-b9dc-cdd07d76a76f tempest-SecurityGroupsNegativeTestJSON-694168569 tempest-SecurityGroupsNegativeTestJSON-694168569-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/a88e9010-ec42-4833-a7b0-1167bf8968ac" status: 404 len: 194 microversion: 2.1 time: 0.096668 Oct 18 16:08:32.429611 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 971/1916] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Oct 18 16:08:32 2022] PUT /compute/v2.1/os-security-groups/a88e9010-ec42-4833-a7b0-1167bf8968ac => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:32.459233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.461746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:32.498859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.499692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.500385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.501358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.502025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.502667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.870568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.871369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:32.890735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.891405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.891962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.892805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.897829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.898635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:33.026902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:33.030566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:33.041850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b3e118ab-5c7b-442a-be7a-22c5fea4eeb5 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.625743 Oct 18 16:08:33.049462 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 946/1917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:32 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:33.063190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecd1bb86-44f8-4662-b7a7-78cb030661af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1855550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:33.146731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecd1bb86-44f8-4662-b7a7-78cb030661af tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.094109 Oct 18 16:08:33.147681 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 947/1918] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:33 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:33.348212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:33.349901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:33.373508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.374723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.375421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:33.377026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.377817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.378504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:33.819783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:33.828905 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56ec9bcb-d190-4a93-b06b-2280d82e2300 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.963057 Oct 18 16:08:33.829528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 972/1919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:32 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:33.852910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:33.856854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:33.878363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.879113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.879294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:33.882509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.888898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.890718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.178617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.213914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.219111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.228265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dae3c48a-b724-4420-b362-5b76159da4b8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1292 microversion: 2.25 time: 0.884481 Oct 18 16:08:34.229529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 948/1920] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:33 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1292 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:08:34.257964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:34.258615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:34.289729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.290292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.300108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.301092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.301654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.304099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.544573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.554084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-775e9b57-472d-4181-891c-80f09e4a5f8a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1467 microversion: 2.1 time: 0.712223 Oct 18 16:08:34.564818 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 973/1921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:33 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1467 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:34.570484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73af9dfd-031c-4d67-ad81-6c086c9682a6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd652e9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:34.684409 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73af9dfd-031c-4d67-ad81-6c086c9682a6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.118123 Oct 18 16:08:34.688105 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 974/1922] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:34 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:34.699519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:34.700282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:34.716597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.719463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.727789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.731709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.732511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.733470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.884842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.902047 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2333b377-5552-46e3-b6fa-ddf9cc429851 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.667482 Oct 18 16:08:34.917021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 949/1923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:34 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:34.924283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:34.924968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:34.948847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.949452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.950221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.950697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:34.951043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:34.951467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.382193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:35.391914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-553c9e75-0705-4648-a19f-5378d47067ad tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1468 microversion: 2.1 time: 0.702478 Oct 18 16:08:35.396552 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 975/1924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:34 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1468 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:35.407361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:35.412779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:35.418794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:35.434535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc775f73-1897-4fbe-820d-2a40e1e49711 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1719 microversion: 2.1 time: 0.524800 Oct 18 16:08:35.436515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.437649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.441125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.442138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.443381 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 950/1925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:34 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1719 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:35.443958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.445812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.459861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:35.476195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:35.484871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Searching by: {'reservation_id': 'r-ijd18dk7', 'deleted': False, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:08:35.506920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.511498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.514563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.515732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.519306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.521742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.815308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:08:35.936024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:35.944577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.948276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.949281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.201809 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-126dcbba-40f7-464e-9da4-e859b78d13e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-ijd18dk7" status: 200 len: 2928 microversion: 2.1 time: 0.756528 Oct 18 16:08:36.213400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 951/1926] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 18 16:08:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ijd18dk7 => generated 2928 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:36.219218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40a53242-d115-42d8-bef8-1a9a761f3ffa tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64db0d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.314565 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40a53242-d115-42d8-bef8-1a9a761f3ffa tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.099644 Oct 18 16:08:36.331276 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 952/1927] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:36.341553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.343241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:36.359866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.361744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.362441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.369530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.370281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.371336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.467104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:36.521810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:36.524494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:36.531387 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0070335-6f50-4d7d-95a3-0f7578fd1c9d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1292 microversion: 2.25 time: 1.132648 Oct 18 16:08:36.532273 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 976/1928] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:35 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1292 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:36.547060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.621631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.server_groups [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Querying cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) for 2 instances {{(pid=120570) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 16:08:36.623117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.625769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.628587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.693020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:36.707064 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0197e9d4-3e95-4039-b08f-6fb063467846 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.367921 Oct 18 16:08:36.713513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e03f842d-50ea-4e83-b3e5-c04656faba39 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/8dd23bdc-168a-4a69-9366-6a4accc85d13" status: 200 len: 271 microversion: 2.1 time: 0.178823 Oct 18 16:08:36.714602 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 977/1929] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/os-server-groups/8dd23bdc-168a-4a69-9366-6a4accc85d13 => generated 271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:36.728799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 953/1930] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:36.743417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.744498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:36.753333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.754058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.754669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.756205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.756841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.757463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.759003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.777664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:36.805490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.818258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.823657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.826132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.829840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.833076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.233316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7dc9179-28b5-4675-ab98-2f3bada9b7ac tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 200 len: 1620 microversion: 2.1 time: 0.502131 Oct 18 16:08:37.283844 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 954/1931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 1620 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:37.291939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:37.293082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:37.302300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.303365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.304646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.305953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.306698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.307382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.555897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fef9fcb4-cba2-4c2e-8aae-98557ec6f937 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1621 microversion: 2.1 time: 0.270350 Oct 18 16:08:37.561799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 955/1932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:37 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1621 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:37.567382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-364255e5-cdb2-420a-b2da-19dbb8ac47b9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1858dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:37.654745 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-364255e5-cdb2-420a-b2da-19dbb8ac47b9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.090844 Oct 18 16:08:37.655949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 956/1933] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:37 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:37.660741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01b8f38-b61b-498c-8ccc-fadba3172511", "name": "network-vif-plugged", "status": "completed", "tag": "9411f477-95b5-4e5b-97f9-08c6f1ed9595"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:37.686905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.689577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.692064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.697300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:37.716743 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05027e73-4b4e-4d45-9cd7-3761c33aa4ff tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1709 microversion: 2.1 time: 1.000813 Oct 18 16:08:37.725028 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 978/1934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1709 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:37.733458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:37.734432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:37.742240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] Creating event network-vif-plugged:9411f477-95b5-4e5b-97f9-08c6f1ed9595 for instance c01b8f38-b61b-498c-8ccc-fadba3172511 on n-h1-858383-14 Oct 18 16:08:37.751417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.758648 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-65646150-210d-4dd9-a3ca-e6c61c3a2789 req-80f2dc39-555f-4bc5-8972-eccc611730fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094807 Oct 18 16:08:37.758648 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 957/1935] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:37.761799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.765422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.766422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.767893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.769936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:37.770831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:37.772127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.790237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.790737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.791171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:37.791881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:37.792331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:37.792752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.336513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:38.347554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e11d025f-06e4-45e6-ab1f-c49e12c7ad4e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 0.588820 Oct 18 16:08:38.349711 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 958/1936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:37 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:38.357383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2a6ec70-4e3d-4724-8537-18dba5f77394 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '.version_select at 0x7f5fd19d19d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:38.377610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec70-4e3d-4724-8537-18dba5f77394 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.378562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec70-4e3d-4724-8537-18dba5f77394 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.381645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec70-4e3d-4724-8537-18dba5f77394 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.400565 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2a6ec70-4e3d-4724-8537-18dba5f77394 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.046889 Oct 18 16:08:38.409202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 959/1937] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:08:38 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:38.422490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-675821798", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:38.514226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:08:38.582726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:38.610230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:38.613098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:38.616253 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2acdc743-e3db-4603-a550-08dd8e655af7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.896151 Oct 18 16:08:38.618293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 979/1938] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:37 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:38.671470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:38.672120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:38.686075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.687289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.688129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.692141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.693668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.694389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.114955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14d48790-a063-4b07-a399-6719b33ae6d0 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1862 microversion: 2.1 time: 0.495037 Oct 18 16:08:39.135285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 980/1939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:38 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1862 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:39.147675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16b910c2-f63e-48a4-a9b6-dbc2a07a861d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd65a0b80>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:39.224621 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16b910c2-f63e-48a4-a9b6-dbc2a07a861d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.091422 Oct 18 16:08:39.225827 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 981/1940] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:39 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:39.236482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:39.238726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:39.255780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.261435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.262146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.263078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.263546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.263981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.307277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:08:39.308284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:08:39.308768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:08:39.309210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:08:39.309679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:08:39.334408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.336146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.336765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.339464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.344295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.346849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.407538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:39.434264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:39.501088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:08:39.511273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:39.584701 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c984a63-bc66-4e74-b1c4-5f1dce479a03 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1862 microversion: 2.1 time: 0.354646 Oct 18 16:08:39.602111 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 982/1941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:39 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1862 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:39.602111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:39.602111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:39.636707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.638240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.639730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.643979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.649909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.650574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.701672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27d42ce1-a1e6-4cfe-8904-563432572a87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277164 Oct 18 16:08:39.708976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 960/1942] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:08:39.718663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:39.719292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:39.732456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:39.740833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.741955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.742407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.743122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.743579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.744169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:40.594266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:40.606583 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c00165fb-32dc-4953-95cc-f28ecfe5caa7 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1315 microversion: 2.1 time: 1.018388 Oct 18 16:08:40.615218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 983/1943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:39 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:40.630508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa2cba45-c98e-471d-b354-d2426318ea50 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:40.631673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa2cba45-c98e-471d-b354-d2426318ea50 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:40.664697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:40.687811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:40.693193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:40.697968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d48b603b-5b80-407f-abd7-04da740191f7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.991366 Oct 18 16:08:40.711189 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 961/1944] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:39 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:40.730745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:40.733129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:40.777260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:40.780691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:40.784914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:40.791459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:40.794783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:40.795593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:40.990205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lazy-loading 'services' on Instance uuid b9c78166-21f2-4415-8634-a43361270c27 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:41.018432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa2cba45-c98e-471d-b354-d2426318ea50 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:41.045553 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa2cba45-c98e-471d-b354-d2426318ea50 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1216 microversion: 2.1 time: 0.422807 Oct 18 16:08:41.047432 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 984/1945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:40 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1216 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:41.072010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91fa2704-f969-4de0-8fab-49ac281b865e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd658d280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.231764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91fa2704-f969-4de0-8fab-49ac281b865e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.182602 Oct 18 16:08:41.234457 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 985/1946] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:41 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:41.326060 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5343887b-3c67-4f16-a06d-a90113953571 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments/672a060c-c131-4ca7-b3c1-526fa8859116" status: 202 len: 0 microversion: 2.1 time: 0.611917 Oct 18 16:08:41.328688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 962/1947] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:08:40 2022] DELETE /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments/672a060c-c131-4ca7-b3c1-526fa8859116 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:08:41.337821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.340670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:41.358519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.359027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.359469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.370969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.371525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.372123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.496041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16116002-167d-48b1-9def-51c7aa37785f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163319 Oct 18 16:08:41.497656 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 986/1948] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:41 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:41.641887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.642750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:41.656674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.665375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.665956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.669050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.672427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.673018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.743128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.744340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:41.751479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.752305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.758726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.760030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.760753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.761457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.019653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:42.035545 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6a461c7-8c4a-4d48-be4e-109926e880d2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1504 microversion: 2.1 time: 0.396943 Oct 18 16:08:42.059146 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 963/1949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:41 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:42.085008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.086127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:42.101381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.106816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.109486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.111040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.113325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.115555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.116697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:42.128607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:42.136523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:42.142218 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d12ff1be-a5d2-41a3-9330-0843473353b6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.410367 Oct 18 16:08:42.147419 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 987/1950] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:41 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:42.154497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.157795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:42.169204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:42.170986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.173606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.174247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.178095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.178827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.179517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.431086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-42bc8027-2c13-464f-8c24-a2d037205e68 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.356850 Oct 18 16:08:42.433607 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 964/1951] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:08:42 2022] DELETE /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511/os-server-password => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:42.452154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32824d60-43f6-4396-b8d5-b2a65c5cc060 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1799310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.587601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32824d60-43f6-4396-b8d5-b2a65c5cc060 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.152210 Oct 18 16:08:42.588191 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 965/1952] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:42 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:42.605436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:42.614002 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd7f5548-a562-4bce-a3e5-2448a8628c9b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1276 microversion: 2.1 time: 0.465138 Oct 18 16:08:42.616378 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 988/1953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:42 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1276 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:42.620298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.621359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:42.626295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.635461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:42.640595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.641383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.643219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.644128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.648749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.649745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.652176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.652673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.653170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.660764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.661749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.663688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.714889 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18a93f29-c12e-4b38-a733-44f5e817de8e tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.125036 Oct 18 16:08:42.715452 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 966/1954] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:08:42 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511/os-server-password => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:08:42.719798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ef57d02-27d1-4870-8b9e-ebabb6d1d22f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101054 Oct 18 16:08:42.720659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 989/1955] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:42 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:42.741500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.741500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:42.742971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.743479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.744210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.745114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:42.745584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:42.746015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:42.759099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=5,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:42.796033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:08:42.932105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:42.972935 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34a3a9d9-6ea0-4183-92d0-fc655fbf0ff0 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 204 len: 0 microversion: 2.1 time: 0.245437 Oct 18 16:08:42.980848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 967/1956] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:42 2022] DELETE /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:42.988677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:42.989364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:43.000796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.001319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.001765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:43.002481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.002940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.003370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:43.181498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:43.182814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:43.210528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.210528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.210528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:43.210528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.210966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.210966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:43.552598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:43.564816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:43.569471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:43.571523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b8d827e-eb92-4405-9bf7-9bd7becf4e81 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.398845 Oct 18 16:08:43.585412 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 968/1957] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:43 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:08:43.605065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1598de88-f475-4d4e-8fc3-f80979953a7a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd174a670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:43.733734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1598de88-f475-4d4e-8fc3-f80979953a7a tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.132931 Oct 18 16:08:43.750683 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 969/1958] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:43 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:43.771042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:43.771700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:43.811844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.816943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.820211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:43.828329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:43.832585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:43.834668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:44.119178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:44.131375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a17cb11-492d-4999-8b0a-406026df1b83 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1274 microversion: 2.1 time: 0.371941 Oct 18 16:08:44.138747 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 970/1959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:43 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1274 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:44.160051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:44.174314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:44.187224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:44.209608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:44.216267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:44.219187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:44.220295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:44.221034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:44.222850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:44.252422 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1bc4858c-53d8-491a-a30f-ad7e8dc8a94f tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1510 microversion: 2.1 time: 1.267349 Oct 18 16:08:44.256075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 990/1960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:42 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1510 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:44.373935 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bae3b786-9ee6-40da-b582-c5593defc6f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233783 Oct 18 16:08:44.389643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 971/1961] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:44 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:44.626156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:44.627094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:44.650782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:44.653551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:44.659007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:44.662941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:44.663692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:44.665378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:44.749982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a122b367-056e-41c4-ada2-a0ee3adabf73 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd18ceb80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:44.855584 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a122b367-056e-41c4-ada2-a0ee3adabf73 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.110061 Oct 18 16:08:44.856357 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 972/1962] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:44 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:45.114665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.136852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.139710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.148919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e5186e0-9c14-47a4-9e18-f888c98589a8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.533491 Oct 18 16:08:45.155341 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 991/1963] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:44 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:45.163962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:45.165368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.183777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.187451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.188157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.189163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.189794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.193245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.283386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:45.284006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.305554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.306329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.306936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.309289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.312945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.313889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.851587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.867886 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83f1333e-05b0-4780-bdc8-d58d1eda4861 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.709360 Oct 18 16:08:45.873039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 973/1964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:45.880804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:45.886103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.902556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.903925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.904563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.905512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.908018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.913655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.958959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.986577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-644ec38d-e604-4a44-9414-636d4daf99b9 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1510 microversion: 2.1 time: 0.707555 Oct 18 16:08:45.988701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 992/1965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:45.997697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e322daa-52ea-45b4-8ed5-5f6e42082a51 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd65223a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:46.002074 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99d39a9e-cb8a-4c57-a392-c52b62173ebd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127580 Oct 18 16:08:46.002671 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 974/1966] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:46.075322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e322daa-52ea-45b4-8ed5-5f6e42082a51 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.084253 Oct 18 16:08:46.075922 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 993/1967] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:46.184491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:46.185192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:46.205114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.205610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.206046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.206761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.207213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.208165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.326952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d783dfb-0c61-45d7-ade2-42b780ae57d0", "tag": "9fa21e49-45ac-4489-afc3-f09c4d4d6fbb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:46.371993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.375716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.376853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.432216 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] Creating event network-changed:9fa21e49-45ac-4489-afc3-f09c4d4d6fbb for instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 on n-h2-858383-14 Oct 18 16:08:46.450490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-39f985a4-305a-4f3f-a841-391989299126 req-02a53427-c013-4743-b8fb-a8c1c5e90eaa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138165 Oct 18 16:08:46.451269 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 994/1968] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:46.762168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:46.809284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:46.814208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:46.815955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02cbbeb4-ec0f-48d1-a14b-ec46016f20e1 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.636603 Oct 18 16:08:46.841907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 975/1969] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:46 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:46.904878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:46.905936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:46.932391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.934499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.935372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.937129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.937856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.944545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:47.015781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:47.018288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:47.041737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.044663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.045153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:47.045892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.046357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.046784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:47.173309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1daa6d92-9251-42d2-b0b6-2345814f72ae tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162431 Oct 18 16:08:47.196802 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 976/1970] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:47 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:47.196802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:47.196802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:47.210418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.211289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.211912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:47.212844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.213540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.214170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.144112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.161556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4cd4076-3f67-4042-9bb5-7c253766abfd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 1.265795 Oct 18 16:08:48.162902 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 995/1971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:46 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:48.214952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.229441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23c436a3-4cfb-4c92-90ad-8bc6354972a2 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1468 microversion: 2.1 time: 1.047505 Oct 18 16:08:48.236109 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 977/1972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:47 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1468 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:48.245186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4c0b576-1e65-426d-b690-b8e54bfa4367 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16eb700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:48.336459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4c0b576-1e65-426d-b690-b8e54bfa4367 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.098613 Oct 18 16:08:48.337415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 978/1973] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:48 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:48.349738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01b8f38-b61b-498c-8ccc-fadba3172511", "name": "network-vif-deleted", "tag": "9411f477-95b5-4e5b-97f9-08c6f1ed9595"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:48.373893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.375789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.376451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.434906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] Creating event network-vif-deleted:9411f477-95b5-4e5b-97f9-08c6f1ed9595 for instance c01b8f38-b61b-498c-8ccc-fadba3172511 on n-h1-858383-14 Oct 18 16:08:48.448543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7643eb09-241d-4942-b5ff-3c65f31de62a req-dde16af3-f8ef-42ce-a71c-e02a96fdc124 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109088 Oct 18 16:08:48.452622 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 979/1974] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:48.460328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:48.461355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:48.461931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:48.464250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.465084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.465813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.467071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.468127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.468953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.475803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.476291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.476732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.477463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.484811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.485811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.519183 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b01dbb4-7823-4017-bddf-71f8a7e05782 tempest-AZV2TestJSON-1840902686 tempest-AZV2TestJSON-1840902686-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.354806 Oct 18 16:08:48.521594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 996/1975] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 18 16:08:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:08:48.539812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:48.578777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:48.600597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.604563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.605463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.606819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:48.613496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:48.616508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.757518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7da27267-dc35-460c-bc4f-98f88d4484cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234147 Oct 18 16:08:48.770835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 997/1976] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:48 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:48.959992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.976908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.988773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.990828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3cd595f9-fed1-4324-b873-c0dd856222eb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.536181 Oct 18 16:08:48.998502 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 980/1977] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:48 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:49.187696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:49.188449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:49.207024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.208205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.208669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.214003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.214521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.214964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.259498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:49.260118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:49.276980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.277581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.278093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.278876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.279601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.280260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.355606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.356218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.358046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.360136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lazy-loading 'fault' on Instance uuid c01b8f38-b61b-498c-8ccc-fadba3172511 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:49.372068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:49.474751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:49.555685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17681a7d5e42d1a134801c65fa65b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:49.578274 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36e24fb2-18a8-4423-919d-7cb1ef299c31 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 200 len: 1305 microversion: 2.1 time: 0.323929 Oct 18 16:08:49.578875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 981/1978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:49 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:49.593496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39f78654-8a53-45a6-b9e7-99ff94a128ff tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1855dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:49.678908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:49.683880 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39f78654-8a53-45a6-b9e7-99ff94a128ff tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1452 microversion: 2.1 time: 0.094116 Oct 18 16:08:49.684766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 982/1979] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:49 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:49.699286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d201f5f6-1649-40fc-9ccd-d508515f0331 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.515424 Oct 18 16:08:49.721018 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 998/1980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:49 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:49.779306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:49.783875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:49.802234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.803255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.804363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.807225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.814302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.815823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.902841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9274cce-1deb-47d5-befc-20453d2d686c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128934 Oct 18 16:08:49.911810 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 983/1981] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:49 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:50.021737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:50.022533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:50.033052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.035533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.038375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.040014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.045445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.048549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.607044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:50.608450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] [instance: c01b8f38-b61b-498c-8ccc-fadba3172511] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:50.623445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.627107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.628009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.632248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.633316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.634012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.684007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] HTTP exception thrown: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Request method failure captured: Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 HTTP/1.1 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs9rRYfetiuwlLMmF8rQdGNY_o84z_JmQ7APmAgEKY5gz5bmN-bEAM382nyEea3zpnPOs-ro1vgGfTLaiXTh2S-yeNLYqo3e98BLwdHgKtYV3LHyAJQZGpiQHYSNroE0PSyeKb0n7FBY9pIQkbEdJTfNNLAE41B8mrd_kaNcdWyQkxE Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d2282f5ad29c4ff8b49ab1d29fdc4331 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerPasswordTestJSON-1528116742 Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:08:50.687827 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d2282f5ad29c4ff8b49ab1d29fdc4331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d2282f5ad29c4ff8b49ab1d29fdc4331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d2282f5ad29c4ff8b49ab1d29fdc4331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d2282f5ad29c4ff8b49ab1d29fdc4331"}]}] Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerPasswordTestJSON-1528116742 Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d2282f5ad29c4ff8b49ab1d29fdc4331 Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1528116742 Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerPasswordTestJSON-1528116742-project Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: be17681a7d5e42d1a134801c65fa65b0 Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerPasswordTestJSON-1528116742-project Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. Oct 18 16:08:50.689536 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c01b8f38-b61b-498c-8ccc-fadba3172511'} Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:50.690594 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. Oct 18 16:08:50.692341 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:08:50.698104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] Returning 404 to user: Instance c01b8f38-b61b-498c-8ccc-fadba3172511 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:50.700514 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49546830-dee8-4986-aeea-e0fd4c5f3f61 tempest-ServerPasswordTestJSON-1528116742 tempest-ServerPasswordTestJSON-1528116742-project] 10.222.0.78 "GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511" status: 404 len: 111 microversion: 2.1 time: 0.097648 Oct 18 16:08:50.705354 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 984/1982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/servers/c01b8f38-b61b-498c-8ccc-fadba3172511 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:08:50.707938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:50.726717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fecee222-0224-48fc-9b02-f88bd3a10e93 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1855430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:50.727010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:50.730964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:50.740571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6429eed-1018-4e94-809d-6a2f94e0a21a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.717934 Oct 18 16:08:50.753021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 999/1983] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:50.771127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:50.778289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:50.808511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.809045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.809631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.813258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.815932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.816496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.873815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fecee222-0224-48fc-9b02-f88bd3a10e93 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1461 microversion: 2.1 time: 0.167014 Oct 18 16:08:50.874613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 985/1984] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1461 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:50.895877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94d6f5cb-6d8d-403e-93a9-2a5ae2919b79 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd646cc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:51.002899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94d6f5cb-6d8d-403e-93a9-2a5ae2919b79 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 200 len: 1461 microversion: 2.1 time: 0.117905 Oct 18 16:08:51.005920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 986/1985] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:51.024838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:51.028486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:51.035864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:51.053312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.059170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.060638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.061796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.063178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.064726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.159694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d52b399b-ce82-4953-99a1-cf13f02cc2d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148654 Oct 18 16:08:51.165299 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 987/1986] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:51 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:51.172401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:51.173815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:51.189596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.191660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.193054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.195432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.196041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.197141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.231355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:51.244371 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13eb8868-64a6-4ed2-accf-1822ddad778a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.501598 Oct 18 16:08:51.246485 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1000/1987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:51.852193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4ac95e2-0fb2-4d30-804d-86d522b321ef tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd65085e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1834480547", "description": "tempest-description-162954886"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:51.945904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:51.956917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c8fa80d-adeb-4672-8c9d-985f90c0f30e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1481 microversion: 2.1 time: 0.794080 Oct 18 16:08:51.960051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 988/1988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:51 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1481 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:51.965036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:51.967306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:51.991479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.993752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.994454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.997234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:51.998713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:51.999285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.006591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:52.055884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4ac95e2-0fb2-4d30-804d-86d522b321ef tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.808163 Oct 18 16:08:52.056693 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1001/1989] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:52.071326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f892aff7-d50e-420e-bd36-84a99497ab0e tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd64f5280>, body: {"security_group_rule": {"parent_group_id": "1ab2d608-9e96-4154-a3b6-86d281f4a4f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:52.435893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:52.446998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:52.462480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:52.467522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55d5a87b-eba1-4b0e-b8e2-b116d0c7ee85 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.503706 Oct 18 16:08:52.469952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 989/1990] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:51 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:52.483748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:52.486052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:52.509162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.509644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.510294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.513177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.513811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.514926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.630627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a93cddb8-3fdb-4c59-9448-14ec806eae7e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156254 Oct 18 16:08:52.637877 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 990/1991] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:52 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:52.649948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:52.651640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:52.682664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.683166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.683638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.690820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.697720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.698257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.811976 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f892aff7-d50e-420e-bd36-84a99497ab0e tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.745426 Oct 18 16:08:52.813362 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1002/1992] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:08:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:08:52.821543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e05c9da-0090-4e3c-8989-7a5fd5235061", "name": "network-vif-plugged", "status": "completed", "tag": "682a0667-46e4-499f-a988-6326eff8cb7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:52.856736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.858557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.859399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.901152 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] Creating event network-vif-plugged:682a0667-46e4-499f-a988-6326eff8cb7e for instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 on n-h2-858383-14 Oct 18 16:08:52.911446 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0729e591-fa11-4628-93dc-a3017b7f7375 req-0089cde7-5a39-4988-a53a-f1a3566a3496 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094717 Oct 18 16:08:52.916838 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1003/1993] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:52.959389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d744e627-27be-4ca7-93da-984967289277 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd652eee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2028130331", "description": "tempest-description-300376591"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:53.170962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.184071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd2e5656-1613-4bba-ba12-2a0eeb2a9751 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.544527 Oct 18 16:08:53.186933 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 991/1994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:52 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:53.202434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:53.208838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:53.218162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.218653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.219085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.221437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.224264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.226062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.531567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.543093 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d744e627-27be-4ca7-93da-984967289277 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.624743 Oct 18 16:08:53.543701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1004/1995] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:53.547825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4e4b48e-8312-47c2-ab08-c4827b5f4775 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1468 microversion: 2.1 time: 0.356233 Oct 18 16:08:53.548493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:53.549256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:53.558659 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 992/1996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:53 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1468 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:53.565508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.567058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.567962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.568949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.570354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.570875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ebc4a05e-dd46-4046-bfb0-8d62599a9b57 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd6485280>, body: {"security_group_rule": {"parent_group_id": "06ab9982-2d68-4e82-8220-2a8603174f0d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:53.573577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.977982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.986607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.988058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.989584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8322418-e0ec-41c7-aed5-7c49ef358bfd tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.444401 Oct 18 16:08:53.990171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1005/1997] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:53 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:53.995064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1063741933"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:53.997473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:54.003576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.004059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.005475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.006453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.007092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.007687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.249560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:54.269412 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-074dda29-1ca3-40b9-9add-8d8cec83b20c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "POST /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1/action" status: 202 len: 0 microversion: 2.1 time: 0.277651 Oct 18 16:08:54.271450 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1006/1998] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:08:53 2022] POST /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:08:54.277746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:54.280467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:54.292259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.293286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.293896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.294857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.295480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.296077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.351252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e85cca33-7261-485a-8a96-8f479e5bfb0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077712 Oct 18 16:08:54.353141 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ebc4a05e-dd46-4046-bfb0-8d62599a9b57 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.790746 Oct 18 16:08:54.354452 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1007/1999] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:08:54 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:08:54.361610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 993/2000] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:08:53 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:54.367449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9625dc12-3f49-4ba8-901f-c7610e7cd417 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd176be50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:54.391724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:54.392347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:54.405522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.406019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.406463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.407174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.407631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.408101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.431777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9625dc12-3f49-4ba8-901f-c7610e7cd417 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.069044 Oct 18 16:08:54.447349 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 994/2001] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:54 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:54.447349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b47406e-ca0b-4c25-afab-d4a243bd5db2 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd182f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1138910312", "description": "tempest-description-132217532"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:54.698123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:54.707491 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d51a669-77eb-458a-8b06-992ec4bf3f9f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.351594 Oct 18 16:08:54.711952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1008/2002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:54 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:55.016441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:55.017197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:55.032874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.039449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.040361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.041504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.044580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.045320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.396128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:55.438127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:55.440263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:55.449890 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ffd90185-8eac-4b1b-9e01-1c4bee58a8da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1280 microversion: 2.25 time: 0.437038 Oct 18 16:08:55.451493 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1009/2003] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:55 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1280 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:08:55.459443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385e121c-14e0-4739-8f89-0cd69ceb7b7e", "name": "network-vif-unplugged", "status": "completed", "tag": "f447c56d-e7d3-4951-98af-dc5ebf3ba71a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:55.480270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.481219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.482169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.531582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] Creating event network-vif-unplugged:f447c56d-e7d3-4951-98af-dc5ebf3ba71a for instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e on n-h1-858383-14 Oct 18 16:08:55.546502 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e8dc77c7-ac22-4356-bd6f-66500fd96613 req-79f25214-079e-4b12-93b4-1c1273f5274f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093591 Oct 18 16:08:55.547205 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1010/2004] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:55.586323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fe844ce-eefd-453d-9c7d-a5e377200efb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd659eaf0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:55.655601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b47406e-ca0b-4c25-afab-d4a243bd5db2 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.214045 Oct 18 16:08:55.669610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 995/2005] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:55.684145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a22aaaa8-f941-4522-9b62-346246016ea4 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd16eed30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1023442589", "description": "tempest-description-678502459"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:55.718801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fe844ce-eefd-453d-9c7d-a5e377200efb tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.168332 Oct 18 16:08:55.728005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1011/2006] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:55 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:55.740027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:55.740788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:55.759432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.765849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.766565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.768124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.768877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.769517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:56.150473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:56.158966 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fe6a180-fe0b-4114-8707-d96514de40e3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.427535 Oct 18 16:08:56.165404 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1012/2007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:55 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:56.357522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a22aaaa8-f941-4522-9b62-346246016ea4 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.685873 Oct 18 16:08:56.359083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 996/2008] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:56.382747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ca832a0-7f87-4e38-908c-6309d6357693 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd27caf70>, body: {"security_group_rule": {"parent_group_id": "be8c1145-5341-4431-bf1f-979690cfa6f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5ddead71-cced-4013-a679-9d931a4b5ac9"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:56.479938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:56.480661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:56.495083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:56.497142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:56.498800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:56.500575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:56.502218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:56.503326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:56.923805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ca832a0-7f87-4e38-908c-6309d6357693 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.547379 Oct 18 16:08:56.925558 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1013/2009] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:08:56 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:56.946786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b0b949d4-f488-4faa-91e8-e2e5ce6eddf4 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd65a0c10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:57.041503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b0b949d4-f488-4faa-91e8-e2e5ce6eddf4 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.112634 Oct 18 16:08:57.051868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1014/2010] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:56 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:57.066077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a869878-e41b-4063-b8b0-ce8950869c8e tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd65229d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-692531298", "description": "tempest-description-1133995271"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:57.143320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.159439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.161950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.164124 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52e2ffc3-b8b7-45c7-b770-08f15c79fb26 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1476 microversion: 2.25 time: 0.688241 Oct 18 16:08:57.165319 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 997/2011] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:56 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1476 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:57.196689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:57.200134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:57.227699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.228245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.229044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.229796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.230244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.230675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.491488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a869878-e41b-4063-b8b0-ce8950869c8e tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.437472 Oct 18 16:08:57.513447 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1015/2012] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:57.516385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.537333 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9b4b49e-b1a7-440a-9e13-95cfb5fa5900 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.350919 Oct 18 16:08:57.538952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 998/2013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:57 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:57.545059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be24879b-48b2-4405-a4db-171b7661f3c3 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd18ce1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1483008", "description": "tempest-description-1197679258"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:57.945430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:57.949708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:57.971429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.973793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.975214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.977370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.978047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.980035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.062567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be24879b-48b2-4405-a4db-171b7661f3c3 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.522103 Oct 18 16:08:58.071489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 999/2014] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:08:57 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:58.076695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d783dfb-0c61-45d7-ade2-42b780ae57d0", "name": "network-vif-plugged", "status": "completed", "tag": "9fa21e49-45ac-4489-afc3-f09c4d4d6fbb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:58.103609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.104382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.104821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.129853 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] Creating event network-vif-plugged:9fa21e49-45ac-4489-afc3-f09c4d4d6fbb for instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 on n-h2-858383-14 Oct 18 16:08:58.143684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1e5b5236-af03-4dfd-91fc-81b543fe09f6 req-a5642f0f-533b-45b7-ba31-4a042ee3f30a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070663 Oct 18 16:08:58.145254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1000/2015] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:58.151681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1aaef0f6-70c1-4c7e-bf0e-8faaed2cd32e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16fe790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:58.276907 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1aaef0f6-70c1-4c7e-bf0e-8faaed2cd32e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.130106 Oct 18 16:08:58.277702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1001/2016] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:58 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:58.286658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e139704-3b14-4fb6-9e8a-e024eaf30871 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd1701ee0>, body: {"security_group_rule": {"parent_group_id": "9ddb92d1-4037-4d35-b566-364cc034dc2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "61059639-5e20-4ebb-b3e6-351adbd029c8"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:58.500373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:58.539483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 5e05c9da-0090-4e3c-8989-7a5fd5235061 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:58.564114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f7bb78f-4ec0-4322-84a5-014bf402f632 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1970 microversion: 2.25 time: 1.049049 Oct 18 16:08:58.578034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1016/2017] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:57 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1970 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:58.592326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:58.593279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:58.600385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.601198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.602512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.603703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.604345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.604945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.909501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:58.927052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da46ba3c-4b26-4548-92d5-bfa39da1066e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 0.346745 Oct 18 16:08:58.943596 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1017/2018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:58 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:58.948781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:58.949442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:58.969663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.970162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.970612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.971328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.981775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.982240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.244591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e139704-3b14-4fb6-9e8a-e024eaf30871 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 328 microversion: 2.1 time: 0.965112 Oct 18 16:08:59.246186 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1002/2019] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:08:58 2022] POST /compute/v2.1/os-security-group-rules => generated 328 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:59.258571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3491ac84-9f30-4159-b116-46a241aa921f tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd16eb550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:59.268444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 5e05c9da-0090-4e3c-8989-7a5fd5235061 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:59.311220 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b8b870a8-ff69-4326-9de1-32fbe5d28414 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1970 microversion: 2.25 time: 0.366399 Oct 18 16:08:59.312335 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1018/2020] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:08:58 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1970 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:08:59.318053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae41ea02-fa4e-460c-be44-108bd3b99ee5 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd658d790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:59.374297 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae41ea02-fa4e-460c-be44-108bd3b99ee5 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.059298 Oct 18 16:08:59.375497 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1019/2021] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:59 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:59.381493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:59.385446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.386157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.386773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.387798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.388485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.389117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.434348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-76b996e7-e300-42b8-9c32-7edb119f6513 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.057444 Oct 18 16:08:59.435284 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1020/2022] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 18 16:08:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:08:59.452759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-14", "block_migration": "auto"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:59.462134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:59.487639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.488173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.495565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.496591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.497108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.497551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.578116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'flavor' on Instance uuid 5e05c9da-0090-4e3c-8989-7a5fd5235061 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:08:59.614647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Going to try to live migrate instance to n-h1-858383-14 {{(pid=120570) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:09:00.465969 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3491ac84-9f30-4159-b116-46a241aa921f tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/61059639-5e20-4ebb-b3e6-351adbd029c8" status: 202 len: 0 microversion: 2.1 time: 1.211960 Oct 18 16:09:00.467830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1003/2023] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:08:59 2022] DELETE /compute/v2.1/os-security-groups/61059639-5e20-4ebb-b3e6-351adbd029c8 => generated 0 bytes in 1214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:09:00.486357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:00.489159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:00.518311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.519395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.520688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.521742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.525732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.526450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:01.552985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:01.576473 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4586c55b-7c47-4b52-902d-23bd3ca3541a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1316 microversion: 2.1 time: 1.107452 Oct 18 16:09:01.595374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1004/2024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:00 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1316 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:01.611736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28ebb8ff-3d4f-4fd9-8f52-70669ecf55a8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd18551f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:01.691936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28ebb8ff-3d4f-4fd9-8f52-70669ecf55a8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.092704 Oct 18 16:09:01.693538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1005/2025] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:01 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:01.711098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b027a0f-b04a-4aea-8049-58330d2be18c tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd17398b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:01.981632 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b027a0f-b04a-4aea-8049-58330d2be18c tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/9ddb92d1-4037-4d35-b566-364cc034dc2f" status: 200 len: 247 microversion: 2.1 time: 0.286768 Oct 18 16:09:01.991809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1006/2026] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:09:01 2022] GET /compute/v2.1/os-security-groups/9ddb92d1-4037-4d35-b566-364cc034dc2f => generated 247 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:01.998408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-803bd215-3b60-4bdd-964f-74d205adf57f tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd21961f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-269203179", "description": "tempest-description-1641085074"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:02.587133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-803bd215-3b60-4bdd-964f-74d205adf57f tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.592240 Oct 18 16:09:02.588080 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1007/2027] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:09:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:02.601925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ab9bc1e-f934-4eca-a7dd-407492b67227 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd1739160>, body: {"security_group_rule": {"parent_group_id": "eab9aa21-f0ee-4a02-825b-ac18963a3da6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:02.827072 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5384dadd-312d-4fb4-906a-5e7dd0cc31ab tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061/action" status: 202 len: 0 microversion: 2.25 time: 3.380945 Oct 18 16:09:02.829453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1021/2028] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:08:59 2022] POST /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061/action => generated 0 bytes in 3385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:02.836584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:02.843162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:02.869996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:02.881188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:02.882481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:02.886495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:02.887281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:02.887917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.213654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.236370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83f3b8f0-0dd6-48a0-b2db-29b85dfeeaf8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1466 microversion: 2.1 time: 0.395479 Oct 18 16:09:03.237652 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1022/2029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:02 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1466 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:03.264887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93c90b2f-5a73-49cc-af64-063d96a26437 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd651aca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.351947 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93c90b2f-5a73-49cc-af64-063d96a26437 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.093869 Oct 18 16:09:03.354435 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1023/2030] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:03.364517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.365253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:03.373012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.376368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.384224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.385759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.386951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.387727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.523353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ab9bc1e-f934-4eca-a7dd-407492b67227 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.926267 Oct 18 16:09:03.524291 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1008/2031] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:09:03.530974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.534903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:03.552139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.555966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.557095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.557520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.558228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.558677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.559098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.562370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.563828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.565124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca676b31-a88a-4c53-ad85-df8643f7bb25 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.208670 Oct 18 16:09:03.573096 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1024/2032] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:03.577353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f71366ef-9de2-4c12-8335-28cfe89a67d2 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Action: 'create', calling method: .version_select at 0x7f5fd650cdc0>, body: {"security_group_rule": {"parent_group_id": "eab9aa21-f0ee-4a02-825b-ac18963a3da6", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:03.912043 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f71366ef-9de2-4c12-8335-28cfe89a67d2 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.343819 Oct 18 16:09:03.913938 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1025/2033] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:03 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:03.925976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-89ba30a1-6a08-465f-90b1-fdd700fa30b5 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd651aee0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.990479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-89ba30a1-6a08-465f-90b1-fdd700fa30b5 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/eab9aa21-f0ee-4a02-825b-ac18963a3da6" status: 200 len: 664 microversion: 2.1 time: 0.068370 Oct 18 16:09:03.999914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1026/2034] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/os-security-groups/eab9aa21-f0ee-4a02-825b-ac18963a3da6 => generated 664 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:09:04.005854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4159225-9809-4da4-8df7-afa8c1dfc580 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd659e820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:04.159819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d31effee-7d0d-485b-a199-e731cf2b6de1 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1619 microversion: 2.1 time: 0.632814 Oct 18 16:09:04.160925 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1009/2035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1619 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:04.374532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3937e8aa-d834-4210-a144-01b4124b95e1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1739550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:04.439351 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4159225-9809-4da4-8df7-afa8c1dfc580 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/08ba38c4-98c1-45b9-9705-ecbd7a1fa0da" status: 202 len: 0 microversion: 2.1 time: 0.437335 Oct 18 16:09:04.440940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1027/2036] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 18 16:09:04 2022] DELETE /compute/v2.1/os-security-group-rules/08ba38c4-98c1-45b9-9705-ecbd7a1fa0da => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:04.447635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1781110979", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a"]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:04.478231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3937e8aa-d834-4210-a144-01b4124b95e1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.111252 Oct 18 16:09:04.488804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1010/2037] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:04 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:04.499048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3561460d-95a8-4c6c-a574-1653104aba77 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd1712940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:04.545818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:09:04.869595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:04.870022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:04.870498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:04.870930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:04.871318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:04.887386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:04.887921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:04.888378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:04.889879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:04.890347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:04.890774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:04.911197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:04.917577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:04.939092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:04.942607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:05.036373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d2c58d3-cf72-4245-9731-defa969763a9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593419 Oct 18 16:09:05.042369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1028/2038] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:09:05.048172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-plugged", "status": "completed", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:05.097720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.098557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.116004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.139408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] Creating event network-vif-plugged:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:09:05.171769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a4391228-96e5-423c-8774-308e57524731 req-8a0f82ee-b2d5-4873-b2f1-f802a7274321 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122849 Oct 18 16:09:05.173512 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1029/2039] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:05.182721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.184117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:05.205700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.208101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.210210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.216822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.217999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.218933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.405180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3561460d-95a8-4c6c-a574-1653104aba77 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/eab9aa21-f0ee-4a02-825b-ac18963a3da6" status: 202 len: 0 microversion: 2.1 time: 0.913536 Oct 18 16:09:05.406421 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1011/2040] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:04 2022] DELETE /compute/v2.1/os-security-groups/eab9aa21-f0ee-4a02-825b-ac18963a3da6 => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:05.414298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a41d6df2-f7bb-4374-867d-48a5d887b722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.415029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a41d6df2-f7bb-4374-867d-48a5d887b722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:05.605494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a41d6df2-f7bb-4374-867d-48a5d887b722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:05.627213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a41d6df2-f7bb-4374-867d-48a5d887b722 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1217 microversion: 2.1 time: 0.216747 Oct 18 16:09:05.629164 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1012/2041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:05 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:05.641428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd1712790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.692389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:09:05.693179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Neutron security group 61059639-5e20-4ebb-b3e6-351adbd029c8 not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:09:05.694277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] HTTP exception thrown: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.694277 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Request method failure captured: Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-security-groups/61059639-5e20-4ebb-b3e6-351adbd029c8 HTTP/1.1 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs-S4eEzvZR2csqysX9UdZlitfKTOg7MQaqbDy6xujs2o6Gs3LI_vVoY340T1aaMLSdjX-1wjHr_h5WV7KfjUA8ND985QVuZj0P0SruQ0XKGBwoa2FUWeW4ROZQxXh0SktTeeNz6Hp8jUfSqlmbdb9tfvIfBir8j55x5Cb851trQQic Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 657fa7d919794871afefb189abc7e337 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1171083031 Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:09:05.696488 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/657fa7d919794871afefb189abc7e337"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/657fa7d919794871afefb189abc7e337"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_657fa7d919794871afefb189abc7e337"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/657fa7d919794871afefb189abc7e337"}]}] Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1171083031 Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 657fa7d919794871afefb189abc7e337 Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1171083031 Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupRulesTestJSON-1171083031-project Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4debcc0bc2264da988d348a818838adb Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1171083031-project Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.698295 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '61059639-5e20-4ebb-b3e6-351adbd029c8'} Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:09:05.699689 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:09:05.701399 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.703807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Returning 404 to user: Security group 61059639-5e20-4ebb-b3e6-351adbd029c8 does not exist Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-57611a43-a50a-4826-ab00-56efbf19df26'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18f5a631-8e65-4271-8a46-1479fde7455d tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/61059639-5e20-4ebb-b3e6-351adbd029c8" status: 404 len: 194 microversion: 2.1 time: 0.065838 Oct 18 16:09:05.705894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1013/2042] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:05 2022] DELETE /compute/v2.1/os-security-groups/61059639-5e20-4ebb-b3e6-351adbd029c8 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:05.717736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4dd75a89-5594-492d-bc03-0dcbbff4d706 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd17398b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.815270 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4dd75a89-5594-492d-bc03-0dcbbff4d706 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.115138 Oct 18 16:09:05.829021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1014/2043] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:05 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:05.845842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0c7f436-75a3-4501-b7dc-004ed5838bb7 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd1712160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:06.096226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:06.110168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:06.114579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:06.120322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-012a4e50-2394-4398-a767-2418d748f1a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.942984 Oct 18 16:09:06.123293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1030/2044] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:05 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:06.168374 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0c7f436-75a3-4501-b7dc-004ed5838bb7 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9ddb92d1-4037-4d35-b566-364cc034dc2f" status: 202 len: 0 microversion: 2.1 time: 0.338130 Oct 18 16:09:06.170105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1015/2045] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:05 2022] DELETE /compute/v2.1/os-security-groups/9ddb92d1-4037-4d35-b566-364cc034dc2f => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:06.179218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0705705-20f0-4135-9e51-60aaa16f8963 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd188b280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:06.503237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-285914668", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "571d9adc-eb14-401c-8cde-5cdfbe7e93d2"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:06.592692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] validate_networks() for [('571d9adc-eb14-401c-8cde-5cdfbe7e93d2', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:09:06.752611 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0705705-20f0-4135-9e51-60aaa16f8963 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/5ddead71-cced-4013-a679-9d931a4b5ac9" status: 202 len: 0 microversion: 2.1 time: 0.577819 Oct 18 16:09:06.753693 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1016/2046] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:06 2022] DELETE /compute/v2.1/os-security-groups/5ddead71-cced-4013-a679-9d931a4b5ac9 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:06.759798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:06.760449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:06.817661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:06.820460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:06.821858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:06.823183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:06.825492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:06.827114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:06.971131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:06.987284 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6021aba3-8a93-4f51-8515-f99472f0e41a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1269 microversion: 2.1 time: 0.232373 Oct 18 16:09:06.992590 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1017/2047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:06 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:07.004283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95b1e790-2938-4a70-a255-c8007d3274f5 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd1712ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:07.478626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:07.479689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:07.480652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:07.481376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:07.481976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:07.492765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:07.493807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:07.494442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:07.495524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:07.496426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:07.497217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:07.524938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:07.532976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for user b7d816c3043c435d8bf79d2c819518ec and project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:07.561121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:07.567781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:07.720589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2348ed7c-8e9b-4aa7-a9e2-c9015d4d3e81 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595406 Oct 18 16:09:07.726610 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1031/2048] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:09:07.742756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-826e3b90-f275-4e31-a1cf-2b4b9d035b70 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd6522e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:08.526313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95b1e790-2938-4a70-a255-c8007d3274f5 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/be8c1145-5341-4431-bf1f-979690cfa6f8" status: 202 len: 0 microversion: 2.1 time: 1.529992 Oct 18 16:09:08.528071 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1018/2049] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:06 2022] DELETE /compute/v2.1/os-security-groups/be8c1145-5341-4431-bf1f-979690cfa6f8 => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:08.533262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:08.534320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:08.542274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:08.543425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:08.544366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:08.545957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:08.547252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:08.548144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:09.116044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:09.135878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:09.140984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:09.145738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ce4abd8-16f2-421c-ad8b-708b56033137 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.616294 Oct 18 16:09:09.149875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1019/2050] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:08 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:09.155053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:09.158919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:09.175096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:09.176807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:09.177610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:09.178654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:09.182299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:09.183596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:09.350705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:09.359804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-357f5cac-dbc2-48cd-9ad0-41ca2469fa83 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1221 microversion: 2.1 time: 0.208391 Oct 18 16:09:09.362658 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1020/2051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:09 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:09.377388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:09.383751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:09.396281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:09.397366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:09.398078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:09.401727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:09.402650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:09.403344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:09.727627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:09.740758 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1758c5ee-3b40-41f7-811b-5c3e56fc34f7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1275 microversion: 2.1 time: 0.373218 Oct 18 16:09:09.747315 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1021/2052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:09 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:09.765399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd151032-45a2-4b89-9575-69bfa90e163c tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd16edaf0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:11.211260 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd151032-45a2-4b89-9575-69bfa90e163c tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/06ab9982-2d68-4e82-8220-2a8603174f0d" status: 202 len: 0 microversion: 2.1 time: 1.459041 Oct 18 16:09:11.212517 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1022/2053] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:09 2022] DELETE /compute/v2.1/os-security-groups/06ab9982-2d68-4e82-8220-2a8603174f0d => generated 0 bytes in 1464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:11.218093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:11.218918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:11.258517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:11.263310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:11.268625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:11.269655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:11.278418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:11.279082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:12.667841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:12.684151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:12.688570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:12.689728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-368e8d64-7644-46ae-a8d3-3a0d89da50e3 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 1.476074 Oct 18 16:09:12.698742 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1023/2054] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:11 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:12.703727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:12.704357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:12.746596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:12.747652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:12.748292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:12.749249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:12.762370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:12.762829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:13.594623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:13.606514 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-294e2a5b-75c2-4940-9822-685ea26c4b68 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1275 microversion: 2.1 time: 0.906495 Oct 18 16:09:13.642086 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1024/2055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:12 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1275 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:13.652965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:13.658511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:13.676008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:13.682483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:13.683771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:13.683771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:13.693392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:13.694712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:13.695815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:14.330564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:14.341444 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93b67538-403a-41ea-b4f2-ed949fe7df87 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 0.697182 Oct 18 16:09:14.342524 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1025/2056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:13 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:14.359095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5185b828-15cd-4292-8741-4f5c25bedde6 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] Calling method '.version_select at 0x7f5fd17015e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:15.087265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5185b828-15cd-4292-8741-4f5c25bedde6 tempest-SecurityGroupRulesTestJSON-1171083031 tempest-SecurityGroupRulesTestJSON-1171083031-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/1ab2d608-9e96-4154-a3b6-86d281f4a4f6" status: 202 len: 0 microversion: 2.1 time: 0.742144 Oct 18 16:09:15.089342 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1026/2057] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:09:14 2022] DELETE /compute/v2.1/os-security-groups/1ab2d608-9e96-4154-a3b6-86d281f4a4f6 => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:15.115151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba42be3d-9f5f-4f99-80e7-f03044feb794", "tag": "f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:15.187716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:15.188460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:15.189062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:15.243226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] Creating event network-changed:f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec for instance ba42be3d-9f5f-4f99-80e7-f03044feb794 on n-h2-858383-14 Oct 18 16:09:15.261172 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-20fc122c-cb2d-482e-9f0a-0100a6f990c9 req-874cc418-e2e6-494b-a961-da8193777736 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165545 Oct 18 16:09:15.262340 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1027/2058] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:15.275127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:15.276375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:15.285667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:15.287121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:15.288129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:15.289598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:15.290268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:15.292043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:15.613503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:16.202059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:16.214222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3765f1f9-182f-41f9-b5b6-81ceb4215a37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.948159 Oct 18 16:09:16.215126 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1028/2059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:15 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:16.228419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:16.231075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:16.254141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:16.257588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:16.259408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:16.260828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:16.263140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:16.264657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:16.277516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:16.817448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:16.828278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:16.829745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:16.830935 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02801752-a294-4ca8-b8c2-e6af441b0db4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.612899 Oct 18 16:09:16.832369 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1029/2060] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:16 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:16.864302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:16.876180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:16.899951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:16.900910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:16.900910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:16.901914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:16.902527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:16.910655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:17.400366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-826e3b90-f275-4e31-a1cf-2b4b9d035b70 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 9.672112 Oct 18 16:09:17.408946 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1032/2061] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:07 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 9675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:17.417940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:17.419906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:17.422309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:17.449884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:17.450416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:17.450912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:17.451742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:17.452322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:17.452766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:17.539172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:17.558496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:17.801895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:17.828135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d28f76c-5099-4955-af8c-cdb3d6a24c08 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.994631 Oct 18 16:09:17.849649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1030/2062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:16 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:17.873512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:17.874191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:17.894428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:17.894428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:17.894428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:17.900588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:17.900588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:17.900588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:18.507775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:18.540136 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0a9902c-5142-4892-9fcb-2524340378c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.685910 Oct 18 16:09:18.565352 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1031/2063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:17 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:18.572061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:18.612298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:18.614885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:18.617395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:18.679382 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] Creating event network-changed:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:09:18.698004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f6420a00-2d94-45d8-810f-c191eace5c02 req-efda7fae-7b10-48c1-b500-be602333588b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144502 Oct 18 16:09:18.701206 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1032/2064] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:18.711301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:18.719876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:18.742214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:18.742724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:18.743249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:18.743885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:18.744353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:18.744776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:19.179064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:19.196578 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94d897cc-f44d-478a-880d-c4cc32100e80 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 1.793253 Oct 18 16:09:19.203658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1033/2065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:17 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:19.209146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f561592-3cb5-4ba8-9651-39a1cccd9ce4 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64ae940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:19.308036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f561592-3cb5-4ba8-9651-39a1cccd9ce4 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.102514 Oct 18 16:09:19.318609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:19.324213 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1034/2066] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:19 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:19.328889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:19.333173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:19.337437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:19.339267 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9406cdb-9e3d-4678-95ed-960d02748fda tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.636698 Oct 18 16:09:19.345689 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1033/2067] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:18 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:19.347864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:19.352489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:19.353650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:19.364526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:19.365355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:19.365999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:19.368134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:19.368780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:19.371428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:19.379353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:19.380136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:19.380756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:19.381736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:19.383505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:19.385579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:19.438382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:19.659544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:19.668313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c63eb7e5-0518-41ca-bf39-1a7c788dc929 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.321216 Oct 18 16:09:19.669373 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1034/2068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:19 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:20.230211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:20.230780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:20.249613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.250418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.251076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.252033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.252661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.253357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.309243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:20.334024 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9bdf1d0a-03b9-4037-a575-e7e7fbe2da36 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 1.008389 Oct 18 16:09:20.334796 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1035/2069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:19 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:20.340899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3984cfc-510a-4b75-bc7b-2f40e6d9b608 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1fa4ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:20.433708 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3984cfc-510a-4b75-bc7b-2f40e6d9b608 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.097528 Oct 18 16:09:20.444163 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1036/2070] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:20 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:20.451681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-723007161"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:20.455206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:20.477024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.477832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.479783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.480943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.483881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.484639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.531090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:20.555445 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33e73bc0-ccaf-4b4e-bc35-f00ff3eb1787 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 0.329171 Oct 18 16:09:20.556908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1035/2071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:20 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:20.563938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:20.564833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:20.574337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.575012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.575621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.576643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.577414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.578339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.849221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:20.865377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:20.865892 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2575269-98e4-4a99-b5dc-ecf8720d345b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.420172 Oct 18 16:09:20.866646 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1037/2072] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:20 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 16:09:20.872183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:20.874558 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7dc90398-4332-4281-9507-f59057d30135 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.316253 Oct 18 16:09:20.875631 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1036/2073] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:20 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:20.885176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:20.886402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:20.896664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.900073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.902959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:20.903954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:20.904606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:20.907066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:21.329791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:21.341468 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-183fadb2-427b-4acb-877a-65108311010a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.469668 Oct 18 16:09:21.354035 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1038/2074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:20 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:21.453071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70591350-a074-4feb-accd-7fdbd124ccf2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16fee50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:21.525095 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70591350-a074-4feb-accd-7fdbd124ccf2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.077769 Oct 18 16:09:21.526380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1037/2075] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:21 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:21.600372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:21.601331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:21.615248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:21.616074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:21.616705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:21.617658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:21.621359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:21.622167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:21.905393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:21.906748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:21.921304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:21.923429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:21.924318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:21.926592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:21.929966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:21.931267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:22.143996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:22.157526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:22.163878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:22.170781 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9bf1956f-7e7e-4443-bd7e-35c4af5afffb tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.269206 Oct 18 16:09:22.172958 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1038/2076] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:21 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:09:22.383982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:22.385067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:22.395643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:22.415556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-906aaa58-7821-4ea4-a210-dc089e08e29d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 0.817236 Oct 18 16:09:22.419647 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1039/2077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:21 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:22.421650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:22.422526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:22.428679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:22.432364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:22.432821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:22.433851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:22.549969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-066d2e0a-d719-4cb6-9dea-7121b35a0a40 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64fe700>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:22.657426 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-066d2e0a-d719-4cb6-9dea-7121b35a0a40 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.120185 Oct 18 16:09:22.671558 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1040/2078] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:22 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:22.682325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba42be3d-9f5f-4f99-80e7-f03044feb794", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:22.702005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:22.702904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:22.704425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:22.722472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] Creating event network-vif-plugged:f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec for instance ba42be3d-9f5f-4f99-80e7-f03044feb794 on n-h2-858383-14 Oct 18 16:09:22.729174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6c7579f6-7db6-4674-9cbb-e5328fa7785f req-689e6c85-0b7c-4282-8a2a-783b199f5f21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054709 Oct 18 16:09:22.730528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1041/2079] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:22.794357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:22.806832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dae4a93f-c1f6-406c-916b-29d687ebaa26 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.428590 Oct 18 16:09:22.808245 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1039/2080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:22 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:23.203295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:23.204426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:23.212817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:23.213714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:23.214433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:23.215391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:23.216087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:23.216777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:23.443393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:23.444493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:23.452784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:23.453628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:23.454325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:23.455323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:23.456769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:23.457947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:23.669542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:23.687739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:23.704923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:23.713688 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fee5d4b8-cb88-4570-bcbd-3de68f28bf89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.510558 Oct 18 16:09:23.714807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1042/2081] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:23 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:23.766236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d2dc9e7f-2598-489a-a033-4ca4d465cc49 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd652e940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:23.959701 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d2dc9e7f-2598-489a-a033-4ca4d465cc49 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.231239 Oct 18 16:09:23.963345 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1043/2082] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:23 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:23.986405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:23.990753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:24.010416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:24.025849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:24.028865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:24.030291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:24.033845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:24.035586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:24.133592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:24.156394 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e426552-0900-4cfd-8790-3114d14c0688 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 0.707413 Oct 18 16:09:24.178538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1040/2083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:23 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:24.413025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2025232980", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:24.433494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:24.444707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f59ea38d-a85a-49fa-b45d-d7c10ce235a9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.477984 Oct 18 16:09:24.446970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1044/2084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:23 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:24.546439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] validate_networks() for [('6713780e-c408-4821-852a-f2bf2b47fc47', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:09:24.755743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:24.757774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:24.779636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:24.781944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:24.782707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:24.783738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:24.786633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:24.788942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.136535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:25.148400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:25.149774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:25.157608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64b5a5b4-6bf2-42ae-a61d-e9cf8feefc4c tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.409352 Oct 18 16:09:25.169243 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1045/2085] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:24 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:25.180575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ec8dd8a-1d39-47a6-ae0b-39f8c035def1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64a8040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:25.280784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ec8dd8a-1d39-47a6-ae0b-39f8c035def1 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.120924 Oct 18 16:09:25.284337 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1046/2086] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:25 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:25.301825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:25.302455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:25.330659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.332816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.333300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.334073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.348284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.352077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.682740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:25.704906 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7663a512-1a3a-4c82-acd4-a0d0b2ade3f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1317 microversion: 2.1 time: 0.413743 Oct 18 16:09:25.704906 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1047/2087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:25 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:25.709063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:25.720663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:25.736135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.736646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.737168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.737920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.738398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.738903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.847405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:25.851208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:25.852050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:25.853844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:25.854547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:25.871891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.872767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.873971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.876720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:25.877662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:25.879160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:25.955521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Getting quotas for project 65ac19ca0ab84dc7b0bcfad3962a33b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:25.978058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Getting quotas for user d31742926f754ebfb4914ea5f7269e7e and project 65ac19ca0ab84dc7b0bcfad3962a33b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:26.071309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:26.080447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:26.192843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:26.211967 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0cb0f7c-12ac-401f-89d8-db749f5d01fa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.510856 Oct 18 16:09:26.212571 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1048/2088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:25 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:26.241492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:26.243811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:26.271518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:26.272110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:26.272623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:26.273441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:26.273971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:26.278097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:26.318388 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae57966b-c213-43ed-835d-3809b9fb8fdf tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.038877 Oct 18 16:09:26.326897 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1041/2089] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:09:26.332745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9de392b6-2ca6-4132-9eca-e8196c23970b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1858c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:26.414146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9de392b6-2ca6-4132-9eca-e8196c23970b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.091834 Oct 18 16:09:26.417529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1042/2090] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:26 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:26.423937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09207ff6-7361-42ce-a57d-cd9928607fa5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:26.429404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09207ff6-7361-42ce-a57d-cd9928607fa5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:26.605292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:26.620591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:26.634702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:26.636629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea499535-16cc-4e0f-83b9-40537a872b13 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.414446 Oct 18 16:09:26.638118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1049/2091] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:26 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:26.732480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:26.733766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:26.766521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:26.767046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:26.767848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:26.769055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:26.769540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:26.769982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.100944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-09207ff6-7361-42ce-a57d-cd9928607fa5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:27.120848 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09207ff6-7361-42ce-a57d-cd9928607fa5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1214 microversion: 2.1 time: 0.690655 Oct 18 16:09:27.121901 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1043/2092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:26 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1214 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:27.169644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:27.186004 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-75234145-3925-445d-a305-48e15681d2c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1466 microversion: 2.1 time: 0.459349 Oct 18 16:09:27.203245 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1050/2093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:26 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1466 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:27.218448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:27.219166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:27.246031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.249010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.251387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.252162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.253240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.253897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.325985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:27.331923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:27.364710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.365890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.368486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.369362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.379367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.381432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.775761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:27.793181 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51669c01-de7c-42aa-a3df-012404f83d99 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 0.524478 Oct 18 16:09:27.795184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1051/2094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:27 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:27.803214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-623d3685-1cb9-4e94-845e-d2951bf69cac tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd6508940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:27.903064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-623d3685-1cb9-4e94-845e-d2951bf69cac tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.104530 Oct 18 16:09:27.904334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1052/2095] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:27 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:27.931225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:27.935297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:27.954703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.958235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.959989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:27.967064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:27.968492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:27.969860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.461183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:28.481465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:28.489187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:28.490431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15d9c3f0-5655-4db2-a76f-050a3567bb98 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.565467 Oct 18 16:09:28.521179 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1053/2096] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:27 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:28.526881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:28.527709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:28.546187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.547301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.547907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.548970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.554009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.554941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.750498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:28.763488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49ccfbf4-fea1-478f-8297-8104b1d52685 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1266 microversion: 2.1 time: 0.240783 Oct 18 16:09:28.769855 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1054/2097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:28 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:28.770575 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee6b6f2c-6094-4d25-a09c-a04f30e8c0b2 tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1619 microversion: 2.1 time: 1.555242 Oct 18 16:09:28.784377 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1044/2098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:27 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1619 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:28.823756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:28.824563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:28.838260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.843521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.845718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.848075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.855018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.860308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.923014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad7a81a0-6e21-4800-8998-adfb675f9088 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd175a1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:29.057227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad7a81a0-6e21-4800-8998-adfb675f9088 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.137567 Oct 18 16:09:29.075900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1045/2099] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:28 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:29.104985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1195312712", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:29.294911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:09:29.927742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:29.947650 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6174c07-56d1-4876-b7fe-7b827f1a8521 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 1.128725 Oct 18 16:09:29.954659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1055/2100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:28 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:29.960227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e05c9da-0090-4e3c-8989-7a5fd5235061", "name": "network-vif-unplugged", "status": "completed", "tag": "682a0667-46e4-499f-a988-6326eff8cb7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:30.019723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.029703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.031600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.043154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:30.104868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] Creating event network-vif-unplugged:682a0667-46e4-499f-a988-6326eff8cb7e for instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 on n-h2-858383-14 Oct 18 16:09:30.114917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-506f5927-57b2-40c9-9e7c-a814348cc40a req-42b5aaa5-214c-48d2-a540-42ef457f7970 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158014 Oct 18 16:09:30.119500 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1056/2101] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:30.128561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:30.129830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:30.142171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.144240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.145669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.147661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.148468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.149369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.410581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:30.412199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:30.413045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:30.413634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:30.414264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:30.440034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.440034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.466521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.478332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.478838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.479276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.536482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:30.547839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Getting quotas for user e5a251b917b244a3b1f55bf9079ff5ef and project a0d47fbb4e9040039f2ae5153fe6bbbe. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:30.579881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:30.583339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:30.680277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f1b838e-86fa-4c9c-ba09-f835c6f25ef2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602374 Oct 18 16:09:30.684943 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1046/2102] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:09:30.705282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:30.710725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:30.736536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.738803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.753823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.760844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.761793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.763564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:31.050980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:31.102613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:31.134845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:31.139436 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a8da086-70ec-4c3f-a507-e587ed620894 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 1.017531 Oct 18 16:09:31.156255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:31.170361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1057/2103] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:30 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:31.172915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9cbcb4df-ac75-4886-adc1-9cf598563476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1272 microversion: 2.1 time: 0.486403 Oct 18 16:09:31.174378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1047/2104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:30 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1272 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:31.181831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "name": "network-vif-plugged", "status": "completed", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:31.224471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:31.224968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:31.235016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:31.241678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93773487-9bae-454e-96b1-53580d170277 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd652e940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:31.315963 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] Creating event network-vif-plugged:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:09:31.348434 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-dcf92d9a-44fc-4494-8a73-5a73a1334136 req-5ff8dab6-527e-4fff-92ed-8cdea1a12c28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171572 Oct 18 16:09:31.372093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1048/2105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:31.388440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ef6093e-4c2a-42b0-9ded-49e86318543f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:31.399213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ef6093e-4c2a-42b0-9ded-49e86318543f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:31.533230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93773487-9bae-454e-96b1-53580d170277 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.328876 Oct 18 16:09:31.534850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1058/2106] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:31 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:31.554784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:31.557897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:31.592100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:31.592819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:31.595007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:31.598248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:31.601478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:31.604810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:31.875259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ef6093e-4c2a-42b0-9ded-49e86318543f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:31.890656 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ef6093e-4c2a-42b0-9ded-49e86318543f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1217 microversion: 2.1 time: 0.514120 Oct 18 16:09:31.891752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1049/2107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:31 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1217 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:32.187055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e05c9da-0090-4e3c-8989-7a5fd5235061", "tag": "682a0667-46e4-499f-a988-6326eff8cb7e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:32.209967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:32.213844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:32.214686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:32.241914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] Creating event network-changed:682a0667-46e4-499f-a988-6326eff8cb7e for instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 on n-h2-858383-14 Oct 18 16:09:32.250734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a240f4eb-5c27-46f6-a4e3-2cc2dbb47f38 req-00f6c373-b104-4c22-af2e-2a246797135e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068485 Oct 18 16:09:32.255655 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1050/2108] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:09:32.267019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:32.268143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:32.278113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:32.279030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:32.293062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:32.305187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:32.306086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:32.306777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:32.606347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:32.634006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:32.639477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:32.643604 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ffb64210-e950-4839-a0f7-48499d10fd18 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.384052 Oct 18 16:09:32.645770 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1051/2109] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:32 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:32.661293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:32.664523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:32.685227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:32.686774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:32.688314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:32.691800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:32.693251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:32.694748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:32.874654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:32.886254 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-419ca5ea-d6d6-410d-b10a-f16842de7b89 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1272 microversion: 2.1 time: 0.236181 Oct 18 16:09:32.906814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1052/2110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:32 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:32.916853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2a5c988-8d8c-4794-b433-4709226b69f3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1701550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:33.016128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2a5c988-8d8c-4794-b433-4709226b69f3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1455 microversion: 2.1 time: 0.106323 Oct 18 16:09:33.016913 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1053/2111] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:32 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:33.021820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:33.022440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:33.035405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:33.035973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:33.036450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:33.037236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:33.037711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:33.038137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:33.169328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:33.184879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f63deee-c7cf-4b4a-8395-b2d36b610f18 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1213 microversion: 2.1 time: 0.166739 Oct 18 16:09:33.185848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1054/2112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:33 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:33.193641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1750357339", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "36cd9606-04bb-4353-9340-97cb35289c50"}], "block_device_mapping_v2": [{"uuid": "3475568a-3614-4072-ba52-f6cdebaf6760", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:33.263202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:33.273601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-713bfc19-7182-48b5-a9d6-c0da8ce06542 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1317 microversion: 2.1 time: 1.737637 Oct 18 16:09:33.277153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1059/2113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:31 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1317 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:33.398921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] validate_networks() for [('36cd9606-04bb-4353-9340-97cb35289c50', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:09:33.431090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-plugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:33.444376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:33.450922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:33.453675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:33.500079 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] Creating event network-vif-plugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:09:33.532010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4936e33e-cc58-4863-9af2-87ebec569f77 req-f0513c47-4153-46aa-b58a-946337cad5d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100283 Oct 18 16:09:33.543853 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1060/2114] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:33.680106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:33.681052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:33.709206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:33.715372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:33.716502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:33.719420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:33.723940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:33.724789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:34.406819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:34.407283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:34.407838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:34.408385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:34.409395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:34.419771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:34.420485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:34.421144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:34.422073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:34.422714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:34.423326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:34.437821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:34.451096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:34.459642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Getting quotas for user ab2aa9c224654cfbbc1559ed58556ad5 and project 32ade5f58ea543ceb17c4bb5d230705f. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:34.536597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:34.559330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:34.563142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:34.566173 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23d27e44-3db9-4c35-aa2d-17ac8d9a8133 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.891862 Oct 18 16:09:34.568109 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1061/2115] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:33 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:09:34.588897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:34.589573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:34.592745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:34.597168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3475568a-3614-4072-ba52-f6cdebaf6760',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:34.604186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:34.604837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:34.605567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:34.606641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:34.612556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:34.613423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:34.942806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2ce1294-071a-478a-ba77-1757cb176895 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755564 Oct 18 16:09:34.943452 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1055/2116] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:09:34.948245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afbffd2c-e03e-4e37-ae51-6eea0c6ccf59 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd17013a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:35.259748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:35.277356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78114b2c-c24e-43d7-a928-a60c4f878895 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.705263 Oct 18 16:09:35.279292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1062/2117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:34 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:35.301504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:35.310888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:35.342540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:35.343088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:35.343415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:35.348708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:35.349226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:35.349663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:35.476286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:35.490196 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b177f956-ed24-404f-9441-e7009f6332fe tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1287 microversion: 2.1 time: 0.208758 Oct 18 16:09:35.491513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1063/2118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:35 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:35.497959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:35.499330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:35.518703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:35.521508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:35.523093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:35.525867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:35.526551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:35.530320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.108750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:36.140970 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f16d907-1614-42db-b64d-bb8a0c7e1b80 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1506 microversion: 2.1 time: 0.642772 Oct 18 16:09:36.141887 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1064/2119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:35 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:36.161970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:36.168493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:36.187956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.188509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.188964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.189795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.190453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.190984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.363550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:36.377598 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0592db83-9c3a-4f37-8aa0-fa34fffae79d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1103 microversion: 2.1 time: 0.230133 Oct 18 16:09:36.378993 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1065/2120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:36 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1103 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:36.400868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:36.403775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:36.430545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.433054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.436037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.438800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.444052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.445491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.964271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afbffd2c-e03e-4e37-ae51-6eea0c6ccf59 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1464 microversion: 2.1 time: 2.019395 Oct 18 16:09:36.966285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1056/2121] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:34 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1464 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:37.013478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:37.014502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:37.039849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.040950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.042789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.044491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.046790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.047337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.478538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:37.497384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:37.502976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:37.504642 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-753c7c2d-1944-408c-9159-15112a9f2750 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 1.123112 Oct 18 16:09:37.513160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1066/2122] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:36 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:37.529731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:37.535781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:37.568733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.569279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.569736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.570466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.577303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.577768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.614390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:37.626132 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fbdb209-c76d-431d-9913-545f0777efe3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1506 microversion: 2.1 time: 0.645751 Oct 18 16:09:37.662039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1057/2123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:36 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:37.668050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:37.668679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:37.675440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:37.678067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.678586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.679037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.679777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.680238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.680671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.226846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:38.237786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c644c718-f996-401d-911f-194fdfb4dacd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.573376 Oct 18 16:09:38.242594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1058/2124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:37 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:38.258233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49c08873-95db-4dbe-b32d-70e7baa4c394 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1701670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:38.338604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:38.353627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dab9bdb-7478-40df-9cee-3c30f45d609a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.836370 Oct 18 16:09:38.354206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1067/2125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:37 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:38.378287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:38.379227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:38.393693 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49c08873-95db-4dbe-b32d-70e7baa4c394 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 200 len: 1464 microversion: 2.1 time: 0.148258 Oct 18 16:09:38.396101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.402131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.403008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.403771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.404245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.404684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.405609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1059/2126] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:38 2022] GET /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:38.424802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:38.439270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:38.470407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.470967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.471432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.473819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.474286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.474722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.627014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:38.627997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:38.628466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:38.629320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:38.629910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:38.776770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:38.791134 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eed7a903-2aea-4576-8143-22fb6c834373 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1169 microversion: 2.1 time: 0.424742 Oct 18 16:09:38.792467 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1068/2127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:38 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1169 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:38.812384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ccea9b-86b9-449a-af3e-998c97a3b737", "tag": "c4356cab-e246-432a-a988-f639d5c40edc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:38.847830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:38.855491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.858843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.862623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.889839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.905417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.906535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.907685 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] Creating event network-changed:c4356cab-e246-432a-a988-f639d5c40edc for instance 92ccea9b-86b9-449a-af3e-998c97a3b737 on n-h1-858383-14 Oct 18 16:09:38.908057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:38.911706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:38.912589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:38.944857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7275ddd1-ea09-433d-b07c-c1f8cea32a04 req-19ca18db-f988-47ea-857d-f28625a84fe7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131628 Oct 18 16:09:38.953607 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1069/2128] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:38.972816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:38.977489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:38.998456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.006319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.008011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.008978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.015519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.016208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.047937 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2feda375-f814-48dc-9bab-c751e3421a46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "POST /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7/action" status: 202 len: 1108 microversion: 2.1 time: 0.641066 Oct 18 16:09:39.075160 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1060/2129] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:38 2022] POST /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7/action => generated 1108 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:09:39.123644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:39.144235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:39.224734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.225593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.239245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.240608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.241460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.242200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.190701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.202167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.203614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.204802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fca6f6bf-4726-4a19-b253-5eeae9e78358 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 1.126087 Oct 18 16:09:40.205451 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1061/2130] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:39 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:40.222788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:40.227401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:40.248201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.248902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.249710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.249932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.250391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.250823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.563041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.612555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0616e74e-947a-425e-b32d-65589d3daf5d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1467 microversion: 2.1 time: 1.653153 Oct 18 16:09:40.616879 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1070/2131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:38 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1467 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:40.629450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.637032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb462331-c5a6-45c6-b171-53afdf6d3a4c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.422117 Oct 18 16:09:40.638232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1062/2132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:40 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:40.679745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:40.682746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:40.687553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:40.687818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:40.705809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.706106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.706603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.707050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.707422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.708123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.709551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.710195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.710851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.714332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.714842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.715288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.962274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:40.971606 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a517359-dbd6-481b-9157-761eb008b50f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.331524 Oct 18 16:09:40.975028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1063/2133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:40 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:40.990407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4207748e-17b9-4137-b3c1-ce0a1f42027d", "tag": "1670ec3f-a7c1-4df2-9aed-840c7d6068a2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:41.012915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.015839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.017468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.053688 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] Creating event network-changed:1670ec3f-a7c1-4df2-9aed-840c7d6068a2 for instance 4207748e-17b9-4137-b3c1-ce0a1f42027d on n-h1-858383-14 Oct 18 16:09:41.066815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4010673d-fc1e-49da-abe3-24b904500412 req-6d0da896-dc0b-4c41-8f71-68e5c9499376 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086928 Oct 18 16:09:41.067614 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1064/2134] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:41.082726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.086863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:41.101510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.103355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.104566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.108134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.109808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.111008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.273898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:41.285329 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-867c0f2d-66d6-497c-8f63-f823b4091ea3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1169 microversion: 2.1 time: 0.211632 Oct 18 16:09:41.303141 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1065/2135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1169 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:41.315982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95f27590-2422-4484-a09c-186ac25787ec tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1712550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.363494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:41.381669 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-042fa8ad-b5b3-4a6c-8b7b-51f2b5e2b4c2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.724957 Oct 18 16:09:41.384616 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1071/2136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:40 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:41.401191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.403048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:41.423361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.424915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.428499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.429664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.430355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.431025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.573412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95f27590-2422-4484-a09c-186ac25787ec tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?changes-since=2022-10-18T16%3A06%3A52Z" status: 200 len: 1900 microversion: 2.1 time: 0.259105 Oct 18 16:09:41.574089 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1066/2137] 10.222.0.78 () {58 vars in 1199 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/images?changes-since=2022-10-18T16%3A06%3A52Z => generated 1900 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:41.596366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f837eb3-fa49-4956-a826-e8ad4c47c12e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd182f310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.735660 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f837eb3-fa49-4956-a826-e8ad4c47c12e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1653044048" status: 200 len: 485 microversion: 2.1 time: 0.146788 Oct 18 16:09:41.738209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1067/2138] 10.222.0.78 () {58 vars in 1231 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1653044048 => generated 485 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:41.749620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.753356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:41.767544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.771032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.771702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.772618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.775511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.776131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.137085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.168764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.178456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.184737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ebb2e049-a1ee-414a-aee4-dab3e84a3550 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.798237 Oct 18 16:09:42.190003 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1072/2139] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:42.222046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-237d0800-5e14-4a80-bbdc-716093deda75 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd652e670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:42.328972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.342896 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b649314-f7a9-443f-9e59-582d2b46fa42 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.603413 Oct 18 16:09:42.346040 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1068/2140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:42.349228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-237d0800-5e14-4a80-bbdc-716093deda75 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?server=dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 958 microversion: 2.1 time: 0.148167 Oct 18 16:09:42.359573 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1073/2141] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/images?server=dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 958 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:42.359802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:42.365726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:42.366196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:42.375869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.376048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:42.376376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.376820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.378131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.378596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.379259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.392312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.393466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.394346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.395162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.397393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.398202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.821958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.833820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67bfcc09-e098-4f76-be4d-c9c43fbc971f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.485615 Oct 18 16:09:42.840467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1069/2142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:42.855213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0c18737-2ad1-4a5d-b401-4fae3052ae7c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16bd670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:42.977497 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0c18737-2ad1-4a5d-b401-4fae3052ae7c tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 482 microversion: 2.1 time: 0.133734 Oct 18 16:09:42.990537 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1070/2143] 10.222.0.78 () {58 vars in 1317 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 482 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:43.002398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:43.003860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:43.012366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.013261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.014598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.015740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.017392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.018482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.367851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:43.382968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ecdb3be4-96f6-414c-ab2c-3561059ce498 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1211 microversion: 2.1 time: 1.026764 Oct 18 16:09:43.383721 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1074/2144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1211 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:43.394903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-unplugged", "status": "completed", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:43.423325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.424215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.424866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.454782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] Creating event network-vif-unplugged:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:09:43.469756 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-71695ae9-3ad2-4cd5-99e8-f2f0f94fb80e req-6dd4b0fb-5677-482f-b654-8545e114407d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083599 Oct 18 16:09:43.472870 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1075/2145] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:43.488487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5753345a-d17c-45ae-a26b-f7aab64f7b5b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd6522700>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:43.595321 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5753345a-d17c-45ae-a26b-f7aab64f7b5b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 482 microversion: 2.1 time: 0.119556 Oct 18 16:09:43.597039 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1076/2146] 10.222.0.78 () {58 vars in 1303 bytes} [Tue Oct 18 16:09:43 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 482 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:43.605444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:43.606471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:43.618547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.619179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.619740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.621740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.625814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.626420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.888895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:43.906135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:43.912368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:43.915758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8788f94b-65ba-4860-a409-78a9b18f18be tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.316887 Oct 18 16:09:43.921094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1077/2147] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:43 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:43.930411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:43.935487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:43.956481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.961373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.962354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.962879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.963341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.963774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:44.009522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:44.035678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:44.056914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c52b4ae-de87-4e31-8a68-280c860f3941 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 1.063052 Oct 18 16:09:44.060035 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1071/2148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.074858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53de1b00-54d5-4779-b70a-5af83ebb3c78 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16adb80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.354166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:44.373939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fadd2c0-30c2-4662-be45-3ec582963454 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.451625 Oct 18 16:09:44.379203 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1078/2149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:43 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.384217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53de1b00-54d5-4779-b70a-5af83ebb3c78 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.322884 Oct 18 16:09:44.393794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.400261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:44.406922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1072/2150] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.425137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-432bbc51-2448-4eda-a71a-adea2816946b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd167f940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.437942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:44.444393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:44.445191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:44.447884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:44.449845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:44.452222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:44.454727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:44.470944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=22 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:44.586269 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-432bbc51-2448-4eda-a71a-adea2816946b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.177557 Oct 18 16:09:44.586980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1073/2151] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.631816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.634023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:44.644564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:44.645440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:44.646094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:44.648898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:44.649970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:44.650716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:44.793552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:44.809429 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ddbc6e1-cbb7-4ee9-b80a-bd9240dab9e6 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.427138 Oct 18 16:09:44.810672 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1079/2152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.816154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-589fc93e-fa5e-44ab-a9ea-f9bbb5024900 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64c23a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.952396 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-589fc93e-fa5e-44ab-a9ea-f9bbb5024900 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.140388 Oct 18 16:09:44.953305 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1080/2153] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:44.960174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:44.973411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47dae8af-89dc-4ce8-9e60-c93479e1e6fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1211 microversion: 2.1 time: 0.362443 Oct 18 16:09:44.975101 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1074/2154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1211 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:44.985143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.986089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:44.994292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0ad00e0-ff29-4122-9508-4bf7d2d60361 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd182f310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.998273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:44.998957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:44.999605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.000493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.001150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.001874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.147871 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0ad00e0-ff29-4122-9508-4bf7d2d60361 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?changes-since=2022-10-18T16%3A06%3A44Z" status: 200 len: 6331 microversion: 2.1 time: 0.168112 Oct 18 16:09:45.151966 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1075/2155] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-18T16%3A06%3A44Z => generated 6331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:45.176292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.178100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:45.186006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.186826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.187437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.188508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.188965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.189969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.301046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:45.324131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:45.325995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:45.327301 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3917ed7b-1b07-4ce5-b757-45fb40924a07 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.372882 Oct 18 16:09:45.341147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1081/2156] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:44 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:45.341147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bafe446-0578-471e-9f6e-c1b77b2f29d3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64f5280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.427058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2bafe446-0578-471e-9f6e-c1b77b2f29d3 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1653044048" status: 200 len: 665 microversion: 2.1 time: 0.097329 Oct 18 16:09:45.438946 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1082/2157] 10.222.0.78 () {58 vars in 1252 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1653044048 => generated 665 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:45.445380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.446003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:45.460462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.461706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.462419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.463219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.463683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.464159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.549580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:45.576685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1e809a4-5321-4802-960c-bb5b14ba33b8 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.396072 Oct 18 16:09:45.594062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1076/2158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:45.676025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a493e275-bfe1-4f0b-aafd-a52f2051c290 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16bd4c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.681038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:45.692153 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9db497bb-9c9e-4c27-97d0-0a6bdbcdaa15 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.255539 Oct 18 16:09:45.692819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1083/2159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:45.723002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a493e275-bfe1-4f0b-aafd-a52f2051c290 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1464 microversion: 2.1 time: 0.127208 Oct 18 16:09:45.724123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1077/2160] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1464 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:45.747177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7341555-86e5-4026-a4a3-2a0c3352c6be tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64aedc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.836250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:45.837101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:45.866454 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7341555-86e5-4026-a4a3-2a0c3352c6be tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1464 microversion: 2.1 time: 0.123689 Oct 18 16:09:45.867123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1084/2161] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1464 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:45.877912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.877912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.877912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.877912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:45.878247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:45.878247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:45.892382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4544efa4-01ea-4809-9142-cb516ac6d304 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64c2940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:46.166497 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4544efa4-01ea-4809-9142-cb516ac6d304 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.279737 Oct 18 16:09:46.168396 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1085/2162] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:46.180275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:46.184235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:46.206817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:46.207569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:46.208222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:46.209247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:46.211174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:46.215779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:46.696240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:46.713017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-feeeff77-82d9-4f56-ac6e-4aa6125f25ac tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.880437 Oct 18 16:09:46.715590 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1078/2163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:45 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:46.732141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-628d82d1-5e1c-470e-a378-6443741e94a9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd16eb670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:46.859701 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-628d82d1-5e1c-470e-a378-6443741e94a9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.140239 Oct 18 16:09:46.871472 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1079/2164] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:09:46 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:46.876486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:46.881848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:46.897047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:46.899686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:46.901231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:46.902822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:46.906034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:46.908284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:47.387137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:47.399674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:47.405538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:47.408623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40b09e28-6289-497a-89a5-bdb2275dc002 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.542675 Oct 18 16:09:47.421057 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1080/2165] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:46 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:47.421769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:47.424227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:47.439150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:47.443169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:47.443677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:47.448258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:47.448780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:47.449335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:47.507548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:47.597544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:47.608385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05887305-df43-480a-a15c-73f18b3ac529 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1211 microversion: 2.1 time: 1.437979 Oct 18 16:09:47.625948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1086/2166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:46 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1211 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:47.643234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:47.645333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:47.647619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=82 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:47.662658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:47.666426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:47.667174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:47.669818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:47.670479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:47.671065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:47.823360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:47.839012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48e5aaf4-c937-4ff1-99ec-1d5b2f7e4b29 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.427928 Oct 18 16:09:47.843137 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1081/2167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:47 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:47.866301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2c49b9b-26e1-4f58-895f-b1582ea0604d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd167fe50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:47.991711 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2c49b9b-26e1-4f58-895f-b1582ea0604d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce" status: 200 len: 784 microversion: 2.1 time: 0.143440 Oct 18 16:09:48.002637 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1082/2168] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:47 2022] GET /compute/v2.1/images/716a8cb0-5725-40db-af07-5a18594590ce => generated 784 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:48.016157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:48.017219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:48.037391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.039098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.040193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:48.046256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.047033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.050108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:48.384124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:48.395706 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba9e3aaf-90a5-4e78-9447-7433321c4243 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.764306 Oct 18 16:09:48.396422 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1087/2169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:47 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:48.410231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f56fc355-0cb0-4e17-ac1b-b9de5fd9e6b9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd646ddc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:48.472024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:48.496143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58d5adcb-b064-4a2c-ba48-f8115fe318a8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.501126 Oct 18 16:09:48.496872 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1083/2170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:47 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:48.545860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:48.546569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:48.562993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.563519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.563990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:48.564793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.565281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.566322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:48.653498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f56fc355-0cb0-4e17-ac1b-b9de5fd9e6b9 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.247377 Oct 18 16:09:48.668380 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1088/2171] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:09:48 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:48.674548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:48.680161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:48.702564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.703063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.703503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:48.704259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:48.704716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:48.711724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:49.075347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:49.087691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:49.090042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:49.091924 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a580847-52a4-4069-b453-d2e8e51064e2 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.569708 Oct 18 16:09:49.117216 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1084/2172] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:48 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:49.122431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77369b16-17bf-4f18-8046-bca833f89662 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1661ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:50.260270 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77369b16-17bf-4f18-8046-bca833f89662 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899" status: 204 len: 0 microversion: 2.1 time: 1.141207 Oct 18 16:09:50.265095 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1085/2173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:49 2022] DELETE /compute/v2.1/images/f8aa0ede-f95f-4386-903c-e82e1bff7899 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:50.270831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:50.271452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:50.289970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:50.300803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:50.301427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:50.302288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:50.302762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:50.303199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:50.789789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:50.806600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e5e7642-ed24-4eaf-9ef4-a5f903ff6678 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1211 microversion: 2.1 time: 2.134851 Oct 18 16:09:50.810469 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1089/2174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:48 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1211 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:50.843530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:50.845102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:50.866809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:50.867379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:50.867846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:50.868625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:50.881434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:50.882195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:50.956436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:50.990005 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-396c4120-6851-4ad8-9a64-9630d8985a84 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.723430 Oct 18 16:09:50.998304 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1086/2175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:50 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:51.019111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:51.020447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:51.034275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:51.035106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:51.035830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:51.036797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:51.037766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:51.038657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:51.343452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:51.373253 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6558bee-7066-49d4-9234-60d977fdaff7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.368836 Oct 18 16:09:51.375188 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1087/2176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:50 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:51.382623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:51.383478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:51.392309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:51.393637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:51.394265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:51.395148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:51.395818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:51.396918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:51.821335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:51.846181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:51.848614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:51.850348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8156ae45-0cde-4d5d-b270-f0331363b101 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.473220 Oct 18 16:09:51.851560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1088/2177] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:51 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:51.889410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62a744fb-27ea-42ff-829f-ad2788a9f3a7 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd167f310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:52.077978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:52.088600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3726ab79-a12b-4853-8e26-8ad85f2dad21 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 1.276910 Oct 18 16:09:52.089258 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1090/2178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:50 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:52.098427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4207748e-17b9-4137-b3c1-ce0a1f42027d", "name": "network-vif-plugged", "status": "completed", "tag": "1670ec3f-a7c1-4df2-9aed-840c7d6068a2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:52.109459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:52.110330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:52.113663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:52.131044 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] Creating event network-vif-plugged:1670ec3f-a7c1-4df2-9aed-840c7d6068a2 for instance 4207748e-17b9-4137-b3c1-ce0a1f42027d on n-h1-858383-14 Oct 18 16:09:52.138915 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-384713a4-51af-4e58-ab74-03ea6fdabf95 req-ebefa697-bdca-4e0d-b3fc-106edd3de456 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045809 Oct 18 16:09:52.145533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1091/2179] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:52.165045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:52.166033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:52.179630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:52.180578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:52.181319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:52.182619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:52.183949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:52.184561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.022224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.030872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce1aba19-ca22-4d46-a6d4-307986fe89f2 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.882071 Oct 18 16:09:53.031477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1092/2180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:52 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:53.038771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.039774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:53.047633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.048125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.048742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.049585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.050332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.050897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.132796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62a744fb-27ea-42ff-829f-ad2788a9f3a7 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015" status: 204 len: 0 microversion: 2.1 time: 1.270319 Oct 18 16:09:53.134235 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1089/2181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:51 2022] DELETE /compute/v2.1/images/648a6f53-46af-4d8a-8bbd-57aea5705015 => generated 0 bytes in 1282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:53.140107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.140909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:53.160363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.161151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.168672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.169627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.170465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.171076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.369296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.381848 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b6d3916-e41d-4e8a-b67e-1640b1d60b0f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.246088 Oct 18 16:09:53.383091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1090/2182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:53 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:53.388190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.389160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:53.409703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.410615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.411291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.412268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.413193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.413941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.649949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.661851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.663542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.664885 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0514756-952e-49f0-b4fe-7a79ac452fef tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1486 microversion: 2.25 time: 0.280575 Oct 18 16:09:53.665622 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1091/2183] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:53 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1486 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:53.671349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.672342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:53.681458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.682419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.683111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.692052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.693055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.694152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.905332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.916076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9265e585-ecd9-4a44-94db-8a29f663c465 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.249002 Oct 18 16:09:53.935809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1092/2184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:53 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:53.944520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cc062c-144d-485a-ad2d-f2efc7af6161 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd1799c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.985587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.998552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad3200fd-be2d-412a-acf8-610b9a8e7c8e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.965048 Oct 18 16:09:54.012107 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1093/2185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:53 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:54.023090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55048fe8-cfbd-434e-b92f-c13cf9c0415a", "tag": "9e6ae16a-c285-47dc-a6b9-7a6e12438633"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:54.039221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.041209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.041834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.066138 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] Creating event network-changed:9e6ae16a-c285-47dc-a6b9-7a6e12438633 for instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a on n-h1-858383-14 Oct 18 16:09:54.074724 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6114abf3-6e6f-4cc8-a6c9-d54208cf57f5 req-a2d16790-a893-4da3-a451-5b2be4fee215 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060938 Oct 18 16:09:54.075560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1094/2186] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:54.083488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:54.085799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:54.093534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.094033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.094477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.095381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.096639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.097218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.666985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:54.686714 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40b56418-8aa4-45d5-b2f5-83832e03465e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.609369 Oct 18 16:09:54.704282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1095/2187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:54 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:54.710330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ccea9b-86b9-449a-af3e-998c97a3b737", "name": "network-vif-plugged", "status": "completed", "tag": "c4356cab-e246-432a-a988-f639d5c40edc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:54.724150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.725195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.725788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.744602 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] Creating event network-vif-plugged:c4356cab-e246-432a-a988-f639d5c40edc for instance 92ccea9b-86b9-449a-af3e-998c97a3b737 on n-h1-858383-14 Oct 18 16:09:54.759376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c30bb785-5378-4c52-b724-48d9071f4e45 req-247cf7cb-dd95-4b61-a532-3f9a675da264 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053213 Oct 18 16:09:54.761385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1096/2188] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:54.777834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:54.788389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:54.803162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.805509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.806101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.806902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.813924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.815280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.972507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6cc062c-144d-485a-ad2d-f2efc7af6161 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa" status: 204 len: 0 microversion: 2.1 time: 1.034874 Oct 18 16:09:54.976853 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1093/2189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:53 2022] DELETE /compute/v2.1/images/f37ef8b8-27ce-4a43-9502-57afbe24c7aa => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:54.988547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:54.989295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.007174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.007678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.008123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.013693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.014182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.014630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.276803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.289102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.291420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.294507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee57256d-06fe-44be-ae0c-892503dfb373 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1476 microversion: 2.25 time: 0.318816 Oct 18 16:09:55.296755 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1094/2190] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:54 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:55.303918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.304846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.311937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.313203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.314289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.316265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.317491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.318419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.459208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.471720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f0a605f-9b3b-4bb5-86fc-2f72432d184d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1317 microversion: 2.1 time: 0.705253 Oct 18 16:09:55.489548 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1097/2191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:54 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:55.495728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.496591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.522329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.523473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.524196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.525823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.528546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.529679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.545408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.559069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63b3811f-deb8-4897-a972-fb0a557a2e78 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.260106 Oct 18 16:09:55.559667 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1095/2192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:55 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:55.567067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.568021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.610589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:09:55.612863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.613470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.625299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.626213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.626738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.627816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.858271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdbc7592-c08a-4668-a0f9-37ca8eaaf95b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 204 len: 0 microversion: 2.1 time: 0.366799 Oct 18 16:09:55.860031 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1098/2193] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:09:55 2022] DELETE /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:55.880745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dfbfd15-5af4-4a98-8898-7893d3703d19 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '.version_select at 0x7f5fd658b040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.894353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dfbfd15-5af4-4a98-8898-7893d3703d19 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.896119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dfbfd15-5af4-4a98-8898-7893d3703d19 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.898171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dfbfd15-5af4-4a98-8898-7893d3703d19 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.955954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dfbfd15-5af4-4a98-8898-7893d3703d19 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3228 microversion: 2.25 time: 0.093372 Oct 18 16:09:55.957189 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1099/2194] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Oct 18 16:09:55 2022] GET /compute/v2.1/os-migrations => generated 3228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:55.963844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.965674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.975558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.976360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.976974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.977938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.979229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.979958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.040033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:56.050760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-829c7797-2a09-4957-b855-65837639ae87 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.489684 Oct 18 16:09:56.051893 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1096/2195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:55 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:56.057025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:56.057825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:56.067425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.068154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.068770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.069699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.070160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.070620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.236614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:56.247659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5360f5ac-d830-4a64-84c4-aec41f7f8d90 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.289131 Oct 18 16:09:56.248793 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1100/2196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:55 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:56.255573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:56.256809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:56.265370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.266355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.267006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.268134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.269203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.271565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.297177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:56.402194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:56.414304 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37fae0bb-064e-4eda-bbcd-2344ae06eb2b tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1474 microversion: 2.1 time: 0.361021 Oct 18 16:09:56.433199 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1097/2197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:56 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:56.640369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] Lazy-loading 'services' on Instance uuid 5e05c9da-0090-4e3c-8989-7a5fd5235061 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:09:56.679875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-472d6df7-9cdb-4b72-a35d-be0f541918b3 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd16fe040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1365583298", "description": "tempest-description-2039190943"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:56.695238 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6523831-5e64-4d58-92b6-e7d88f0072d6 tempest-LiveAutoBlockMigrationV225Test-309529965 tempest-LiveAutoBlockMigrationV225Test-309529965-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1970 microversion: 2.25 time: 0.444936 Oct 18 16:09:56.697973 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1101/2198] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:56 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1970 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:56.711179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:56.715379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:56.730760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.733695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.735321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.738255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.738902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.739400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.985012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:56.993022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-472d6df7-9cdb-4b72-a35d-be0f541918b3 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.538328 Oct 18 16:09:56.993703 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1098/2199] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:09:56 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:57.003292 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9af85e54-ee0a-4dd2-9f39-67c36fbbf158 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1466 microversion: 2.1 time: 0.296940 Oct 18 16:09:57.003292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1102/2200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:56 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1466 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:57.003504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.003504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.008187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.008690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.009323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.010062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.010647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.011092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.014036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.014561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.024735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.025886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.026809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.027736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.028457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.029789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.085616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:09:57.221228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38f64eca-fb8d-4d07-b93b-254d07360dc6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 204 len: 0 microversion: 2.25 time: 0.221957 Oct 18 16:09:57.221953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1103/2201] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:09:56 2022] DELETE /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:09:57.230648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05b1e946-d448-4b87-b137-abed41dc1368 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd64b8a60>, body: {"security_group_rule": {"parent_group_id": "47f186b5-1cbc-434c-8540-626a50d2551f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:57.282111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.293257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-113ab8a7-02f9-48d2-a19d-c61d491d77dd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.298161 Oct 18 16:09:57.305023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1099/2202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:56 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:57.305023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.305023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.321946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.322508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.322956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.323912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.325664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.326113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.556173 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d24c43a9-4ba0-470b-ba1d-62bb4ae6f02e tempest-ServersOnMultiNodesTest-1155382082 tempest-ServersOnMultiNodesTest-1155382082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1619 microversion: 2.1 time: 0.260930 Oct 18 16:09:57.558399 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1100/2203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:57 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1619 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:57.563464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.564408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.571744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.572577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.573281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.574187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.574838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.575571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.632757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05b1e946-d448-4b87-b137-abed41dc1368 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409521 Oct 18 16:09:57.633933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1104/2204] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:57.646016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.646959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.655912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.656353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.656800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.657616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.658800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.659139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.796901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.820391 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-adf952e5-8201-4ca8-91d5-8b1fd303fba2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1314 microversion: 2.1 time: 0.260577 Oct 18 16:09:57.838978 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1101/2205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:57 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:57.848702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.850898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.868061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.871187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.872799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.874558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.877590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.879232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.879591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.880745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.882531 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e709af6-ea74-4153-83f3-f47a079535d8 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1482 microversion: 2.25 time: 0.247614 Oct 18 16:09:57.882873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.894258 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1105/2206] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:57 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1482 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:57.911945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:57.912580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:57.919336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.920025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.920466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.921205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:57.921663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:57.922149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.139794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:58.152608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:58.156600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:58.161620 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc78a257-961e-4b7f-9248-0115a8146fc8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1474 microversion: 2.1 time: 0.266137 Oct 18 16:09:58.162234 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1106/2207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:57 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1474 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:58.181155 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94057af9-ddb1-4c95-8a96-1b7a741908a0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.340581 Oct 18 16:09:58.182339 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1102/2208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:57 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:58.187130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.187633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:58.187746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c07b9b8-4a13-4f59-ab10-d89dcd48311e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd188bca0>, body: {"security_group_rule": {"parent_group_id": "47f186b5-1cbc-434c-8540-626a50d2551f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:58.226648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.227161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.227605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.228324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.229086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.235254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.270151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7c07b9b8-4a13-4f59-ab10-d89dcd48311e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c07b9b8-4a13-4f59-ab10-d89dcd48311e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 138 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:09:58.272949 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: {"security_group_rule": {"parent_group_id": "47f186b5-1cbc-434c-8540-626a50d2551f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 16:09:58.274296 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: exception: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'security_group_rule': {'parent_group_id': '47f186b5-1cbc-434c-8540-626a50d2551f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:09:58.274974 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:58.275907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c07b9b8-4a13-4f59-ab10-d89dcd48311e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: This rule already exists in group 47f186b5-1cbc-434c-8540-626a50d2551f {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:58.276641 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c07b9b8-4a13-4f59-ab10-d89dcd48311e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.090873 Oct 18 16:09:58.278514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1103/2209] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:58 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:09:58.285491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9300bcb-558f-4cee-870f-4843f31138e6 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd18cea60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.301410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:09:58.470191 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4bebca7c-6091-4fd6-92bb-e092fcfc92f2 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 204 len: 0 microversion: 2.1 time: 0.305388 Oct 18 16:09:58.472440 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1107/2210] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:09:58 2022] DELETE /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:58.486163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.487454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:58.522547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.523158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.523870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.524630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.525197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.525621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.553253 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9300bcb-558f-4cee-870f-4843f31138e6 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/5be1f129-dd39-42b5-a8a8-144044f31805" status: 202 len: 0 microversion: 2.1 time: 0.273461 Oct 18 16:09:58.554236 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1104/2211] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 18 16:09:58 2022] DELETE /compute/v2.1/os-security-group-rules/5be1f129-dd39-42b5-a8a8-144044f31805 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:58.559857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.560771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:58.578573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.584132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.587354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.588285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.589902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.590473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.822752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:58.832367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d2a8e45-4fc3-4230-80a6-28d43a894788 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1472 microversion: 2.1 time: 0.276817 Oct 18 16:09:58.845077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1105/2212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:58 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:58.845077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e91f855-e2ff-4067-a4b4-e0169bedf56e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd188b820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1781172965", "description": "tempest-description-1480375771"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:58.885422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:58.896015 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81c26724-62bf-4d0f-9eb9-780a4eec3c5c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.421184 Oct 18 16:09:58.900272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1108/2213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:58 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:58.914318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.921591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:58.949247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.949247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.949247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.949247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.950283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.950283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.138746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e91f855-e2ff-4067-a4b4-e0169bedf56e tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.304114 Oct 18 16:09:59.165971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1106/2214] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:09:58 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:59.165971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:59.165971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.165971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.166325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.166325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.166715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.167281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.167946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.180453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.192712 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-468d1c98-e764-4766-a5e8-3103ebac9375 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1499 microversion: 2.1 time: 0.290440 Oct 18 16:09:59.193967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1109/2215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:58 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:59.201179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10500b4d-ce0f-4667-a0d0-0c70ca3f394b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd64a8dc0>, body: {"security_group_rule": {"parent_group_id": "4f31f6d4-8ae8-47e0-808b-3c282e995054", "ip_protocol": "tcp", "from_port": 2101755572, "to_port": 22}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:59.311252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-10500b4d-ce0f-4667-a0d0-0c70ca3f394b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Invalid port range 2101755572:22. Former value cannot be greater than the later Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10500b4d-ce0f-4667-a0d0-0c70ca3f394b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 146 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:09:59.312930 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: {"security_group_rule": {"parent_group_id": "4f31f6d4-8ae8-47e0-808b-3c282e995054", "ip_protocol": "tcp", "from_port": 2101755572, "to_port": 22}} Oct 18 16:09:59.314066 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid port range 2101755572:22. Former value cannot be greater than the later Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4f31f6d4-8ae8-47e0-808b-3c282e995054', 'ip_protocol': 'tcp', 'from_port': 2101755572, 'to_port': 22}}} Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2101755572:22. Former value cannot be greater than the later Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:59.315426 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2101755572:22. Former value cannot be greater than the later Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2101755572:22. Former value cannot be greater than the later Oct 18 16:09:59.321147 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.322377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10500b4d-ce0f-4667-a0d0-0c70ca3f394b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: Invalid port range 2101755572:22. Former value cannot be greater than the later {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:59.322377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10500b4d-ce0f-4667-a0d0-0c70ca3f394b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.119215 Oct 18 16:09:59.322377 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1110/2216] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:59 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:09:59.327251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:59.327888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.350096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.353834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.354549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.356212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.357669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.358356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.384084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.394282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.395754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.397053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83bbab58-328c-49b8-ae18-32f6616f2e88 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1482 microversion: 2.25 time: 0.245865 Oct 18 16:09:59.402614 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1107/2217] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:09:59 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1482 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:09:59.416392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:59.420423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.431181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.432088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.432932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.450163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.451060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.452569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.597089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.607559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52c0c793-3f5c-4617-b606-e47d8620c04e tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1474 microversion: 2.1 time: 0.289765 Oct 18 16:09:59.622405 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1111/2218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:59 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:59.640652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:59.643777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.651806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.652307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.652752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.655256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.655950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.656635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.711485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lazy-loading 'flavor' on Instance uuid 92ccea9b-86b9-449a-af3e-998c97a3b737 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:09:59.808503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.823993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96d9d152-df14-4f00-8922-5fdeee07d22d tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.416941 Oct 18 16:09:59.825321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1108/2219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:59 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:59.831275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a64ca5f-df32-49e0-ac5e-a9c818ef8d49 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd16fe160>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-871489638", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:59.834482 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7a64ca5f-df32-49e0-ac5e-a9c818ef8d49 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Security group id should be uuid Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a64ca5f-df32-49e0-ac5e-a9c818ef8d49 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 130 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:09:59.836281 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-871489638", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:09:59.837485 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group id should be uuid Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-871489638', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:59.838100 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 18 16:09:59.839020 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:09:59.841641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a64ca5f-df32-49e0-ac5e-a9c818ef8d49 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: Security group id should be uuid {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:59.842816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a64ca5f-df32-49e0-ac5e-a9c818ef8d49 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016321 Oct 18 16:09:59.843662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1109/2220] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:09:59 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:09:59.858158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99cd9c13-6371-4c35-9f0b-130d45788b9b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd167fee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1823774607", "description": "tempest-description-725895154"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:59.862711 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb017e91-b862-4b77-9651-05434a5ba9ef tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "POST /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737/action" status: 200 len: 32 microversion: 2.1 time: 0.238694 Oct 18 16:09:59.869429 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1112/2221] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:59 2022] POST /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:09:59.876829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:59.877698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.884681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.885268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.891412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.892970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.893604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.894302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.088469 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99cd9c13-6371-4c35-9f0b-130d45788b9b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.236270 Oct 18 16:10:00.089571 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1110/2222] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:09:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:00.094423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.095275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.116782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.117338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.117796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.118552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.119064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.119502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.145497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.156857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b516523-d5c0-42b2-a557-ba541c1f506e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1472 microversion: 2.1 time: 0.285751 Oct 18 16:10:00.157706 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1113/2223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:59 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:00.170911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.171538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.179771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.180286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.180841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.181588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.182044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.182968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.198412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:00.386300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.400608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.410809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ffc29559-51d0-4c3a-b1d3-0d2c6cd67362 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.243850 Oct 18 16:10:00.411723 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1114/2224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:00.414399 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cba15a61-fe04-4bc6-832e-f63889088708 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.323651 Oct 18 16:10:00.415517 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1111/2225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:00.416297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5634d3fe-f86d-4c2e-b4c4-238b914a4e19 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd6499550>, body: {"security_group_rule": {"parent_group_id": "c1d16458-93b4-494c-8f58-2b5c202e38e5", "ip_protocol": "tempest-999-651339263", "from_port": 22, "to_port": 22}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:00.439792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.441789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.451528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.452259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.452864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.453785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.454413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.455521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.497732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5634d3fe-f86d-4c2e-b4c4-238b914a4e19 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Invalid IP protocol tempest-999-651339263. Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5634d3fe-f86d-4c2e-b4c4-238b914a4e19 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 156 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:00.503534 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: {"security_group_rule": {"parent_group_id": "c1d16458-93b4-494c-8f58-2b5c202e38e5", "ip_protocol": "tempest-999-651339263", "from_port": 22, "to_port": 22}} Oct 18 16:10:00.505093 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid IP protocol tempest-999-651339263. Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c1d16458-93b4-494c-8f58-2b5c202e38e5', 'ip_protocol': 'tempest-999-651339263', 'from_port': 22, 'to_port': 22}}} Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-651339263. Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:00.505886 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-651339263. Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-651339263. Oct 18 16:10:00.506918 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.511324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5634d3fe-f86d-4c2e-b4c4-238b914a4e19 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: Invalid IP protocol tempest-999-651339263. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:00.512386 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5634d3fe-f86d-4c2e-b4c4-238b914a4e19 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.099729 Oct 18 16:10:00.519482 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1115/2226] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:10:00 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:00.530136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-614d6b86-a96e-43d0-8c10-735d8c128c84 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd649eb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-231530470", "description": "tempest-description-1641157725"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:00.659798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.669547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.670978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.672206 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acbae6d0-7fa0-470d-a3c5-26b83eb2cc62 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1482 microversion: 2.25 time: 0.245672 Oct 18 16:10:00.672761 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1112/2227] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1482 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:10:00.678062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.678485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.684454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.684931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.685575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.686276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.686729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.687145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.763475 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-614d6b86-a96e-43d0-8c10-735d8c128c84 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.237020 Oct 18 16:10:00.765799 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1116/2228] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:10:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:10:00.780286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e04a177-2fcd-45c7-a1e2-3b936b90bf36 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd652ef70>, body: {"security_group_rule": {"parent_group_id": "cbd73a91-d570-45fa-93eb-847f05213542", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:00.849548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1e04a177-2fcd-45c7-a1e2-3b936b90bf36 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e04a177-2fcd-45c7-a1e2-3b936b90bf36 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 138 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:00.851095 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: {"security_group_rule": {"parent_group_id": "cbd73a91-d570-45fa-93eb-847f05213542", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 18 16:10:00.852141 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbd73a91-d570-45fa-93eb-847f05213542', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:00.852846 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 16:10:00.854249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:00.855128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e04a177-2fcd-45c7-a1e2-3b936b90bf36 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:00.855128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e04a177-2fcd-45c7-a1e2-3b936b90bf36 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.077189 Oct 18 16:10:00.855128 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1117/2229] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:10:00 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:00.855549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.864452 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2973d0f6-af06-4972-aa4b-86a997ad4e31 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1474 microversion: 2.1 time: 0.190488 Oct 18 16:10:00.864612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.865205 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1113/2230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1474 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:00.869473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.870347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d924c7b-c619-495e-866f-b1fa7f693503 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd16ebdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-289970003", "description": "tempest-description-1655419738"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:00.877170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.877694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.878121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.878825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.879278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.879702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.021712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:01.031004 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fe1f6aa-d2d5-4f96-9920-e6dd22106311 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.170805 Oct 18 16:10:01.031596 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1118/2231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:01.037197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d924c7b-c619-495e-866f-b1fa7f693503 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.170575 Oct 18 16:10:01.038270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1114/2232] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:10:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:01.057188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9b324af-4b76-463a-98c5-1261b41f8013 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd64c2dc0>, body: {"security_group_rule": {"parent_group_id": "589fb646-858d-4e57-ab86-7e27fb7023f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1181284358}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:01.108669 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f9b324af-4b76-463a-98c5-1261b41f8013 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9b324af-4b76-463a-98c5-1261b41f8013 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 146 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:01.110256 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: {"security_group_rule": {"parent_group_id": "589fb646-858d-4e57-ab86-7e27fb7023f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1181284358}} Oct 18 16:10:01.111967 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'security_group_rule': {'parent_group_id': '589fb646-858d-4e57-ab86-7e27fb7023f9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1181284358}}} Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.113156 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 Oct 18 16:10:01.114724 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.116271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9b324af-4b76-463a-98c5-1261b41f8013 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 400 to user: Invalid port range 22:1181284358. Valid TCP ports should be between 1-65535 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:01.116271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9b324af-4b76-463a-98c5-1261b41f8013 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.058952 Oct 18 16:10:01.116271 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1119/2233] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:10:01 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:01.123584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Action: 'create', calling method: .version_select at 0x7f5fd1799940>, body: {"security_group_rule": {"parent_group_id": "c5892430-2747-45f8-9b32-ec9221277066", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:01.147885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:10:01.148485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Neutron security group c5892430-2747-45f8-9b32-ec9221277066 not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:10:01.149113 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.149113 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 138 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:01.150974 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: {"security_group_rule": {"parent_group_id": "c5892430-2747-45f8-9b32-ec9221277066", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 16:10:01.152138 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c5892430-2747-45f8-9b32-ec9221277066', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:10:01.152873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 18 16:10:01.154388 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.155548 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 404 to user: Security group c5892430-2747-45f8-9b32-ec9221277066 does not exist Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-04428d5b-aab2-4219-9a2d-a5ff802bf2e4'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:01.156787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8d9693d-c592-4260-a9bc-f643db81da34 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.033103 Oct 18 16:10:01.157738 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1115/2234] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 18 16:10:01 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:01.163269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd649e4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.180487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.181137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.184640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:10:01.185315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Neutron security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 not found {{(pid=120570) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 18 16:10:01.185849 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] HTTP exception thrown: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.185849 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Request method failure captured: Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-group-rules/256bb9c6-ff5d-4091-adc6-49f811c23177 HTTP/1.1 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_UjNgddx_p31gKnCtdc_DQa7cGIQt6c30IJtL1L2TeuB08P-O9n2R8RrJ0ONat8EhUZnK3M_xL0YJZHQMa_nAPbIzk2tamZEkPKxO0x61vE-G1m0mN5xol4iFwQqjZFDODE8YQZmsT__lszNXFXoS6f40b56dBEnWMVkLb2pS3OMY Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:01.187787 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7a79243f5bfd49b3b5dde98a5e969459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7a79243f5bfd49b3b5dde98a5e969459"}]}] Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7a79243f5bfd49b3b5dde98a5e969459 Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742 Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 98a48155bd2d48f9b1f7db3f6807a213 Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-424165742-project Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.189269 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '256bb9c6-ff5d-4091-adc6-49f811c23177'} Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.190520 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 18 16:10:01.191714 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.192762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Returning 404 to user: Security group rule 256bb9c6-ff5d-4091-adc6-49f811c23177 does not exist Oct 18 16:10:01.194044 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-3ee74a83-3d5f-49ed-b531-4d521eeb4038'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:01.195134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.195134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.195134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.195350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c6bb037-6ef5-4a0c-8d31-24e82470ae87 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/256bb9c6-ff5d-4091-adc6-49f811c23177" status: 404 len: 199 microversion: 2.1 time: 0.030657 Oct 18 16:10:01.195427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.195502 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1120/2235] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 18 16:10:01 2022] DELETE /compute/v2.1/os-security-group-rules/256bb9c6-ff5d-4091-adc6-49f811c23177 => generated 199 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:01.195572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.195572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.199506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7a5917c-2a1a-42fb-bc5d-5f85c482f03f tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd64818b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.335219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:01.346380 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-975742ca-c7c6-4a91-97ae-fee798087731 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1472 microversion: 2.1 time: 0.169500 Oct 18 16:10:01.347142 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1116/2236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:01.365864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.366514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.372706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.373214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.373649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.374341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.374787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.375207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.399336 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7a5917c-2a1a-42fb-bc5d-5f85c482f03f tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/589fb646-858d-4e57-ab86-7e27fb7023f9" status: 202 len: 0 microversion: 2.1 time: 0.203521 Oct 18 16:10:01.404692 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1121/2237] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:10:01 2022] DELETE /compute/v2.1/os-security-groups/589fb646-858d-4e57-ab86-7e27fb7023f9 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:10:01.410901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83700dc2-0fc7-4ce3-b6b0-a401da45b51b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd64aed30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.553579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:01.562764 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd81c875-0217-44f3-99a2-dc2a5073732c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.201633 Oct 18 16:10:01.563349 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1117/2238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:01.568249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.568858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.574851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.575331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.575932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.576624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.577247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.577813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.634154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83700dc2-0fc7-4ce3-b6b0-a401da45b51b tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cbd73a91-d570-45fa-93eb-847f05213542" status: 202 len: 0 microversion: 2.1 time: 0.228100 Oct 18 16:10:01.634975 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1122/2239] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:10:01 2022] DELETE /compute/v2.1/os-security-groups/cbd73a91-d570-45fa-93eb-847f05213542 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:10:01.647393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.648282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.681783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.685377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.685851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.687898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.689574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.690438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.767576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:01.776077 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-abbd4360-f7a0-4462-b64e-9cfe90ad8999 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.211550 Oct 18 16:10:01.776661 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1118/2240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:01.781585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f22644d1-d292-4f49-abfb-29f1f2f34927 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd16619d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.917045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:01.926209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adccecc9-2f57-4fe3-a2f3-1fadd1557b50 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.285834 Oct 18 16:10:01.926802 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1123/2241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:01.932126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.932939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.940365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.940855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.941397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.942287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.942893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.943458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.014195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f22644d1-d292-4f49-abfb-29f1f2f34927 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c1d16458-93b4-494c-8f58-2b5c202e38e5" status: 202 len: 0 microversion: 2.1 time: 0.235406 Oct 18 16:10:02.016209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1119/2242] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:10:01 2022] DELETE /compute/v2.1/os-security-groups/c1d16458-93b4-494c-8f58-2b5c202e38e5 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:10:02.025237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:02.026695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:02.036395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.036977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.037517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.038302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.038979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.039472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.131173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.140761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.142833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.144221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7ce02d6-ccee-4716-9ae8-7dd3fee03ddc tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1482 microversion: 2.25 time: 0.216200 Oct 18 16:10:02.145022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1124/2243] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1482 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:02.150876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db74c1ec-a4cf-460a-a8d2-5fca5be30b41 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd659e310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:02.208085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.216761 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2386aadd-3e18-4df6-82d6-c12a41b1bcd2 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1474 microversion: 2.1 time: 0.198765 Oct 18 16:10:02.217456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1120/2244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:02 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:02.223505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:02.224121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:02.230457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.230952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.231388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.232089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.232574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.233041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.913832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db74c1ec-a4cf-460a-a8d2-5fca5be30b41 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4f31f6d4-8ae8-47e0-808b-3c282e995054" status: 202 len: 0 microversion: 2.1 time: 0.766482 Oct 18 16:10:02.920535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1125/2245] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:10:02 2022] DELETE /compute/v2.1/os-security-groups/4f31f6d4-8ae8-47e0-808b-3c282e995054 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:10:02.930109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:02.931379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:02.947966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.975354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.976897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.981009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.982526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:02.986902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:02.988046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.994325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5ae581b-2783-43f0-8d40-042769b66b6a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.775391 Oct 18 16:10:02.995578 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1121/2246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:02 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:03.023954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:03.025118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:03.036423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.037268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.041959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.043052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.043696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.044275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.645757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:03.657877 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0576c70-2b4a-48b3-9b4b-749a524a83d2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.660315 Oct 18 16:10:03.664970 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1122/2247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:02 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:03.664970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:03.664970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:03.671959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.672465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.672920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.674882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.676231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.676231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.786485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:03.802067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbcf14da-4427-437e-9977-ada8d7c890c7 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1472 microversion: 2.1 time: 0.881746 Oct 18 16:10:03.821095 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1126/2248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:02 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1472 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:03.821095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-927480bf-1086-4892-b067-86ddacfc9c65 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] Calling method '.version_select at 0x7f5fd64c2430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.268408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-927480bf-1086-4892-b067-86ddacfc9c65 tempest-SecurityGroupRulesNegativeTestJSON-424165742 tempest-SecurityGroupRulesNegativeTestJSON-424165742-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/47f186b5-1cbc-434c-8540-626a50d2551f" status: 202 len: 0 microversion: 2.1 time: 0.463408 Oct 18 16:10:04.269045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1127/2249] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:10:03 2022] DELETE /compute/v2.1/os-security-groups/47f186b5-1cbc-434c-8540-626a50d2551f => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:10:04.275460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.276317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.291387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.292344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.293282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.294504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.295733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.296458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.318482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.341664 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-892a83c6-269c-47f6-9bd6-d200fa0ef328 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.681225 Oct 18 16:10:04.342267 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1123/2250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:03 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:04.378098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.384219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.417064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.426402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.430057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.435532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.436283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.436831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.621161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.633141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.634555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.635904 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e02568b5-41a6-4896-b4fc-21bd7c600f8a tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1440 microversion: 2.25 time: 0.280487 Oct 18 16:10:04.649599 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1124/2251] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:04 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1440 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:04.662262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.663226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.670698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.671902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.672944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.674448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.675119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.675784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.748274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.749111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.749748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.750419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lazy-loading 'fault' on Instance uuid 385e121c-14e0-4739-8f89-0cd69ceb7b7e {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:04.809316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.819915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ea83eb1-cb98-407e-ad1e-dd64c0d94817 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 200 len: 1308 microversion: 2.1 time: 0.168932 Oct 18 16:10:04.826307 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1125/2252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:04 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:04.844870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1116700714"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:04.855424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.870763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.871618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.878294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.879398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.888677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.889400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.957442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.972645 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-683a6468-cc36-4a14-82cf-83c5c0473816 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.702181 Oct 18 16:10:04.974323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1128/2253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:04 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:04.979808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385e121c-14e0-4739-8f89-0cd69ceb7b7e", "name": "network-vif-deleted", "tag": "f447c56d-e7d3-4951-98af-dc5ebf3ba71a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:05.018994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.019573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.020076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.039339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] Creating event network-vif-deleted:f447c56d-e7d3-4951-98af-dc5ebf3ba71a for instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e on n-h1-858383-14 Oct 18 16:10:05.054149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f1797814-9a79-46eb-a3fc-e525729874cd req-2c645a48-ef4d-4714-8a96-5f61284079a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076651 Oct 18 16:10:05.058276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1129/2254] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:05.069425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.070138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:05.084773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.085303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.085743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.086452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.087061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.087629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.247466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:05.333556 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52a83e55-bbe7-4968-855f-70444498c076 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.505721 Oct 18 16:10:05.335624 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1126/2255] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:10:04 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 16:10:05.345865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4207748e-17b9-4137-b3c1-ce0a1f42027d", "name": "network-vif-deleted", "tag": "1670ec3f-a7c1-4df2-9aed-840c7d6068a2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:05.362496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:05.366002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.366374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.366961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.401862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] Creating event network-vif-deleted:1670ec3f-a7c1-4df2-9aed-840c7d6068a2 for instance 4207748e-17b9-4137-b3c1-ce0a1f42027d on n-h1-858383-14 Oct 18 16:10:05.421249 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8becdefc-2cf3-4760-aec8-34fa328114f7 req-227b1241-6ae9-437e-8b0f-0953a55d29a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077629 Oct 18 16:10:05.426920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1127/2256] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:05.466544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.468874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:05.519594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.523216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.524445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.535767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.538916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.540663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.620839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.622918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.623623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.624406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lazy-loading 'fault' on Instance uuid 4207748e-17b9-4137-b3c1-ce0a1f42027d {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:05.665928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.691995 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a79f88a4-6a33-487d-bfde-f7fb4fcdf356 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.615468 Oct 18 16:10:05.692730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1130/2257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:05.706961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-unplugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:05.732454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.732947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.733578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.734885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.745981 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f686046-f825-46b5-ab49-0b9616eb144a tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 200 len: 1307 microversion: 2.1 time: 0.317755 Oct 18 16:10:05.757326 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1128/2258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 1307 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:05.757326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.757614 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] Creating event network-vif-unplugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:10:05.757695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:05.765333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.765333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.765333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.765932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.766682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.767133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.782519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9fd56369-5f90-42bb-949b-379d243e5dbf req-12cb041c-8ecb-4441-9af2-845bd7f2223e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062667 Oct 18 16:10:05.786292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1131/2259] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:05.801993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.802817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:05.810503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.811003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.811449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.812174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.812636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.813339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.951514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.958497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.963621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4744be3-16a4-4d78-adb2-71cc3b91e311 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.212067 Oct 18 16:10:05.964582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1129/2260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:05.970072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.971033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.971652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: 385e121c-14e0-4739-8f89-0cd69ceb7b7e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:05.972001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.973755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a797d60f-3e63-46c5-91bc-c948f388fa69 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.185786 Oct 18 16:10:05.978248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.978996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.979431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.980236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:05.980488 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1132/2261] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:05.994992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:05.995455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:05.997815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:05.998444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.010345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.010849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.011296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.012054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.012581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.013076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.016236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] HTTP exception thrown: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Request method failure captured: Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e HTTP/1.1 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8SX3jkHrgF_eRL46tBNZrZqgo_LOTKZKmpEyaZ74GQNrHdf0NZvZfj6FaYuG7hlhb4Ho0MHr63QKOol69lYyZDUfQFTh5T_aPgsywTrcdpfZjTiqAXHVQ8i1NjmVZ4KMDPi7eBoZtZhb6nwxKiGHLEdFLGnaEBeEW9g-mqp2ZMwmU Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 11cf155786464a64826aadc055af9032 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:06.020385 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/11cf155786464a64826aadc055af9032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/11cf155786464a64826aadc055af9032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_11cf155786464a64826aadc055af9032"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/11cf155786464a64826aadc055af9032"}]}] Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 11cf155786464a64826aadc055af9032 Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListImageFiltersTestJSON-1357514434-project Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 04fd432bad6740efad5a96720455b658 Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListImageFiltersTestJSON-1357514434-project Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. Oct 18 16:10:06.021522 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '385e121c-14e0-4739-8f89-0cd69ceb7b7e'} Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:06.022135 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. Oct 18 16:10:06.023112 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.024002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Returning 404 to user: Instance 385e121c-14e0-4739-8f89-0cd69ceb7b7e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:06.024002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05236036-d536-44de-ae61-588c8229b660 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e" status: 404 len: 111 microversion: 2.1 time: 0.055290 Oct 18 16:10:06.025971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1130/2262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/385e121c-14e0-4739-8f89-0cd69ceb7b7e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:06.030817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:06.031321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.039560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.039971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.040412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.041180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.041637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.042058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.072775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:06.181642 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1181875-baa5-454e-8d70-4ed2da190937 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 204 len: 0 microversion: 2.1 time: 0.153937 Oct 18 16:10:06.182625 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1131/2263] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:06 2022] DELETE /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:06.192455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:06.193369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.200379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.200966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.201506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.202683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.202986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.203498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.255276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:06.274375 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed50bdb3-3fb8-434c-a88e-097cd6515100 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.271699 Oct 18 16:10:06.279379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1133/2264] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:05 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:06.427029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:06.440869 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07292b6a-6397-420a-9935-7d8f0bfe958d tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1473 microversion: 2.1 time: 0.252028 Oct 18 16:10:06.453018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1132/2265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:06 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:06.718091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:06.718819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.725784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.726560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.727209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.728142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.729189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.729813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.773119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:06.774257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 4207748e-17b9-4137-b3c1-ce0a1f42027d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.781142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.781935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.782613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.785196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.786261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.786922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.807557 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d HTTP/1.1 Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:06.809962 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. Oct 18 16:10:06.811325 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4207748e-17b9-4137-b3c1-ce0a1f42027d'} Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:06.811973 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. Oct 18 16:10:06.812954 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:06.815525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance 4207748e-17b9-4137-b3c1-ce0a1f42027d could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:06.816607 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a70c0609-ae91-44b5-b475-07a098bdd234 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d" status: 404 len: 111 microversion: 2.1 time: 0.047467 Oct 18 16:10:06.820805 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1133/2266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:06 2022] GET /compute/v2.1/servers/4207748e-17b9-4137-b3c1-ce0a1f42027d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:06.826335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:06.827126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:06.833888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.834684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.835489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.836423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:06.837123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:06.837767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:06.876972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:07.002564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad8e08e8-6997-46a6-9d90-573f4b434eb8 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 204 len: 0 microversion: 2.1 time: 0.180159 Oct 18 16:10:07.006810 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1134/2267] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:06 2022] DELETE /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:07.012757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.013353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.014261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.021456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.022269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.022900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.023812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.024458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.025152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.026772 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a621424-8170-4236-912f-9e4889c70c42 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.312425 Oct 18 16:10:07.027373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1134/2268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:06 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:07.032615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.034072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.041092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.041869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.042535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.043429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.044055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.044640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.188081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.200775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.201809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.203126 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-463bd27e-65b0-4641-9aba-cc1624c8d916 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.174657 Oct 18 16:10:07.204038 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1135/2269] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:07.206665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.215666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5125c5e7-d40a-4116-975b-7c478df41c30 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.207188 Oct 18 16:10:07.221893 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1135/2270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:07.230859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.231721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.241456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.242031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.242488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.247679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.248348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.248810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.304151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.305150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.317898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.329462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.331552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.332337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.333289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.333734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.594334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.595053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.605681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9cb6a484-f36f-4226-9b05-33cd10d59110 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1472 microversion: 2.1 time: 0.399762 Oct 18 16:10:07.606508 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1136/2271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:07.611530 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a661751-10c8-4062-852d-46485b01e27c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.310182 Oct 18 16:10:07.621031 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1136/2272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:07.633879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.634531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e05c9da-0090-4e3c-8989-7a5fd5235061", "name": "network-vif-deleted", "tag": "682a0667-46e4-499f-a988-6326eff8cb7e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:07.635047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.643831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.644286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.645485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.646235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.646702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.647157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.659889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.662769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.663407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.692634 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] Creating event network-vif-deleted:682a0667-46e4-499f-a988-6326eff8cb7e for instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 on n-h1-858383-14 Oct 18 16:10:07.699360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-dc3baf4e-24f4-4f85-aa50-7bddd8a41d4f req-bc0e25a2-804a-4db6-9d8b-e746091be5d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090470 Oct 18 16:10:07.701576 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1137/2273] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:07.882558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.891228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49366f66-e36b-4602-b1fa-2ec9ac9baeb8 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1473 microversion: 2.1 time: 0.276088 Oct 18 16:10:07.892164 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1137/2274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:08.052567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.054208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.063929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.065321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.066520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.067487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.068204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.069322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.231163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.232038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.241005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.241528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.241985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.243176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.243304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.243682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.321919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.333471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.334910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.336906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1fa4ebc8-03ef-48a1-add8-301a03d0e7c4 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.109650 Oct 18 16:10:08.350912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1138/2275] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:08.364563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.365337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.372690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.373264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.373652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.374625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.375084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.375507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.591189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.603303 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98c8c950-370f-4d7b-8d53-8a074ac9801b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1513 microversion: 2.1 time: 0.251066 Oct 18 16:10:08.605688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1139/2276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:08.630853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.631618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.639120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.639619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.640066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.640806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.641327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.641765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.853118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.867188 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-92a187fe-1e90-400f-9624-cffc8ed0b544 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.819929 Oct 18 16:10:08.868600 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1138/2277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:08.873813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.874781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.886497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.887345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.887982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.888900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.891474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.892744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.927145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:08.935305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:08.952491 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ee01df3-9a31-444b-9bd6-ad8f164cf408 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1472 microversion: 2.1 time: 0.318829 Oct 18 16:10:08.953441 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1140/2278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:08.964210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.965185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.977618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.985776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.986282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.987229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.987696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.988297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.106068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.116661 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb1dccd6-9bf7-4ad7-9c2d-16f6568e81eb tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.246599 Oct 18 16:10:09.117546 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1139/2279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:09.255869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.268976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a45f0ec1-4e2e-4638-8d39-a1d090bffe61 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1473 microversion: 2.1 time: 0.312951 Oct 18 16:10:09.269631 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1141/2280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1473 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:09.368431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:09.369222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:09.383366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.383871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.384288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.385216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.385822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.386395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.502340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.532364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.551001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.556966 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab738f8b-0ec3-4fc9-b71c-84541b49740f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.192536 Oct 18 16:10:09.558228 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1140/2281] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:09 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:09.628715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:09.629339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:09.644465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.645177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.646488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.647610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.648201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.648762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.890468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:09.891408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:09.898638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:09.900832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.901603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.902281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.903194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.903849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:09.904470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.927756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.940730 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad907e95-db86-40d4-9e61-c2f1a243b747 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1531 microversion: 2.1 time: 0.316321 Oct 18 16:10:09.956445 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1142/2282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:09 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1531 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:09.990607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:09.991572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:09.998748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:09.999531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.000162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.001092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.002282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.002948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.276104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.314951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b335b492-c39c-44d6-91ef-d3c89d1495b1 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1472 microversion: 2.1 time: 0.323238 Oct 18 16:10:10.318638 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1143/2283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:09 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:10.328474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:10.330025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:10.354259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.355022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.355611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.357062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.358160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.358868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.607073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.624006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ed13157-c507-4060-9369-2659fd05fcd7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.303663 Oct 18 16:10:10.639451 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1144/2284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:10 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:10.656688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:10.657435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:10.685908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.686411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.687366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.691564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.694269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.694788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.794270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.802127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:10.810590 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a2efd30-4a4c-4cb3-a942-8328eb99ea8b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.923737 Oct 18 16:10:10.811319 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1141/2285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:09 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:10.820514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:10.824295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:10.833991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.834736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.835323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.837312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.837935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.838519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.967359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.978279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.987244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.988778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.990055 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70c92f68-71d1-4f50-85c0-97fbd5fd8c42 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.177665 Oct 18 16:10:11.003999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1142/2286] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:10 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:11.003999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:11.003999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:11.004421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2da3f428-dc36-429e-ba55-46d6374ae9b6 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1473 microversion: 2.1 time: 0.361243 Oct 18 16:10:11.011862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.014121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.014706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.020348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1145/2287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:10 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:11.021173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.021826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.022401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.332717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:11.343589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8645137-0742-41df-bbfe-37a087cb8d1c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.351441 Oct 18 16:10:11.346279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1143/2288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:10 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:11.346882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:11.348390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:11.366212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.367276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.368480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.369397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.370025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.371144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.589544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1", "name": "network-vif-deleted", "tag": "f016a12b-b11d-4342-aa64-1b3e30f12ff8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:11.598593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:11.609790 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e5cff57-c150-4597-b6d0-da5c48b231b0 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1472 microversion: 2.1 time: 0.269472 Oct 18 16:10:11.611628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1146/2289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:11 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:11.622507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.622997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.623436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.652042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:11.652669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:11.659860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.660367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.660815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.661604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] Creating event network-vif-deleted:f016a12b-b11d-4342-aa64-1b3e30f12ff8 for instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 on n-h2-858383-14 Oct 18 16:10:11.661691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.662024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.662447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.702149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d4dc9702-1d90-4890-a2a5-ed723505e79c req-32cc65b0-5c28-4252-b7c9-9e3bee8ab8cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111894 Oct 18 16:10:11.705911 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1144/2290] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:10:11.843905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:11.853039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:11.853509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e8fab19e-7e70-4f6e-8bed-c07b1c9d5214 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.204659 Oct 18 16:10:11.854410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1147/2291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:11 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:11.871816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:11.880465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.881232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.881880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.882857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.883556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.885182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.021298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.022144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.034670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.035217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.035720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.036401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.039739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.042367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.139687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.152615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.154117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.155303 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8be3a768-4040-4da0-9770-393862941a76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 200 len: 1265 microversion: 2.25 time: 0.138431 Oct 18 16:10:12.156254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1148/2292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:10:12.170045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.170766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.180607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.180986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.181685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.182332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.183468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.184130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.184966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.191522 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-809303d8-ebd0-4c9a-8a29-b725d7d816fa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.355974 Oct 18 16:10:12.192301 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1145/2293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:11 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:12.229675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.230297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.230953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.231750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lazy-loading 'fault' on Instance uuid dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:12.280526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fd432bad6740efad5a96720455b658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cf155786464a64826aadc055af9032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.291986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-423b0101-61ff-463a-b591-5c550e97b6b0 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 200 len: 1308 microversion: 2.1 time: 0.133944 Oct 18 16:10:12.293148 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1149/2294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:12.369922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.370576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.376701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.377474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.377916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.378618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.379375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.379807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.557978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.570051 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4030b371-8429-435a-b354-0e2c99a75db1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.204057 Oct 18 16:10:12.571339 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1146/2295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:12.643479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.644533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.686942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.692497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.693772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.703090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.712596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.714388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.805715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.806742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.808612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.810706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lazy-loading 'fault' on Instance uuid ba42be3d-9f5f-4f99-80e7-f03044feb794 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:12.880188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.880869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.906098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.906238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.910375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.912082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.912577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.915719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.940382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.955209 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29976849-b9be-4295-a7ec-2f0850066072 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 200 len: 1307 microversion: 2.1 time: 0.320859 Oct 18 16:10:12.959615 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1150/2296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:13.184214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.184837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 5e05c9da-0090-4e3c-8989-7a5fd5235061] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:13.194404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.198569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.199090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.200031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.210037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.210881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.230138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] HTTP exception thrown: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Request method failure captured: Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 HTTP/1.1 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4HCO1ZoFIs9GxPJuFJlC6u-8daAnaX_wc1AhCXkLm8n0TdrdIRZDrbml0ck7M8bsoyVRAYgv0dfjGbkw77YPaqQr_KJuD1DkDmenWvjrLbzRMRTCzj0j1Qlx2LJBBEtTI8OcTEd61kltk4dnBjwde2d_7bdajUYssTlVykY50dwck Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:13.232167 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c91c440777a0421c961411bafbc058ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c91c440777a0421c961411bafbc058ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}] Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 19e2cb9474fb47a6b3f3793c7f162caf Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. Oct 18 16:10:13.233347 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5e05c9da-0090-4e3c-8989-7a5fd5235061'} Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:13.233978 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. Oct 18 16:10:13.234967 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.236382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Returning 404 to user: Instance 5e05c9da-0090-4e3c-8989-7a5fd5235061 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:13.236382 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-328b1552-f0d4-44a0-a9d4-839adda8aeb5 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061" status: 404 len: 111 microversion: 2.25 time: 0.055971 Oct 18 16:10:13.239862 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1151/2297] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:13 2022] GET /compute/v2.1/servers/5e05c9da-0090-4e3c-8989-7a5fd5235061 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:13.246325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.246942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:13.263850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.264336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.269293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.270333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.270808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.271511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.305925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:13.320154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7844213a-49ca-470a-9d34-35054b4b2c02 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.445743 Oct 18 16:10:13.324038 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1147/2298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:13.334199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.337753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] [instance: dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:13.359927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.360355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.360840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.362437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.362907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.363365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.400747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] HTTP exception thrown: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Request method failure captured: Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 HTTP/1.1 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8SX3jkHrgF_eRL46tBNZrZqgo_LOTKZKmpEyaZ74GQNrHdf0NZvZfj6FaYuG7hlhb4Ho0MHr63QKOol69lYyZDUfQFTh5T_aPgsywTrcdpfZjTiqAXHVQ8i1NjmVZ4KMDPi7eBoZtZhb6nwxKiGHLEdFLGnaEBeEW9g-mqp2ZMwmU Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 11cf155786464a64826aadc055af9032 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:13.402797 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/11cf155786464a64826aadc055af9032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/11cf155786464a64826aadc055af9032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_11cf155786464a64826aadc055af9032"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/11cf155786464a64826aadc055af9032"}]}] Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 11cf155786464a64826aadc055af9032 Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1357514434 Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ListImageFiltersTestJSON-1357514434-project Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 04fd432bad6740efad5a96720455b658 Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ListImageFiltersTestJSON-1357514434-project Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. Oct 18 16:10:13.403926 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1'} Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:13.404535 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. Oct 18 16:10:13.406244 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:13.407160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Returning 404 to user: Instance dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:13.407160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c78b7a1d-c060-4ba8-8bd7-85643e8dda9f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1" status: 404 len: 111 microversion: 2.1 time: 0.079192 Oct 18 16:10:13.412763 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1148/2299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:13 2022] GET /compute/v2.1/servers/dca3ac7a-bcb0-4a3c-8a32-932270e8f7d1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:13.427417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8784655-74d1-49bc-990b-6d7516c7ae91 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd6457d30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.525836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:13.537402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8ac101f-b854-4108-936a-893b8c2be991 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.296386 Oct 18 16:10:13.539821 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1152/2300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:13 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:13.597175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.598228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:13.606937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.611248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.611963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.612916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.617690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.618406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.924162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:13.941398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f48b04d-5760-4856-8907-e1af3e023224 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.347004 Oct 18 16:10:13.943821 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1153/2301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:13 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:13.951394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba42be3d-9f5f-4f99-80e7-f03044feb794", "name": "network-vif-deleted", "tag": "f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:13.971100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.971983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.973142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.998746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] Creating event network-vif-deleted:f9a7cc46-a8fd-43bc-b409-f33cc7f8ccec for instance ba42be3d-9f5f-4f99-80e7-f03044feb794 on n-h2-858383-14 Oct 18 16:10:14.004801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-29530085-aeb5-4829-a4b4-9482e73b254a req-1289a04d-0d3e-4556-979f-e2bef56afc5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057006 Oct 18 16:10:14.009035 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1154/2302] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:14.015144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.016941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ba42be3d-9f5f-4f99-80e7-f03044feb794] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.028359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.029231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.030018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.031119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.031865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.032520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.047905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 HTTP/1.1 Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:14.050180 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. Oct 18 16:10:14.051281 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'ba42be3d-9f5f-4f99-80e7-f03044feb794'} Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:14.051874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. Oct 18 16:10:14.052849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:14.056140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance ba42be3d-9f5f-4f99-80e7-f03044feb794 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:14.058203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0a1a4a2-8538-4231-b0b7-207164afa72e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794" status: 404 len: 111 microversion: 2.1 time: 0.047129 Oct 18 16:10:14.059628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1155/2303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] GET /compute/v2.1/servers/ba42be3d-9f5f-4f99-80e7-f03044feb794 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:14.068595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-plugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:14.083376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.084548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.085388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.089323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8784655-74d1-49bc-990b-6d7516c7ae91 tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad" status: 204 len: 0 microversion: 2.1 time: 0.674361 Oct 18 16:10:14.090326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1149/2304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:13 2022] DELETE /compute/v2.1/images/6a19cb8e-cf41-46aa-9a72-c475946942ad => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:14.097217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.097742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.102533 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] Creating event network-vif-plugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:10:14.110218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b9ba4d52-da51-4195-bbd9-f17a69af2740 req-fe4cbcb9-b3ea-47eb-b2cf-e5214d298114 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048946 Oct 18 16:10:14.111898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1156/2305] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:14.119323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8194f6dc-0bc9-4944-9745-1e5274b438db tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd182aca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.127578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.128191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.131053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.131969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.132938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.137207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.192638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:14.391610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd9d2d71-8427-4d73-ae4e-ed5cad25f24b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 204 len: 0 microversion: 2.1 time: 0.296677 Oct 18 16:10:14.396131 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1150/2306] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:14 2022] DELETE /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:14.444350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.445802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.454348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.455653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.456346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.457963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.458980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.459908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.557576 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8194f6dc-0bc9-4944-9745-1e5274b438db tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae" status: 204 len: 0 microversion: 2.1 time: 0.443763 Oct 18 16:10:14.558148 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1157/2307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] DELETE /compute/v2.1/images/b101d25a-dc15-46e8-9702-d3a90aa17eae => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:14.566786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.567788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.574879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.575625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.576468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.577595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.578255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.578876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.736463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:14.746946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-986fe2d8-1127-42df-9c12-7c4364b87c0c tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1472 microversion: 2.1 time: 0.187554 Oct 18 16:10:14.748951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1158/2308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:14.766818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.768372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.777527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.778030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.778471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.779191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.779913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.780531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.869233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:14.885523 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cdbf11a-4921-4349-a932-7f67b6efb476 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.483341 Oct 18 16:10:14.886235 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1151/2309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:14.901604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b8e6e83-3183-428d-b2c2-37c72f985d6f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] Calling method '.version_select at 0x7f5fd64c2940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:15.111392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:15.126223 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a879205-d067-48cf-91c1-f0d5b0533a66 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.373945 Oct 18 16:10:15.128797 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1159/2310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:15.148184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:15.149299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:15.174355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.178157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.181173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:15.185393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.186789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.191857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:15.241083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:15.333820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b8e6e83-3183-428d-b2c2-37c72f985d6f tempest-ListImageFiltersTestJSON-1357514434 tempest-ListImageFiltersTestJSON-1357514434-project] 10.222.0.78 "DELETE /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a" status: 204 len: 0 microversion: 2.1 time: 0.446716 Oct 18 16:10:15.334407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1152/2311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] DELETE /compute/v2.1/images/73e2370a-9b20-48cd-b103-a7c9e661803a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:15.513167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:15.528642 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36d68650-5e25-446b-a177-f5883ea00ab7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.396928 Oct 18 16:10:15.530200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1160/2312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:15 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:15.771058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:15.771765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:15.786397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.791927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.792901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:15.796072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.801458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.802043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:15.913687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:15.914786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:15.928044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.939189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.939950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:15.943466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:15.943923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:15.944362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.186379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:16.202951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37b9a0fb-66ca-40c9-9888-120e6a094282 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1472 microversion: 2.1 time: 0.436580 Oct 18 16:10:16.204384 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1153/2313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:15 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:16.219640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "name": "network-vif-unplugged", "status": "completed", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:16.240200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.241199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.241792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.271239 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] Creating event network-vif-unplugged:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:10:16.273692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:16.284972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0cd620f2-83d1-4e29-8db5-e5446e307ca1 req-67d6d920-aab8-48b6-affd-ca1589068220 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078778 Oct 18 16:10:16.285339 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1154/2314] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:16.287135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9d1dcc3-0cc4-42b0-8be3-d189b2bbfe58 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.378903 Oct 18 16:10:16.301253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1161/2315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:15 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:16.301353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:16.301353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:16.302072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.303035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.303619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.304554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.305182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.305751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.556114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:16.557867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:16.564536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.565396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.566024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.567090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.567751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.568373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.739630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:16.753059 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8c972c1-5f92-43c2-8dbf-13bc663fd251 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.200788 Oct 18 16:10:16.755641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1162/2316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:16 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:17.073386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:17.082462 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-021ba89f-6446-413e-a86a-84efeb7abbfa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.793604 Oct 18 16:10:17.083053 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1155/2317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:16 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:17.229505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:17.230275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:17.248644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.249741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.250405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.252113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.253818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.254549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.324204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:17.333477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:17.368366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.369067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.369585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.370344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.379047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.382242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.718948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:17.742912 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-60f5b26e-3ba3-465d-8767-482a4baea1f9 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1472 microversion: 2.1 time: 0.514529 Oct 18 16:10:17.763032 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1163/2318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:17 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:17.786866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:17.787644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:17.796029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.796598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.797070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.797875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.828581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.835948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.298914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:18.316959 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25d3f98e-0943-4f3e-943a-26edc06ab096 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.537657 Oct 18 16:10:18.321227 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1164/2319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:17 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:18.344033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:18.347232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:18.368791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.369327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.380309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.381201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.381628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.382073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.647352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:18.661971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aee0c952-7666-4740-9eed-04a713090d69 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 1.346791 Oct 18 16:10:18.662628 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1156/2320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:17 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:18.770697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:18.772123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:18.803914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.817368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.817969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.818815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.819366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.820024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:19.146436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:19.176248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b24bef9e-28ff-4c5a-9ca8-5223561139bd tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 200 len: 1430 microversion: 2.1 time: 0.409593 Oct 18 16:10:19.180609 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1157/2321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:18 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 1430 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:19.225641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d783dfb-0c61-45d7-ade2-42b780ae57d0", "name": "network-vif-deleted", "tag": "9fa21e49-45ac-4489-afc3-f09c4d4d6fbb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:19.276546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:19.276745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:19.277222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:19.320482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] Creating event network-vif-deleted:9fa21e49-45ac-4489-afc3-f09c4d4d6fbb for instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 on n-h2-858383-14 Oct 18 16:10:19.342915 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d83bf7e3-f164-45da-9b93-005d68f3c5ec req-dd603f56-b8f7-4424-b82e-e2aedb7cea08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141369 Oct 18 16:10:19.348476 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1158/2322] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:19.907712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Calling method '.version_select at 0x7f5fd640a430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:19.951229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:19.956060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:19.956718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:19.958789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:19.961317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:19.962902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.058854 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a02c463b-3839-4ed3-9bfe-4fd2c0f23421 tempest-AbsoluteLimitsTestJSON-405860466 tempest-AbsoluteLimitsTestJSON-405860466-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.707291 Oct 18 16:10:20.062072 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1159/2323] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:20.082636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:20.087121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:20.102782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.106654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.107213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.108036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.108583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.109469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.494622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:20.510450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fac4681e-e001-40e5-83ac-9be70757131a tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.443315 Oct 18 16:10:20.518005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1160/2324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:20 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:20.556902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55048fe8-cfbd-434e-b92f-c13cf9c0415a", "name": "network-vif-plugged", "status": "completed", "tag": "9e6ae16a-c285-47dc-a6b9-7a6e12438633"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:20.592374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.594329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.596047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.612859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:20.636769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a8ae1530-0809-4f8c-9ab4-e165252afbf7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 2.313432 Oct 18 16:10:20.663574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1165/2325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:18 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:20.683168 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] Creating event network-vif-plugged:9e6ae16a-c285-47dc-a6b9-7a6e12438633 for instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a on n-h1-858383-14 Oct 18 16:10:20.685206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:20.686697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:20.694832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-38fdcd75-44e4-4536-ac80-45f6246cc722 req-5b095ec7-77b1-410e-a26b-2c4ef2017661 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164177 Oct 18 16:10:20.698594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1161/2326] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:20.703311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.704101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.704944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.707463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.709919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.710529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.713168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:20.714475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 1d783dfb-0c61-45d7-ade2-42b780ae57d0] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:20.734811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.735580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.737204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.738175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.738778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.739950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.774757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 HTTP/1.1 Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:20.777801 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. Oct 18 16:10:20.779054 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '1d783dfb-0c61-45d7-ade2-42b780ae57d0'} Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:20.779717 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. Oct 18 16:10:20.780880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:20.810317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance 1d783dfb-0c61-45d7-ade2-42b780ae57d0 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:20.811727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22bcfe53-14f3-4fcb-a7c5-0e9097920b32 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0" status: 404 len: 111 microversion: 2.1 time: 0.111294 Oct 18 16:10:20.814688 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1162/2327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:20 2022] GET /compute/v2.1/servers/1d783dfb-0c61-45d7-ade2-42b780ae57d0 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:20.824489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:20.825436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:20.846532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.847326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.848256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.849246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.850338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.850983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.890414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:20.919529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:21.134032 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5b0f180-385c-46a8-a89c-7d7e884d1a89 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 204 len: 0 microversion: 2.25 time: 0.314208 Oct 18 16:10:21.141707 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1163/2328] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:10:20 2022] DELETE /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:10:21.162311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:21.162910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:21.195372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.195963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.196418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:21.197300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.200938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.201512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:21.273074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:21.332058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:21.347170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e5025ce-2596-4cca-96e8-3fa51c1a4875 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.682266 Oct 18 16:10:21.350110 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1166/2329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:20 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:21.356921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:21.357586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:21.365038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.374998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.375836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:21.379542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.380060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.380507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:21.575041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-792c7b83-233a-4688-a300-507cc264a634 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 204 len: 0 microversion: 2.1 time: 0.434565 Oct 18 16:10:21.576148 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1164/2330] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:21 2022] DELETE /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:21.593022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:21.594215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:21.621708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.624061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.626344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:21.628414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:21.629995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:21.632263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.193892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.203006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.208334 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7f013ba-a6bd-430c-84fc-8becc2d86cfe tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.628930 Oct 18 16:10:22.210921 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1165/2331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:21 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:22.224412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:22.224938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:22.243262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.246248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.246742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.253337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.254145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.254760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.255060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.259935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.269344 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e77dfcf2-14c0-4730-821b-44c8a97beffa tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1731 microversion: 2.25 time: 0.909903 Oct 18 16:10:22.283361 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1167/2332] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:21 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1731 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:22.297165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:22.298196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:22.306618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.307390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.308171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.309957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.312634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.313334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.377251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:22.570844 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0011aa37-df07-495a-9050-3ff533d584de tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 204 len: 0 microversion: 2.1 time: 0.352032 Oct 18 16:10:22.574909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1166/2333] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:22 2022] DELETE /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:22.593190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:22.595288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:22.608376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.609298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.610084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.611693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.621741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.622282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.765356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.780216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04343764-f4ec-4296-9c2d-41cd63ed5c29 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.494801 Oct 18 16:10:22.781434 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1168/2334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:22 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:22.795278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:22.797459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:22.815374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:22.831240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.831757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.832208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.833237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.833702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.834320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:22.936072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:22.946912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f4ef84c-7852-4b57-a1c9-5c57bc9c9577 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.370573 Oct 18 16:10:22.949996 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1167/2335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:22 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:22.962269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "name": "network-vif-plugged", "status": "completed", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:22.987726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:22.992077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:22.992077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.019570 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] Creating event network-vif-plugged:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:10:23.032147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c0fcb5bc-e45d-4261-beb8-5707a2fd6ac8 req-b9b694fa-c191-4808-948e-cdb66c38830f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078612 Oct 18 16:10:23.035596 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1168/2336] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:23.264218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:23.269659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:23.285629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:23.299555 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75743cc1-f396-438e-91ee-40e8e5365132 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1474 microversion: 2.1 time: 0.515614 Oct 18 16:10:23.299705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.300373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.300501 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1169/2337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:22 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1474 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:23.317677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.318319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:23.318897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.320143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:23.320403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.321038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.343947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.346596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.348002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.350479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.351148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.352137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.639269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:23.656816 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18a6a63e-55ed-43de-9c90-d3adf32fce60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.406799 Oct 18 16:10:23.660109 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1169/2338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:23 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:23.774496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:23.796522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:23.798847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:23.808912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:23.810455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:23.818587 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8aaa0f98-d850-4293-8f8a-2a869f47b65b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1731 microversion: 2.25 time: 0.516981 Oct 18 16:10:23.827674 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1170/2339] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:23 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1731 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:23.831347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.832053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.834168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.835116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.836910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.841161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:23.972458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:23.973032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:23.993691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:23.996773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:23.997716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.007512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.008520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.009142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.186598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:24.210871 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88022da4-38fa-499e-bc20-aa0fd5151cd0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1199 microversion: 2.1 time: 0.406737 Oct 18 16:10:24.212945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1170/2340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:23 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1199 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:24.324157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:24.325199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:24.340769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.346032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.346732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.347837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.348453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.349818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.664001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:24.682508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-169f7907-0411-4d69-82c4-06c575bf0e45 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.714437 Oct 18 16:10:24.683760 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1171/2341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:23 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:24.690397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:24.693959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:24.711302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.712197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.712827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.713788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.714459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.715072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.796267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:24.811659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0a33362-d868-41f7-8a62-7d0adeb4635f tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1474 microversion: 2.1 time: 0.490886 Oct 18 16:10:24.812643 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1171/2342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:24 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:24.853430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:24.854465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:24.862473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.863235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.863777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:24.864610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:24.865244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:24.866645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:25.390283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:25.418921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d272997f-5577-43c2-ae6e-152806f9b1d7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.719113 Oct 18 16:10:25.421765 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1172/2343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:24 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:25.441104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:25.441744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:25.460602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:25.461163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:25.461618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:25.462362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:25.462984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:25.463426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:25.508527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:25.526575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:25.535107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:25.536372 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f89012d-7165-46f7-a1e9-26e223753941 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1731 microversion: 2.25 time: 0.686967 Oct 18 16:10:25.561102 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1172/2344] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:24 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1731 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:25.569727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27db667c-7280-4fa8-99da-3d6b005ddff1", "name": "network-vif-deleted", "tag": "9604d31f-3fa8-48fb-b16b-87e7031a4452"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:25.609661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:25.616107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:25.617649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:25.669495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] Creating event network-vif-deleted:9604d31f-3fa8-48fb-b16b-87e7031a4452 for instance 27db667c-7280-4fa8-99da-3d6b005ddff1 on n-h2-858383-14 Oct 18 16:10:25.690967 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d2d5dfa4-3b3c-4879-8897-7fa09dfd935e req-4bb4c670-c8f1-4102-b4ce-7cd46c047a91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124813 Oct 18 16:10:25.697635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1173/2345] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:25.715733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:25.716437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:25.747461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:25.751142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:25.752484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:25.755619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:25.757494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:25.758618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.076065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:26.091615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51b4cfa9-8e91-4e4a-a561-434b5990fc10 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.379508 Oct 18 16:10:26.093747 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1174/2346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:25 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:26.103388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:26.108003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:26.128737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.129410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.145718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.148329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.148836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.149354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.475522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:26.490793 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09a5b748-40d6-4f44-b15b-a7e5f5d71e7e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1474 microversion: 2.1 time: 0.388887 Oct 18 16:10:26.501933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1175/2347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:26 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:26.513689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:26.515523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:26.525202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.526081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.526798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.528253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.528968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.529975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.562092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:26.769369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:26.788042 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfdcce34-a0b8-4465-a3eb-13e8dd35724b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1519 microversion: 2.1 time: 0.278600 Oct 18 16:10:26.789415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1176/2348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:26 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:26.796519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:26.798619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:26.808527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.809515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.810215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.812831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:26.813703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:26.814432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:26.980536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:26.999166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:27.000458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:27.002114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a241002-55d2-47a2-a44d-e9f36e4b2b3d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1664 microversion: 2.25 time: 0.210514 Oct 18 16:10:27.029598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1177/2349] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:26 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1664 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:27.119852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:27.120523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:27.128841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:27.129386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:27.129832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:27.131330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:27.131330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:27.131533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:27.436863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:27.447003 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af908c4c-320b-4e4a-9d18-e4da3ecf49e6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1383 microversion: 2.1 time: 2.022682 Oct 18 16:10:27.453411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1173/2350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:25 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1383 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:27.481749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:27.482369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:27.495165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:27.499928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:27.503608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:27.505872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:27.506529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:27.507839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:27.990959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.011759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eacd923c-896a-4ec6-912c-600de8efc5a2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.897822 Oct 18 16:10:28.012586 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1178/2351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:27 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:28.051729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:28.053364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:28.074471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:28.077459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.078019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.098373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.101621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.102126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.102571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.225217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.226114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.226703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.228028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lazy-loading 'fault' on Instance uuid 53fff94e-a07e-4e96-8001-e765d4c2aab1 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:28.291160 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8dda177a-5228-4737-aa11-64b5debc269f tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1536 microversion: 2.1 time: 0.810578 Oct 18 16:10:28.293045 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1174/2352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:27 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1536 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:28.299306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fff94e-a07e-4e96-8001-e765d4c2aab1", "name": "network-vif-deleted", "tag": "0becb27d-d227-4e3c-98bf-51b87e0f6c42"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:28.330642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.333425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.336250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.380719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] Creating event network-vif-deleted:0becb27d-d227-4e3c-98bf-51b87e0f6c42 for instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 on n-h1-858383-14 Oct 18 16:10:28.405356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d138614e-7e8a-40c2-80e6-e82b8e3bfb3d req-bf78bd46-09f3-48f6-8eef-6ad795287e9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110627 Oct 18 16:10:28.412537 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1175/2353] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:28.423741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:28.430376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:28.436741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.452151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.455191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.457965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.460563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.461326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.462224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.465019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d56c7f7c-baab-4ade-8301-9b2d2ce237bf tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 200 len: 1308 microversion: 2.1 time: 0.450740 Oct 18 16:10:28.470338 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1179/2354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:28 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:28.477915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:28.479373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:28.490774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.491809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.492497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.493471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.494145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.494784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.805891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.824065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.827286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.833177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:28.838934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33934ea5-37f5-4f37-a39d-877912a55a84 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 200 len: 1664 microversion: 2.25 time: 0.366368 Oct 18 16:10:28.839952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f100bdd-294d-4824-b032-e1a6e9364819 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1504 microversion: 2.1 time: 0.420908 Oct 18 16:10:28.840087 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1180/2355] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:28 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 1664 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:28.846000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:28.853704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:28.853842 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1176/2356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:28 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:28.867859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.870669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.873155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:28.889066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:28.889971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:28.895318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.151444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47e223c0-42fc-41db-8c13-f8c2a2c1036b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd188b280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-443462901", "description": "tempest-description-1325572327"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:29.512610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f2e2d85-b97b-43e9-b11e-c1e4046e4137 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1536 microversion: 2.1 time: 0.670787 Oct 18 16:10:29.537204 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47e223c0-42fc-41db-8c13-f8c2a2c1036b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.673618 Oct 18 16:10:29.538748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1177/2357] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:10:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:29.540115 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1181/2358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:28 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1536 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:29.552749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:29.555389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:29.557531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:29.558180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:29.567466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.567905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.568367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.569465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.569952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.570537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.573549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.574042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.574482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.575181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.575637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.576058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.747400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:29.756749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:29.760253 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a40d4799-143e-4ff1-a1c1-1752e469a9ba tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.215782 Oct 18 16:10:29.761188 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1178/2359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:29 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:29.766289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:29.767438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 53fff94e-a07e-4e96-8001-e765d4c2aab1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:29.774854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.775552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.776589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.777473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.778106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.778681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.796786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 HTTP/1.1 Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:29.799068 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. Oct 18 16:10:29.800622 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '53fff94e-a07e-4e96-8001-e765d4c2aab1'} Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:29.801450 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. Oct 18 16:10:29.802486 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:29.803378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance 53fff94e-a07e-4e96-8001-e765d4c2aab1 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:29.803378 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd428a6e-1071-4189-b9b1-93fa0b857d38 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1" status: 404 len: 111 microversion: 2.1 time: 0.038683 Oct 18 16:10:29.803378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1179/2360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:29 2022] GET /compute/v2.1/servers/53fff94e-a07e-4e96-8001-e765d4c2aab1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:29.806040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:29.810143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.810635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.811078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.811811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:29.812261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:29.812843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:29.847602 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed2be887-34af-4f9a-9b5b-a1560b021dbc tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045122 Oct 18 16:10:29.848753 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1180/2361] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:10:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:29.853900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f15b5213-b65b-46ed-875a-993926c887cc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd18c3dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1761471973", "description": "tempest-description-2108419928"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:29.936424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:29.999850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:30.229882 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f15b5213-b65b-46ed-875a-993926c887cc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.379508 Oct 18 16:10:30.247023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1181/2362] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:10:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:30.268276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:30.270147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: 27db667c-7280-4fa8-99da-3d6b005ddff1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:30.295109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.296232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.297390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.302841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.303574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.304198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.339566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 HTTP/1.1 Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:30.351361 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. Oct 18 16:10:30.352720 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '27db667c-7280-4fa8-99da-3d6b005ddff1'} Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:30.353679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. Oct 18 16:10:30.355122 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.365146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance 27db667c-7280-4fa8-99da-3d6b005ddff1 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:30.365521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:30.366293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-46404932-aa5f-4d3e-a0bd-2fa70c8f869e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1" status: 404 len: 111 microversion: 2.1 time: 0.118817 Oct 18 16:10:30.370642 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1182/2363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:30 2022] GET /compute/v2.1/servers/27db667c-7280-4fa8-99da-3d6b005ddff1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:30.375604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f0fa83e-c4ed-4efd-9d6d-ed309480681d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 200 len: 1504 microversion: 2.1 time: 0.833298 Oct 18 16:10:30.376734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1182/2364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:29 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:30.381936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-14", "block_migration": false, "disk_over_commit": false}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:30.383050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:30.384221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 72eddaaa-d9ba-4a52-bd9b-a576e4b04414] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:30.389518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:30.394056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.394887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.395506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.396378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.397072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.397975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.407178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.408467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.409091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.410030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:30.410638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:30.411249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:30.421575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] HTTP exception thrown: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Request method failure captured: Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 HTTP/1.1 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4HCO1ZoFIs9GxPJuFJlC6u-8daAnaX_wc1AhCXkLm8n0TdrdIRZDrbml0ck7M8bsoyVRAYgv0dfjGbkw77YPaqQr_KJuD1DkDmenWvjrLbzRMRTCzj0j1Qlx2LJBBEtTI8OcTEd61kltk4dnBjwde2d_7bdajUYssTlVykY50dwck Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:30.424303 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c91c440777a0421c961411bafbc058ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c91c440777a0421c961411bafbc058ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}] Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 19e2cb9474fb47a6b3f3793c7f162caf Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. Oct 18 16:10:30.425767 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '72eddaaa-d9ba-4a52-bd9b-a576e4b04414'} Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:30.426586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. Oct 18 16:10:30.427780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:30.438772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Returning 404 to user: Instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:30.439965 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0fe0bef0-378f-4833-b2d7-11fec63b1259 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414" status: 404 len: 111 microversion: 2.25 time: 0.061482 Oct 18 16:10:30.440747 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1183/2365] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:30 2022] GET /compute/v2.1/servers/72eddaaa-d9ba-4a52-bd9b-a576e4b04414 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:30.446524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1821763903", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8d73174a-10ee-4fc5-89d7-9ccd7fe0ecee"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:30.476482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lazy-loading 'flavor' on Instance uuid 55048fe8-cfbd-434e-b92f-c13cf9c0415a {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:30.518821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Going to try to live migrate instance to n-h2-858383-14 {{(pid=120571) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:10:30.558116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] validate_networks() for [('8d73174a-10ee-4fc5-89d7-9ccd7fe0ecee', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:10:31.992317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:10:31.993603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:10:31.994989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:10:31.996685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:10:31.997962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:10:32.010993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.011751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.013597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.014933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.015919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.016747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.049621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Getting quotas for project 24dd02df7fd44c1fbe5df55e6ccde4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:32.058881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Getting quotas for user c2a4c2cd88304000a7277caf5bb29ed6 and project 24dd02df7fd44c1fbe5df55e6ccde4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:32.078918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:10:32.082162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:10:32.160087 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34321274-bbe1-48a8-981e-b14afbc62ba7 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717395 Oct 18 16:10:32.161059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1184/2366] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:10:32.173859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-477e8949-2bb6-49e2-acca-092dd30bf288 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:32.222727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-477e8949-2bb6-49e2-acca-092dd30bf288 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/8dd23bdc-168a-4a69-9366-6a4accc85d13" status: 204 len: 0 microversion: 2.1 time: 0.053453 Oct 18 16:10:32.223852 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1185/2367] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:10:32 2022] DELETE /compute/v2.1/os-server-groups/8dd23bdc-168a-4a69-9366-6a4accc85d13 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:32.231614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:32.234538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:32.245248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.245978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.246601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.247671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.248281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.248961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.295620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:32.437934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24d194a5-020c-4af7-a89f-27b649291176 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 204 len: 0 microversion: 2.1 time: 0.212404 Oct 18 16:10:32.443698 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1186/2368] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:32 2022] DELETE /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:32.451665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eddaaa-d9ba-4a52-bd9b-a576e4b04414", "name": "network-vif-deleted", "tag": "c889aa88-14de-45a5-ab3b-0841fc8c3998"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:32.475774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.476377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.476964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.491702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] Creating event network-vif-deleted:c889aa88-14de-45a5-ab3b-0841fc8c3998 for instance 72eddaaa-d9ba-4a52-bd9b-a576e4b04414 on n-h1-858383-14 Oct 18 16:10:32.500869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-440737fa-9f2e-441b-8e6a-65fffbfe8b98 req-5bffb87a-802d-427e-b60c-f828aa0708d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057271 Oct 18 16:10:32.501697 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1187/2369] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:32.514093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3fe7dec-dbbe-49ab-a7bb-5621a159f992 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '.version_select at 0x7f5fd63a8a60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:32.568360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3fe7dec-dbbe-49ab-a7bb-5621a159f992 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442286090" status: 204 len: 0 microversion: 2.25 time: 0.064935 Oct 18 16:10:32.569421 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1188/2370] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442286090 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:10:32.604714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:32.606886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:32.623318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.624843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.626807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.628663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:32.632452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:32.633127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:32.934167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:32.944084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a89c9a35-cce7-49a9-b015-0b08a5f9b5d9 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.372241 Oct 18 16:10:32.953794 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1189/2371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:32 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:32.960508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b40f6ba1-f724-4918-861b-6d81376b50b0 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:32.961524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b40f6ba1-f724-4918-861b-6d81376b50b0 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:33.051813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b40f6ba1-f724-4918-861b-6d81376b50b0 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:33.065525 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b40f6ba1-f724-4918-861b-6d81376b50b0 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1216 microversion: 2.1 time: 0.108582 Oct 18 16:10:33.066726 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1190/2372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:32 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:33.071639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:33.072306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:33.105215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:33.106188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:33.106846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:33.108615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:33.112088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:33.112820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:33.185897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:33.378495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f2fa0536-2140-4727-8e7f-6fb7a63da53b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 204 len: 0 microversion: 2.1 time: 0.309659 Oct 18 16:10:33.382769 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1191/2373] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:33 2022] DELETE /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:33.397263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1996602621", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "571d9adc-eb14-401c-8cde-5cdfbe7e93d2"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:33.529482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] validate_networks() for [('571d9adc-eb14-401c-8cde-5cdfbe7e93d2', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:10:34.041675 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e00bee0e-44f9-448a-ac2f-4768ed340fb3 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a/action" status: 202 len: 0 microversion: 2.1 time: 3.666190 Oct 18 16:10:34.042287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1183/2374] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:10:30 2022] POST /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a/action => generated 0 bytes in 3671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:10:34.052422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:34.052927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:34.084550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.085063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.093855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.100401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.100919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.101400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.202147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:34.496150 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20651b9e-7fcf-4117-9edb-30b4c809432e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 204 len: 0 microversion: 2.1 time: 0.448211 Oct 18 16:10:34.505092 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1184/2375] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:34 2022] DELETE /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:34.533391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:34.538219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:34.580278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.583750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.590783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.596159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.599927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.603259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.702388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:10:34.702935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:10:34.703277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:10:34.703693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:10:34.704801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:10:34.725921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.727275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.727731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.728488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:34.728949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:34.729654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:34.757363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:34.794297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for user b7d816c3043c435d8bf79d2c819518ec and project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:34.811528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:10:34.815790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:10:34.958895 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad91d860-1d51-460c-aa47-b399a253862f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574483 Oct 18 16:10:34.961877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1192/2376] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:10:34.990362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:34.992426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:35.021351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.021871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.022319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.023048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.023502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.029563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.343715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:35.363294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-435200c0-ca1d-4753-922d-a01ab12840ec tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.400232 Oct 18 16:10:35.364037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1193/2377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:34 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:35.375091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:35.375737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:35.387829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.390703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.391160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.393500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.393982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.394423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.451731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:35.466821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58c4170a-84a1-41c2-a9ef-f0b7d0d016ea tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1505 microversion: 2.1 time: 0.959916 Oct 18 16:10:35.467334 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1185/2378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:34 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1505 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:35.502691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:35.503612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:35.544549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.545043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:35.545184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.545499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.546207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.546658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.547089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.566062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e79b190-623b-4648-b8e9-d91da8653d78 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1220 microversion: 2.1 time: 0.200779 Oct 18 16:10:35.566819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1194/2379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:35 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1220 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:35.572312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:35.573319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:35.597758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.598518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.602117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.602907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:35.603385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:35.603815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:35.611536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:35.621113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:35.865354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eaa50d57-4849-40da-bfb2-b56b9451093d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 204 len: 0 microversion: 2.25 time: 0.389710 Oct 18 16:10:35.866024 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1186/2380] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:10:35 2022] DELETE /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:10:35.880874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bfe35058-451a-4b59-80fa-f3c5ed139271 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:35.884755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bfe35058-451a-4b59-80fa-f3c5ed139271 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:36.008780 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:10:36.009011 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 (ip 10.222.0.78) !!! Oct 18 16:10:36.045486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.056348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ddffe7a-906b-4100-bf3c-ef1979fe77eb tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 200 len: 1474 microversion: 2.1 time: 0.487848 Oct 18 16:10:36.073049 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1195/2381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:35 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 1474 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:36.078880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:36.078880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:36.093139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.093823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.094369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.096592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.105032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.105032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.348765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.363158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.368959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.370223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c824ad4-5fc4-41a2-93cb-57feb415a186 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1549 microversion: 2.25 time: 0.300380 Oct 18 16:10:36.370801 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1196/2382] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:36 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1549 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:36.395901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:36.396541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:36.403245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.403751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.404267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.409708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.412102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.412559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.552954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfe35058-451a-4b59-80fa-f3c5ed139271 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.568471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bfe35058-451a-4b59-80fa-f3c5ed139271 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1218 microversion: 2.1 time: 0.697707 Oct 18 16:10:36.575173 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1187/2383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:35 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1218 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:36.583850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:36.594403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:36.637798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.639189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.644004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.649824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.651754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.653107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.836618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:36.858112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7642e858-41d0-422e-a449-dfe27c71e5bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.470891 Oct 18 16:10:36.861786 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1197/2384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:36 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:36.874021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:36.882076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:36.897526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.900314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.901036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:36.903874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:36.904508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:36.907192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:37.280211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:37.290660 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06074e5a-049b-40c9-a998-b92fbcf607e9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1268 microversion: 2.1 time: 0.427652 Oct 18 16:10:37.294706 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1198/2385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:36 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1268 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:37.304189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:37.308090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:37.325282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:37.326270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:37.327132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:37.331081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:37.333237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:37.337863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.469242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:38.483765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c0aaabb-8469-4483-8838-ab80c0e86b6d tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 200 len: 1474 microversion: 2.1 time: 1.187867 Oct 18 16:10:38.497068 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1199/2386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:37 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 1474 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:38.503002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:38.504224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:38.516015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.516500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.517023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.522657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.526109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.526588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.632234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:38.653602 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90eb7621-e289-4cd7-a236-2f2bf0d609ec tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1485 microversion: 2.1 time: 2.076078 Oct 18 16:10:38.658688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1188/2387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:36 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1485 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:38.672422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:38.688534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:38.726779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.727670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.728470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.730885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.731587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.735160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:39.161074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:39.174311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac31b546-97a5-40a2-85cb-07f496b65396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1278 microversion: 2.1 time: 0.503691 Oct 18 16:10:39.176952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1189/2388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:38 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1278 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:39.189003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "name": "network-vif-unplugged", "status": "completed", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:39.215160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:39.234294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:39.241591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:39.313315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] Creating event network-vif-unplugged:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:10:39.340962 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3f82e2f8-4d01-4658-87ce-c0537bff3562 req-cfd760a6-6120-491f-8d9c-9324514d3980 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157684 Oct 18 16:10:39.342678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1190/2389] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:39.353270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:39.374139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:39.404703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:39.406902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:39.407924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:39.415863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:39.416375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:39.416952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:39.823778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:40.293331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:40.324866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:40.338353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:40.342413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4dfbb8e2-bc66-4ac9-85fe-b46a624436a6 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1549 microversion: 2.25 time: 1.851887 Oct 18 16:10:40.343661 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1200/2390] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:38 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1549 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:40.375037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:40.381527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:40.407268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:40.420220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:40.421432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:40.422609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:40.424456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:40.425170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:40.659378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:40.725248 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0c10c8a-b7cd-4190-8ffa-2618902b50ce tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.361308 Oct 18 16:10:40.730468 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1191/2391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:39 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:40.755688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1702700017", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:40.858409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:40.878874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c329ad8-be3d-489c-8305-16b875460ee2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1274 microversion: 2.1 time: 0.530657 Oct 18 16:10:40.879488 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1201/2392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:40 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1274 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:40.901069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:40.911818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:40.946985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:40.947486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:40.947925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:40.961009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] validate_networks() for [('6713780e-c408-4821-852a-f2bf2b47fc47', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:10:40.961779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:40.962285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:40.962731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:41.128954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:41.170846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:41.172145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:41.174239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:41.176416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lazy-loading 'fault' on Instance uuid a192fb0b-72e9-4208-a1bd-2306f5cfc96b {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:41.967835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:41.977049 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b956d1ff-fe5c-4be1-b326-0dfb86ed9c34 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 200 len: 1308 microversion: 2.1 time: 1.083121 Oct 18 16:10:41.997579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1202/2393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:40 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 1308 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:42.003153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58480315-8ecb-418d-b6fd-3101dbeefbd7", "name": "network-vif-deleted", "tag": "1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:42.039233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.040381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.040967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.060908 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] Creating event network-vif-deleted:1a1f8b72-f04f-4ab7-ab8f-b8f1cffc3d9c for instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 on n-h1-858383-14 Oct 18 16:10:42.069056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ac210d59-769a-43e3-bb87-27b2fd0e1c84 req-3b803609-0feb-4c32-b857-d49c7ab9e8fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069623 Oct 18 16:10:42.069684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1203/2394] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:42.075180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:42.075898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:42.100469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.102480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.103257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.107110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.107772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.108565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.328566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:42.365435 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-beef998b-f290-403d-9595-9048adee3a77 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1276 microversion: 2.1 time: 0.294279 Oct 18 16:10:42.366105 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1204/2395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:42 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:42.391085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a192fb0b-72e9-4208-a1bd-2306f5cfc96b", "name": "network-vif-deleted", "tag": "52334bcf-eb3f-4076-9742-38fa03058235"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:42.419762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.422595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.423256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.446727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] Creating event network-vif-deleted:52334bcf-eb3f-4076-9742-38fa03058235 for instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b on n-h2-858383-14 Oct 18 16:10:42.481376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-80b5da22-7c11-4c1c-b7c8-15bfce890519 req-a29749c9-636e-4483-a32a-b79693df915a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113220 Oct 18 16:10:42.486353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1205/2396] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:42.512600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:42.513700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:42.545547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.549585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.550849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.552426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.553363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.554374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.677982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.681132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.684541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.685239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'fault' on Instance uuid 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:42.805240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:42.842943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:42.852774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:42.854679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5cd44ce7-7da8-4b4a-8461-e55077ab307d tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 200 len: 1352 microversion: 2.25 time: 0.363055 Oct 18 16:10:42.860505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1206/2397] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:42 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 1352 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:42.888404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:10:42.890317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:10:42.891682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:10:42.893975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:10:42.894445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:10:42.899428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:42.900054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:42.923728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.928108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.928620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.946961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.950904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.951447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.951885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.953437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.953961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:42.955611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:42.956162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:42.956606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:43.040443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Getting quotas for project 65ac19ca0ab84dc7b0bcfad3962a33b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:43.061955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Getting quotas for user d31742926f754ebfb4914ea5f7269e7e and project 65ac19ca0ab84dc7b0bcfad3962a33b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:43.108518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:10:43.121186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:10:43.302528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbc7e219-70a2-4891-953f-1001a32e0d06 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.570431 Oct 18 16:10:43.307052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1192/2398] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:10:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:10:43.330016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:43.331149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:43.359988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:43.367866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:43.367866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:43.373649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:43.374276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:43.374731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.499024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:44.514251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe4c49b8-3d8e-4507-a51c-29f2dc82d7f5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.634118 Oct 18 16:10:44.515536 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1207/2399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:42 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:44.552014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:44.553967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: a192fb0b-72e9-4208-a1bd-2306f5cfc96b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:44.575678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.576495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.577119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.580552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.581318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.581944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.615474 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b HTTP/1.1 Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:44.620844 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. Oct 18 16:10:44.622129 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a192fb0b-72e9-4208-a1bd-2306f5cfc96b'} Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:44.622776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. Oct 18 16:10:44.623810 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:44.625666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance a192fb0b-72e9-4208-a1bd-2306f5cfc96b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:44.629825 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa760149-4d7b-4dff-84b8-9e83fc01d4ec tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b" status: 404 len: 111 microversion: 2.1 time: 0.087050 Oct 18 16:10:44.631722 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1208/2400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:44 2022] GET /compute/v2.1/servers/a192fb0b-72e9-4208-a1bd-2306f5cfc96b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:44.641495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:44.644339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:44.658990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.665214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.666052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.666986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.667616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.668260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.742603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:44.805013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=14 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:44.832523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:44.844687 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-437e71ff-a123-46eb-87ec-e2e1fe07a297 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 1.535960 Oct 18 16:10:44.845921 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1193/2401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:43 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:44.865127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:44.865127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:44.897820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.899053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.902292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:44.903763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:44.904459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:44.905617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.121406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:45.137020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30969ead-2bdf-408d-a384-a43ccfcd598d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1218 microversion: 2.1 time: 0.503931 Oct 18 16:10:45.138108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1209/2402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:44 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1218 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:45.151840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:45.159898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: 9e048f30-18e3-4a26-b6b7-9cdc3bd62961] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:45.179131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.180600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.182014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.183661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.184696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.185943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.233646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] HTTP exception thrown: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Request method failure captured: Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 HTTP/1.1 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4HCO1ZoFIs9GxPJuFJlC6u-8daAnaX_wc1AhCXkLm8n0TdrdIRZDrbml0ck7M8bsoyVRAYgv0dfjGbkw77YPaqQr_KJuD1DkDmenWvjrLbzRMRTCzj0j1Qlx2LJBBEtTI8OcTEd61kltk4dnBjwde2d_7bdajUYssTlVykY50dwck Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:45.248499 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c91c440777a0421c961411bafbc058ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c91c440777a0421c961411bafbc058ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}] Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 19e2cb9474fb47a6b3f3793c7f162caf Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. Oct 18 16:10:45.251938 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9e048f30-18e3-4a26-b6b7-9cdc3bd62961'} Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:45.254254 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. Oct 18 16:10:45.256670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.261243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Returning 404 to user: Instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:45.267110 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f9667ce-6898-436f-80cb-9c27c534196f tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961" status: 404 len: 111 microversion: 2.25 time: 0.126928 Oct 18 16:10:45.269151 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1210/2403] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:45 2022] GET /compute/v2.1/servers/9e048f30-18e3-4a26-b6b7-9cdc3bd62961 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:45.287491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea765be0-6de8-49ee-9575-a167c38fcbca", "name": "network-vif-deleted", "tag": "57c5b00d-5992-4e55-9b6d-82d86bc3a75b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:45.326110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.346445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.349492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.417284 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] Creating event network-vif-deleted:57c5b00d-5992-4e55-9b6d-82d86bc3a75b for instance ea765be0-6de8-49ee-9575-a167c38fcbca on n-h2-858383-14 Oct 18 16:10:45.434524 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-21300fb6-c951-4eef-b076-4d8b998da3b2 req-024e3922-06cb-4de0-8e34-4c65c765d3db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161173 Oct 18 16:10:45.435756 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1211/2404] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:45.444667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e048f30-18e3-4a26-b6b7-9cdc3bd62961", "name": "network-vif-deleted", "tag": "d8680135-5476-443d-9367-6684d3edbaeb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:45.467207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.468312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.468918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.483817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] Creating event network-vif-deleted:d8680135-5476-443d-9367-6684d3edbaeb for instance 9e048f30-18e3-4a26-b6b7-9cdc3bd62961 on n-h2-858383-14 Oct 18 16:10:45.496285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8b4a2c74-f95f-441f-b203-c2b8a94bb9d4 req-a5d48e7c-d341-41f6-b99d-2a5f6afd5dd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056082 Oct 18 16:10:45.497675 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1212/2405] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:45.505304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:45.507188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: ea765be0-6de8-49ee-9575-a167c38fcbca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:45.515037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.515970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.516598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.518540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.519173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.519760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.555063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca HTTP/1.1 Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:45.568954 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. Oct 18 16:10:45.570899 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ea765be0-6de8-49ee-9575-a167c38fcbca'} Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:45.571655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. Oct 18 16:10:45.572982 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:45.574143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance ea765be0-6de8-49ee-9575-a167c38fcbca could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:45.582185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17cf942d-2316-495c-bc60-5543c66cbcb3 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca" status: 404 len: 111 microversion: 2.1 time: 0.072043 Oct 18 16:10:45.582871 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1213/2406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:45 2022] GET /compute/v2.1/servers/ea765be0-6de8-49ee-9575-a167c38fcbca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:45.602389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:45.605672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:45.626856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.627567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.632289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.633889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:45.636388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:45.640809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:45.726369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:45.856537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:45.982335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:46.023026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-affc1b35-8291-45ac-a60d-b5acc4583802 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 1.175440 Oct 18 16:10:46.031139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6725f26e-0de3-4cd2-9380-dfd5ce7c47d9 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 204 len: 0 microversion: 2.25 time: 0.443552 Oct 18 16:10:46.034489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1214/2407] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:10:45 2022] DELETE /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:10:46.047470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:46.051695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:46.057370 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1194/2408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:44 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:46.075105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a00b2a8-5091-41fa-9256-0c5966d63103 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:46.106400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:46.113505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:46.117078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:46.117916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:46.118392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:46.118837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:46.231665 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a00b2a8-5091-41fa-9256-0c5966d63103 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/78da005f-bbb3-449d-a36b-e739ec0e46f8" status: 204 len: 0 microversion: 2.1 time: 0.168397 Oct 18 16:10:46.238091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1195/2409] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:10:46 2022] DELETE /compute/v2.1/os-server-groups/78da005f-bbb3-449d-a36b-e739ec0e46f8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:46.257654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:46.258770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:46.277621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:46.292951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:46.293807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:46.294785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:46.295475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:46.296722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:46.415695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:47.145932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:47.158176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4dfda69e-a1e8-49a9-ba0d-681529b52369 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.120424 Oct 18 16:10:47.158926 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1215/2410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:46 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:47.199113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:47.200070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:47.215974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:47.216484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:47.216933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:47.217711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:47.218171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:47.221346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.078148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:48.100941 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa67cfa1-4e35-4cbd-a482-b00edc9f3638 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 1.855434 Oct 18 16:10:48.102076 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1196/2411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:46 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:48.119139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:48.119759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:48.148153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.149105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.150494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.154141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.154871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.157542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.550168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:48.566858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6f583d4-476b-488d-b70e-e5fe321e6935 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1272 microversion: 2.1 time: 0.463205 Oct 18 16:10:48.567489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1197/2412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:48 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1272 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:48.583265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:48.583842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:48.625457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.627880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.631518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.632490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.632983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.638249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.683418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:48.699869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:48.711718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:48.716271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2440a67c-c6ae-4369-8b80-e76ea23b6b65 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1565 microversion: 2.25 time: 1.553816 Oct 18 16:10:48.723817 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1216/2413] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:47 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1565 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:48.731090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:10:48.736611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:48.750067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:48.817034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.817545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.817981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:48.842768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:48.843514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:48.844171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.082363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-31b9faee-45db-49bb-b8af-92e32d3d3e2e tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 204 len: 0 microversion: 2.1 time: 0.504047 Oct 18 16:10:49.084374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1198/2414] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:10:48 2022] DELETE /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:10:49.098023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5", "tag": "29b0af49-1b8e-4ae5-afca-8206160fa7c4"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:49.138774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:49.140974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.142185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.142625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.209530 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] Creating event network-changed:29b0af49-1b8e-4ae5-afca-8206160fa7c4 for instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 on n-h2-858383-14 Oct 18 16:10:49.232003 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9b9b5772-cd95-4488-ada0-578319a613d6 req-ac970913-7a2b-4a04-8739-89c0da9e4708 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144698 Oct 18 16:10:49.232699 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1199/2415] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:49.249574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:49.250295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:49.324494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.325258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.325724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.326487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.326948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.327549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.671170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:49.684331 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d003481f-7111-4b95-9884-6ea2d2884a20 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.950160 Oct 18 16:10:49.686037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1217/2416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:48 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:49.721830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01b82ae-ae99-44b7-b198-2c5a8a8bf60d", "tag": "f05dd803-7698-4cad-9a31-be4970debf76"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:49.749642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.750136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.750574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.783823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:49.784840 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] Creating event network-changed:f05dd803-7698-4cad-9a31-be4970debf76 for instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d on n-h2-858383-14 Oct 18 16:10:49.800144 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e8a5e1e6-1b24-4058-8348-f2b1bce9a9d7 req-bfc7275b-644c-4825-ac22-b066647e203f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088708 Oct 18 16:10:49.801021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1218/2417] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:49.806512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0663baf-879f-4a8b-8fa8-428701a1fcd3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.561167 Oct 18 16:10:49.820156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:49.822166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1200/2418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:49 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:49.823783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:49.834611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:49.841952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:49.849368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.852427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.852941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.853470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.853920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.854150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.855364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.856574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:49.859660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.859932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:49.861649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:49.862222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.771662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:50.784000 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-145c17cc-4885-4882-b8ea-0eec9e30cb8c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.960349 Oct 18 16:10:50.795490 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1201/2419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:49 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:50.795490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:50.795490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:50.808475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:50.808983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:50.809570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.810295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:50.810753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:50.811183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.814300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:50.827758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e46f7888-3f11-4f14-9f3c-cceaa2494025 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1473 microversion: 2.1 time: 1.018435 Oct 18 16:10:50.831185 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1219/2420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:49 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1473 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:50.842458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:50.843351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:50.864227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:50.865145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:50.865818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.866807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:50.867497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:50.871985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.957604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:50.958257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:50.958825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:50.960955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'fault' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:51.108415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:51.121793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:51.123969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:51.125518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12c23edf-8b73-47f8-bd55-cb7550b92c76 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1352 microversion: 2.25 time: 0.292617 Oct 18 16:10:51.127596 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1220/2421] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:50 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1352 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:51.144252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:51.146393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:51.163056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.166533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.167409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:51.168459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.171481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.172511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:51.331426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:51.351978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbf31ca5-29c5-4d75-985b-273d066a6c6c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.558643 Oct 18 16:10:51.356485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1202/2422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:50 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:51.365012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:51.377392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:51.419206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.419741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.420188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:51.426982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.430868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.431844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:51.633186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:51.650398 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51f008c1-b63e-48d1-8ae3-35d919e89c25 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.520930 Oct 18 16:10:51.651615 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1221/2423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:51 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:51.662262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:51.663402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:51.681467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.681982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.682403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:51.689855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:51.690677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:51.691627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.247611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:52.267774 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2052a24f-2575-4ac5-bb59-c9da12dcee35 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.907639 Oct 18 16:10:52.269071 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1203/2424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:51 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:52.280316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c448ab30-eab1-44d6-b53f-3359ba5f9fb9", "name": "network-vif-deleted", "tag": "90e7134e-d481-4d33-9ff7-c7d7206b126b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:52.310642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.314957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.318109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.351037 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] Creating event network-vif-deleted:90e7134e-d481-4d33-9ff7-c7d7206b126b for instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 on n-h2-858383-14 Oct 18 16:10:52.366165 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c01fd580-2720-4f13-9801-010fcb03236c req-feba37ec-2880-4a73-a021-ba8c7cf75dd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094386 Oct 18 16:10:52.369736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1204/2425] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:52.413142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:52.413879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:52.431096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.431647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.432038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.437529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.438599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.439409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.568291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:52.585758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd6979db-5ac7-4614-8e7d-06d3dd16313e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.931471 Oct 18 16:10:52.586347 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1222/2426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:51 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:52.591010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:52.591802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:52.611102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.611878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.612687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.613382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.614302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.614899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.774734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:52.786473 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9ad0750-490d-4cca-b51c-e7b42c253fd5 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.412475 Oct 18 16:10:52.808676 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1205/2427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:52 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:52.815130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:52.816473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:52.826992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.828080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.829667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.830907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.831545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.832213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.893148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:52.894764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:52.895655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:52.897140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'fault' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:52.960075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a251b917b244a3b1f55bf9079ff5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:52.978747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae361726-ed0f-46a0-b2dd-884bb4c71f33 tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 200 len: 1473 microversion: 2.1 time: 0.391001 Oct 18 16:10:52.981939 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1223/2428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:52 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:52.998250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:53.001115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:53.005238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:53.027050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.028468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.030441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.033505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.035070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:53.035773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.037523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.055003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:53.058487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:53.060451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13928590-11a2-4893-b7b1-64221a030d15 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1352 microversion: 2.25 time: 0.250019 Oct 18 16:10:53.061514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1206/2429] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:52 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:53.090283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-871668134"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:53.093609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:53.103627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:53.107626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.108590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.109366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.110581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.111748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.112866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.421070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:53.451900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82e67bcf-a64a-473e-85ef-e11a2c08910a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.464406 Oct 18 16:10:53.453170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1224/2430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:52 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:53.462642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:53.466380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:53.482660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.483153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.487719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.490026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.503721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.505410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.782915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd5cb05a-db4b-4e72-a3dc-d8911f124f13 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.704163 Oct 18 16:10:53.789923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1207/2431] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:10:53 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 16:10:53.808225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a", "name": "network-vif-deleted", "tag": "50de8160-ec27-4fbf-9446-ab951137f8ca"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:53.820947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.822003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.822872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.842239 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] Creating event network-vif-deleted:50de8160-ec27-4fbf-9446-ab951137f8ca for instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a on n-h1-858383-14 Oct 18 16:10:53.848532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-45ac3e45-8caf-4be2-bf9e-cb3ab3ef8bae req-9eaef8f0-179a-4223-af8e-226d84c29797 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056895 Oct 18 16:10:53.849852 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1208/2432] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:53.856711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:53.857799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:53.867179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.868120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.868723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:53.869954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:53.870852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:53.871582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.060880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.070817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f8d0b65-f789-4759-a659-4777a5ab898d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.615666 Oct 18 16:10:54.085024 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1225/2433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:53 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:54.085024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:54.085024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:54.085921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.086717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.087232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.088002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.089643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.089643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.118132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.133334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8006281b-9650-4f32-8358-553561b0ec1f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.279748 Oct 18 16:10:54.133966 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1209/2434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:53 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:54.159797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:54.160412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:54.168137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.168625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.169110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.169969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.170380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.170809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.416922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.428758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ad29b43-842a-4921-abb0-27507cb59444 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.355835 Oct 18 16:10:54.430473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1226/2435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:54 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:54.438490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:54.443028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] [instance: f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:54.457949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.459793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.460502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.462114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.464089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.464774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.514896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] HTTP exception thrown: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Request method failure captured: Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a HTTP/1.1 Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8VhqNYfU0b6FcSOcUUqO2V32QD8MAqKHVTuSuLQgDfB6ObYvGCqNUDYBzxvCX7V2cgXM_FqTF0y7AogVFeAqWAcXNolW7ZVUN_uMTTyXhaV_Wg5WVlmhaXhUb3tpv5-EmeCZET41QXJnjwVySTkdzbTB07QzxPWQ_1ueZBUjanKmY Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:10:54.521043 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a0d47fbb4e9040039f2ae5153fe6bbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a0d47fbb4e9040039f2ae5153fe6bbbe"}]}] Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a0d47fbb4e9040039f2ae5153fe6bbbe Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2017488845 Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e5a251b917b244a3b1f55bf9079ff5ef Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersOnMultiNodesTest-2017488845-project Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. Oct 18 16:10:54.522429 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a'} Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:54.523199 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. Oct 18 16:10:54.524696 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:10:54.525870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] Returning 404 to user: Instance f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:54.529519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.535820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-74327432-278e-4773-a831-693e9f53144b tempest-ServersOnMultiNodesTest-2017488845 tempest-ServersOnMultiNodesTest-2017488845-project] 10.222.0.78 "GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a" status: 404 len: 111 microversion: 2.1 time: 0.089407 Oct 18 16:10:54.544140 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1227/2436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:54 2022] GET /compute/v2.1/servers/f39ebc5a-9baf-4a41-b0a6-0575c8e3fe9a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:54.561788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58aad6f0-9184-405f-962d-b5432077b02e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.406790 Oct 18 16:10:54.567107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:54.570464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:54.578241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.579301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.580048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.581071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.581913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.582666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.601745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1210/2437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:54 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:54.620036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:54.623169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:54.643279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.644769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.648289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.651093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.652235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.653511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.655761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.656492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.657550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.658421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'fault' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:54.738747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.750261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.753350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:54.755246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fea57697-ff13-4183-9966-94b8e34da8b7 tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1352 microversion: 2.25 time: 0.209613 Oct 18 16:10:54.758138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1228/2438] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:54 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:54.764083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0bf707-a16f-4450-ad9d-a3c9c701cde2", "tag": "65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:54.779068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:54.780029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:54.781473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:54.799937 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] Creating event network-changed:65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a for instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 on n-h2-858383-14 Oct 18 16:10:54.806903 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2e43f83d-d11c-4e67-92d3-92a0ff6d918a req-9e99b8b0-84d7-4c94-95a5-5c6a28ee9060 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046361 Oct 18 16:10:54.812713 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1229/2439] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:55.025581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:55.029725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:55.039741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d71919b-317a-4329-af40-ca9e5a17736d tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.435241 Oct 18 16:10:55.039741 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1211/2440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:54 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:55.104831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:55.107211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:55.150761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.151533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.155686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.159311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.161451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.164434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:55.164889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.165194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:55.186758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.188742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.189436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.191037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.192795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.195555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.449551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:55.459071 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9db6a169-006b-4e00-8c1e-cf92456976c2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.362830 Oct 18 16:10:55.460383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1230/2441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:55 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:55.465615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:55.465839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:55.473954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.473954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.474357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.474838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.475297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.475718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.692403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:55.706202 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51f403b3-f1d2-4a3d-a2ac-8e7f44a0b813 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.244880 Oct 18 16:10:55.707201 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1231/2442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:55 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:55.724908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:55.726441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:55.727266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:55.744065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.745653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.746259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.747088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.747640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.748123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.750373 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7499fc5c-e2c2-411e-9ef2-99d063a30143 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.594616 Oct 18 16:10:55.752866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1212/2443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:55 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:55.790778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:55.792284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:55.804987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.805903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:55.806175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.807195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:55.808524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:55.809217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:55.809834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.016745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.017634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.018418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.019233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lazy-loading 'fault' on Instance uuid c448ab30-eab1-44d6-b53f-3359ba5f9fb9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:10:56.065084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:56.079648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96e56f70-0821-403c-8913-ab94d99d2d9d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.357654 Oct 18 16:10:56.094093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1232/2444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:55 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:56.109138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-unplugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:56.134667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.136374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.137053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.163437 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] Creating event network-vif-unplugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:10:56.171300 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-856583b5-30fa-4b68-b617-1b4b23919cc3 req-4c7cfdf0-0457-4070-953d-8c442b318469 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074221 Oct 18 16:10:56.172985 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1233/2445] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:56.183845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:56.199816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:56.200580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:56.211775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.212976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.214149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.215086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.216414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.217266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.226682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:56.228140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19e2cb9474fb47a6b3f3793c7f162caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91c440777a0421c961411bafbc058ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:56.231998 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a3edafc-3709-4a02-8ba8-b0b71e5741da tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 200 len: 1352 microversion: 2.25 time: 0.449034 Oct 18 16:10:56.236707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1213/2446] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:55 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 1352 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:10:56.496696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:56.502906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:56.537458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.538801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.543360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.548504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:56.557286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:56.558791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:56.944723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:56.960455 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d35abfb9-f17f-4962-a3d0-b5eefcb42d43 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.784096 Oct 18 16:10:56.960934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1234/2447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:56 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:56.974529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:56.977748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:56.996429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.000408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.002173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.004692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.007092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.009393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.478320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:57.508933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76a979e2-346a-43b3-8782-6de0ff5e3102 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 1.024384 Oct 18 16:10:57.511927 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1214/2448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:56 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:10:57.536804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:57.538110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:57.564593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.569581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.570335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.573263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.573760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.574209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.800399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:57.826732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb46c624-f301-4b64-afad-c16c1d6ec015 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.859406 Oct 18 16:10:57.828414 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1235/2449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:57.845491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:57.847147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:57.886561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.887085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.887533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.888278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.888748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.894162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.611271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:58.613207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:58.664123 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8447eb9-9d5a-4411-91f9-67ae077f6bb4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.149514 Oct 18 16:10:58.691878 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1215/2450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:57 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:58.703597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c210a9d-441c-456a-ba23-6a2b54690e80 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.860527 Oct 18 16:10:58.724296 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1236/2451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:57 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:58.747236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:58.750211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] [instance: c448ab30-eab1-44d6-b53f-3359ba5f9fb9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:58.758552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:58.763285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:58.782931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.785940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.788027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.789884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.791050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.792346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.793400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.793739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.795233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.797706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.799283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.799971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.840583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] HTTP exception thrown: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Request method failure captured: Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 HTTP/1.1 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4HCO1ZoFIs9GxPJuFJlC6u-8daAnaX_wc1AhCXkLm8n0TdrdIRZDrbml0ck7M8bsoyVRAYgv0dfjGbkw77YPaqQr_KJuD1DkDmenWvjrLbzRMRTCzj0j1Qlx2LJBBEtTI8OcTEd61kltk4dnBjwde2d_7bdajUYssTlVykY50dwck Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:10:58.845486 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c91c440777a0421c961411bafbc058ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c91c440777a0421c961411bafbc058ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c91c440777a0421c961411bafbc058ad"}]}] Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c91c440777a0421c961411bafbc058ad Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-7749244 Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 19e2cb9474fb47a6b3f3793c7f162caf Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-7749244-project Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. Oct 18 16:10:58.847230 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c448ab30-eab1-44d6-b53f-3359ba5f9fb9'} Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:10:58.848217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. Oct 18 16:10:58.849770 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:10:58.855024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] Returning 404 to user: Instance c448ab30-eab1-44d6-b53f-3359ba5f9fb9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:10:58.856325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6465eb5f-8e13-4101-a67c-fc2ed886cc9b tempest-LiveAutoBlockMigrationV225Test-7749244 tempest-LiveAutoBlockMigrationV225Test-7749244-project] 10.222.0.78 "GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9" status: 404 len: 111 microversion: 2.25 time: 0.153264 Oct 18 16:10:58.865390 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1216/2452] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:10:58 2022] GET /compute/v2.1/servers/c448ab30-eab1-44d6-b53f-3359ba5f9fb9 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:10:58.881972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:58.884126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:58.905167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.907555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.908203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:58.909297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:58.914247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:58.915293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:59.244817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:59.260825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-952c3b84-9d45-44ff-9749-9c82c4323298 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.391767 Oct 18 16:10:59.263592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1217/2453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:58 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:59.272633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01b82ae-ae99-44b7-b198-2c5a8a8bf60d", "name": "network-vif-plugged", "status": "completed", "tag": "f05dd803-7698-4cad-9a31-be4970debf76"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:59.303072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:59.303672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:59.304250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:59.326803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] Creating event network-vif-plugged:f05dd803-7698-4cad-9a31-be4970debf76 for instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d on n-h2-858383-14 Oct 18 16:10:59.347149 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c20176d2-e75d-4ff2-8310-ddfae5f4065b req-24767fc0-86b6-4ece-81f6-ef394c207351 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076320 Oct 18 16:10:59.351708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1218/2454] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:59.366224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:59.366975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:59.375260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:59.377182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:59.377824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:59.378738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:59.379520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:59.380980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:59.933173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:59.947586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02e59df0-b138-4b1e-a466-14347378b6a7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 1.219378 Oct 18 16:10:59.948584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1237/2455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:58 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:59.965929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:59.968389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:59.982126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:59.982892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:59.989806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:59.990833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:59.991477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:59.992075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:00.079298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:00.113421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47e9b349-0297-4700-94d4-b1ee3c490e9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.756410 Oct 18 16:11:00.119988 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1219/2456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:59 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:00.136923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:00.145314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:00.164681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:00.165885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:00.166895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:00.168438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:00.169535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:00.170565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:00.515643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:00.540520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0b836d0-64bb-4770-b095-cdd1fcfe405e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.419002 Oct 18 16:11:00.541905 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1220/2457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:00 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:00.550129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:00.550846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:00.559754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:00.560660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:00.561442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:00.562473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:00.563812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:00.564463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:00.686580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:00.697812 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4249074a-3126-4c0e-a04b-cce48004afe9 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.747942 Oct 18 16:11:00.714171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1238/2458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:59 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:00.839499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:00.851591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5268711e-5c99-4859-b84c-2692a8af2d7f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.308195 Oct 18 16:11:00.852830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1221/2459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:00 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:00.930956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a4fe1ca-9971-4b29-92d6-afc9852af65c tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Calling method '.version_select at 0x7f5fd6355f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:00.958991 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5a4fe1ca-9971-4b29-92d6-afc9852af65c tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a4fe1ca-9971-4b29-92d6-afc9852af65c tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/7ba21202-b6d5-4061-90f8-ffeb58c66562/metadata/os_distro HTTP/1.1 Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:00.965151 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'image_id': '7ba21202-b6d5-4061-90f8-ffeb58c66562', 'id': 'os_distro'} Oct 18 16:11:00.966404 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:00.967514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7ba21202-b6d5-4061-90f8-ffeb58c66562 Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:00.973261 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ba21202-b6d5-4061-90f8-ffeb58c66562 could not be found. Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:00.977609 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:00.980627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a4fe1ca-9971-4b29-92d6-afc9852af65c tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:00.984666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a4fe1ca-9971-4b29-92d6-afc9852af65c tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "DELETE /compute/v2.1/images/7ba21202-b6d5-4061-90f8-ffeb58c66562/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.251189 Oct 18 16:11:00.984666 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1239/2460] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:11:00 2022] DELETE /compute/v2.1/images/7ba21202-b6d5-4061-90f8-ffeb58c66562/metadata/os_distro => generated 62 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:00.984915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b0b6356-c86b-4747-9fa3-9cf513f0fffb tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Calling method '.version_select at 0x7f5fd6490550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:00.985106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:00.985106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:01.008131 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4b0b6356-c86b-4747-9fa3-9cf513f0fffb tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b0b6356-c86b-4747-9fa3-9cf513f0fffb tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/images/43ca3f91-83b6-4f2e-bf99-2bad3552cb6e/metadata/os_version HTTP/1.1 Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:01.011616 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'image_id': '43ca3f91-83b6-4f2e-bf99-2bad3552cb6e', 'id': 'os_version'} Oct 18 16:11:01.013162 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.014175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 43ca3f91-83b6-4f2e-bf99-2bad3552cb6e Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.015543 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43ca3f91-83b6-4f2e-bf99-2bad3552cb6e could not be found. Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:01.017545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.018815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b0b6356-c86b-4747-9fa3-9cf513f0fffb tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:01.023004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b0b6356-c86b-4747-9fa3-9cf513f0fffb tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "GET /compute/v2.1/images/43ca3f91-83b6-4f2e-bf99-2bad3552cb6e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.038859 Oct 18 16:11:01.023004 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1222/2461] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:11:00 2022] GET /compute/v2.1/images/43ca3f91-83b6-4f2e-bf99-2bad3552cb6e/metadata/os_version => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:01.025306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.025705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.026170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.026930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.029536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.030014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.035524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b4ae412-ea8a-474d-ba0e-b5185b7c2acf tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Calling method '.version_select at 0x7f5fd2105040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:01.079206 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4b4ae412-ea8a-474d-ba0e-b5185b7c2acf tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b4ae412-ea8a-474d-ba0e-b5185b7c2acf tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/images/dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e/metadata HTTP/1.1 Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:01.081853 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'image_id': 'dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e'} Oct 18 16:11:01.083809 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.091571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.093247 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e could not be found. Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:01.096095 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.097580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b4ae412-ea8a-474d-ba0e-b5185b7c2acf tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:01.099125 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b4ae412-ea8a-474d-ba0e-b5185b7c2acf tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "GET /compute/v2.1/images/dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059787 Oct 18 16:11:01.099125 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1223/2462] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:11:01 2022] GET /compute/v2.1/images/dfe4b0f4-fe4b-48aa-b5b3-eec9867a766e/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:01.103421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef71542c-ed63-4362-b85f-ede0f22ad9a1 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Action: 'update_all', calling method: .version_select at 0x7f5fd24d18b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:01.142911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ef71542c-ed63-4362-b85f-ede0f22ad9a1 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef71542c-ed63-4362-b85f-ede0f22ad9a1 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/images/752007e2-651a-4c36-9edc-e4024558703c/metadata HTTP/1.1 Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 57 Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:01.147355 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:11:01.148812 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'image_id': '752007e2-651a-4c36-9edc-e4024558703c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.149731 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 752007e2-651a-4c36-9edc-e4024558703c Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.158059 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 752007e2-651a-4c36-9edc-e4024558703c could not be found. Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:01.159935 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:01.161174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.162490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef71542c-ed63-4362-b85f-ede0f22ad9a1 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:01.162490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef71542c-ed63-4362-b85f-ede0f22ad9a1 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "PUT /compute/v2.1/images/752007e2-651a-4c36-9edc-e4024558703c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057029 Oct 18 16:11:01.162490 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1224/2463] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:11:01 2022] PUT /compute/v2.1/images/752007e2-651a-4c36-9edc-e4024558703c/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 16:11:01.162490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:01.162490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:01.169450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.169552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.169927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.170645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.171113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.171657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.437842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:01.449440 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6168c4ad-04fc-49e8-b24b-6d9017c9c942 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1687 microversion: 2.1 time: 0.296753 Oct 18 16:11:01.450348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1225/2464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:01 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1687 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:01.455707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c69d77d-2e5a-489f-9989-736be8750a70 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Action: 'update', calling method: .version_select at 0x7f5fd18c3280>, body: {"meta": {"os_distro": "alt"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:01.491507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8c69d77d-2e5a-489f-9989-736be8750a70 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c69d77d-2e5a-489f-9989-736be8750a70 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/images/4241b1c8-6327-41d2-ba7f-c88d664212c9/metadata/os_distro HTTP/1.1 Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 30 Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:01.494256 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: {"meta": {"os_distro": "alt"}} Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:11:01.495461 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'image_id': '4241b1c8-6327-41d2-ba7f-c88d664212c9', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.496219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4241b1c8-6327-41d2-ba7f-c88d664212c9 Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.497191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4241b1c8-6327-41d2-ba7f-c88d664212c9 could not be found. Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:01.498297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:01.499269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.500358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c69d77d-2e5a-489f-9989-736be8750a70 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:01.500358 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c69d77d-2e5a-489f-9989-736be8750a70 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "PUT /compute/v2.1/images/4241b1c8-6327-41d2-ba7f-c88d664212c9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.044368 Oct 18 16:11:01.503899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1226/2465] 10.222.0.78 () {60 vars in 1310 bytes} [Tue Oct 18 16:11:01 2022] PUT /compute/v2.1/images/4241b1c8-6327-41d2-ba7f-c88d664212c9/metadata/os_distro => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:01.512776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5", "name": "network-vif-plugged", "status": "completed", "tag": "29b0af49-1b8e-4ae5-afca-8206160fa7c4"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:01.528361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.528899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.530093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.549438 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] Creating event network-vif-plugged:29b0af49-1b8e-4ae5-afca-8206160fa7c4 for instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 on n-h2-858383-14 Oct 18 16:11:01.555338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-39c343e8-7a6a-4704-81dc-4ca1cb5454db req-46ec709c-cdce-48aa-bf9b-b15459d402d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050018 Oct 18 16:11:01.556885 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1227/2466] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:01.565524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b29071a-876f-4800-9eeb-d3c6bc285b05 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Action: 'create', calling method: .version_select at 0x7f5fd6522f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:01.619478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-9b29071a-876f-4800-9eeb-d3c6bc285b05 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] HTTP exception thrown: Image not found. Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b29071a-876f-4800-9eeb-d3c6bc285b05 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Request method failure captured: Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/images/bfa84200-d4f9-49ba-a925-7dc32bb9bda0/metadata HTTP/1.1 Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 57 Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAU1POn5jJ8rL8KOKI83yHGqH3zH_VV0VFsOIpqac36LIqRqNa6mKWVeITl8QIx0vt9kLxTPbmyFOAEbYr8CCUgBgqZtHPGmqNozH5glrzXS7QG9uw8Go7yD32Vo9doBxHK8IXwljz-vUR5K2FJBAIg8uFgfs8jbeJZUiW3RNas7HY Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:01.626391 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79c6b0ef46b449888af03e4a3756d5ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79c6b0ef46b449888af03e4a3756d5ba"}]}] Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79c6b0ef46b449888af03e4a3756d5ba Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-46347337 Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f618899586f9415ebb18589fb9b25a3d Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-46347337-project Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:11:01.627830 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'image_id': 'bfa84200-d4f9-49ba-a925-7dc32bb9bda0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.629287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bfa84200-d4f9-49ba-a925-7dc32bb9bda0 Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:01.631075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfa84200-d4f9-49ba-a925-7dc32bb9bda0 could not be found. Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:01.634444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:01.639305 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:01.644775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b29071a-876f-4800-9eeb-d3c6bc285b05 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:01.645762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b29071a-876f-4800-9eeb-d3c6bc285b05 tempest-ImagesMetadataNegativeTestJSON-46347337 tempest-ImagesMetadataNegativeTestJSON-46347337-project] 10.222.0.78 "POST /compute/v2.1/images/bfa84200-d4f9-49ba-a925-7dc32bb9bda0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.085893 Oct 18 16:11:01.646683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:01.648335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1228/2467] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 18 16:11:01 2022] POST /compute/v2.1/images/bfa84200-d4f9-49ba-a925-7dc32bb9bda0/metadata => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:01.678494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b6deddf-b766-4626-9449-5d8f56c8ff40 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.695310 Oct 18 16:11:01.685643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:01.687148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:01.695191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.696094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.696802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.698120 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1240/2468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:00 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:01.706208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.707126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.707656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.754977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:01.756223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:01.802245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.802859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.803337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:01.804451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:01.806003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:01.806753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.121390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:02.130991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd4c54ea-d77c-4cd5-aa69-c8a9ed31f1bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1316 microversion: 2.1 time: 0.465437 Oct 18 16:11:02.131573 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1229/2469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:01 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:02.143513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:02.144152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:02.151307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.151852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.152612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.153873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.155041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.155664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.289989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:02.334290 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a830aa3a-cc77-4006-95e2-b4b8432e3b6f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.578678 Oct 18 16:11:02.335680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1241/2470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:01 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:02.458609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:02.475085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:02.475737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:02.476647 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e379317-447f-432e-ac45-a95e7d07e2aa tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.337485 Oct 18 16:11:02.478129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1230/2471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:02 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:02.492170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.492710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.496893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.500337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.501621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.504246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.723397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:02.724432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:02.733505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.734306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.735052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.736202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:02.738359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:02.739237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:02.951860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:02.989350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1078ee5-c07e-476a-8fb2-b22c22497729 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1687 microversion: 2.1 time: 0.518380 Oct 18 16:11:02.990288 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1242/2472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:02 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1687 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:03.094948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:03.105335 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1b08735-9e82-4ba2-b2eb-fd8fcdd36628 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.386639 Oct 18 16:11:03.123287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1231/2473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:02 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:03.156829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:03.158139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:03.179040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.179834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.180429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.181347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.181989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.182607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.360734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:03.361783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:03.387728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.388016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.390344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.391349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.393706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.394598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.601556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:03.627182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fb45de2-5075-4721-baeb-1796869ef553 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1504 microversion: 2.1 time: 0.475217 Oct 18 16:11:03.632184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1243/2474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:03 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:03.644327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:03.650344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:03.663197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.664276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.667710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.675703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:03.677550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:03.679059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:03.956666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:03.970543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2182863e-aa89-4644-84a3-304b56159707 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.615705 Oct 18 16:11:03.986854 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1232/2475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:03 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:03.997861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-443462901"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:04.002079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:04.019824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.020588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.021485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:04.022868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.023538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.024196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:04.283102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:04.300526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b9ee9206-a18d-4f5c-9610-b675bd9cebf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.663960 Oct 18 16:11:04.319291 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1244/2476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:03 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:04.338077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:04.341086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:04.359538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.364916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.365921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:04.367102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.368291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.374353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:04.428327 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.network.security_group_api [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Adding security group 1220132e-2b85-4735-a975-23ddecd635ef to port f05dd803-7698-4cad-9a31-be4970debf76 Oct 18 16:11:04.909400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:04.930638 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e442bab4-fb38-4c1d-bfb8-a87633d1e4f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1687 microversion: 2.1 time: 0.604091 Oct 18 16:11:04.956170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1245/2477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:04 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1687 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:04.960188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:04.960821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:04.990430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.990936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.991388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:04.992122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:04.992597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:04.993073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:05.572332 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8553966f-f53c-4c5a-bbfc-51974817df5a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/action" status: 202 len: 0 microversion: 2.1 time: 1.583920 Oct 18 16:11:05.573548 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1233/2478] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:03 2022] POST /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/action => generated 0 bytes in 1586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:05.579844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:05.580819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:05.593785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:05.599449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:05.601405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:05.603005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:05.607283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:05.608090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:05.882888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:05.897914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d3d1af5-9505-4f47-af9e-1bc3def2cef5 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.323059 Oct 18 16:11:05.901055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1234/2479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:05 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:05.910041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:05.910937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:05.942303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:05.945782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:05.948739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:05.979234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:05.987306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:05.990296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:05.990863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.005217 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-efd7a345-82ba-4a52-a10f-bac252e3117f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 1.043578 Oct 18 16:11:06.008239 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1246/2480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:04 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:06.084002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:06.325836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00d9a9f3-3e39-4292-a1ea-ad0b92bf8fe8 tempest-ListImageFiltersNegativeTestJSON-918263152 tempest-ListImageFiltersNegativeTestJSON-918263152-project] Calling method '.version_select at 0x7f5fd63d1160>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:06.330616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:06.346744 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1060c084-9d43-4789-9976-afa1c3a3ef10 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.441394 Oct 18 16:11:06.347700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1235/2481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:05 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:06.355009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-00d9a9f3-3e39-4292-a1ea-ad0b92bf8fe8 tempest-ListImageFiltersNegativeTestJSON-918263152 tempest-ListImageFiltersNegativeTestJSON-918263152-project] HTTP exception thrown: Image not found. Oct 18 16:11:06.355773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-plugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00d9a9f3-3e39-4292-a1ea-ad0b92bf8fe8 tempest-ListImageFiltersNegativeTestJSON-918263152 tempest-ListImageFiltersNegativeTestJSON-918263152-project] Request method failure captured: Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/images/d2f6786a-44c9-4fc4-8279-206c8a5480ef HTTP/1.1 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtAZIaF1_ASneLyX8-U_1kLsZjwS1WBI7HTt8BPZh5dzaOjcaL_OiF0N5CfG_S8PN8OQ2cjsDIb4r4yronNFDKvtRgkLtaDA5vFpvl9MjE2AirldyJVULCwJzIUb8rYrMiJmdW9LTplLaQSXiF-cPcalwvGpBfW-DBwChIBz8UKCIsY Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 5cd24deb7dd84cb3a71c02d7889b7441 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-918263152 Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:06.358501 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5cd24deb7dd84cb3a71c02d7889b7441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5cd24deb7dd84cb3a71c02d7889b7441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5cd24deb7dd84cb3a71c02d7889b7441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5cd24deb7dd84cb3a71c02d7889b7441"}]}] Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-918263152 Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 5cd24deb7dd84cb3a71c02d7889b7441 Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-918263152 Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ListImageFiltersNegativeTestJSON-918263152-project Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c48e6a4f0f804838bad44a786e2bcedf Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-918263152-project Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'd2f6786a-44c9-4fc4-8279-206c8a5480ef'} Oct 18 16:11:06.360373 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:06.361276 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d2f6786a-44c9-4fc4-8279-206c8a5480ef Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:11:06.362290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d2f6786a-44c9-4fc4-8279-206c8a5480ef could not be found. Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:06.363393 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:11:06.364512 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:06.374049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00d9a9f3-3e39-4292-a1ea-ad0b92bf8fe8 tempest-ListImageFiltersNegativeTestJSON-918263152 tempest-ListImageFiltersNegativeTestJSON-918263152-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:06.375205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00d9a9f3-3e39-4292-a1ea-ad0b92bf8fe8 tempest-ListImageFiltersNegativeTestJSON-918263152 tempest-ListImageFiltersNegativeTestJSON-918263152-project] 10.222.0.78 "GET /compute/v2.1/images/d2f6786a-44c9-4fc4-8279-206c8a5480ef" status: 404 len: 62 microversion: 2.1 time: 0.364308 Oct 18 16:11:06.376769 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1247/2482] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:06 2022] GET /compute/v2.1/images/d2f6786a-44c9-4fc4-8279-206c8a5480ef => generated 62 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:06.389318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1761471973"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:06.390323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:06.398040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:06.400133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.400923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.401622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.402574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.403414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.404239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.436687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.437563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.438442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.474925 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] Creating event network-vif-plugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:11:06.489538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3c2026c1-1aef-4b94-afb9-0bc30380a5bd req-75f4f6fe-d527-45cb-a8ef-4d7187b3c2ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140013 Oct 18 16:11:06.494402 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1236/2483] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:06.684532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01b82ae-ae99-44b7-b198-2c5a8a8bf60d", "tag": "f05dd803-7698-4cad-9a31-be4970debf76"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:06.702548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.705516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.706847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.742504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] Creating event network-changed:f05dd803-7698-4cad-9a31-be4970debf76 for instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d on n-h2-858383-14 Oct 18 16:11:06.757669 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fa8b3ea6-4380-42dc-88cd-a8eb3d409531 req-473e36f5-722e-4099-bf6a-2f317c767484 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256564 Oct 18 16:11:06.760950 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1237/2484] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:06.780830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:06.783963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:06.800927 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Adding security group 04f24a2b-eb1e-41f1-96b4-51e64ca101de to port f05dd803-7698-4cad-9a31-be4970debf76 Oct 18 16:11:06.831506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.832402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.833201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:06.837368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:06.838103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:06.839003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.149210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:07.163076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53a86336-23ad-466f-9b95-0bfc10fe3cb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.398861 Oct 18 16:11:07.184356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1238/2485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:06 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:07.190357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:07.196412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:07.225479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.226800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.227658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.230476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.231472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.232157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.517114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:07.527159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef1c010e-5da8-4a41-8c8f-655c0c8a1d32 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.341331 Oct 18 16:11:07.528016 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1239/2486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:07 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:07.538523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:07.539220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:07.546868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.548081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.548604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.549380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.549910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.550341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.849196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:07.863499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7ceb43a-3814-48c8-aeef-07c00188932a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.333980 Oct 18 16:11:07.878386 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1240/2487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:07 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:07.887517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:07.888498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:07.898475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.899453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.900501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:07.902132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:07.902874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:07.903673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.241903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:08.254089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77d95a72-8e17-489e-be83-269718a30c48 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1318 microversion: 2.1 time: 0.373780 Oct 18 16:11:08.254634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1241/2488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:07 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:08.264972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:08.265881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:08.281904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.282603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.283150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.283852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.301837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.303928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.637536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e5bf273-7c4a-478e-b4bd-3f7be1b6233e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/action" status: 202 len: 0 microversion: 2.1 time: 2.259177 Oct 18 16:11:08.639464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1248/2489] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:06 2022] POST /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/action => generated 0 bytes in 2262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:08.646293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:08.648493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:08.651790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:08.662341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.662760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3937728-58f2-4446-8c92-cd5aaba6646a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.407050 Oct 18 16:11:08.663541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1242/2490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:08 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:08.666278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.669516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.672870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.674259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.675109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.697302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:08.698398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:08.706913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.707813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.708575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.709977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.710774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.711594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.074264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-000b6bc9-4353-47d9-bcae-10de1a0477d2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.384104 Oct 18 16:11:09.075623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1243/2491] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:11:08 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d/os-security-groups => generated 1158 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:09.651034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01b82ae-ae99-44b7-b198-2c5a8a8bf60d", "tag": "f05dd803-7698-4cad-9a31-be4970debf76"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:09.688963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.700090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.701900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.744284 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] Creating event network-changed:f05dd803-7698-4cad-9a31-be4970debf76 for instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d on n-h2-858383-14 Oct 18 16:11:09.760104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-93afc81a-5d62-4082-bf03-d1768fe01ed4 req-4cd96130-5f26-46b8-856d-f47ead088626 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683095 Oct 18 16:11:09.776804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1244/2492] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:09.790620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:09.794009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:09.822371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.824104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.827777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.831253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.839664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.841988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.873435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:09.904896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe397f49-09a2-498e-9b83-23dfe0c59aca tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.262497 Oct 18 16:11:09.908625 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1249/2493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:08 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:09.921462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc01e9be-a155-48f4-a9e7-8187d964d851 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd63d10d0>, body: {"security_group": {"name": " tempest-securitygroup -1362070606 ", "description": "tempest-description-1927485111"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:10.471770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:10.490666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-966b5236-303f-4fce-8edd-2fe806b4f75f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.711073 Oct 18 16:11:10.497466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1245/2494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:09 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:10.514271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:10.515118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:10.529322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:10.531037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:10.531602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:10.534239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:10.534732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:10.538870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:10.930498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc01e9be-a155-48f4-a9e7-8187d964d851 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.018458 Oct 18 16:11:10.931922 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1250/2495] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:09 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:10.945142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:10.946015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:10.973550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:10.979026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:10.979544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:10.980574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:10.982809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:10.984119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:11.313781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:11.355772 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c857d231-40e9-4676-8300-91c8247a7ece tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1508 microversion: 2.1 time: 0.856980 Oct 18 16:11:11.363184 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1246/2496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:10 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1508 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:11.846888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a35b4f8d-e3aa-49f2-ad12-3087b0f0f6bc tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd21050d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCX2a2L8j1cfboDD2n0JlVAfKlIf952pjCBRjFxKdKONBw/0FP4nw+fF5a8lwvmNewdnrQ2prH4pISvE9MXobgG89qPpJWTnsTFJuUyqAsuVRfHF+nZTgY4F3Kbc5u/Lg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a35b4f8d-e3aa-49f2-ad12-3087b0f0f6bc tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 257 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:11.856955 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:11.858537 n-d-858383-14 devstack@n-api.service[120571]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCX2a2L8j1cfboDD2n0JlVAfKlIf952pjCBRjFxKdKONBw/0FP4nw+fF5a8lwvmNewdnrQ2prH4pISvE9MXobgG89qPpJWTnsTFJuUyqAsuVRfHF+nZTgY4F3Kbc5u/Lg=="}} Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCX2a2L8j1cfboDD2n0JlVAfKlIf952pjCBRjFxKdKONBw/0FP4nw+fF5a8lwvmNewdnrQ2prH4pISvE9MXobgG89qPpJWTnsTFJuUyqAsuVRfHF+nZTgY4F3Kbc5u/Lg=='}}} Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:11.859458 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:11.861473 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:11:11.862817 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:11:11.863963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 16:11:11.863963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:11.864138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:11.868013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a35b4f8d-e3aa-49f2-ad12-3087b0f0f6bc tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:11.868975 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a51392c-b322-45ab-8e45-a3be9568a2ef tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.935725 Oct 18 16:11:11.869806 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1251/2497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:10 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:11.882156 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a35b4f8d-e3aa-49f2-ad12-3087b0f0f6bc tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.504561 Oct 18 16:11:11.883365 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1247/2498] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:11 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 519 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:11:11.900744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:11.901305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1444468-2b15-4c15-96c7-c98f75dfc27a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd20a1c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:11.901882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:11.917455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:11.928315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:11.928876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:11.929908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:11.932020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:11.932598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.260114 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1444468-2b15-4c15-96c7-c98f75dfc27a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa" status: 200 len: 224 microversion: 2.1 time: 0.375622 Oct 18 16:11:12.270809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1248/2499] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:11 2022] GET /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa => generated 224 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:12.275902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:12.277847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:12.305974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.306719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.307427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.308716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.309452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.312560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.470801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:12.474583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:12.482152 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87aeb285-fbeb-4f3b-a6cc-a364037fc6aa tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.601245 Oct 18 16:11:12.492638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1252/2500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:11 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:12.511297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:12.512340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:12.526458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.526961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.532689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.538197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.538983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.539597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.994555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:13.003633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db53efd8-97aa-419f-9957-a87b54c20c4b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.508544 Oct 18 16:11:13.006821 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1253/2501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:12 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:13.012798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55048fe8-cfbd-434e-b92f-c13cf9c0415a", "name": "network-vif-unplugged", "status": "completed", "tag": "9e6ae16a-c285-47dc-a6b9-7a6e12438633"}, {"name": "network-changed", "server_uuid": "55048fe8-cfbd-434e-b92f-c13cf9c0415a", "tag": "9e6ae16a-c285-47dc-a6b9-7a6e12438633"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:13.034492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.035219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.035818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.055676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Creating event network-vif-unplugged:9e6ae16a-c285-47dc-a6b9-7a6e12438633 for instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a on n-h1-858383-14 Oct 18 16:11:13.056426 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] Creating event network-changed:9e6ae16a-c285-47dc-a6b9-7a6e12438633 for instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a on n-h1-858383-14 Oct 18 16:11:13.062555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4c50e394-b3f3-4823-9ba7-7ca2e2050ec7 req-cf59945a-ae1f-4b2a-83e5-cf915f0c1aca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.054156 Oct 18 16:11:13.064118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1254/2502] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:13.072148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd649e280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1166954167", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:13.097257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:13.105477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for user 4e0d3d0016d14a518f95f394245db6bc and project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:13.129135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 2167 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1166954167", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:11:13.146899 n-d-858383-14 devstack@n-api.service[120570]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1166954167', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:13.149286 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:13.152074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:13.156197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:13.158232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4c71943-88ff-4168-9460-1b0855b22884 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.092552 Oct 18 16:11:13.160218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1255/2503] 10.222.0.78 () {60 vars in 1160 bytes} [Tue Oct 18 16:11:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:13.168783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70de1090-c36c-4309-a9e6-fe3051379a0c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd633eb80>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:13.412314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:13.462531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a1fe0fc-cb76-4e91-b279-b0df903e3425 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1508 microversion: 2.1 time: 1.190351 Oct 18 16:11:13.476740 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1249/2504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:12 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1508 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:13.493325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0bf707-a16f-4450-ad9d-a3c9c701cde2", "name": "network-vif-plugged", "status": "completed", "tag": "65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:13.520720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.521504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.522124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.602258 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] Creating event network-vif-plugged:65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a for instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 on n-h2-858383-14 Oct 18 16:11:13.610260 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a5c6e50c-cbdf-41da-b44c-0ac86812d41d req-75a03c54-1a54-4b81-ac38-d9ec735dfe05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131704 Oct 18 16:11:13.611567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1250/2505] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:13.624860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:13.626443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:13.635197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.638963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.642763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.643728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.644436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.645085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.732160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70de1090-c36c-4309-a9e6-fe3051379a0c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa" status: 202 len: 0 microversion: 2.1 time: 0.569324 Oct 18 16:11:13.732767 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1256/2506] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:13 2022] DELETE /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:13.738038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28398b18-57dd-4604-a79c-668467c87b61 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd6457f70>, body: {"keypair": {"name": "tempest-keypair-1280834333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeJ/cKuWZcebq5FR2W+n6db5NxcwTPvnd+hzA8FqA3s8PqmvpQDXwVbaTxoLz8pKiJr8z+IuHxWcSDl2eCT2H0i5AaykFVoNLtypKcuiw2PwCtL+kwN2MwjlLKRTC6z/A=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:13.775973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-28398b18-57dd-4604-a79c-668467c87b61 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:13.783080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-28398b18-57dd-4604-a79c-668467c87b61 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for user 4e0d3d0016d14a518f95f394245db6bc and project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:13.817298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28398b18-57dd-4604-a79c-668467c87b61 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083174 Oct 18 16:11:13.821286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1257/2507] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:13.831418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:13.841848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:13.861179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.862549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.862998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.863715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.864179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.864607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.027057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6a53944-1ce9-4fed-ac67-585cd3a6d58f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "PUT /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1080 microversion: 2.1 time: 0.204174 Oct 18 16:11:14.028333 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1258/2508] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:11:13 2022] PUT /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1080 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.033753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.034292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:14.040433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.041174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.041970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.042908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.043572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.044443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.215200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:14.223754 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d4d259b-b065-4f62-ab29-0c67cd16fa3a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.194234 Oct 18 16:11:14.224343 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1259/2509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.229353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:14.230203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd63c19d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.258501 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04330cf0-22c8-4d40-b05b-ecdab6cc620a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.642274 Oct 18 16:11:14.259123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1251/2510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:13 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.273941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd19aa1f0>, body: {"keypair": {"name": "tempest-keypair-1280834333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR4LVukImF2t1Bof6wG/fkm1litqHgUfPeX8awWOEwwS7hvWrDDiw5pLsipHnpOfS33QOUTfZJnysvZXRQmV8uCMEovRDdDh2x1RPEPjih1tA0swYquuaaf/LWr75STIA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:14.277871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:11:14.278730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:11:14.279509 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.279509 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa HTTP/1.1 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ae23b8b3-2608-473d-bb01-002fb6ebc3aa'} Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:11:14.281971 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] Oct 18 16:11:14.286321 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.289606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:11:14.289606 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-1542d2df-9965-4f7b-8eb7-1473261fd038'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:14.291014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e76d063d-5770-45bd-a3f3-155fe205fad1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa" status: 404 len: 194 microversion: 2.1 time: 0.065763 Oct 18 16:11:14.292041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1260/2511] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:14.296123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:14.301013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.302511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:14.302660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:14.304147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for user 4e0d3d0016d14a518f95f394245db6bc and project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:14.318380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.319902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.322357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.324818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.326107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.329414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.339502 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] HTTP exception thrown: Key pair 'tempest-keypair-1280834333' already exists. Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 273 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: {"keypair": {"name": "tempest-keypair-1280834333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR4LVukImF2t1Bof6wG/fkm1litqHgUfPeX8awWOEwwS7hvWrDDiw5pLsipHnpOfS33QOUTfZJnysvZXRQmV8uCMEovRDdDh2x1RPEPjih1tA0swYquuaaf/LWr75STIA=="}} Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: exception: Key pair 'tempest-keypair-1280834333' already exists. Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1280834333', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR4LVukImF2t1Bof6wG/fkm1litqHgUfPeX8awWOEwwS7hvWrDDiw5pLsipHnpOfS33QOUTfZJnysvZXRQmV8uCMEovRDdDh2x1RPEPjih1tA0swYquuaaf/LWr75STIA=='}}} Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4e0d3d0016d14a518f95f394245db6bc-tempest-keypair-1280834333' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 16:11:14.351963 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result.read() Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 16:11:14.356338 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4e0d3d0016d14a518f95f394245db6bc-tempest-keypair-1280834333' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 16, 11, 14, 324885), 'updated_at': None, 'name': 'tempest-keypair-1280834333', 'user_id': '4e0d3d0016d14a518f95f394245db6bc', 'fingerprint': '4b:66:19:91:86:99:fb:bd:ef:7f:20:f4:b9:c4:4f:94', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR4LVukImF2t1Bof6wG/fkm1litqHgUfPeX8awWOEwwS7hvWrDDiw5pLsipHnpOfS33QOUTfZJnysvZXRQmV8uCMEovRDdDh2x1RPEPjih1tA0swYquuaaf/LWr75STIA==', 'type': 'ssh'}] Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi keypair.create() Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._create() Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1280834333' already exists. Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 18 16:11:14.360569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1280834333' already exists. Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1280834333' already exists. Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 409 to user: Key pair 'tempest-keypair-1280834333' already exists. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-14dfdc49-2445-49dc-8fe9-886e5e1f29a2 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.092023 Oct 18 16:11:14.367443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1252/2512] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:14 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:11:14.373139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.374179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:14.402523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.402960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.403417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.406334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.406334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.406334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.539144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:14.548576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f027ab34-1275-42b1-ac98-ee579e7e3ce4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1314 microversion: 2.1 time: 0.255236 Oct 18 16:11:14.555044 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1261/2513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.565860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df4d7a44-86c1-4860-aaa3-fc6f5dd2c968 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd6355940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-82328005", "description": "tempest-description-1288516130"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:14.778503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:14.791797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-209e1114-d7c0-42cb-b787-e8cbf55d406c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1506 microversion: 2.1 time: 0.428997 Oct 18 16:11:14.809052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1253/2514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.814588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e430230-2751-4bb5-a0f6-06c40c822c2e tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Calling method '.version_select at 0x7f5fd6490e50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.847828 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df4d7a44-86c1-4860-aaa3-fc6f5dd2c968 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.292037 Oct 18 16:11:14.849015 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1262/2515] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:14 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:14.857574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.859019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:14.860212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e430230-2751-4bb5-a0f6-06c40c822c2e tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280834333" status: 202 len: 0 microversion: 2.1 time: 0.065697 Oct 18 16:11:14.860856 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1254/2516] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280834333 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:14.866413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d61b0298-bdb5-4b5c-916e-762e32d69430 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd19aac10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1607235407", "description": "tempest-description-2146935087"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:14.888178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.889125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.889736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.891655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.892541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.893411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.131985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:15.142318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d57b9d27-a614-49af-87a2-89cc21ddf3b2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1506 microversion: 2.1 time: 0.291520 Oct 18 16:11:15.143559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1263/2517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:15.149594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c055c5b1-a523-49c7-a36a-1ec2422e868a tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd6380b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdpxFt6VGUYZhIm0U3KEAIrub47id0BHKlEwcgorYTzLoJVbQ/d/msdG+0fVnbabvUKKB28RfkTIYSO5/7UFiefSf8OmQ+nrIjlfxFtNiGcfMAErATFJQFMRCUpaHGV8w=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c055c5b1-a523-49c7-a36a-1ec2422e868a tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 247 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdpxFt6VGUYZhIm0U3KEAIrub47id0BHKlEwcgorYTzLoJVbQ/d/msdG+0fVnbabvUKKB28RfkTIYSO5/7UFiefSf8OmQ+nrIjlfxFtNiGcfMAErATFJQFMRCUpaHGV8w=="}} Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdpxFt6VGUYZhIm0U3KEAIrub47id0BHKlEwcgorYTzLoJVbQ/d/msdG+0fVnbabvUKKB28RfkTIYSO5/7UFiefSf8OmQ+nrIjlfxFtNiGcfMAErATFJQFMRCUpaHGV8w=='}}} Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '' Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:11:15.153970 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c055c5b1-a523-49c7-a36a-1ec2422e868a tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c055c5b1-a523-49c7-a36a-1ec2422e868a tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012007 Oct 18 16:11:15.157988 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1264/2518] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:11:15.174553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:15.180682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:15.192189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.192674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.193144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.193841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.194293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.194717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.395820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d61b0298-bdb5-4b5c-916e-762e32d69430 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.533684 Oct 18 16:11:15.396378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1255/2519] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:15.401682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd1865550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1109856360", "public_key": " "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:15.430884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:15.440714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for user 4e0d3d0016d14a518f95f394245db6bc and project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:15.467081 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 95 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1109856360", "public_key": " "}} Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1109856360', 'public_key': ' '}}} Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:15.470469 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:15.474825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4580ae6-93cf-4fdc-8dba-fd43621f7b00 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.074282 Oct 18 16:11:15.481092 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1256/2520] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Oct 18 16:11:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:15.488751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:15.489439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:15.497057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.497576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.498067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.498756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.499451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.501413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.785965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:15.805851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-109e293f-76df-4c2f-87fd-c4afbefe6bc7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.323067 Oct 18 16:11:15.818092 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1257/2521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:15 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:15.832641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:15.842343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:15.864368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.865559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.867814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.870234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.878398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.879725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:16.582074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:16.592912 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2742dfd6-5cc7-4184-bc39-813a3ccb7f38 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.773324 Oct 18 16:11:16.612036 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1258/2522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:15 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:16.620678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14035f7e-5243-42cd-8954-39e44beda712 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd6532f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1357390560", "description": "tempest-description-2128559641"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:17.015125 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-14035f7e-5243-42cd-8954-39e44beda712 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.401871 Oct 18 16:11:17.018978 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1259/2523] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:17.025027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8eaf0369-c634-4c3b-9b6e-60a67937fe16 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd27470d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0I9O5xvI4oDZVIQUKVFt+AEfofWVwsgcTF7l2+4sU9gsqRbNsFetTmlj2Rym6WRyAHp7a5rI4+hl2DlRWOI6GtOqI6jIiX6HU3LRqZ1Ifo0bx7IgSMTuuldbuPSM0Jcw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8eaf0369-c634-4c3b-9b6e-60a67937fe16 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 507 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0I9O5xvI4oDZVIQUKVFt+AEfofWVwsgcTF7l2+4sU9gsqRbNsFetTmlj2Rym6WRyAHp7a5rI4+hl2DlRWOI6GtOqI6jIiX6HU3LRqZ1Ifo0bx7IgSMTuuldbuPSM0Jcw=="}} Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0I9O5xvI4oDZVIQUKVFt+AEfofWVwsgcTF7l2+4sU9gsqRbNsFetTmlj2Rym6WRyAHp7a5rI4+hl2DlRWOI6GtOqI6jIiX6HU3LRqZ1Ifo0bx7IgSMTuuldbuPSM0Jcw=='}}} Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 16:11:17.035895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 16:11:17.038815 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:17.050047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8eaf0369-c634-4c3b-9b6e-60a67937fe16 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:17.063437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8eaf0369-c634-4c3b-9b6e-60a67937fe16 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.035342 Oct 18 16:11:17.064096 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1260/2524] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:17 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:11:17.084697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:17.085469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:17.105499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.110884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.112187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.122254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.124020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.124469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.563672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:17.579867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-095b9c98-7396-4ed2-95c1-9d217dfa7040 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1500 microversion: 2.1 time: 0.513676 Oct 18 16:11:17.582333 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1261/2525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:17 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1500 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:17.592647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:17.597509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:17.622968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.623384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.623824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.631685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.632197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.632646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.954234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:17.973244 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7287a7a6-5f48-4332-9c54-b9e67ce4b3d7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.389761 Oct 18 16:11:17.975310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1262/2526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:17 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:17.987938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a519f2a3-818d-43aa-b538-83ecb7cdbfb2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd223adc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:18.474684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a519f2a3-818d-43aa-b538-83ecb7cdbfb2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.495463 Oct 18 16:11:18.486149 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1263/2527] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:11:17 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:18.493675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Action: 'create', calling method: .version_select at 0x7f5fd215dc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1824385379", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:18.530632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:18.537721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Getting quotas for user 4e0d3d0016d14a518f95f394245db6bc and project 81df979b1a734a979497e69752fd0513. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:18.557938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 118 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1824385379", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1824385379', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 16:11:18.559914 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:18.564347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea32f986-6084-42f4-a481-6dde6c8d35e3 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075224 Oct 18 16:11:18.566719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1264/2528] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:18.573307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:18.576534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:18.585129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.589129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.589687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:18.595007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.595867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.596384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:18.602663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:18.664068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lazy-loading 'flavor' on Instance uuid 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:11:18.808168 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fd4f408-f78b-42e7-9f7e-dbea2fb952fe tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "POST /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2/action" status: 200 len: 32 microversion: 2.1 time: 0.237376 Oct 18 16:11:18.810932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1265/2529] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:18 2022] POST /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:11:18.825053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:18.825981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:18.837330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.838978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.839430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:18.841706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.843928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.847746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:19.128570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:19.142637 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b0ab98e-46bf-4c0f-b5b9-46984070557a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.324951 Oct 18 16:11:19.142637 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1266/2530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:18 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:19.153159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33101212-247b-4397-8c0f-2c14e05b543a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd20e53a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:19.789108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33101212-247b-4397-8c0f-2c14e05b543a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f" status: 202 len: 0 microversion: 2.1 time: 0.646221 Oct 18 16:11:19.790041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1267/2531] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:19 2022] DELETE /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:19.794536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcc09db8-fdce-427e-b882-36ac41d95a76 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Calling method '.version_select at 0x7f5fd2020ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:19.834151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-dcc09db8-fdce-427e-b882-36ac41d95a76 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcc09db8-fdce-427e-b882-36ac41d95a76 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Request method failure captured: Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1808872240 HTTP/1.1 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtAdU4CmcvKFmf0h8Frbooz8qTCyy6Qrn5FOtBhjmHPrOoqHS_mSQrb88qFntNcKt3_F6e60iBtDVMQOFVTT45y7NYCS3fRTObZtrW_assb2ly0aPckDYERCsoC_rqbWLxaCCCNBG5GHJGiZJGidCCQIAGwPO_X5BGQutEniiE8Ipck Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81df979b1a734a979497e69752fd0513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81df979b1a734a979497e69752fd0513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81df979b1a734a979497e69752fd0513"}]}] Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81df979b1a734a979497e69752fd0513 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1345189446 Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1345189446-project Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: exception: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'tempest-keypair-non-existent-1808872240'} Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:19.836101 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcc09db8-fdce-427e-b882-36ac41d95a76 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1808872240 not found for user 4e0d3d0016d14a518f95f394245db6bc {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcc09db8-fdce-427e-b882-36ac41d95a76 tempest-KeyPairsNegativeTestJSON-1345189446 tempest-KeyPairsNegativeTestJSON-1345189446-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1808872240" status: 404 len: 145 microversion: 2.1 time: 0.046602 Oct 18 16:11:19.839818 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1268/2532] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1808872240 => generated 145 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:19.857025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:19.857664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:19.888737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:19.889273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:19.889713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:19.890428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:19.891549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:19.892111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:20.288259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:20.305474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af8b0f6b-48e3-47d7-8691-bcfee4a71dfd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.457105 Oct 18 16:11:20.306138 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1269/2533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:19 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:20.333914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:20.334551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:20.356488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:20.356979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:20.358011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:20.363417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:20.369536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:20.370018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.479082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:21.493945 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40e69be6-7fe9-4b5a-9066-98fe88094ad0 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 1.167128 Oct 18 16:11:21.496799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1270/2534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:20 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:21.504194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd272bf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:21.545916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:11:21.546514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group 507b9e25-7f7e-4690-ad37-9195cb1df48f not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:11:21.547430 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.547430 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f HTTP/1.1 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '507b9e25-7f7e-4690-ad37-9195cb1df48f'} Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:11:21.549588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-b35ba426-98a5-411a-8ba2-d81df3c6f45e'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c484f75a-f0b9-4047-9674-2fbef38d032a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f" status: 404 len: 194 microversion: 2.1 time: 0.053073 Oct 18 16:11:21.553523 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1271/2535] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:21 2022] GET /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:21.557351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:21.557351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:21.574843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.577855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.578874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.581177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.581670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.584751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.943734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:21.955857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-da2d5d9b-65e4-4a5d-8e2e-73b18b8c5405 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.403240 Oct 18 16:11:21.971574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1272/2536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:21 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:21.980925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:21.981823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:21.991410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.992076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.992673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.993619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.994228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.994807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:22.274353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:22.287788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b52bef2a-752c-41c2-ab91-abaf5474520e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.310947 Oct 18 16:11:22.291897 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1273/2537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:21 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:22.301206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f481df56-ebe9-49dd-951c-25728f7a79aa tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd6593af0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:22.771673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f481df56-ebe9-49dd-951c-25728f7a79aa tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7" status: 202 len: 0 microversion: 2.1 time: 0.478532 Oct 18 16:11:22.772832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1274/2538] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:22 2022] DELETE /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:22.780080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:22.780706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:22.800666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:22.806455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:22.806999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:22.807934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:22.808461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:22.808905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.086811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:11:23.087837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:11:23.088477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:11:23.089857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:11:23.090446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:11:23.143498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:23.152739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f927e5a-c551-4971-bfc4-0cfcee0c781a tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1393 microversion: 2.1 time: 0.378738 Oct 18 16:11:23.153358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1275/2539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:22 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1393 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:23.168115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd223b1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:23.219478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:11:23.220553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group 5296190c-1522-45c7-ba85-564e9b4747d7 not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:11:23.221545 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.221545 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7 HTTP/1.1 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5296190c-1522-45c7-ba85-564e9b4747d7'} Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:11:23.224174 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] Oct 18 16:11:23.229259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:23.232834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:11:23.232834 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-f66010a7-f885-4e19-b779-18aaa3266bf8'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:23.234183 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cfc9bd6-e83a-4d03-8050-17b41b298bb3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7" status: 404 len: 194 microversion: 2.1 time: 0.073498 Oct 18 16:11:23.235531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1276/2540] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:23 2022] GET /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:23.247298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:23.248155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:23.272416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.281240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.282392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.286231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:23.294522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.295149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.295610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.301513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.302068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.302451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.304300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.304771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.307725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.374732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d16bcee-e24d-4946-b75f-6b650c2858ba tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "POST /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5/action" status: 202 len: 1112 microversion: 2.1 time: 8.208552 Oct 18 16:11:23.387231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1265/2541] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:15 2022] POST /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5/action => generated 1112 bytes in 8223 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:11:23.393286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-48cfbabe-d2a3-427a-97e8-dd4580f49a4f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd63844c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:23.655507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:23.678721 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c68f4664-3813-4f92-8d95-a9ca4907db4c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.441905 Oct 18 16:11:23.724322 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1277/2542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:23 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:23.738965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:23.739591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:23.754117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.754722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.755333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.755875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.756383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.756930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.793512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:23.915639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-48cfbabe-d2a3-427a-97e8-dd4580f49a4f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d" status: 202 len: 0 microversion: 2.1 time: 0.526560 Oct 18 16:11:23.917606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1266/2543] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:23 2022] DELETE /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:23.930041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:23.931341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:23.950203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.950974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.952000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.955012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:23.955718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:23.958251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.102768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:24.122389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df2fe70e-561f-4d60-b921-d71fbe43e76f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.394550 Oct 18 16:11:24.126220 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1278/2544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:23 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.147241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd2020550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.224726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:11:24.225645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:11:24.226212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.226212 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d HTTP/1.1 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b27fa12d-801e-40d3-aec1-bfe2963c4d2d'} Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:11:24.228694 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-d38bb515-5bd3-4658-8ae4-9d4b025ce1eb'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06e15216-726f-4cc5-9640-59f45b522a2b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d" status: 404 len: 194 microversion: 2.1 time: 0.103551 Oct 18 16:11:24.232965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1279/2545] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:24.241161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.243760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:24.258515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.259086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.259535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.260375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.260735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.265163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.568448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:24.577582 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bcb5d16-13df-4503-9e58-716e56048c80 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1383 microversion: 2.1 time: 0.345042 Oct 18 16:11:24.579454 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1280/2546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1383 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.600271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bfd7764e-b18f-4d24-80da-18f4218d4886 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd20cd280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.791496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:24.806330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3fe74388-8294-4204-913e-48a768cef771 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.886882 Oct 18 16:11:24.809327 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1267/2547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:23 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.827004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d678a466-16de-42a2-89b2-75dd56b5b5cd tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '.version_select at 0x7f5fd64b1040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.831519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d678a466-16de-42a2-89b2-75dd56b5b5cd tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.832011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d678a466-16de-42a2-89b2-75dd56b5b5cd tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.832449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d678a466-16de-42a2-89b2-75dd56b5b5cd tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.852740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d678a466-16de-42a2-89b2-75dd56b5b5cd tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.042117 Oct 18 16:11:24.867658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1268/2548] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.869167 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bfd7764e-b18f-4d24-80da-18f4218d4886 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.287472 Oct 18 16:11:24.870186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.871211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:24.871722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1281/2549] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.876697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.877374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:24.885582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.885778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.888612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.889494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.889980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.890418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.904474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.905906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.907019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.907920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.908394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.908834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.233551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cf95d2d7-e893-4d87-8fa8-79247aa9b147 tempest-LiveMigrationTest-598663044 tempest-LiveMigrationTest-598663044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1536 microversion: 2.1 time: 0.360679 Oct 18 16:11:25.235499 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1282/2550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1536 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:25.240635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5ac6db5-ee33-4157-9aea-c9243fefc460 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd2747a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-183639036", "description": "tempest-description-1331413901"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:25.536868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:25.554192 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fcaea2cd-bc5c-486a-9690-5b6cb2869b32 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.690339 Oct 18 16:11:25.562096 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1269/2551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:25.604768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:25.605744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:25.627534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.628148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.628607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.632238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.632941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.633415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.677169 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5ac6db5-ee33-4157-9aea-c9243fefc460 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.440388 Oct 18 16:11:25.677787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1283/2552] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:25.683811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:25.685224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:25.702065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.702793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.705470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.706554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.709222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.709829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.796566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:11:25.888085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:25.902840 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-edbd7388-bda1-462d-b1b5-6e26c217d2f2 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.325365 Oct 18 16:11:25.904365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1270/2553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:25 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:25.923659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d39c6d7-1399-46e6-ac2a-9eb59212db8d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd63a89d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-278170886", "description": "tempest-description-1991710386"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:26.003161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-336c796d-e280-4a41-9142-8aeed6650630 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 204 len: 0 microversion: 2.1 time: 0.322502 Oct 18 16:11:26.004066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1284/2554] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:11:25 2022] DELETE /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:11:26.016302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:26.018126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:26.027552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.028254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.028801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.029763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.041690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.043515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.254346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d39c6d7-1399-46e6-ac2a-9eb59212db8d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.348801 Oct 18 16:11:26.268974 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1271/2555] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:26.268974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:26.268974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:26.279720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.280985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.286231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.290441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.291954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.293978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.545931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:26.557855 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecdbb2ee-b935-4756-8078-5dcc2ae993a1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.552212 Oct 18 16:11:26.565979 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1285/2556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:26 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:26.575676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1615845689", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8d73174a-10ee-4fc5-89d7-9ccd7fe0ecee"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:26.646128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:26.657768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12b59f07-f26e-4b00-87bd-8909142007d1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1389 microversion: 2.1 time: 0.401795 Oct 18 16:11:26.664216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1272/2557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:26 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1389 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:26.681663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:26.682924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:26.688822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] validate_networks() for [('8d73174a-10ee-4fc5-89d7-9ccd7fe0ecee', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:11:26.695576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.696286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.696934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.698352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.699142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.699752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.083640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:27.096250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39b9001b-e980-4fc7-95a1-58e8d8fdd891 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.430604 Oct 18 16:11:27.118848 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1273/2558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:26 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:27.136083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:27.137378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:27.151405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.152231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.152903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.153854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.161729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.162771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.528128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:11:27.528565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:11:27.529127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:11:27.529542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:11:27.529963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:11:27.541494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.542389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.543097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.544280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.545093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.545676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.559780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:27.577180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Getting quotas for project 24dd02df7fd44c1fbe5df55e6ccde4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:27.586322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Getting quotas for user c2a4c2cd88304000a7277caf5bb29ed6 and project 24dd02df7fd44c1fbe5df55e6ccde4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:27.616616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:11:27.623241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:11:27.729864 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1f09d4d-965b-4925-a8a7-83915f373202 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162593 Oct 18 16:11:27.731370 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1286/2559] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:11:28.155504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b96e4317-d7a2-4644-8437-a58dfeb63ab1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd2105dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:28.331337 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b96e4317-d7a2-4644-8437-a58dfeb63ab1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941" status: 200 len: 371 microversion: 2.1 time: 0.598186 Oct 18 16:11:28.333234 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1287/2560] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:11:27 2022] GET /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941 => generated 371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:28.345259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:28.355950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:28.357447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:28.358336 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-762e8896-afa8-4c1e-8067-26b27b89df46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 1.237087 Oct 18 16:11:28.359559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1274/2561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:27 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:28.371444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.371817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:28.372873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:28.375272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.375840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.376747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.382316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.383066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.390227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.401652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.403294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.404525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.405426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.406067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.682844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:28.694934 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96f0cc70-1ba8-43aa-975a-4cb2fda721bd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.358912 Oct 18 16:11:28.696460 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1288/2562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:28 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:28.701426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47ca54dd-e968-4d12-9dd8-7cb16bb31fc3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:28.702241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47ca54dd-e968-4d12-9dd8-7cb16bb31fc3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:28.723019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:28.826502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47ca54dd-e968-4d12-9dd8-7cb16bb31fc3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:28.840764 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47ca54dd-e968-4d12-9dd8-7cb16bb31fc3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1216 microversion: 2.1 time: 0.142941 Oct 18 16:11:28.841928 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1289/2563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:28 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:28.847329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:28.848345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:28.856735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.857846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.858624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.860204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:28.860952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:28.861591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.885044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:28.901226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dce60fc-ab28-42df-be12-57c2676e0923 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1389 microversion: 2.1 time: 0.535001 Oct 18 16:11:28.902232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1275/2564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:28 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1389 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:28.920380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd19c0280>, body: {"quota_set": {"ram": "5120"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:29.164107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:29.179307 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59f75958-7e4e-4f16-85b1-025cee0737b9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.335850 Oct 18 16:11:29.180900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1290/2565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:28 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:29.187115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.191804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.192583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.195401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.196970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.199395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.218613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:29.350581 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f831f799-1b9f-405d-9adc-7bfa8a4ae729 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941" status: 200 len: 328 microversion: 2.1 time: 0.444438 Oct 18 16:11:29.359010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1276/2566] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:11:28 2022] PUT /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941 => generated 328 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:29.365098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46c999d1-7c4c-44ef-8ff1-fa0d57226a1c tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:29.384901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:29.386786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:29.402003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.402492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.404557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.408139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.409581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.410537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.411528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-46c999d1-7c4c-44ef-8ff1-fa0d57226a1c tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941" status: 202 len: 0 microversion: 2.1 time: 0.050584 Oct 18 16:11:29.412362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1291/2567] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:11:29 2022] DELETE /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:29.431036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b40a556b-6c8f-4589-9422-41c2ab91acd3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd225ea60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:29.574984 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b40a556b-6c8f-4589-9422-41c2ab91acd3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941" status: 200 len: 371 microversion: 2.1 time: 0.156063 Oct 18 16:11:29.575584 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1292/2568] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:11:29 2022] GET /compute/v2.1/os-quota-sets/c7bb26f1d4c94d959aa0d2327b21f941 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:29.721725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:29.723299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:29.731703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.737535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.740790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.743031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.746282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.748364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.016771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:30.031041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a271023-8977-44d5-a59d-58745f1498b0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.650915 Oct 18 16:11:30.035849 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1277/2569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:29 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:30.048917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-589e75c8-2033-475d-a47d-a6afdf2bc2f5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd63d1d30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:30.229199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:30.237965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8175f58f-5b39-4c6a-b021-0e64845ec97e tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.520163 Oct 18 16:11:30.238551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1293/2570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:29 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:30.250683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:30.259340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:30.276390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.278164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.280617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.281604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.285602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.286521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.439622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:30.453558 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2edfd0df-b716-4d90-880d-765d90e52ec1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1268 microversion: 2.1 time: 0.207267 Oct 18 16:11:30.454773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1294/2571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:30 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:30.492451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:30.493328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:30.504570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.505085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.505524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.506219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.509648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.510281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.518494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-589e75c8-2033-475d-a47d-a6afdf2bc2f5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.481139 Oct 18 16:11:30.531274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1278/2572] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:30 2022] GET /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6/defaults => generated 371 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:30.538641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:30.544065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:30.575023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.578265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.582957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.585326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.587705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.589518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.885286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:30.902778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-220004db-64d1-46f3-a7d9-360a0b6fbaee tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1347 microversion: 2.1 time: 0.435221 Oct 18 16:11:30.906899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1295/2573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:30 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1347 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:30.918463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55048fe8-cfbd-434e-b92f-c13cf9c0415a", "name": "network-vif-deleted", "tag": "9e6ae16a-c285-47dc-a6b9-7a6e12438633"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:30.942895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.946639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.949607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.975287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] Creating event network-vif-deleted:9e6ae16a-c285-47dc-a6b9-7a6e12438633 for instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a on n-h2-858383-14 Oct 18 16:11:31.012430 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5ee62a86-75dd-4fb8-a980-9e90780eccad req-61f1c6fe-99d7-4d58-8a0d-d4b1442a34be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090753 Oct 18 16:11:31.013953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1296/2574] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:31.062032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:31.063644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:31.081038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.092976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.093649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.095010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.096075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.097427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.578760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:31.590812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-332f0a26-e140-4de8-b8fc-3ae34053735b tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.533675 Oct 18 16:11:31.593551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1297/2575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:31 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:31.604274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd659c160>, body: {"quota_set": {"ram": "5120"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:31.789871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:31.804231 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0c79d4a-0f6b-4cf1-b852-545688eacf5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 1.275000 Oct 18 16:11:31.821071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1279/2576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:30 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:31.835332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:31.835951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:31.860159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.860653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.861128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.861842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.868025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.868469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.012458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.016790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.018374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.021949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.022619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.023220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.169609 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83525041-1d57-418b-a6a9-86f3641a45a3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f" status: 200 len: 328 microversion: 2.1 time: 0.573953 Oct 18 16:11:32.170875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1298/2577] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:11:31 2022] PUT /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f => generated 328 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:32.176462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.177519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:32.184388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.186538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.187353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.189085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.189791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.190394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.288314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:32.299007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef7108c6-fc76-4270-972b-0a9096ec4373 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1274 microversion: 2.1 time: 0.126901 Oct 18 16:11:32.302385 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1299/2578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:32.318641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.320209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:32.327384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.328235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.331135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.332273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.332887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.333777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.488145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:32.495137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:32.503905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-efe2a082-a2ec-46ea-81f7-3a0e953ba49b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1184 microversion: 2.1 time: 0.200269 Oct 18 16:11:32.507072 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0932f0b-18ff-423d-8223-71699de3b11d tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.681015 Oct 18 16:11:32.510231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1280/2579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:31 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:32.519125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd63d1670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.519990 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1300/2580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1184 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:32.639293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.640260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:32.664115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.671674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.673064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.680307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.681045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.683744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.759261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.759855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.761469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.764085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.764810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.772399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.852580 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d78d9598-40b2-4531-ad7d-fc98dfab6f49 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f/detail" status: 200 len: 916 microversion: 2.1 time: 0.340787 Oct 18 16:11:32.854748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1281/2581] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f/detail => generated 916 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:32.869861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.871446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:32.885314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.889498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.892843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.893918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.896894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.897372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.362956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:33.369733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:33.374298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8d3aa9a-64f3-4880-83bb-945673d23f20 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.756958 Oct 18 16:11:33.376538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1301/2582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:33.387200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd18654c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:33.400139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1551765a-7d84-4ec3-8a2b-330586a492fe tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.543811 Oct 18 16:11:33.402543 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1282/2583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:33.409381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:33.412366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:33.442038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.444946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.445544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.446386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.449719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.450278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.573806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.574673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.575557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.579131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.582938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.588841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.771343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.772680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.773777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.775245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.776633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.777442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.935612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:33.954888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e0d333a-540a-4990-a664-4f1f2a69df59 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.549047 Oct 18 16:11:33.973490 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1283/2584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:33 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:33.989463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:33.990485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:34.008728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.022689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.023319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.024223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.024844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.025430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.074435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f07e527-8552-4535-acf4-e7249487332b tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f?user_id=4a44d1239fc74d57874c4fe421d40edd" status: 200 len: 328 microversion: 2.1 time: 0.690200 Oct 18 16:11:34.075505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1302/2585] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:11:33 2022] PUT /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f?user_id=4a44d1239fc74d57874c4fe421d40edd => generated 328 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:34.086642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:34.087275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:34.100757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.101309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.101756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.102485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.102947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.103391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.175496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:34.194720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-246d35f9-e4d3-4355-aa4f-778fb569e37e tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1184 microversion: 2.1 time: 0.219621 Oct 18 16:11:34.210350 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1284/2586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:33 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1184 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:34.216659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f2a63756-dbcc-404f-962d-2cf1002e1ad3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd19e41f0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:34.385668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:34.387459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f2a63756-dbcc-404f-962d-2cf1002e1ad3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f?user_id=4a44d1239fc74d57874c4fe421d40edd" status: 200 len: 370 microversion: 2.1 time: 0.175826 Oct 18 16:11:34.389968 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1285/2587] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Oct 18 16:11:34 2022] GET /compute/v2.1/os-quota-sets/69796d713d1643cc9e9f792c72ed3a3f?user_id=4a44d1239fc74d57874c4fe421d40edd => generated 370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:34.423462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:34.424397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:34.446025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.446727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.447568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.448437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.449251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.449966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.776349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:34.784837 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-891c78bb-16ac-4d2a-9d96-f4f083113b9f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.388947 Oct 18 16:11:34.785475 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1286/2588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:34 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:34.806480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:34.807107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:34.835084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.837699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.838545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.839586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:34.842642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:34.843278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.982710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:34.994929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d61b839e-f927-4959-abe5-c42280bdb396 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.918129 Oct 18 16:11:35.000425 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1303/2589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:34 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:35.016055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:35.019493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:35.055837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.064507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.069833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.070839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.071468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.072075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.218203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:35.231271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9cfaf1cd-9d2c-4186-bb30-6de1d4ae3945 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.435508 Oct 18 16:11:35.247278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1287/2590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:34 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:35.259388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:35.260313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:35.268134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.269223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.270793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.271776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.272302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.272795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.349900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:35.361761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aeda21f2-b0d6-4b6f-837d-2ec44370f693 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1184 microversion: 2.1 time: 0.113154 Oct 18 16:11:35.362363 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1288/2591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:35 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1184 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:35.383770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5e96fe7-5ed1-4bf2-862f-62f842e5953f tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Calling method '.version_select at 0x7f5fd6384820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:35.711254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:35.711881 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5e96fe7-5ed1-4bf2-862f-62f842e5953f tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.332201 Oct 18 16:11:35.713271 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1289/2592] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:11:35 2022] GET /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6/defaults => generated 371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:35.723950 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-575a990e-8316-4210-95ec-16363929c9a9 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.720297 Oct 18 16:11:35.724876 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1304/2593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:35 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:35.731035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd19b2ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:35.808817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:35.809738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:35.822241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.825213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.826035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.829847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.830814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.832854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.882921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.884936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.888844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.893386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.894228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.895721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.198724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:36.212568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec62a37c-c605-4aaf-ae50-6fe2bd9ade88 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.408002 Oct 18 16:11:36.216269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1305/2594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:35 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:36.224880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:36.225738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:36.249121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.249683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.251904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.252668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.253181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.253617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.270556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72630582-f94f-4c57-8023-33dcf171b0d2 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6" status: 200 len: 329 microversion: 2.1 time: 0.547463 Oct 18 16:11:36.272072 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1290/2595] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Oct 18 16:11:35 2022] PUT /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6 => generated 329 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:11:36.286588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:36.287353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:36.296589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.298214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.298869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.299724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.300208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.300647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.518954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:36.534887 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-244b840f-a9da-4bc7-b0f8-300c33e78b2b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1682 microversion: 2.1 time: 0.260755 Oct 18 16:11:36.545955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1291/2596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:36 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:36.545955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Action: 'update', calling method: .version_select at 0x7f5fd63554c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:36.619378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.619975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.620491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.621384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.621928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.622451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.970608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=24,nova_api:UPDATE=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:37.028442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:37.043906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9eb89d2-7b44-453d-bf95-ed78ad47e482 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.823376 Oct 18 16:11:37.049467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1306/2597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:36 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:37.067944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:37.069345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:37.092118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.092634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.093307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.094197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.098432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.104556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.122385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-298978cb-9053-4600-a18a-cf717a057c5d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6" status: 200 len: 329 microversion: 2.1 time: 0.583122 Oct 18 16:11:37.133670 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1292/2598] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Oct 18 16:11:36 2022] PUT /compute/v2.1/os-quota-sets/3748e4ee8bdf41798158bc6e65f409e6 => generated 329 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:37.144865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:37.145567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:37.159534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.163193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.163805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.164700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.166795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.167415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.348177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:37.360353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-38aed7d1-036a-4d24-b7c0-a5730837b6b4 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1184 microversion: 2.1 time: 0.309348 Oct 18 16:11:37.365379 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1307/2599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:37 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1184 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:37.370827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:37.371702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:37.398571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.410071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.410742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.411668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.414781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.415375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.430624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:37.460703 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b82e798f-05b8-400a-952d-eda9a5725bf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.325855 Oct 18 16:11:37.465240 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1293/2600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:37 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:37.476724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca", "tag": "22572460-8e2e-44dc-a813-b3ecee63c2e0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:37.508758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.510880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.512917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.529919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] Creating event network-changed:22572460-8e2e-44dc-a813-b3ecee63c2e0 for instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca on n-h1-858383-14 Oct 18 16:11:37.540807 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-bb9e808e-19df-4cc8-aba3-542e89c74733 req-c4aeb894-d4d4-4e08-b7fd-c5d3d7d3c4df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072817 Oct 18 16:11:37.542300 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1294/2601] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:37.562012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:37.563254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:37.581466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.588338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.595010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.596328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:37.597559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:37.599279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:37.993269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:38.012394 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62e835e8-c824-42cc-a3bd-34c219a6d13f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.453168 Oct 18 16:11:38.014155 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1295/2602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:38.069413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:38.070174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:38.082919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.083611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.084980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.085879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.086466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.087017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.220672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:38.236949 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eefa7968-4378-45f0-92d3-da453c1e71e6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.870031 Oct 18 16:11:38.240831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1308/2603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:37 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:38.260217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:38.261750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:38.287250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.287784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.290433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.291228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.291708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.292227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.300940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:38.714814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:38.732970 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63a42e99-d7f1-4aba-b5ef-58c78421c883 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.667167 Oct 18 16:11:38.734664 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1296/2604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:38 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:38.743537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:38.744588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:38.756226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:38.771024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.771443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.771866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.772570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.773087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.773455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.782861 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bf951e5-91ec-444c-b06e-c7fd911ffc6d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.540660 Oct 18 16:11:38.783466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1309/2605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:38 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:38.811027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:38.811662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:38.866319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.868218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.869422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:38.895472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:38.896178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:38.896795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:39.002337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:39.017023 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84336b2e-78fe-4150-aba7-84c4daa6b4f6 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 200 len: 1184 microversion: 2.1 time: 0.280293 Oct 18 16:11:39.022043 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1297/2606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:38 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 1184 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:39.265498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:39.269090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:39.269865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:39.275157 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5662e87-6c19-42bd-8302-cc75ea11a617 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.476682 Oct 18 16:11:39.275471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1310/2607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:38 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:39.281777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:39.283397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:39.285107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:39.286618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:39.288321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:39.290504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:39.534284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:39.546076 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7b47f38-08ea-48cb-96bf-633cdffdfde4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.281626 Oct 18 16:11:39.547945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1298/2608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:39 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:39.764164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:39.764790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:39.777597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:39.779815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:39.782141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:39.783147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:39.785332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:39.786618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.355184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-unplugged", "status": "completed", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:40.366032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:40.374133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.374501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.374971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.375957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-488a447b-2bb8-4781-bbd1-72e9b584a283 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.617879 Oct 18 16:11:40.382558 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1311/2609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:39 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:40.390216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:40.402181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:40.404911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 55048fe8-cfbd-434e-b92f-c13cf9c0415a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:40.429245 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] Creating event network-vif-unplugged:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:11:40.430434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.431162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.435635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.440650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.441418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.443702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-98acab89-6427-40d5-92e2-2f40af86f700 req-62fc9261-f235-4883-a53f-de60723b1321 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.538723 Oct 18 16:11:40.445035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.457425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1299/2610] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:40.465163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:40.465877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:40.483036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.485268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.485909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.488015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.490837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] HTTP exception thrown: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. Oct 18 16:11:40.490980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.493895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Request method failure captured: Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a HTTP/1.1 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4blS7dsKYXMsUI1mxcvFnWQaFwxhA7lIO-7VKcUytlOklqdJYMYaIfsGYi_-e16hzvXqyzxWbN8vvflUh3ZAzg2TrMmDDWeZSDULrVvYPmHPHY-eHxbar03DHf_i-snhDMFSzL_vBQ1mNPc5d5-IvuAO-gA2UEDTIyYc0qyhPPaE0 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}] Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationTest-182807803 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationTest-182807803-project Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ab2aa9c224654cfbbc1559ed58556ad5 Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationTest-182807803-project Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '55048fe8-cfbd-434e-b92f-c13cf9c0415a'} Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:40.496693 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:40.500971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Returning 404 to user: Instance 55048fe8-cfbd-434e-b92f-c13cf9c0415a could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:40.503772 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddd0917f-f416-42cc-bb27-d9d896372338 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a" status: 404 len: 111 microversion: 2.1 time: 0.115909 Oct 18 16:11:40.507716 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1312/2611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:40 2022] GET /compute/v2.1/servers/55048fe8-cfbd-434e-b92f-c13cf9c0415a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:40.573238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:40.574300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:40.588503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.589111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.589571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.590313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:40.596535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:40.598860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:40.965720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:40.978226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff491c49-9e09-4feb-852c-e442cad1cc1c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.518914 Oct 18 16:11:40.979468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1300/2612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:40 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:40.989559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:40.998888 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70059aa3-f0cc-4eef-a5af-29b8f918ae9a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.429755 Oct 18 16:11:41.010773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1313/2613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:40 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:41.180510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:41.181177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:41.199297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:41.199806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:41.200253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:41.200965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:41.201448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:41.201875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:41.238731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dadfbab3-ecf7-479c-8964-384bffb734cd tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Action: 'create', calling method: .version_select at 0x7f5fd633e5e0>, body: {"keypair": {"name": "tempest-keypair-1198593321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUvwHTBKIaFj2Av1zMTmplF0ZX+ddi6X+Ut3S72Cys7Ig+d29aK1Y5jCeqAfXKYHz1BveeExg2vkn8I1W2YeVng9HihfgEaC0SDOyuoIeala5ZBCQCO8LOkbV0PulY5Vg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:41.286216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-dadfbab3-ecf7-479c-8964-384bffb734cd tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for project a26e133352f14345a82cf54eb512f1be. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:41.306501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-dadfbab3-ecf7-479c-8964-384bffb734cd tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for user e8c66912f0ca4625a0cb274c1386cb28 and project a26e133352f14345a82cf54eb512f1be. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:41.361513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dadfbab3-ecf7-479c-8964-384bffb734cd tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354040 Oct 18 16:11:41.370527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1301/2614] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:11:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:11:41.408720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:41.409734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:41.424835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:41.425855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:41.427774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:41.429027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:41.431404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:41.432580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:41.987730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:42.000953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:42.003793 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4fca57a-233f-4604-84fd-394c19f057ff tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.598227 Oct 18 16:11:42.008076 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1302/2615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:41 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:42.025188 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad676e1a-e66f-4fc3-92b5-2172f8709ce2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.854625 Oct 18 16:11:42.026106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1314/2616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:41 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:42.039672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:42.044773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:42.045986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:42.058917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:42.065427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.065918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.078591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.079617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.083406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.083968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.084123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.084528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.085263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.085557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.085718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.086141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.557168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:42.573787 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-608160e0-e8b3-4f94-8b4d-8c57ebfb100a tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.563568 Oct 18 16:11:42.576157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1303/2617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:42 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:42.593732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:42.594345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:42.616620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.620580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.623351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.630485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:42.631190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:42.631643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:42.893025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:42.908025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8edafa15-d704-4d81-b302-7394c9801805 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.877692 Oct 18 16:11:42.910050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1315/2618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:42 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:43.042204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:43.045659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:43.071222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:43.073777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:43.076101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:43.077311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:43.079272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:43.079857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:43.169326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:43.219526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-86f6201e-51ea-4809-8733-5808cb6589f2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.612979 Oct 18 16:11:43.223005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1304/2619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:42 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:43.262672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:43.263275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:43.290267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:43.290767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:43.291231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:43.295533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:43.296068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:43.299288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:43.405127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:43.423971 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4df370bb-54f3-4547-96d2-a4daba8f1a02 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.391004 Oct 18 16:11:43.427398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1316/2620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:43 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:43.812017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:43.973505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7c65398-3ec7-4616-aa38-274973c4475f tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] Action: 'create', calling method: .version_select at 0x7f5fd6494ca0>, body: {"security_group": {"name": "tempest-securitygroup-1929323012", "description": "tempest-description-938306784"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:44.045784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=44 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:44.235212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:44.255537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-586af2a7-b03c-401c-aa97-4d815c532c83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 1.013469 Oct 18 16:11:44.269424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1305/2621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:43 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:44.278857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:44.279653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:44.294274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.294900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.303814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.304704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.305480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.306156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.545322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7c65398-3ec7-4616-aa38-274973c4475f tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.969717 Oct 18 16:11:44.554832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1317/2622] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:43 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:44.559706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:44.560327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:44.577506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.578601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.579051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.591826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.592345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.592804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.775153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:44.786333 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a2a2bc5-e492-4a97-a85f-a5dcfb1136b1 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.512957 Oct 18 16:11:44.787066 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1306/2623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:44 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:44.802342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:44.805204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:44.824719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.825601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.826254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.827207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.827990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.828708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.878663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:44.889822 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2b68a42-c8ba-4a3a-baf2-4e8fb0d537df tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.333796 Oct 18 16:11:44.891401 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1318/2624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:44 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:44.897342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:44.898372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:44.907087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.907976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.908653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.909633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:44.910385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:44.911436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:44.976902 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af438916-e8a2-428a-a0cf-df6428f87c66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.178277 Oct 18 16:11:44.977570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1307/2625] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:44 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:44.989515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-286dcdbc-e8ce-4ed7-bd29-1aca17015484 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] Action: 'create', calling method: .version_select at 0x7f5fd6330f70>, body: {"security_group": {"name": "tempest-securitygroup-1747757467", "description": "tempest-description-40596825"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:45.146010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:45.160442 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-639abbcf-8a12-4f39-a972-53fbc803db5f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1517 microversion: 2.1 time: 0.267686 Oct 18 16:11:45.168230 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1319/2626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:44 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:45.173770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:45.174468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:45.199806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:45.204494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:45.208483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:45.208483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:45.208483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:45.228735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:45.560640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:45.574272 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07e56fa2-a713-41cb-88af-5d00fe4e6dd2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1671 microversion: 2.1 time: 0.404341 Oct 18 16:11:45.591614 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1320/2627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:45 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1671 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:45.821379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:45.822435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:45.842746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:45.846445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:45.847924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:45.852376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:45.853219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:45.853951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:45.881106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-286dcdbc-e8ce-4ed7-bd29-1aca17015484 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.902090 Oct 18 16:11:45.882345 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1308/2628] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:44 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:46.110094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c36cd0e9-fcfa-48df-a572-485c98a39019 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] Action: 'create', calling method: .version_select at 0x7f5fd6330c10>, body: {"security_group": {"name": "tempest-securitygroup-521897804", "description": "tempest-description-1208308328"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:46.251839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:46.262548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cbff86f-c713-4bae-b652-16fb4cfda13c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.449249 Oct 18 16:11:46.263558 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1321/2629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:45 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:46.305872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:46.306923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:46.326325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:46.354508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:46.355007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:46.355710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:46.356421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:46.356881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:46.357393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:46.644119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:46.959334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:46.969980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81a69d49-0c99-4432-ab7a-59e84dcb9ed7 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.679518 Oct 18 16:11:46.971407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1322/2630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:46 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:46.978073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1435017169", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4f903b64-6ae8-4a9d-9a63-a93021d2bc5a"}], "security_groups": [{"name": "tempest-securitygroup--714339137"}], "key_name": "tempest-keypair-1198593321", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:47.013825 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c36cd0e9-fcfa-48df-a572-485c98a39019 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.121612 Oct 18 16:11:47.016407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1309/2631] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:45 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:47.028117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:47.029213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:47.050590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:47.051600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:47.052324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:47.053377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:47.054102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:47.054753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:47.199696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] validate_networks() for [('4f903b64-6ae8-4a9d-9a63-a93021d2bc5a', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:11:47.389984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:47.410086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f53efc01-256c-4919-be79-54f6cd1b4bda tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.390409 Oct 18 16:11:47.412730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1310/2632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:47 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:47.425279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:47.426493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:47.447292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:47.449968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:47.452457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:47.458054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:47.458914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:47.459689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:47.716346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:47.729048 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c2a88c9-af98-4bb2-8902-02cb65dcb02a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1671 microversion: 2.1 time: 0.313020 Oct 18 16:11:47.729976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1311/2633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:47 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:47.735299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58f7731d-d66e-4a01-9653-c5a5e14a3021 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] Action: 'create', calling method: .version_select at 0x7f5fd64111f0>, body: {"security_group": {"name": "tempest-securitygroup-1246090737", "description": "tempest-description-1861164380"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:47.986250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58f7731d-d66e-4a01-9653-c5a5e14a3021 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.254683 Oct 18 16:11:47.987181 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1312/2634] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:11:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:48.018442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:48.020644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:48.028525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.029371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.030057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.033801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.034594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.035357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.298957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for project a26e133352f14345a82cf54eb512f1be. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:48.305426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:48.313055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for user e8c66912f0ca4625a0cb274c1386cb28 and project a26e133352f14345a82cf54eb512f1be. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:48.321291 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2bc317b4-5507-4f36-a6d7-fa0b26951b08 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.323326 Oct 18 16:11:48.322305 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1313/2635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:47 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:48.333270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:11:48.341777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:48.342536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:48.345394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:11:48.348605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:11:48.349220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:11:48.349787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:11:48.355977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.356676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.357222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.358037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.358609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.359813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.383093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.383577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.384177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.385418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.386151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.386720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.402818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:11:48.418476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for project a26e133352f14345a82cf54eb512f1be. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:48.426374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Getting quotas for user e8c66912f0ca4625a0cb274c1386cb28 and project a26e133352f14345a82cf54eb512f1be. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:48.460632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:11:48.465950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:11:48.592816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9085e92-a4fe-471f-825b-64fb2e836840 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.618432 Oct 18 16:11:48.597999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1323/2636] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:11:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:11:48.605112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-433586d8-e444-45e3-bda2-31ea3cd3757b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 204 len: 0 microversion: 2.1 time: 0.280641 Oct 18 16:11:48.606413 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1314/2637] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:11:48 2022] DELETE /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:11:48.611152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:48.614857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:48.616373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c361010b-fa89-462d-8f86-22cfd1bc6064 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] Calling method '.version_select at 0x7f5fd64138b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:48.641958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.642921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.643603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.644524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.645265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.646436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.832565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:48.842011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a51041a-01e9-4438-88fa-37ae42749dd5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.240675 Oct 18 16:11:48.843380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1324/2638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:48 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:48.851596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca", "name": "network-vif-plugged", "status": "completed", "tag": "22572460-8e2e-44dc-a813-b3ecee63c2e0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:48.865128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.865871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.866595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.889008 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] Creating event network-vif-plugged:22572460-8e2e-44dc-a813-b3ecee63c2e0 for instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca on n-h1-858383-14 Oct 18 16:11:48.902666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-09849759-8e29-4e06-861e-0871cb99ecc2 req-f1504291-eca2-44d7-b292-f6fe6d4350b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057847 Oct 18 16:11:48.906055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1325/2639] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:48.922589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:48.923391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:48.935869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.936376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.936819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:48.938145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:48.938721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:48.939163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:49.324048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:49.339414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77f8b5db-b7f3-4c8c-b9ec-ce4a0c28fed9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.430506 Oct 18 16:11:49.363329 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1326/2640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:48 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:49.379808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b681fe9-4022-4c8f-993f-efb80be98678 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:49.391248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b681fe9-4022-4c8f-993f-efb80be98678 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:49.586547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8b681fe9-4022-4c8f-993f-efb80be98678 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:49.596484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b681fe9-4022-4c8f-993f-efb80be98678 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1270 microversion: 2.1 time: 0.230559 Oct 18 16:11:49.606046 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1327/2641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:49 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:49.630035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:49.631048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:49.641439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:49.642212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:49.643045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:49.643917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:49.644526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:49.645177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:49.868524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:49.877914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d6a051d0-6132-4eb5-984b-e759b383ed7c tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1669 microversion: 2.1 time: 0.269070 Oct 18 16:11:49.878505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1328/2642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:49 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:49.886047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:49.886890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:49.895294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:49.896095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:49.896536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:49.897271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:49.897731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:49.898156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:50.058496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:50.062693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:50.074408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f943074-f5c9-4042-bf49-4662e7cae30d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1671 microversion: 2.1 time: 0.194036 Oct 18 16:11:50.075211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1329/2643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:49 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:50.080754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:50.081693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:50.090026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:50.090744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:50.091236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:50.091947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:50.092405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:50.092862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:50.490501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:50.504902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28cd0333-f3d1-4e48-96e3-6d5d78d29494 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1316 microversion: 2.1 time: 0.428446 Oct 18 16:11:50.507328 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1330/2644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:50 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:50.527620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:50.528573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:50.538125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:50.538733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:50.539272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:50.540078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:50.541180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:50.541180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:50.957217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:50.976802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bfce3ff8-06f5-452d-8e26-28ba5a4b2e5a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.468011 Oct 18 16:11:51.006833 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1331/2645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:50 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:51.023933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:51.024685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:51.043150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.043660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.044099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.048975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.050310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.050955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.325669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=86 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:51.556347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:51.569475 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f27ec71-bdcb-4c8f-adb3-fab3c32bfaa3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.561342 Oct 18 16:11:51.572018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1332/2646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:51 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:51.578282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:51.579193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:51.591012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.591848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.595446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.606442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.607110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.607570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.703324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:51.713684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-874c6aa8-833b-4774-b573-3efe1af77539 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1266 microversion: 2.1 time: 0.139307 Oct 18 16:11:51.719130 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1333/2647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:51 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:51.726819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:51.732330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:51.740409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.741177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.741920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.742830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.743437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.744039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.869320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:51.886359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65a151c4-f877-4e3f-9097-385f9cdbe9c1 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 200 len: 1601 microversion: 2.1 time: 0.166041 Oct 18 16:11:51.887285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1334/2648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:51 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:51.892101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5", "name": "network-vif-unplugged", "status": "completed", "tag": "29b0af49-1b8e-4ae5-afca-8206160fa7c4"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:51.918574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:51.919273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:51.926316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:51.974490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] Creating event network-vif-unplugged:29b0af49-1b8e-4ae5-afca-8206160fa7c4 for instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 on n-h2-858383-14 Oct 18 16:11:51.993775 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-69ddb198-8d9c-4cbd-99c9-eb9dfe20a7a5 req-20976084-8796-46b3-a3fd-bb3f66db382c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094255 Oct 18 16:11:51.994645 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1335/2649] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:52.000482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:52.001264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:52.012349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:52.012849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:52.013324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:52.014046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:52.014510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:52.014939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:52.495342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:52.512165 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a34612e1-dad1-4ce3-8f78-71e6711ebdb2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1676 microversion: 2.1 time: 0.512695 Oct 18 16:11:52.513383 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1336/2650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:51 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1676 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:52.520169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:52.521585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:52.564283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:52.565045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:52.565506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:52.566244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:52.566702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:52.567201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.072095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:53.081478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d0cfe4d-6a25-40ed-9e9b-2adc052861a2 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1504 microversion: 2.1 time: 0.566805 Oct 18 16:11:53.086298 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1337/2651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:52 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:53.092720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:53.097116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:53.112452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:53.112984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:53.113464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.117658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:53.118273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:53.118596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.594269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:53.604816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afa2db9a-8635-4a50-b7f1-2a5ef06f16ad tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1486 microversion: 2.1 time: 0.516909 Oct 18 16:11:53.618370 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1338/2652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:53 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1486 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:53.628726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c78166-21f2-4415-8634-a43361270c27", "name": "network-vif-deleted", "tag": "0119e457-4cba-4e18-b8e3-a0614d29c888"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:53.640233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:53.641419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:53.642016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.656241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] Creating event network-vif-deleted:0119e457-4cba-4e18-b8e3-a0614d29c888 for instance b9c78166-21f2-4415-8634-a43361270c27 on n-h1-858383-14 Oct 18 16:11:53.662540 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a241a232-8df0-4cc2-9a1c-afb8d471e629 req-c6cedfff-0e89-4dae-9786-b4d8f7b5e503 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042383 Oct 18 16:11:53.663434 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1339/2653] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:53.669496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:53.670384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:53.678326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:53.679055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:53.679663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.680536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:53.681187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:53.681787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:53.977351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:53.988924 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6909995a-dde9-401f-817a-cc7e86489ad3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.324050 Oct 18 16:11:53.990702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1340/2654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:53 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:53.995676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0562977-8b79-4c28-8713-9b4608f79362 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Action: 'create', calling method: .version_select at 0x7f5fd64ae5e0>, body: {"keypair": {"name": "tempest-keypair-1320027980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDprmUHzwgq09nDLkM39LcEI4d0Sn4kslRvIiffK6ibOqI1Z0BSsaVATaC8Svf9TbUYqoj66x/GsB38iFrBSDCCNfnFdwZYQuVe5UxrxkP5687jNKp1hv+ARkvasLeMUnw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:54.026366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c0562977-8b79-4c28-8713-9b4608f79362 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Getting quotas for project 5daf1d849d91426d94f338ed22af5f9a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:11:54.033185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c0562977-8b79-4c28-8713-9b4608f79362 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Getting quotas for user 16bd1444400e47de84f0c1c15cc42c66 and project 5daf1d849d91426d94f338ed22af5f9a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:11:54.070369 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0562977-8b79-4c28-8713-9b4608f79362 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.077983 Oct 18 16:11:54.071197 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1341/2655] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:11:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:11:54.072230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c361010b-fa89-462d-8f86-22cfd1bc6064 tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13196 microversion: 2.1 time: 5.464416 Oct 18 16:11:54.073763 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1315/2656] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:11:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13196 bytes in 5467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:11:54.076858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:54.078978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:54.080208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:54.081493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: b9c78166-21f2-4415-8634-a43361270c27] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:54.086693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.087279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.087818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.088467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.088634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.089188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.089521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.089672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.092434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.094373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.096533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.097206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.123950 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] HTTP exception thrown: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Request method failure captured: Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 HTTP/1.1 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs4blS7dsKYXMsUI1mxcvFnWQaFwxhA7lIO-7VKcUytlOklqdJYMYaIfsGYi_-e16hzvXqyzxWbN8vvflUh3ZAzg2TrMmDDWeZSDULrVvYPmHPHY-eHxbar03DHf_i-snhDMFSzL_vBQ1mNPc5d5-IvuAO-gA2UEDTIyYc0qyhPPaE0 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}] Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-LiveMigrationTest-182807803 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-LiveMigrationTest-182807803-project Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ab2aa9c224654cfbbc1559ed58556ad5 Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-LiveMigrationTest-182807803-project Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9c78166-21f2-4415-8634-a43361270c27'} Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:54.126943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. Oct 18 16:11:54.131139 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:11:54.132830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Returning 404 to user: Instance b9c78166-21f2-4415-8634-a43361270c27 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:54.134010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c54ed16c-b06a-4e78-a2c8-44d3bcac9d0f tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27" status: 404 len: 111 microversion: 2.1 time: 0.059053 Oct 18 16:11:54.134772 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1316/2657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:54 2022] GET /compute/v2.1/servers/b9c78166-21f2-4415-8634-a43361270c27 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:54.143101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-183639036"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:54.144036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:54.151052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.151618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.152241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.152965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.153513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.153939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.188015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:54.197388 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1647da42-cf07-4a4f-88c3-e676a74bcfa7 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1328 microversion: 2.1 time: 0.124766 Oct 18 16:11:54.198251 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1342/2658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:54 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:54.219446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:54.221085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:54.228688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.229406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.230027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.231192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.231640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.232265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.422114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Adding security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c to port 22572460-8e2e-44dc-a813-b3ecee63c2e0 Oct 18 16:11:54.557659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:54.581648 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05920c34-11ef-43b1-8f46-740089d6a035 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.363663 Oct 18 16:11:54.584908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1343/2659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:54 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:54.592920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:54.596634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:54.610056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.610543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.610961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.611687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:54.612224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:54.612572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:54.713179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a42a3c08-ad7d-4898-b6ad-c949ee8a13c0 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "POST /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2/action" status: 202 len: 0 microversion: 2.1 time: 0.124772 Oct 18 16:11:54.714211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1344/2660] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:54 2022] POST /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:54.729357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe323ca1-71d8-4813-935a-cd9f984ab119 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] Calling method '.version_select at 0x7f5fd215d700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:54.955673 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f19a462-3cd4-4ec2-bf77-1066be6131af tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action" status: 202 len: 0 microversion: 2.1 time: 0.819584 Oct 18 16:11:54.957330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1317/2661] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:54 2022] POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:54.974561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d703ecd-cbad-41bc-ad90-a8d6ecc3e917 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '.version_select at 0x7f5fd64130d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:55.011447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d703ecd-cbad-41bc-ad90-a8d6ecc3e917 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320816053" status: 202 len: 0 microversion: 2.1 time: 0.052667 Oct 18 16:11:55.014819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1318/2662] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320816053 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:55.022730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:55.026013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:55.037915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.039469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.041871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.043567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.045673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.046196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.137138 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca663992-929a-448b-b81d-e6c77d39f63d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 200 len: 324 microversion: 2.1 time: 0.122588 Oct 18 16:11:55.138323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1319/2663] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:55 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 324 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:55.144673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:55.145444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:55.159296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.160157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.161484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.162584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.163365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.164856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.329195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe323ca1-71d8-4813-935a-cd9f984ab119 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.613259 Oct 18 16:11:55.340226 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1345/2664] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:11:54 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:55.345848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd175aca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:55.603198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:55.615373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-debc7cbe-e0b1-4f1f-9669-510c62177082 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1494 microversion: 2.1 time: 0.475553 Oct 18 16:11:55.620985 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1320/2665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:55 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1494 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:55.644288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca", "tag": "22572460-8e2e-44dc-a813-b3ecee63c2e0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:55.664255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.665006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.666595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.674978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:55.686393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] Creating event network-changed:22572460-8e2e-44dc-a813-b3ecee63c2e0 for instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca on n-h1-858383-14 Oct 18 16:11:55.695987 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3bc52c5d-d3f3-45e3-9151-cbd87b62ddff req-b7a253d9-0de7-4b0f-b459-a5990f4d63cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072730 Oct 18 16:11:55.697772 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1321/2666] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:55.723168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:55.723972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:55.732306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.732847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.733314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.734580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.735034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.735465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.774379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use.", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:11:55.776520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.776520 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c HTTP/1.1 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: exception: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9d3cf815-7cde-4748-bc22-0325ae87cd4c'} Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:11:55.781159 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] Oct 18 16:11:55.786535 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:11:55.797606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 400 to user: Security Group 9d3cf815-7cde-4748-bc22-0325ae87cd4c in use. Oct 18 16:11:55.797606 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-fbc85146-da40-406e-9764-0440758c584a'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:11:55.797606 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f54b1c4-5b26-4ec8-a703-d7e13b9a93db tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c" status: 400 len: 185 microversion: 2.1 time: 0.452340 Oct 18 16:11:55.797606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1346/2667] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:55 2022] DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c => generated 185 bytes in 454 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:11:55.812814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:55.814162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:55.828556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.829682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.830130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:55.830859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:55.831475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:55.831911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.131583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:56.166891 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1ec1ddb9-d191-4f02-a983-2168832b8079 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.467152 Oct 18 16:11:56.181017 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1322/2668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:55 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:56.188052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:56.188052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:56.197063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.197373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.197977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.198812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.199438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.200289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.487587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:56.507213 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09f9003e-b6df-4be2-9656-d4d5bcb509cc tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.334423 Oct 18 16:11:56.507924 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1323/2669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:56 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:56.514054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8c94451-8335-40e1-8e7a-dcaac4fce7ba tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] Calling method '.version_select at 0x7f5fd63805e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:56.618272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:56.628211 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c00ad83-be57-448c-a1b5-9d20d12d3a7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.832303 Oct 18 16:11:56.628842 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1347/2670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:55 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:56.634042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:56.636418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:56.643131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.643630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.644243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.645170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.645785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.646380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.721994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:56.735668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32dd8fba-b9c0-4c7d-b27d-58fe096aae19 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action" status: 202 len: 0 microversion: 2.1 time: 0.105160 Oct 18 16:11:56.736538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1348/2671] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:56 2022] POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:56.742298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5", "name": "network-vif-plugged", "status": "completed", "tag": "29b0af49-1b8e-4ae5-afca-8206160fa7c4"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:56.754010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.754632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.755029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.769350 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] Creating event network-vif-plugged:29b0af49-1b8e-4ae5-afca-8206160fa7c4 for instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 on n-h2-858383-14 Oct 18 16:11:56.774974 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8fb5a808-8100-4177-a614-39c46ce24706 req-8f2f09d4-3908-4003-b019-98846a668fce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036979 Oct 18 16:11:56.776352 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1349/2672] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:56.783409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:56.784269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:56.791351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.791853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.792516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.793493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.793975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.794587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.804079 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8c94451-8335-40e1-8e7a-dcaac4fce7ba tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/18c44af2-9236-45ab-92bb-732a09b5a8a5" status: 202 len: 0 microversion: 2.1 time: 0.293952 Oct 18 16:11:56.807665 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1324/2673] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:56 2022] DELETE /compute/v2.1/os-security-groups/18c44af2-9236-45ab-92bb-732a09b5a8a5 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:56.809650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:56.810474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:56.830137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.830910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.831534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:11:56.831893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.833047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.834319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.835275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.943873 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5864161e-6acf-4281-8dcf-0bb142320107 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 204 len: 0 microversion: 2.1 time: 0.165268 Oct 18 16:11:56.945350 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1350/2674] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:11:56 2022] DELETE /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:11:56.952268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:56.954425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:56.960604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.961461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.962125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.963021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:56.963473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:56.963899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:56.992848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.002981 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3c63411-b569-42bc-a626-98a821a68809 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1494 microversion: 2.1 time: 0.197208 Oct 18 16:11:57.003573 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1325/2675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:56 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1494 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.008277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.009045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:57.016315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.016895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.017553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.018431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.018977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.019404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.179104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.186258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-167b42a1-794c-430a-b460-9839df36d018 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1574 microversion: 2.1 time: 0.181670 Oct 18 16:11:57.187364 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1326/2676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:57 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.192447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32296e9f-d58a-4d46-8ace-e0d0ab8cb8ae tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] Calling method '.version_select at 0x7f5fd6413550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.370576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32296e9f-d58a-4d46-8ace-e0d0ab8cb8ae tempest-SecurityGroupsTestAdminJSON-1743432867 tempest-SecurityGroupsTestAdminJSON-1743432867-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/897328e8-a5ab-4d95-bd7d-6a46e7074c46" status: 202 len: 0 microversion: 2.1 time: 0.181981 Oct 18 16:11:57.374209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1327/2677] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:57 2022] DELETE /compute/v2.1/os-security-groups/897328e8-a5ab-4d95-bd7d-6a46e7074c46 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:57.377984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.378609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:57.385569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.385923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.386408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.387123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.387749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.388704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.391138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.403376 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8b0b37f-3563-4a04-8f99-600919f20980 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.456416 Oct 18 16:11:57.403964 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1351/2678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.410745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.411693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:57.418860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.419687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.420339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.423169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.423910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.425192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.574142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.583125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a43e39d-0b0d-4130-904f-ebc66bbdc6d3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1484 microversion: 2.1 time: 0.210323 Oct 18 16:11:57.583784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1328/2679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:57 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1484 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.589494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55e2fdbb-7e0a-4ad6-a0a0-81d46ddeb602 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] Calling method '.version_select at 0x7f5fd6411f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.775465 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55e2fdbb-7e0a-4ad6-a0a0-81d46ddeb602 tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cffba738-e6be-4700-89d1-fb41c7df1668" status: 202 len: 0 microversion: 2.1 time: 0.190375 Oct 18 16:11:57.776059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1329/2680] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:57 2022] DELETE /compute/v2.1/os-security-groups/cffba738-e6be-4700-89d1-fb41c7df1668 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:57.783001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.783770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:57.790067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.790563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.791006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.791715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.792336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.792971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.865019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.881444 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-432ebfc1-440c-46ac-ab06-2dd23815369c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.472883 Oct 18 16:11:57.896613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1352/2681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:57 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.900441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:57.901122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:57.904688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:57.909955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.910836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.911472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.912401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:57.913121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:57.914029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:57.955427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:57.967250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b94aca8d-9a31-46bf-bbfc-5a9f22225c0a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.189576 Oct 18 16:11:57.981421 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1330/2682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:57 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:57.991786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d39dbc7d-ae09-448c-872a-09accdda1e2c tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] Calling method '.version_select at 0x7f5fd6413040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:58.191302 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d39dbc7d-ae09-448c-872a-09accdda1e2c tempest-SecurityGroupsTestAdminJSON-429602946 tempest-SecurityGroupsTestAdminJSON-429602946-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/3bd05bbd-f5bf-480f-a6f1-bfced7d306ad" status: 202 len: 0 microversion: 2.1 time: 0.208127 Oct 18 16:11:58.192967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1331/2683] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:11:57 2022] DELETE /compute/v2.1/os-security-groups/3bd05bbd-f5bf-480f-a6f1-bfced7d306ad => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:58.200641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:58.201523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:58.206607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:58.214318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.214908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.215443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.216446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.217041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.217573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.410903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:58.458624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:58.467802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a65d76eb-deaa-4530-8438-fcb7f23bc0db tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.273360 Oct 18 16:11:58.469166 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1332/2684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:58 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:58.485160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:58.485888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:58.493210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.493875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.494427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.495763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.495763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.496327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:58.496471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.506447 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce70cb80-e38f-4fea-9b32-73b0aa1d23f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.611164 Oct 18 16:11:58.510247 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1353/2685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:57 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:58.515832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:58.520946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:58.536246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.537207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.537890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.538840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.539358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.539900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.770555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:58.781158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5d85c0df-2ef3-4709-82b6-5a6613a5270a tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1494 microversion: 2.1 time: 0.309903 Oct 18 16:11:58.782217 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1333/2686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:58 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1494 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:58.798684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb3dfc7-b536-4532-b613-8ccb0ad449b3", "tag": "f83c1c15-79c0-49b5-8fc6-59d5e9ca1984"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:58.809770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.810291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.810718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.823296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] Creating event network-changed:f83c1c15-79c0-49b5-8fc6-59d5e9ca1984 for instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 on n-h1-858383-14 Oct 18 16:11:58.829120 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-754ae454-c9ad-4999-8743-f50399a7660b req-2ae052a8-0a32-4651-b592-99706dcdbd3f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044950 Oct 18 16:11:58.829890 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1334/2687] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:58.835948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:58.836652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:58.845654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.846259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.846747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:58.847655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:58.848676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:58.849141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:59.103375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:59.120787 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2eba7a6f-a322-4e36-90cc-686eb22028fe tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1484 microversion: 2.1 time: 0.288503 Oct 18 16:11:59.121067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1335/2688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:58 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1484 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:59.126564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1233396767", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b4a50421-5452-4e65-84ea-78b361222489"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:59.141302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:59.154906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f0b52ba-d746-4bef-9be2-cdf0cafd0a4b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1574 microversion: 2.1 time: 0.643322 Oct 18 16:11:59.177112 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1354/2689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:58 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1574 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:59.199167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:59.199747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:59.206879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:59.207444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:59.207903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:59.208585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:59.209052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:59.209646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:59.242118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] validate_networks() for [('b4a50421-5452-4e65-84ea-78b361222489', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:11:59.869594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:59.892965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cdb37edb-ba61-4976-9945-ba6647af10df tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1523 microversion: 2.1 time: 0.712259 Oct 18 16:11:59.894196 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1355/2690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:59 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1523 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:59.899278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-115801719", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "84cc8820-61f7-4324-8f37-b009daae6411"}, {"port": "d545d154-d29a-4721-974e-2346990757e0", "tag": "port-1"}, {"port": "0147223d-48b4-4d3c-b607-26ce497fc0bc", "tag": "port-2"}, {"uuid": "7f5596e5-6fbc-48ab-a21a-175b199740d4", "tag": "net-1"}, {"uuid": "7f5596e5-6fbc-48ab-a21a-175b199740d4"}, {"uuid": "6fd9b902-4902-419a-aac8-6a9488354f7e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6fd9b902-4902-419a-aac8-6a9488354f7e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2dd4e004-9131-4364-b2e9-e020e0fcc0a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e97f5ac7-5a11-43a9-90e2-f5949a2e916d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e0bf8256-4d36-4dc6-9cc3-d5ecc4d86b5c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--688378824"}], "key_name": "tempest-keypair-1320027980", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:00.004550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:00.005258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:00.005914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:00.006518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:00.007109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:00.038134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.038628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.039063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.039791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.040372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.040802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.087714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:00.097815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:00.138278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:00.143592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:00.169038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] validate_networks() for [('84cc8820-61f7-4324-8f37-b009daae6411', None, None, None, None, None), (None, None, 'd545d154-d29a-4721-974e-2346990757e0', None, None, None), (None, None, '0147223d-48b4-4d3c-b607-26ce497fc0bc', None, None, None), ('7f5596e5-6fbc-48ab-a21a-175b199740d4', None, None, None, None, None), ('7f5596e5-6fbc-48ab-a21a-175b199740d4', None, None, None, None, None), ('6fd9b902-4902-419a-aac8-6a9488354f7e', '10.2.2.100', None, None, None, None), ('6fd9b902-4902-419a-aac8-6a9488354f7e', '10.2.2.200', None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:12:00.242980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25d458cd-5d95-44d7-b417-ccccd60dd4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120729 Oct 18 16:12:00.252041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1336/2691] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:12:00.263662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:00.264325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:00.279213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.279946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.281741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.282629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.283244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.284039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.494208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:00.506769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e17589c-0be1-4f95-b2cb-40c06d85b9a8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.252615 Oct 18 16:12:00.521663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1337/2692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:00 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:00.527394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:00.528088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:00.535206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.536046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.536678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.537723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.538401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.539058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.725953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:00.737702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9cc760c1-4381-4ec0-9470-a9094589ec46 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1500 microversion: 2.1 time: 0.214967 Oct 18 16:12:00.738946 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1338/2693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:00 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1500 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:00.757861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:00.761443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:00.770961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.771768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.772708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.773640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.775218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.775856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.812051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.813050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.814179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.815588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lazy-loading 'fault' on Instance uuid 8119dd60-6ba9-466e-b2e1-94d8892fc406 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:00.886243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:00.894479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60288561-e370-4e40-802f-8fcdf4d26b9b tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1299 microversion: 2.1 time: 0.154076 Oct 18 16:12:00.895058 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1339/2694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:00 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:00.899529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:00.900135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:00.906717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.907392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.908245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:00.909093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:00.909907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:00.910370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.088045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:01.097509 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69c32ac0-7a76-4344-9e28-6fc33553df96 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1579 microversion: 2.1 time: 0.201422 Oct 18 16:12:01.098100 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1340/2695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:00 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:01.104396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:01.105107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:01.115581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.116097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.116614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.117434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.118036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.118537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.190988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:01.198798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dbbdb6d-50f4-4514-aeeb-d2119ab9ee40 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1211 microversion: 2.1 time: 0.099364 Oct 18 16:12:01.200477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1341/2696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:01 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:01.205997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:01.206383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:01.212415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.212902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.213367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.214068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.214562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.215134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.243791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:01.282454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:01.370555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8bb9f0c6-79d6-4629-9ffe-c7e1be2d48c5 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 204 len: 0 microversion: 2.1 time: 0.168760 Oct 18 16:12:01.374953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1342/2697] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:01 2022] DELETE /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:01.378594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8119dd60-6ba9-466e-b2e1-94d8892fc406", "name": "network-vif-deleted", "tag": "f37100fb-faf4-45fe-a847-3cce12c7a10e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:01.391576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.392066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.392496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.407730 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] Creating event network-vif-deleted:f37100fb-faf4-45fe-a847-3cce12c7a10e for instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 on n-h1-858383-14 Oct 18 16:12:01.412782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e4e879d2-649d-42d2-b3e8-64305026a894 req-fc59390d-c531-4295-9afa-790882991f57 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039937 Oct 18 16:12:01.413916 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1343/2698] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:01.418936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:01.419764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:01.427183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.427290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.427698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.428468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.431264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.431264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.953414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:01.971478 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bec7ac8-9888-4722-a9d7-ebb0bcc62b87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1508 microversion: 2.1 time: 0.556361 Oct 18 16:12:01.972069 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1344/2699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:01 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1508 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:01.977104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:01.977946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:01.984276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.985130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.985849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:01.986624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:01.987150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:01.987643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.223368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:02.232390 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-672117f3-1511-4c6b-a942-7ee4cd8cea41 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.259078 Oct 18 16:12:02.233193 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1345/2700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:01 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:02.254349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:02.255083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:02.260756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.261381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.261741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.262455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.262915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.263349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.469828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:02.484804 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99999ca7-b831-49a5-9dbb-dd2934721d0d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.237993 Oct 18 16:12:02.486768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1346/2701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:02 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:02.494232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:02.495042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:02.505990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.506675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.507662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.508470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.509047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.509572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.572591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.573227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.573773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.574425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lazy-loading 'fault' on Instance uuid 8119dd60-6ba9-466e-b2e1-94d8892fc406 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:02.637053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:02.645377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-213b1af7-3d9b-46cf-91d1-bbe40b1a26b7 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 200 len: 1299 microversion: 2.1 time: 0.157399 Oct 18 16:12:02.662709 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1347/2702] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:02 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:02.669413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:02.670047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:02.677747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.678244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.678695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.679410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.679868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.680298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.820713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:02.821316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:02.822192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:02.822693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:02.823355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:02.834961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.835834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.836378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.837284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:02.837835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:02.838563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:02.865518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Getting quotas for project 5daf1d849d91426d94f338ed22af5f9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:02.872096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Getting quotas for user 16bd1444400e47de84f0c1c15cc42c66 and project 5daf1d849d91426d94f338ed22af5f9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:03.032659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:03.048307 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21b2ed87-841a-4afa-9beb-317729b83eab tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 200 len: 1508 microversion: 2.1 time: 0.384369 Oct 18 16:12:03.048908 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1348/2703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:02 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:03.055561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:03.062906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.082068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.082880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.083549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.084426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.085540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.087883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.147369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:03.150432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2dd4e004-9131-4364-b2e9-e020e0fcc0a3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e97f5ac7-5a11-43a9-90e2-f5949a2e916d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0bf8256-4d36-4dc6-9cc3-d5ecc4d86b5c',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:03.448389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:03.464025 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f99d9e4e-7452-4ff9-bc8c-739e4fdb752b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1572 microversion: 2.1 time: 0.411301 Oct 18 16:12:03.466298 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1349/2704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:03 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1572 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:03.474179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:03.475027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.493260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.494080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.494679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.495706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.496320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.496923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.596212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:03.607495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7454b1fc-157d-4b0d-81c8-df161af7d823 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1267 microversion: 2.1 time: 0.138178 Oct 18 16:12:03.609173 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1350/2705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:03 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:03.617922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:03.619786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.631747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.632373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.633157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.633759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.634311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.634781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.656144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f0f5604-d35d-42c9-a087-222b1ae95703 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 3.760385 Oct 18 16:12:03.664044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1356/2706] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Oct 18 16:11:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 3766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:12:03.674730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:03.675390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.684127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.684768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.685409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.687428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.688312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.688429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:03.689115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.840843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-71fee4bd-911c-4ae8-8d04-5bd4d53edde4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 204 len: 0 microversion: 2.1 time: 0.229319 Oct 18 16:12:03.841728 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1351/2707] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:03 2022] DELETE /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:03.848468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-278170886"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:03.849187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.861934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.862538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.862935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.867104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.868518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.871234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.901965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:03.922465 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80926329-3ad4-4b31-90b7-fd1e211ae5f6 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.258808 Oct 18 16:12:03.962900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1357/2708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:03 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:03.971158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:03.971986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:03.983326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.984804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.985457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:03.986226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:03.986686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:03.987121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:04.208134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:04.217731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8ef50f1-9600-4dff-aeab-a634115f0be8 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.252464 Oct 18 16:12:04.219162 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1358/2709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:03 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:04.226815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:04.227761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:04.308972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Adding security group b6220f63-3728-4d70-9556-e186931fcc4b to port 22572460-8e2e-44dc-a813-b3ecee63c2e0 Oct 18 16:12:04.316962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:04.328722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:04.330312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:04.331715 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc48c0a1-bb04-4d7d-b355-dcd5b4d45167 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1285 microversion: 2.42 time: 0.109794 Oct 18 16:12:04.333460 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1359/2710] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:04 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:04.338190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:04.339676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 8119dd60-6ba9-466e-b2e1-94d8892fc406] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:04.351397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:04.351985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:04.352602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:04.353591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:04.354145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:04.354670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:04.370908 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] HTTP exception thrown: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Request method failure captured: Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 HTTP/1.1 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4blS7dsKYXMsUI1mxcvFnWQaFwxhA7lIO-7VKcUytlOklqdJYMYaIfsGYi_-e16hzvXqyzxWbN8vvflUh3ZAzg2TrMmDDWeZSDULrVvYPmHPHY-eHxbar03DHf_i-snhDMFSzL_vBQ1mNPc5d5-IvuAO-gA2UEDTIyYc0qyhPPaE0 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}] Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationTest-182807803 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationTest-182807803-project Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ab2aa9c224654cfbbc1559ed58556ad5 Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationTest-182807803-project Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '8119dd60-6ba9-466e-b2e1-94d8892fc406'} Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:04.372665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. Oct 18 16:12:04.376619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:04.378012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Returning 404 to user: Instance 8119dd60-6ba9-466e-b2e1-94d8892fc406 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:04.378947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a6c5a3e-4614-420d-8be2-5ca28ab244fd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406" status: 404 len: 111 microversion: 2.1 time: 0.044313 Oct 18 16:12:04.382746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1360/2711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:04 2022] GET /compute/v2.1/servers/8119dd60-6ba9-466e-b2e1-94d8892fc406 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:04.385337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1713268376", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "571d9adc-eb14-401c-8cde-5cdfbe7e93d2"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:04.454511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] validate_networks() for [('571d9adc-eb14-401c-8cde-5cdfbe7e93d2', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:12:05.013829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:05.015570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:05.016412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:05.016987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:05.017584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:05.029414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.030169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.030890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.032132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.032626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.033056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.053727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:05.059691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Getting quotas for user b7d816c3043c435d8bf79d2c819518ec and project b9650da009f3482f9fc67cacebd2e09e. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:05.078627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:05.081969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:05.136146 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3faaa3d6-1efd-441b-af78-450e01ea458d tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action" status: 202 len: 0 microversion: 2.1 time: 1.293079 Oct 18 16:12:05.137304 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1352/2712] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:12:03 2022] POST /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca/action => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:05.146033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.146751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:05.155298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1edba2b1-a828-4413-b457-71657fed742f tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771843 Oct 18 16:12:05.157651 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1361/2713] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:12:05.167176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.167670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.168113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.168833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.169325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.169756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.173646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.175495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:05.184662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.185371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.185980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.187823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.188507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.189183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.214827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:05.345435 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c6716cd-7e24-44dd-9eee-0dbd78c925bd tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 204 len: 0 microversion: 2.1 time: 0.203584 Oct 18 16:12:05.347734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:05.351588 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1353/2714] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:05 2022] DELETE /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:05.365869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.368043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:05.373126 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-046f0a8e-f766-487d-b3d7-54b16ab2b21e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1267 microversion: 2.1 time: 0.212468 Oct 18 16:12:05.374822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1362/2715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:05 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:05.383036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd163a820>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.386395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.386902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.387349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.388119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.389161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.389584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.544896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use.", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:05.545674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.545674 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b HTTP/1.1 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: exception: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b6220f63-3728-4d70-9556-e186931fcc4b'} Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:05.548257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 400 to user: Security Group b6220f63-3728-4d70-9556-e186931fcc4b in use. Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-21c01f15-4832-4b06-adb6-2caeba053825'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9fcc106-e96b-4aa9-907b-794c42599067 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b" status: 400 len: 185 microversion: 2.1 time: 0.173030 Oct 18 16:12:05.552480 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1363/2716] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:05 2022] DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b => generated 185 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:12:05.563224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca", "tag": "22572460-8e2e-44dc-a813-b3ecee63c2e0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:05.587697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.588478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.589168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.619517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] Creating event network-changed:22572460-8e2e-44dc-a813-b3ecee63c2e0 for instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca on n-h1-858383-14 Oct 18 16:12:05.630880 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b438bdb2-f816-43f9-8400-b3fcd8955d1d req-6ffe71f1-cc1c-4e68-9088-41b2db6d6446 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078133 Oct 18 16:12:05.633839 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1364/2717] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:05.645788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1535f47a-a286-4f08-9947-ce8aebcbeccd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.646516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1535f47a-a286-4f08-9947-ce8aebcbeccd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:05.841992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1535f47a-a286-4f08-9947-ce8aebcbeccd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:05.856972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1535f47a-a286-4f08-9947-ce8aebcbeccd tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1218 microversion: 2.1 time: 0.219889 Oct 18 16:12:05.873022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1365/2718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:05 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:05.873022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:05.874668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:05.890271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.893690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.895020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.896591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:05.899816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:05.900518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:05.978724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:05.992858 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-320d17e1-e7e2-47f9-8b83-64fa80de625c tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.638941 Oct 18 16:12:05.995197 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1354/2719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:05 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:06.002661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:06.003266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:06.042695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:06.045688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:06.046980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:06.047734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:06.054890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:06.055425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:06.916755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:06.965525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02fad6bc-8bc9-4915-bf54-a8b74ff092f3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 1.096037 Oct 18 16:12:06.966448 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1366/2720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:05 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:06.989642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:06.992424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:07.021929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.025401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.030818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.038977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.039824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.040314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.460479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:07.475715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:07.481376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:07.483004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-60b0fd9d-051a-4d36-b75a-6e90ec827743 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1593 microversion: 2.42 time: 0.513664 Oct 18 16:12:07.529679 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1367/2721] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:06 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1593 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:07.535338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:07.538257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:07.558604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.562408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.563546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.567384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.568130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.568806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.678647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:07.695081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:07.702808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:07.707018 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-994b2d98-6aff-446c-8ba4-1f310e86c8cb tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1500 microversion: 2.1 time: 1.708787 Oct 18 16:12:07.729533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1355/2722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:05 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1500 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:07.741040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:07.745897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:07.761628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.766398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.767368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.768436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.770162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.771262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.802497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:07.899521 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c998b9a-c015-4a90-9eec-1cbec556926e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 204 len: 0 microversion: 2.1 time: 0.366104 Oct 18 16:12:07.901394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1368/2723] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:07 2022] DELETE /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:07.915809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:07.916954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:07.953798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.954190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.954629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:07.955494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:07.955955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:07.956378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.190032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:08.200061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:08.207743 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-331130b2-cb12-4b7d-81ec-4ee5d73ccbc2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1288 microversion: 2.1 time: 0.304536 Oct 18 16:12:08.209518 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1369/2724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:07 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1288 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:08.216284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:08.218858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:08.228180 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1eb0e428-5e12-4fba-92da-f939252d204a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1273 microversion: 2.1 time: 0.496634 Oct 18 16:12:08.232403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1356/2725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:07 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:08.242256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:08.243263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.244279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.244887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.245926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.246523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.247159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.249868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:08.265450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.266241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.267451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.277563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.278511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.279305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.698262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:08.719718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e338311-140b-4133-ab8c-62e3213cd66f tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1506 microversion: 2.1 time: 0.508514 Oct 18 16:12:08.734629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1370/2726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:08 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:08.751638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:08.752487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:08.762501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.763104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.764590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:08.767123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:08.768452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:08.769129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.134256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.147010 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8ce27bc-f9e4-495e-9a82-8ce03420fbc3 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.404150 Oct 18 16:12:09.147405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.148211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1371/2727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:08 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:09.161358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:09.162182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:09.164782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf812f50-6c52-433a-b18a-a975b36c9b71 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1646 microversion: 2.1 time: 0.929268 Oct 18 16:12:09.175366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.176019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.176567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.177446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.189038 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1357/2728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:08 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1646 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:09.189300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.189300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.200347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:09.206834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:09.237271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.239368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.240356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.244477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.245111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.247538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.687633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.697506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2aa9c224654cfbbc1559ed58556ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ade5f58ea543ceb17c4bb5d230705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.714443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.717676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:09.722608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcb882c3-4181-442c-a876-88052cd9cd5c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1593 microversion: 2.42 time: 0.573104 Oct 18 16:12:09.725753 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1372/2729] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:09 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1593 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:09.739001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:09.740184 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49418ad3-03c8-46be-b55c-1a2c6aadddb3 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 200 len: 1458 microversion: 2.1 time: 0.559698 Oct 18 16:12:09.742787 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1358/2730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:09 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 1458 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:09.743421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:09.759330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:09.762037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:09.763648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.764145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.764664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.773897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.774395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.774859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.789846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.795614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.800567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:09.803504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:09.804293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:09.804595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.056956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:10.109407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:10.159934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:10.172549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-561a2b82-9a36-460d-8f27-7e4c4fcafd86 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1276 microversion: 2.1 time: 0.445201 Oct 18 16:12:10.175261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1373/2731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:09 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:10.189293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f83e7cd-4f18-4d1c-bda4-2980657a36da", "name": "network-vif-deleted", "tag": "1e1cbb5c-6cde-4417-b545-112b71dc740c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:10.223548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.227310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.229569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.281733 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] Creating event network-vif-deleted:1e1cbb5c-6cde-4417-b545-112b71dc740c for instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da on n-h1-858383-14 Oct 18 16:12:10.307608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9d81d5ab-b4f8-496e-9e96-fe3666501878 req-cd6ceeed-c371-42e8-bdb7-c2b004386df9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128175 Oct 18 16:12:10.309066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1374/2732] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:10.322111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0bf707-a16f-4450-ad9d-a3c9c701cde2", "name": "network-vif-deleted", "tag": "65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:10.356732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.358132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.372945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.416680 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] Creating event network-vif-deleted:65e7332b-9dc0-4ac1-bcde-0fcacafb2e4a for instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 on n-h2-858383-14 Oct 18 16:12:10.430739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-35c97dbf-070a-4098-b83c-bc792c57e60b req-a12d3d31-fe9d-4b34-ad53-c70fac76aca4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118596 Oct 18 16:12:10.433803 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1375/2733] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:10.457141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:10.477045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:10.506571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.508508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.510571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.512823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.514869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.516365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.603255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:10.624921 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0adc7b5-822a-4ad5-87de-1742bee1d833 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.874742 Oct 18 16:12:10.630173 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1359/2734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:09 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:10.646425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:10.657982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:10.674938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.676139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.676855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.679157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.679502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.680484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:10.681694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lazy-loading 'fault' on Instance uuid 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:10.687170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:10.697540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:10.703998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.121984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:11.138300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba287724-d5db-4528-8b47-5da8900654e4 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 200 len: 1304 microversion: 2.1 time: 0.700257 Oct 18 16:12:11.142346 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1376/2735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:10 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 1304 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:11.162466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:11.165693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:11.189578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.190062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.205776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.206697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.212719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.213316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.714369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:11.727137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-065a82fa-c076-4617-b43d-164845288458 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 1.093093 Oct 18 16:12:11.730062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1360/2736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:10 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:11.743035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:11.745957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:11.759999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.764353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.766053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.767063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.768736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.771622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.911861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:11.921724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-970c5b1e-640d-4cd1-a293-f556780218d4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1646 microversion: 2.1 time: 0.777341 Oct 18 16:12:11.933314 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1377/2737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:11 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1646 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:11.934772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:11.944205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] [instance: 1f83e7cd-4f18-4d1c-bda4-2980657a36da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:11.958904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.959412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.959857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:11.960588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:11.961092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:11.961531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:12.005941 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] HTTP exception thrown: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Request method failure captured: Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da HTTP/1.1 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs4blS7dsKYXMsUI1mxcvFnWQaFwxhA7lIO-7VKcUytlOklqdJYMYaIfsGYi_-e16hzvXqyzxWbN8vvflUh3ZAzg2TrMmDDWeZSDULrVvYPmHPHY-eHxbar03DHf_i-snhDMFSzL_vBQ1mNPc5d5-IvuAO-gA2UEDTIyYc0qyhPPaE0 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32ade5f58ea543ceb17c4bb5d230705f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32ade5f58ea543ceb17c4bb5d230705f"}]}] Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-LiveMigrationTest-182807803 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 32ade5f58ea543ceb17c4bb5d230705f Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-LiveMigrationTest-182807803 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-LiveMigrationTest-182807803-project Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ab2aa9c224654cfbbc1559ed58556ad5 Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-LiveMigrationTest-182807803-project Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1f83e7cd-4f18-4d1c-bda4-2980657a36da'} Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:12.011028 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] Returning 404 to user: Instance 1f83e7cd-4f18-4d1c-bda4-2980657a36da could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d476d5c2-d427-4a4e-beab-9341480f7601 tempest-LiveMigrationTest-182807803 tempest-LiveMigrationTest-182807803-project] 10.222.0.78 "GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da" status: 404 len: 111 microversion: 2.1 time: 0.084085 Oct 18 16:12:12.019376 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1378/2738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:11 2022] GET /compute/v2.1/servers/1f83e7cd-4f18-4d1c-bda4-2980657a36da => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:12.028818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb3dfc7-b536-4532-b613-8ccb0ad449b3", "name": "network-vif-plugged", "status": "completed", "tag": "f83c1c15-79c0-49b5-8fc6-59d5e9ca1984"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:12.047711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:12.048758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:12.049234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:12.078291 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] Creating event network-vif-plugged:f83c1c15-79c0-49b5-8fc6-59d5e9ca1984 for instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 on n-h1-858383-14 Oct 18 16:12:12.088015 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d99517d7-2af4-49d2-a83f-0958c7d90b11 req-ca878b12-34f7-493d-b4dc-a3abd0f8aacb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069697 Oct 18 16:12:12.089416 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1379/2739] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:12.096532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:12.097507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:12.104381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:12.106254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:12.106878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:12.107703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:12.108305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:12.109312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:12.726455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:12.748254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:12.750617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:12.760958 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-422a3cd3-e513-4d8b-bab9-ec5eef94d52f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1593 microversion: 2.42 time: 1.028409 Oct 18 16:12:12.764476 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1361/2740] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:11 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1593 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:12.953335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:12.954234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:12.960875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:12.961637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:12.962265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:12.963142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:12.963759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:12.964973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.005082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:13.031281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-caffc23b-fda4-4127-8d7b-cc74ca636276 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1276 microversion: 2.1 time: 0.939784 Oct 18 16:12:13.032231 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1380/2741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:12 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1276 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:13.037648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:13.039265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 2c0bf707-a16f-4450-ad9d-a3c9c701cde2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:13.052140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.052888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.053503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.056120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.056848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.057655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.075147 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] HTTP exception thrown: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Request method failure captured: Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 HTTP/1.1 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs-zWu5QIu5YPo35UHV2wwOWZRSqcJTrAECDF597PukJU99agMrNOx6SSWsaM6mg9ipSn0bfaQxfzEc55UWdYc6meJkEg8hdl5tHCrR6MVQYRmVSBX8t4GtawguzLMjnOPVU0wt9SRW401NcUSqaH5OTYbX12vBpWJd6CXX1-pCfuRs Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 65ac19ca0ab84dc7b0bcfad3962a33b5 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}] Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 65ac19ca0ab84dc7b0bcfad3962a33b5 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerRescueTestJSON-1465846213-project Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d31742926f754ebfb4914ea5f7269e7e Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerRescueTestJSON-1465846213-project Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2c0bf707-a16f-4450-ad9d-a3c9c701cde2'} Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:13.083762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. Oct 18 16:12:13.087634 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:13.089649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Returning 404 to user: Instance 2c0bf707-a16f-4450-ad9d-a3c9c701cde2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:13.090770 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fcc03c0-21b1-4fcb-b7f0-651a01cc3fc3 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2" status: 404 len: 111 microversion: 2.1 time: 0.057093 Oct 18 16:12:13.096029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1381/2742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:13 2022] GET /compute/v2.1/servers/2c0bf707-a16f-4450-ad9d-a3c9c701cde2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:13.103212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5", "name": "network-vif-deleted", "tag": "29b0af49-1b8e-4ae5-afca-8206160fa7c4"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:13.135719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.141704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.142471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.172981 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] Creating event network-vif-deleted:29b0af49-1b8e-4ae5-afca-8206160fa7c4 for instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 on n-h2-858383-14 Oct 18 16:12:13.179644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c59b4ca4-7457-4c73-87f9-46fe63f9902b req-d0d22b22-26ba-4ec0-924b-de61e6887bf8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081954 Oct 18 16:12:13.185072 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1382/2743] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:13.199124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:13.199842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:13.203134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:13.216273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.217080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.217731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.224921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.225698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.226297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.722717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:13.735951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc5d0825-00aa-48c4-896f-3d25c113759e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.549271 Oct 18 16:12:13.738484 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1383/2744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:13 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:13.747000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:13.750714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:13.768161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.769180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.770794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.772060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.774643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.775378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.852256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:13.853707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:13.856858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:13.857447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lazy-loading 'fault' on Instance uuid ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:13.962410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:13.969363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:13.983364 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a074993a-c5b0-4993-898b-8c36e85e08bd tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 1.216843 Oct 18 16:12:13.983804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41cc65ea-ee2e-4e5f-84a7-80c98952f1e6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1306 microversion: 2.1 time: 0.243881 Oct 18 16:12:13.984776 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1362/2745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:12 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:13.986597 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1384/2746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:13 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1306 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:13.997741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:13.999645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca", "name": "network-vif-deleted", "tag": "22572460-8e2e-44dc-a813-b3ecee63c2e0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:14.000542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:14.019004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.020271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.020967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.022232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.022701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.023132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.023579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.025042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.025897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.056085 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] Creating event network-vif-deleted:22572460-8e2e-44dc-a813-b3ecee63c2e0 for instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca on n-h1-858383-14 Oct 18 16:12:14.066871 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7b6b51f5-3426-401e-9c05-ccd2b8157ed9 req-ffeba640-f9c3-4461-b481-566854a64603 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078711 Oct 18 16:12:14.067321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:14.069648 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1385/2747] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:14.075847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:14.076842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:14.084877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.085678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.086329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.087210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.087833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.088560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.159986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:14.188980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42f8b4ff-e0e4-40aa-9873-49890950b960 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "DELETE /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 204 len: 0 microversion: 2.1 time: 0.201296 Oct 18 16:12:14.190045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1363/2748] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:13 2022] DELETE /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:14.217534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:14.219663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:14.228269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.229308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.229982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.231357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.232192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.232839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.471808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:14.502245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:14.507439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:14.510655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef092373-1bf0-4430-b6eb-3dcbb74fcfa9 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1660 microversion: 2.42 time: 0.439105 Oct 18 16:12:14.512890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1386/2749] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:14 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1660 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:14.525657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:14.527216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:14.542904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.546451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.549785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.550900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.551605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.554292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.894531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:14.911005 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-48562997-798a-460b-97c0-72a761f3baf0 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.715459 Oct 18 16:12:14.912575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:14.913488 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1364/2750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:14 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:14.934001 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9e64d6b-25c6-4ca1-a2f8-cb7317d6ea97 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1491 microversion: 2.1 time: 0.419554 Oct 18 16:12:14.934219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:14.938198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:14.953469 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1387/2751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:14 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1491 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:14.959004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.964713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.966051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:14.967041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:14.968292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:14.968978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.011096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:15.011722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:15.021338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.022141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.022787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.024192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.024861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.025542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.050667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:15.361160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:15.370091 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88b81a8b-4098-4d74-aa4e-47a44113721f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.363018 Oct 18 16:12:15.377387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1388/2752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:15 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:15.384266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:15.385862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:15.400387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.411334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.411792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.412544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.413028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.413473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.418106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:15.437240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:15.452617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8ccf9c5e-f891-475f-9170-5c987c893045 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1395 microversion: 2.1 time: 0.535670 Oct 18 16:12:15.453868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1365/2753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:14 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1395 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:15.487224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.487627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.488068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.488525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lazy-loading 'fault' on Instance uuid ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:15.548776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:15.553927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:15.570264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.571358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.572039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.574019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.575787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.577875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.584260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:15.593643 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-222b9dff-bd34-4016-b54d-31d563f40a8f tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1306 microversion: 2.1 time: 0.214663 Oct 18 16:12:15.596059 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1389/2754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:15 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:15.937406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:15.940046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:15.943474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=32 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:15.953457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.954364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.955033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:15.955977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:15.956647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:15.957672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.310277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:16.321405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a88f408-590d-4958-ab2f-809f6cf06bb3 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.389456 Oct 18 16:12:16.322953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1390/2755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:15 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:16.333451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:16.339561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:16.349086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.349925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.351541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.352515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.353219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.354250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.527773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:16.544202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:16.549356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:16.551472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eaef5dcd-7ebf-44db-9130-97a67e53629e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1660 microversion: 2.42 time: 1.011266 Oct 18 16:12:16.552613 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1366/2756] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:15 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1660 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:16.559765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25218f60-c04c-4c77-8eda-e8c2d4c5a116", "tag": "3a59b973-8e30-4ced-8cca-ac5297de0016"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:16.591281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.591885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.592855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.608224 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] Creating event network-changed:3a59b973-8e30-4ced-8cca-ac5297de0016 for instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 on n-h2-858383-14 Oct 18 16:12:16.616427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6ed612b1-2ee3-4b3a-90cc-ecee242a6cca req-262619c2-db7b-4949-9fb4-6ce07aca35a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061808 Oct 18 16:12:16.617680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1367/2757] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:16.625508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:16.626904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:16.637470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.637975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.639456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.640877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.641545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.644158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.861027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:16.873056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56d1761e-5388-4b17-b772-1ba91b76d8dd tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1491 microversion: 2.1 time: 0.548707 Oct 18 16:12:16.875731 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1391/2758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:16 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1491 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:16.893972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:16.894626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:16.911372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.915375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.915873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:16.916693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:16.917250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:16.922190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.167200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:17.177675 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09bc8f7c-ce8f-4099-b287-172e7dd2c17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.558541 Oct 18 16:12:17.178278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1368/2759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:16 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:17.182801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:17.183848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:17.195292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.196316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.197031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.197994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.198933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.199575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.243919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.244662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.245340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.246008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lazy-loading 'fault' on Instance uuid ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:17.393839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:17.408135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acaea41a-6bac-49b1-9668-be24ca571011 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 200 len: 1306 microversion: 2.1 time: 0.228798 Oct 18 16:12:17.408739 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1369/2760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:17 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:17.425554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ff65a2-174e-4934-b2f5-5a91bdf55118", "tag": "52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:17.435195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.435982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.436732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.461408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] Creating event network-changed:52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d for instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 on n-h1-858383-14 Oct 18 16:12:17.470340 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1ee66f5a-7431-43be-adc2-7e2aac8c82ff req-dfeb1f3c-ff76-43bb-8b2d-990a937c3288 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060223 Oct 18 16:12:17.471083 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1370/2761] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:17.476349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:17.486853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:17.500235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.500826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.501549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.502606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.503071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.506162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.837288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:17.857531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d1873b2-5a7a-48f4-bdfa-8d3c323e984a tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1574 microversion: 2.1 time: 0.980386 Oct 18 16:12:17.876103 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1392/2762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:16 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1574 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:17.890190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:17.890630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:17.904618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.905242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.905776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:17.912217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:17.916877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:17.917587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:18.216262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:18.220882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:18.241024 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5af28c5f-7be8-4477-9764-123cd69799c8 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.768460 Oct 18 16:12:18.241638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1371/2763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:17 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:18.255927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:18.256514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:18.277646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:18.278153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:18.278608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:18.279344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:18.279812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:18.280811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:18.526349 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e33f9b7a-2008-4ed6-9f03-e23541ad5449 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283390 Oct 18 16:12:18.527098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1372/2764] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:12:18 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:18.532849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:18.533508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:18.557687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:18.558190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:18.558643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:18.559387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:18.560057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:18.560663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:19.611294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:19.631037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:19.644170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:19.648932 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06056bff-1c02-4f4a-adc5-ab55c0004533 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1706 microversion: 2.42 time: 1.768164 Oct 18 16:12:19.650056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1393/2765] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:17 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1706 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:19.672620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:19.675493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:19.693513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:19.696934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:19.698641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:19.699699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:19.701641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:19.702301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:20.326292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:20.340606 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a0e79f8-fabf-4054-967b-f30fabc1a419 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1491 microversion: 2.1 time: 1.812528 Oct 18 16:12:20.341407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1373/2766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:18 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1491 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:20.348821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:20.354051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:20.373505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:20.374741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:20.375302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:20.376336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:20.377230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:20.378658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:20.409629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca HTTP/1.1 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca'} Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:20.413166 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:20.417829 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:20.420099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:20.425061 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d4f27ea-9a3d-4c5a-8776-3816f22e3357 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 404 len: 111 microversion: 2.1 time: 0.082233 Oct 18 16:12:20.425768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1374/2767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:20 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:20.438662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:20.439469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:20.452852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:20.459529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:20.460148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:20.461055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:20.461649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:20.467990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:20.624818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:20.637301 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c21a049-ca56-4dd4-a1aa-875920c87a8f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.981929 Oct 18 16:12:20.647895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1394/2768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:19 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:20.667889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-336f0572-5d1c-4f79-b0f2-33a355e2518e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd19abee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:20.991396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:21.017658 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e93123d5-85bd-420a-a2a4-6291b743c3da tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.590386 Oct 18 16:12:21.019337 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1375/2769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:20 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:21.027218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ccea9b-86b9-449a-af3e-998c97a3b737", "name": "network-vif-unplugged", "status": "completed", "tag": "c4356cab-e246-432a-a988-f639d5c40edc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:21.046215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.047137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.049588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.113268 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] Creating event network-vif-unplugged:c4356cab-e246-432a-a988-f639d5c40edc for instance 92ccea9b-86b9-449a-af3e-998c97a3b737 on n-h1-858383-14 Oct 18 16:12:21.124843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0080b916-800d-4136-a340-05a76a1aceca req-aec4a19a-415f-4b2b-b1de-9bd91014a87f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097921 Oct 18 16:12:21.126065 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1376/2770] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:21.131841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:21.137942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:21.149944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.150814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.151770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.153315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.154127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.154741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.812127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-336f0572-5d1c-4f79-b0f2-33a355e2518e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c" status: 202 len: 0 microversion: 2.1 time: 1.162748 Oct 18 16:12:21.814672 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1395/2771] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:20 2022] DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:21.821321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ccea9b-86b9-449a-af3e-998c97a3b737", "name": "network-vif-deleted", "tag": "c4356cab-e246-432a-a988-f639d5c40edc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:21.856429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.857304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.861314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.876769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] Creating event network-vif-deleted:c4356cab-e246-432a-a988-f639d5c40edc for instance 92ccea9b-86b9-449a-af3e-998c97a3b737 on n-h1-858383-14 Oct 18 16:12:21.884148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6107575e-d8a9-41fe-ac1f-f30c44a446a4 req-124d5cb9-5fa2-4a6d-a3b5-7623ef5d3610 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067976 Oct 18 16:12:21.885506 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1396/2772] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:21.894866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:21.896591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:21.904433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.905984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.907841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.908846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.909630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.910272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.933149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:21.946610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:21.953690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:21.956671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3ce9c07-217b-42ba-9dbf-4362294ab535 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1752 microversion: 2.42 time: 0.829290 Oct 18 16:12:21.965988 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1377/2773] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:21 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1752 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:21.973154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:21.979965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.980540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.981285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.981848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lazy-loading 'fault' on Instance uuid 92ccea9b-86b9-449a-af3e-998c97a3b737 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:21.982413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:21.990728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.995879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.996657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:21.997693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:21.998393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:21.999162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:22.070979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:22.082697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e45de9b2-185e-46d1-9d1c-b1331ec82d0e tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1304 microversion: 2.1 time: 0.192570 Oct 18 16:12:22.084399 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1397/2774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:21 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:22.096226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c96e1d26-f896-458f-a2b2-83a748dbb24e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd15e6160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:22.390829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:22.411772 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c7ad73f-8184-4b08-833f-f1f970e99cfc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.440992 Oct 18 16:12:22.418005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1378/2775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:21 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:22.427297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:22.431149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:22.442111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:22.444376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:22.445082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:22.446038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:22.446720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:22.447941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:22.779078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:22.799272 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f674fb92-539d-4721-91e8-55c117a15e87 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.379706 Oct 18 16:12:22.800277 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1379/2776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:22 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:22.805163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:22.805792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:22.820319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:22.820834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:22.821362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:22.822092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:22.822556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:22.822987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.158593 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c96e1d26-f896-458f-a2b2-83a748dbb24e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b" status: 202 len: 0 microversion: 2.1 time: 1.072168 Oct 18 16:12:23.159580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1398/2777] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:22 2022] DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:23.164382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb3dfc7-b536-4532-b613-8ccb0ad449b3", "tag": "f83c1c15-79c0-49b5-8fc6-59d5e9ca1984"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:23.180463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.181314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.181930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.205777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] Creating event network-changed:f83c1c15-79c0-49b5-8fc6-59d5e9ca1984 for instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 on n-h1-858383-14 Oct 18 16:12:23.219215 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-66be9dd9-b474-4022-9bc1-2ab177a3eee4 req-8dbadc4f-3261-407d-a3cc-f551e2c9741c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058239 Oct 18 16:12:23.220401 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1399/2778] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:23.227544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:23.229206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:23.238348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.239146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.239756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.244438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.245212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.245815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.346204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:23.365062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-35e70f1f-1348-4fe5-9983-62b7d4da6e79 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1574 microversion: 2.1 time: 0.563546 Oct 18 16:12:23.374274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1380/2779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:22 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1574 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:23.391300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:23.392362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:23.415528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.416103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.416553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.417299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.417763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.418658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.481301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.482090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.483813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.484564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lazy-loading 'fault' on Instance uuid 92ccea9b-86b9-449a-af3e-998c97a3b737 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:12:23.588885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31742926f754ebfb4914ea5f7269e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:23.611403 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4743033a-9fb4-4e99-b04d-3130c69c0535 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 200 len: 1304 microversion: 2.1 time: 0.219121 Oct 18 16:12:23.613564 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1381/2780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:23 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:23.642342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-775b3da7-e5c2-45ae-9b4b-23e0a33b7a0b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'create', calling method: .version_select at 0x7f5fd6408b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1884033345", "description": "tempest-description-1898270394"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:24.465395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:24.478320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:24.490961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:24.492956 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cbc9818-a7f3-4b51-b81d-26ef849628e2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1752 microversion: 2.42 time: 1.270814 Oct 18 16:12:24.493745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1400/2781] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:23 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1752 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:24.498523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:24.501833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:24.516072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.521041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.521735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.522676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.523516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.524143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.798828 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-775b3da7-e5c2-45ae-9b4b-23e0a33b7a0b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.180112 Oct 18 16:12:24.800227 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1382/2782] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:12:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:24.815457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:24.816583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:24.844231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.844748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.848715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.852398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.866793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.867976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.066621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:25.075245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49771106-323f-49d3-a0a1-e8fd64db8f51 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.580265 Oct 18 16:12:25.079567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1401/2783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:24 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:25.084601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25218f60-c04c-4c77-8eda-e8c2d4c5a116", "name": "network-vif-plugged", "status": "completed", "tag": "3a59b973-8e30-4ced-8cca-ac5297de0016"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:25.116937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.117724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.118319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.145573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] Creating event network-vif-plugged:3a59b973-8e30-4ced-8cca-ac5297de0016 for instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 on n-h2-858383-14 Oct 18 16:12:25.154276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a423741b-f001-4d1a-acad-e0f68689b628 req-ca1dc5ee-1fad-4aa0-902d-b0bf583e88fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073200 Oct 18 16:12:25.155903 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1402/2784] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:25.171198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:25.172512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] [instance: 92ccea9b-86b9-449a-af3e-998c97a3b737] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:25.206177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.207454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.218694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.219769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.220627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.220627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.264785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] HTTP exception thrown: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Request method failure captured: Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 HTTP/1.1 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs-zWu5QIu5YPo35UHV2wwOWZRSqcJTrAECDF597PukJU99agMrNOx6SSWsaM6mg9ipSn0bfaQxfzEc55UWdYc6meJkEg8hdl5tHCrR6MVQYRmVSBX8t4GtawguzLMjnOPVU0wt9SRW401NcUSqaH5OTYbX12vBpWJd6CXX1-pCfuRs Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 65ac19ca0ab84dc7b0bcfad3962a33b5 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65ac19ca0ab84dc7b0bcfad3962a33b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65ac19ca0ab84dc7b0bcfad3962a33b5"}]}] Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 65ac19ca0ab84dc7b0bcfad3962a33b5 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerRescueTestJSON-1465846213 Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerRescueTestJSON-1465846213-project Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d31742926f754ebfb4914ea5f7269e7e Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerRescueTestJSON-1465846213-project Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '92ccea9b-86b9-449a-af3e-998c97a3b737'} Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:25.266645 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] Returning 404 to user: Instance 92ccea9b-86b9-449a-af3e-998c97a3b737 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7a564ea-9d8f-4e75-81b4-ea553f509768 tempest-ServerRescueTestJSON-1465846213 tempest-ServerRescueTestJSON-1465846213-project] 10.222.0.78 "GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737" status: 404 len: 111 microversion: 2.1 time: 0.110926 Oct 18 16:12:25.271498 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1403/2785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:25 2022] GET /compute/v2.1/servers/92ccea9b-86b9-449a-af3e-998c97a3b737 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:25.294318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c003998-04e5-41b2-aad9-02e99e153795 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Action: 'update', calling method: .version_select at 0x7f5fd15e68b0>, body: {"security_group": {"name": "tempest-sg-hth-1505836179", "description": "tempest-description-hth-1320572034"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:25.322940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:25.364205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d1b7af1-497b-4f19-97c6-0d8f0a1b2a9c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.560463 Oct 18 16:12:25.368813 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1383/2786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:24 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:25.524615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:25.534702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:25.548616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.553703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.554503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.555416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.559265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.560149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.134915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:26.152244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:26.158359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:26.159606 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5441c07-f588-4588-abfa-348d7c5cd1e7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1798 microversion: 2.42 time: 0.639603 Oct 18 16:12:26.167953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1384/2787] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:25 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1798 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:26.177566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:26.185065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:26.196363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.196853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.201483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.204951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.209576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.210044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.580674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c003998-04e5-41b2-aad9-02e99e153795 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d" status: 200 len: 218 microversion: 2.1 time: 1.294278 Oct 18 16:12:26.582183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1404/2788] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Oct 18 16:12:25 2022] PUT /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d => generated 218 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:26.586923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:26.587795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:26.602139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.602913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.603538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.604456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.605102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.605688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.625631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:26.635463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1836ccf4-ec3e-4c01-aac7-91c0b320ebd5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1315 microversion: 2.1 time: 0.466413 Oct 18 16:12:26.636728 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1385/2789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:26 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:26.643257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f952b1a3-8068-442f-977e-e4723852317e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd652e310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:27.054151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:27.067955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb4375c9-6459-4950-9fa0-872c3b4be0dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.484537 Oct 18 16:12:27.070391 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1405/2790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:26 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:27.106715 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f952b1a3-8068-442f-977e-e4723852317e tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d" status: 200 len: 218 microversion: 2.1 time: 0.468451 Oct 18 16:12:27.109037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1386/2791] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:12:26 2022] GET /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d => generated 218 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:27.123565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2694f23-00a7-4a6b-b907-dfcefe533f38 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd15e6670>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:27.187237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:27.187873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:27.194211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:27.194639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:27.195260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:27.196132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:27.196748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:27.197367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:27.479491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:27.490778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:27.499225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:27.500761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f684761b-875d-44f3-863e-eae69cccc90f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1798 microversion: 2.42 time: 0.317966 Oct 18 16:12:27.504043 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1387/2792] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:27 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1798 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:27.665593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:27.666279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:27.678541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:27.681323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:27.683644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:27.687752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:27.688491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:27.689704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.108525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:28.121356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7a85917-aefa-4a97-bade-86ddd1e1008d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1501 microversion: 2.1 time: 0.459408 Oct 18 16:12:28.122458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1388/2793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:27 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1501 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:28.127758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:28.133759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:28.144452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.147113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.147302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.150094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.150443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.152968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.406568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2694f23-00a7-4a6b-b907-dfcefe533f38 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d" status: 202 len: 0 microversion: 2.1 time: 1.286736 Oct 18 16:12:28.407222 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1406/2794] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:27 2022] DELETE /compute/v2.1/os-security-groups/08019201-59be-40cc-8ff7-6e510ac0b71d => generated 0 bytes in 1288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:28.412529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:28.427000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.431955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.432637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.437318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:28.449007 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a0f4f08c-d666-4cb9-98fc-41f7cb352c54 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.325286 Oct 18 16:12:28.449930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1389/2795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:28 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:28.471054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ff65a2-174e-4934-b2f5-5a91bdf55118", "name": "network-vif-plugged", "status": "completed", "tag": "52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:28.480481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:12:28.493482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.493968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.494403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.510295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] Creating event network-vif-plugged:52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d for instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 on n-h1-858383-14 Oct 18 16:12:28.531663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ba8f333-3c3a-4015-8694-aa0f6abb0b72 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116/action" status: 202 len: 0 microversion: 2.1 time: 0.122498 Oct 18 16:12:28.532494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9d1b9bd5-a642-487d-973b-4d61c8c29149 req-f7124968-4fd4-4571-ac25-4b2e77c484e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080142 Oct 18 16:12:28.536817 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1407/2796] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:12:28 2022] POST /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:28.539567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:28.540400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:28.541545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1390/2797] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:28.551360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.551702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:28.552487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:28.552665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.553403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.554392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.555074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.555741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.570084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.570610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.571062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.571795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.572258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.572691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.576155 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca HTTP/1.1 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca'} Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:28.579067 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:28.583444 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.585049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:28.586127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c66b7364-7338-46b4-bce0-725581bafd7c tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 404 len: 111 microversion: 2.1 time: 0.051849 Oct 18 16:12:28.587199 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1408/2798] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:28 2022] DELETE /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:28.594357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:28.595218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:28.601779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.602544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.603138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.604024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.604632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.605238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.973746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:28.984181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:28.993550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:28.994961 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff25958a-27b3-4851-a803-3651db12898c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1844 microversion: 2.42 time: 0.452228 Oct 18 16:12:29.002299 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1391/2799] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:28 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1844 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:29.007346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.007959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:29.022282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.024201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.024201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.024201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.024508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.024808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.060053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca HTTP/1.1 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca'} Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.073175 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Instance ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.079225 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70811180-0683-40ae-8134-2945d50bc4fc tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca" status: 404 len: 111 microversion: 2.1 time: 0.071307 Oct 18 16:12:29.079890 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1392/2800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:29 2022] GET /compute/v2.1/servers/ea44bf8f-9fdf-435a-98a1-9fc5e7ea42ca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.084247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd64c2940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.122780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:29.135074 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55feab83-8e17-45a5-9342-a446a76fd4f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.544880 Oct 18 16:12:29.136986 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1409/2801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:28 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:29.222518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.223020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group b6220f63-3728-4d70-9556-e186931fcc4b not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.223919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.223919 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b HTTP/1.1 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b6220f63-3728-4d70-9556-e186931fcc4b'} Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.226143 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] Oct 18 16:12:29.229772 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.237944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group b6220f63-3728-4d70-9556-e186931fcc4b does not exist Oct 18 16:12:29.237944 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-2625160a-abd7-41f5-83fc-c525a4125a70'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.239202 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-580d8cae-84a3-4aef-8607-50796e4208ec tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b" status: 404 len: 194 microversion: 2.1 time: 0.158949 Oct 18 16:12:29.243146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1393/2802] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/b6220f63-3728-4d70-9556-e186931fcc4b => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.252447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd160d430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.410999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.412361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c not found {{(pid=120571) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.413155 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.413155 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c HTTP/1.1 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: exception: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9d3cf815-7cde-4748-bc22-0325ae87cd4c'} Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.415545 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] Oct 18 16:12:29.419160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.432622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group 9d3cf815-7cde-4748-bc22-0325ae87cd4c does not exist Oct 18 16:12:29.432622 n-d-858383-14 devstack@n-api.service[120571]: Neutron server returns request_ids: ['req-35196d0b-fced-4834-9194-dbe7765723ce'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.433910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68efb8aa-612d-4d93-ab61-29d4d6ccc820 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c" status: 404 len: 194 microversion: 2.1 time: 0.189378 Oct 18 16:12:29.439005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1410/2803] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/9d3cf815-7cde-4748-bc22-0325ae87cd4c => generated 194 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.444236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd64fed30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.472578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.473371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:29.484292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.486868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.487569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.491713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.492482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.493252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.569281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.570439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.571121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.571121 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d HTTP/1.1 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b27fa12d-801e-40d3-aec1-bfe2963c4d2d'} Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.573250 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] Oct 18 16:12:29.577428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.582449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group b27fa12d-801e-40d3-aec1-bfe2963c4d2d does not exist Oct 18 16:12:29.582449 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-9421fc50-92f8-4b5c-b18e-f0fb57e2b61a'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.583657 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ebef0799-5b6a-4f68-abc2-0a27bd328c3b tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d" status: 404 len: 194 microversion: 2.1 time: 0.143643 Oct 18 16:12:29.585939 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1394/2804] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/b27fa12d-801e-40d3-aec1-bfe2963c4d2d => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.595574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd2a7e4c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.644519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.645575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group 5296190c-1522-45c7-ba85-564e9b4747d7 not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.646291 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.646291 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7 HTTP/1.1 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5296190c-1522-45c7-ba85-564e9b4747d7'} Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.648434 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] Oct 18 16:12:29.651991 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.656970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group 5296190c-1522-45c7-ba85-564e9b4747d7 does not exist Oct 18 16:12:29.656970 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-aed157bc-edb2-47e7-936d-14641fed71bd'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.658124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a42b0db8-3ec8-427e-8ea4-f3136a33f6b8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7" status: 404 len: 194 microversion: 2.1 time: 0.069768 Oct 18 16:12:29.659216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1395/2805] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/5296190c-1522-45c7-ba85-564e9b4747d7 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.672075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd645eca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.803322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.804339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group 507b9e25-7f7e-4690-ad37-9195cb1df48f not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.805769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.805769 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f HTTP/1.1 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '507b9e25-7f7e-4690-ad37-9195cb1df48f'} Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.809281 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] Oct 18 16:12:29.814037 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.821306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group 507b9e25-7f7e-4690-ad37-9195cb1df48f does not exist Oct 18 16:12:29.821306 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-542482fa-f02c-4b68-950e-c6d12b326291'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.822612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81add31b-cc53-44ac-af7d-10cbf81f8044 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f" status: 404 len: 194 microversion: 2.1 time: 0.159016 Oct 18 16:12:29.823707 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1396/2806] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/507b9e25-7f7e-4690-ad37-9195cb1df48f => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:12:29.833006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd6330af0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.876606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG neutronclient.v2_0.client [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist", "detail": ""}} {{(pid=120570) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:12:29.877314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.security_group_api [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Neutron security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa not found {{(pid=120570) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 16:12:29.878115 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.878115 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa HTTP/1.1 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: exception: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ae23b8b3-2608-473d-bb01-002fb6ebc3aa'} Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:12:29.880095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Security group ae23b8b3-2608-473d-bb01-002fb6ebc3aa does not exist Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: Neutron server returns request_ids: ['req-5c4bacd1-a12a-4fb3-b3c0-5f47c4c035a9'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:29.883881 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c8e3e92-5e32-4f40-93fb-67c71ae342f3 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa" status: 404 len: 194 microversion: 2.1 time: 0.053145 Oct 18 16:12:29.886277 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1397/2807] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/os-security-groups/ae23b8b3-2608-473d-bb01-002fb6ebc3aa => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:29.894086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:29.894593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:29.911876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.912622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.917355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.918377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:29.919124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:29.919917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:29.927256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:30.009943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:30.133945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:30.152281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-889b9be1-e898-4de9-88ab-3685316d83dc tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1318 microversion: 2.1 time: 0.681172 Oct 18 16:12:30.156545 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1411/2808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:29 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:30.191632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:30.194630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:30.229605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.234010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.234537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:30.235308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.235779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.236214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:30.261467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5985169f-c392-4bf0-bd9a-3649d9be1374 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 204 len: 0 microversion: 2.1 time: 0.369581 Oct 18 16:12:30.263130 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1398/2809] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:29 2022] DELETE /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:30.296296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:30.298142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:30.334681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.341621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.342184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:30.355531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.356419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.356868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:30.364747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:30.786608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:30.796719 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9512381-48cb-4f37-898d-4c03793ae47d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.526677 Oct 18 16:12:30.799948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1399/2810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:30 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:30.813199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:30.813741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:30.842089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.845752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.849469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:30.850700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:30.851370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:30.852494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:31.121250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:31.150663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:31.152674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:31.155272 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f5ad37f-e0bc-4bd6-a32f-138bb254beea tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1844 microversion: 2.42 time: 0.996085 Oct 18 16:12:31.171333 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1412/2811] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:30 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1844 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:31.178047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:31.185486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:31.200260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:31.202304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:31.208114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:31.209137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:31.209641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:31.210413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:31.447254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:31.458023 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5822acd2-3092-4661-b883-60e5e10a1cf8 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1647 microversion: 2.1 time: 0.656770 Oct 18 16:12:31.477221 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1400/2812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:30 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1647 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:31.826022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:31.827448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:31.838585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:31.845824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:31.846273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:31.847025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:31.847477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:31.848088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.032105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:32.041070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90d2939d-87fb-468a-95cd-dbdc3e45251b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.218873 Oct 18 16:12:32.054165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1401/2813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:31 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:32.197445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:32.198101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:32.212461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.213250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.213885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.214775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.215415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.216021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.671495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:32.694517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:32.701419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:32.703879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7acc985-e089-463f-a754-3788753c5350 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1844 microversion: 2.42 time: 0.510356 Oct 18 16:12:32.718110 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1402/2814] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:32 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1844 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:32.723252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:32.723959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:32.742479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.750817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.751411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.752424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.753901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.758639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.862644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:32.886631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1afa2246-be2d-4efe-8540-54aac951bd41 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1508 microversion: 2.1 time: 1.713565 Oct 18 16:12:32.887522 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1413/2815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:31 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1508 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:32.912380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:32.913290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:32.923042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.923809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.924413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:32.925530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:32.926146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:32.926903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:33.159598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:33.175229 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0a75854b-c300-4a9e-b52d-c813c13513b4 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1647 microversion: 2.1 time: 0.455864 Oct 18 16:12:33.189021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1403/2816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:32 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1647 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:33.189021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:33.189021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:33.215489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:33.215986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:33.216426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:33.217701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:33.218316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:33.218845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:33.480481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:33.491464 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7826fdeb-3d11-40d0-bf9e-5486e8916cf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.313990 Oct 18 16:12:33.492637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1404/2817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:33 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:33.759500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:33.760642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:33.787802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:33.789914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:33.790879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:33.796957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:33.800003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:33.801419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.003433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:34.027699 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b26bfbf-2fe3-45ae-89b6-ebbe96ad841c tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1508 microversion: 2.1 time: 1.119268 Oct 18 16:12:34.029056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1414/2818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:32 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1508 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:34.052234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:34.056345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:34.064529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.065397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.066068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.067022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.067692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.068351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.117963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:34.133202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:34.135463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:34.136869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6943933e-b501-45bd-956e-e85eb6f92e64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1844 microversion: 2.42 time: 0.385354 Oct 18 16:12:34.155940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1405/2819] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:33 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1844 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:34.190211 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b32a5c05-ce63-4ec8-8ab4-1a78bde2ee96 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "PUT /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1080 microversion: 2.1 time: 0.141793 Oct 18 16:12:34.203513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "d69b5074-0fd6-4391-9702-d54fc28d744e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:34.223347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1415/2820] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:12:34 2022] PUT /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1080 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:34.231928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:34.233136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:34.241942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.243267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.243887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.245550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.246023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.246176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.246752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.247395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.261740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.278385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] Creating event network-changed:d69b5074-0fd6-4391-9702-d54fc28d744e for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:34.290489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-31b4f1ef-e6e7-4350-9cc5-096a91da4007 req-ed7d3e04-066e-4f03-ab83-e31ab8c24ea5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100904 Oct 18 16:12:34.294034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1406/2821] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:34.306698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:34.315733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:34.335326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.339707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.340374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.341333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.341942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:34.346993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:34.955861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:34.977869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ef3ddb5-009b-4c29-965d-6c01fc2c7af4 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1506 microversion: 2.1 time: 0.682376 Oct 18 16:12:34.979070 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1407/2822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:34 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:34.984437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:34.985317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:34.994630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:34.999731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.000426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.001365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:35.001987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.002673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.122546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2a4c2cd88304000a7277caf5bb29ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:35.138680 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-733736c0-0e81-42a5-946e-8118826ab3bd tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 200 len: 1647 microversion: 2.1 time: 0.911617 Oct 18 16:12:35.141839 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1416/2823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:34 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 1647 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:35.172054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:35.176891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:35.199920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:35.202101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.207274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.208333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:35.209029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.209811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.333415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:35.359158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cf02bf4-0e4d-4094-b747-f31db1d23d56 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.375747 Oct 18 16:12:35.361830 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1408/2824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:34 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:35.373758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:35.374782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:35.396136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:35.400187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.400798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.401776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:35.402534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:35.403151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:35.698120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:35.711224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:35.713658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:35.715116 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c97b83b-eb79-4f3c-8168-07f7ca13e7ee tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1844 microversion: 2.42 time: 0.351364 Oct 18 16:12:35.729455 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1409/2825] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:35 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1844 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:36.021193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:36.033875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-026e245b-312d-493b-bd76-3d5b80652671 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1506 microversion: 2.1 time: 0.886532 Oct 18 16:12:36.035246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1417/2826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:35 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1506 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:36.059905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:36.070566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:36.084235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.084801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.085329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.086362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.086817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.087419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.171830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:36.173068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] [instance: b01b82ae-ae99-44b7-b198-2c5a8a8bf60d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:36.184273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.185149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.186983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.188500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.189560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.189970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.192205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23c245c8-6d0b-46d7-a146-01b95f28a5e9 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "PUT /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1082 microversion: 2.1 time: 0.136029 Oct 18 16:12:36.193377 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1410/2827] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:12:36 2022] PUT /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1082 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:36.224656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:36.224952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] HTTP exception thrown: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. Oct 18 16:12:36.226309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Request method failure captured: Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d HTTP/1.1 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs_0nWxD9JYFAS8iJhipJHrvMk85w6CV2q2nMPZDqlSf_DdC9OeKOD2sIt5QTHpkvl_Gek_Uv06_UFYnBJnIWFRx5Vj_DWvJdoBfhX-pwyeM6I277lB4nnksy4NNmhR4LETY8Bk6Uuu80M_LIK7AIKmv78lJVwceLecblvhCC11Ma14 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_24dd02df7fd44c1fbe5df55e6ccde4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/24dd02df7fd44c1fbe5df55e6ccde4ee"}]}] Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 24dd02df7fd44c1fbe5df55e6ccde4ee Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2073890447 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c2a4c2cd88304000a7277caf5bb29ed6 Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-SecurityGroupsTestJSON-2073890447-project Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b01b82ae-ae99-44b7-b198-2c5a8a8bf60d'} Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:36.226882 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. Oct 18 16:12:36.231873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:36.234850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.234994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Returning 404 to user: Instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:36.235347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.235785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.236325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40dc8a45-e31f-47dc-881c-4768e478ebbb tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d" status: 404 len: 111 microversion: 2.1 time: 0.071895 Oct 18 16:12:36.236491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.236946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.237419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.238012 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1418/2828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:36 2022] GET /compute/v2.1/servers/b01b82ae-ae99-44b7-b198-2c5a8a8bf60d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:12:36.262041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0bbc3cd-b463-4c9c-bd10-6e20203b6cd6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd1615af0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:36.397524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:36.407158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-410ceeda-a27a-4f38-90e8-278447bd194b tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1508 microversion: 2.1 time: 0.188588 Oct 18 16:12:36.408510 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1411/2829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:36 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:36.414200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01b82ae-ae99-44b7-b198-2c5a8a8bf60d", "name": "network-vif-deleted", "tag": "f05dd803-7698-4cad-9a31-be4970debf76"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:36.426293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.426947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.427357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.440956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] Creating event network-vif-deleted:f05dd803-7698-4cad-9a31-be4970debf76 for instance b01b82ae-ae99-44b7-b198-2c5a8a8bf60d on n-h2-858383-14 Oct 18 16:12:36.447413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1ba67004-f738-4cec-802e-3dae3d014cc5 req-e89b173b-45b6-420e-a390-736df91c9383 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037435 Oct 18 16:12:36.448418 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1412/2830] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:36.454835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:36.455659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:36.457788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:36.465446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.466022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.466535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.467430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:36.467893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:36.468395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:36.971667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:36.978083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:36.988376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a6378df-dc84-47f4-ba7a-ee99abcca56f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.538666 Oct 18 16:12:36.989702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1413/2831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:36 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:37.002833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.003485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:37.012554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.013072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.014853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.015827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.016467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.016902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.183841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:37.194194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3df2bb5e-533a-45e3-94c0-b13f8585e137 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1508 microversion: 2.1 time: 0.203118 Oct 18 16:12:37.197293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0bbc3cd-b463-4c9c-bd10-6e20203b6cd6 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/04f24a2b-eb1e-41f1-96b4-51e64ca101de" status: 202 len: 0 microversion: 2.1 time: 0.952749 Oct 18 16:12:37.198176 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1419/2832] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:36 2022] DELETE /compute/v2.1/os-security-groups/04f24a2b-eb1e-41f1-96b4-51e64ca101de => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:37.204289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.205027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:37.207778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1414/2833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:36 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:37.215614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d8ec8f4-6b30-4deb-89fd-60e966ee1561 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] Calling method '.version_select at 0x7f5fd279c5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.218339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.221261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.221928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.222825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.223521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.225508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.513031 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d8ec8f4-6b30-4deb-89fd-60e966ee1561 tempest-SecurityGroupsTestJSON-2073890447 tempest-SecurityGroupsTestJSON-2073890447-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/1220132e-2b85-4735-a975-23ddecd635ef" status: 202 len: 0 microversion: 2.1 time: 0.303910 Oct 18 16:12:37.515341 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1415/2834] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:12:37 2022] DELETE /compute/v2.1/os-security-groups/1220132e-2b85-4735-a975-23ddecd635ef => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:37.523698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.524465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:37.540611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.541543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.543482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.548031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.548543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.549050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.627730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:37.811737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42368a71-64ca-4cf9-a67b-ae27ccdb88f2 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 204 len: 0 microversion: 2.1 time: 0.294352 Oct 18 16:12:37.813054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1416/2835] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:37 2022] DELETE /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:37.847770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:37.868239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:37.869948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:37.871154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e984f09-8e66-46b6-9a28-2046afd2d266 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1853 microversion: 2.42 time: 0.671832 Oct 18 16:12:37.871729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1420/2836] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:37 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1853 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:37.893294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.893793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:37.918397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.918896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.919335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.920044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.920753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.921343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.979034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:38.067929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Instance is already in deleting state, ignoring this request Oct 18 16:12:38.069414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9e12824-3c1d-47cc-9b58-6b0f98e51731 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 204 len: 0 microversion: 2.1 time: 0.196476 Oct 18 16:12:38.070453 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1421/2837] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:37 2022] DELETE /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:38.075738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:38.077252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:38.098800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.099314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.099763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.100472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.100931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.101592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.185502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31669a3c-bd61-49e5-b964-d5c09d1f6f6f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Action: 'create', calling method: .version_select at 0x7f5fd1fb2940>, body: {"keypair": {"name": "tempest-keypair-286292537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzP1F8riIoDMIUtAo/jOQQVv6xj+YVAFfUFv6lzCRIlFh4niYX1t5Fwr7FR2dZexceFMpao1m9Nxr5o6qu6Bc1HXuYzU1hHqqdA6VM2cH6c28Ivdtgfgd75uQptgYPVBQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:38.205300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-31669a3c-bd61-49e5-b964-d5c09d1f6f6f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:38.214132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-31669a3c-bd61-49e5-b964-d5c09d1f6f6f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for user 5bd4aa75ffc54e5f840a70d8a901da15 and project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:38.245749 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31669a3c-bd61-49e5-b964-d5c09d1f6f6f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.431066 Oct 18 16:12:38.246998 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1417/2838] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:12:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:38.258444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:38.259680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:38.268519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.269300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.269993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.270870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.271714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.272913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.332555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:38.340488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a89fd39-0844-4ed0-bd91-b7369ce3c0ad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.268683 Oct 18 16:12:38.341084 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1422/2839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:38 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:38.437034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1663200212", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:38.518196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:12:38.722237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:38.735293 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c301d7b6-1e8a-42cf-8809-3921c7ee2198 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1514 microversion: 2.1 time: 0.486902 Oct 18 16:12:38.736198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1418/2840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:38 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:38.767207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "d545d154-d29a-4721-974e-2346990757e0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:38.780535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.781274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.781919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.802985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] Creating event network-changed:d545d154-d29a-4721-974e-2346990757e0 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:38.812685 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-349e2cad-8b62-49f5-9b35-bdcdeeed1dc6 req-9d8888f5-aaf7-4d58-9746-7390e71cd903 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058715 Oct 18 16:12:38.815346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1419/2841] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:38.906535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:38.910002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:38.917784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.918689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.919390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:38.920430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:38.921157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:38.921957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.162996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:39.164175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:39.164856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:39.165872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:39.167241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:39.191144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.192823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.193525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.194836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.196396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.197094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.226627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:39.234250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:39.257075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:39.264982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:39.342651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:39.354270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:39.361898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:39.370891 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a43c9cf9-ef36-4bba-a6f3-3e39ec4f1479 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996814 Oct 18 16:12:39.377053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a04bf08d-7261-4cc0-ad48-ee434f72c883 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1853 microversion: 2.42 time: 0.477975 Oct 18 16:12:39.377662 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1420/2842] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:38 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1853 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:39.382443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1423/2843] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:12:39.391824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:39.392416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:39.398591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8866d95-68c2-47e6-b28b-47fcc5a92811 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:39.401878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8866d95-68c2-47e6-b28b-47fcc5a92811 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:39.424968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.425498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.425948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.431142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.431825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.432540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.589051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8866d95-68c2-47e6-b28b-47fcc5a92811 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:39.602895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8866d95-68c2-47e6-b28b-47fcc5a92811 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1213 microversion: 2.1 time: 0.215894 Oct 18 16:12:39.619418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1424/2844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:39 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:39.765404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:39.766043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:39.781935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.783965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.784452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:39.785233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:39.788730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:39.789853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:40.003695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:40.013679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-495f2e49-78cb-4f30-982e-8276c94acdb8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.634954 Oct 18 16:12:40.018044 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1421/2845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:39 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:40.405612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:40.406607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:40.422743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:40.424385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:40.425632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:40.426396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:40.426871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:40.427315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:40.731711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:40.742963 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a6223db-d18c-4361-8f42-d456f32199b1 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1514 microversion: 2.1 time: 0.982082 Oct 18 16:12:40.762472 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1425/2846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:39 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1514 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:40.776888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:40.778005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:40.787943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:40.788804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:40.789494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:40.790537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:40.791243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:40.791956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.149465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.161517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56992a30-775f-439e-a2ca-31948d1a9e43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1265 microversion: 2.1 time: 0.392798 Oct 18 16:12:41.164112 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1426/2847] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:40 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:41.178422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:41.179046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:41.204078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.206085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.207899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.210010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.210412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.212202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.218772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.241206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.242787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.243835 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c10d74c2-7e97-4e46-a28a-ba883129cb18 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1853 microversion: 2.42 time: 0.844376 Oct 18 16:12:41.251301 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1422/2848] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:40 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1853 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:41.770551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:41.771402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:41.784730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.785558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.786729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.787815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.788919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.789661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.888814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.903899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ec5b2dd-57c8-433a-a3fd-2f28b11ab585 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.738480 Oct 18 16:12:41.909710 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1427/2849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:41 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:42.047577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ff65a2-174e-4934-b2f5-5a91bdf55118", "name": "network-vif-deleted", "tag": "52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:42.101548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:42.116495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.117260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.117866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.165239 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] Creating event network-vif-deleted:52cbbc92-cd1c-4b48-ab5f-ccf07ea03a7d for instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 on n-h1-858383-14 Oct 18 16:12:42.217191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b3849048-551d-4e16-9998-72172d5a2dfb req-dbbf8eb8-af1c-4da2-9e92-43db261a4f33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178226 Oct 18 16:12:42.219039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1428/2850] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:12:42.228472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:42.229235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:42.255945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.256403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.256860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.259971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.265410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.267786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.583385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:42.594796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-131c4676-6bbf-47af-8655-ca591871d694 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1271 microversion: 2.1 time: 0.374413 Oct 18 16:12:42.599746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1429/2851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:42 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:42.599843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d816c3043c435d8bf79d2c819518ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9650da009f3482f9fc67cacebd2e09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:42.602978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:42.604492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:42.613897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.614671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.615328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.617052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.618100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.618613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.622301 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84f3c822-fba1-4855-81da-73866bf98b46 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 200 len: 1472 microversion: 2.1 time: 0.842874 Oct 18 16:12:42.622993 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1423/2852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:41 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 1472 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:42.968326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:42.971722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:42.990832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.991956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.992948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.997100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.997903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.999268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.059462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.085525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.091973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.093925 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b1dfcd00-514f-46a5-a498-1eeaf094f004 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.496745 Oct 18 16:12:43.095988 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1430/2853] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:42 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:43.371613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.382765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2da9b185-f747-47af-ba0c-e1b800c75cc5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.448383 Oct 18 16:12:43.383686 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1424/2854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:42 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:43.621589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.622607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.634546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.635541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.636032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.654233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.654935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.655601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.659078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.661393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 01ff65a2-174e-4934-b2f5-5a91bdf55118] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.670964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.671906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.673343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.674859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.676717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.677795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.694836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:43.709870 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] HTTP exception thrown: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Request method failure captured: Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 HTTP/1.1 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs-hsb_ILc2MAhLAbSgYlaWfIGOL3UVLcdcgXzyWPlEln5ElUXT-PBwSTCrVuiR3NNLjUfFw0Dpm_NrIHWk0OEvPhONV1p2wEcvsmJ_PgzvLKjIX48BZqKAB-Lver5Sv6o9FvxQmXoltDLBeLzNrH-njC135sPR0D7P3GhtKRZzrJp0 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}] Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: b7d816c3043c435d8bf79d2c819518ec Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '01ff65a2-174e-4934-b2f5-5a91bdf55118'} Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.712203 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. Oct 18 16:12:43.719479 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.723759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Returning 404 to user: Instance 01ff65a2-174e-4934-b2f5-5a91bdf55118 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:43.725768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39f8a3d9-56b5-4173-ad85-3d512ccfa275 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118" status: 404 len: 111 microversion: 2.1 time: 0.078929 Oct 18 16:12:43.729884 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1425/2855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:43 2022] GET /compute/v2.1/servers/01ff65a2-174e-4934-b2f5-5a91bdf55118 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:43.738197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.739070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.747509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.748770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.749537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.750485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.751162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.751758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.781346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] HTTP exception thrown: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Request method failure captured: Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 HTTP/1.1 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs-hsb_ILc2MAhLAbSgYlaWfIGOL3UVLcdcgXzyWPlEln5ElUXT-PBwSTCrVuiR3NNLjUfFw0Dpm_NrIHWk0OEvPhONV1p2wEcvsmJ_PgzvLKjIX48BZqKAB-Lver5Sv6o9FvxQmXoltDLBeLzNrH-njC135sPR0D7P3GhtKRZzrJp0 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}] Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: b7d816c3043c435d8bf79d2c819518ec Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5'} Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:43.784885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.789118 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.792730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Returning 404 to user: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:43.794780 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-879b7fee-1f48-432e-ba5a-84d6bf1f0a60 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 404 len: 111 microversion: 2.1 time: 0.062579 Oct 18 16:12:43.796490 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1426/2856] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:43 2022] DELETE /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:43.810166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.812041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.833811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.834470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.835104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.835391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.835828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.836288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.836713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.845540 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a86ce9f-0f4e-41df-aece-1349075728c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1271 microversion: 2.1 time: 0.228603 Oct 18 16:12:43.847692 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1431/2857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:43 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:43.882856 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] HTTP exception thrown: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Request method failure captured: Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 HTTP/1.1 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs-hsb_ILc2MAhLAbSgYlaWfIGOL3UVLcdcgXzyWPlEln5ElUXT-PBwSTCrVuiR3NNLjUfFw0Dpm_NrIHWk0OEvPhONV1p2wEcvsmJ_PgzvLKjIX48BZqKAB-Lver5Sv6o9FvxQmXoltDLBeLzNrH-njC135sPR0D7P3GhtKRZzrJp0 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}] Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: b7d816c3043c435d8bf79d2c819518ec Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5'} Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.884850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.890764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Returning 404 to user: Instance 32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:43.892284 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b600577-cffa-414d-b9f6-941090240ea7 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5" status: 404 len: 111 microversion: 2.1 time: 0.091459 Oct 18 16:12:43.893446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1427/2858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:43 2022] GET /compute/v2.1/servers/32c2a51c-a2e7-4e88-b6fa-9cafe79bb6c5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:43.901268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.901763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.917961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.918780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.919509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.921124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.921965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.922610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.940092 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] HTTP exception thrown: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Request method failure captured: Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 HTTP/1.1 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs-hsb_ILc2MAhLAbSgYlaWfIGOL3UVLcdcgXzyWPlEln5ElUXT-PBwSTCrVuiR3NNLjUfFw0Dpm_NrIHWk0OEvPhONV1p2wEcvsmJ_PgzvLKjIX48BZqKAB-Lver5Sv6o9FvxQmXoltDLBeLzNrH-njC135sPR0D7P3GhtKRZzrJp0 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}] Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: b7d816c3043c435d8bf79d2c819518ec Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '58480315-8ecb-418d-b6fd-3101dbeefbd7'} Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:43.942807 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:43.948137 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:12:43.950735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Returning 404 to user: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:43.953050 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83ff1e2e-675c-4bba-ac98-c7f2f6307fd6 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 404 len: 111 microversion: 2.1 time: 0.055741 Oct 18 16:12:43.954746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1432/2859] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:43 2022] DELETE /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:43.964981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.966075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] [instance: 58480315-8ecb-418d-b6fd-3101dbeefbd7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.977415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.978133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.978675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.979489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.980052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.980860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.020366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] HTTP exception thrown: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Request method failure captured: Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 HTTP/1.1 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs-hsb_ILc2MAhLAbSgYlaWfIGOL3UVLcdcgXzyWPlEln5ElUXT-PBwSTCrVuiR3NNLjUfFw0Dpm_NrIHWk0OEvPhONV1p2wEcvsmJ_PgzvLKjIX48BZqKAB-Lver5Sv6o9FvxQmXoltDLBeLzNrH-njC135sPR0D7P3GhtKRZzrJp0 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9650da009f3482f9fc67cacebd2e09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9650da009f3482f9fc67cacebd2e09e"}]}] Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b9650da009f3482f9fc67cacebd2e09e Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1284847046 Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: b7d816c3043c435d8bf79d2c819518ec Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiskConfigTestJSON-1284847046-project Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '58480315-8ecb-418d-b6fd-3101dbeefbd7'} Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:44.023047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. Oct 18 16:12:44.027550 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:12:44.031440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] Returning 404 to user: Instance 58480315-8ecb-418d-b6fd-3101dbeefbd7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:44.033805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-620ae18e-572e-444d-8322-dad901f2c737 tempest-ServerDiskConfigTestJSON-1284847046 tempest-ServerDiskConfigTestJSON-1284847046-project] 10.222.0.78 "GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7" status: 404 len: 111 microversion: 2.1 time: 0.075525 Oct 18 16:12:44.037856 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1428/2860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:43 2022] GET /compute/v2.1/servers/58480315-8ecb-418d-b6fd-3101dbeefbd7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:44.094752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-317674761", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "f4e54443-b052-449e-b9db-065b05a2a7a2"}], "security_groups": [{"name": "tempest-securitygroup--796677753"}], "key_name": "tempest-keypair-286292537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:44.131142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:44.132526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:44.147513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.149836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.152478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.158403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.160759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.162656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.357898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] validate_networks() for [('f4e54443-b052-449e-b9db-065b05a2a7a2', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:12:44.628730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:44.641657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:44.644481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:44.647920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e004e2df-a277-4f41-a2b0-42a003938459 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.530449 Oct 18 16:12:44.661514 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1429/2861] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:44 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:44.673538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "0147223d-48b4-4d3c-b607-26ce497fc0bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:44.684445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.685146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.685838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.698632 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] Creating event network-changed:0147223d-48b4-4d3c-b607-26ce497fc0bc for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:44.706295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-acf8d697-5175-4fb1-b6c7-0d31830be2ec req-d4959703-4fb6-4a84-a7b7-78c66078fae0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043121 Oct 18 16:12:44.707392 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1430/2862] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:44.719781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:44.720659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:44.732645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.733423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.734312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.735373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.736260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.736946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.111965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:45.131082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a18bf13-9ff4-4976-bff9-9fc487e96930 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.421178 Oct 18 16:12:45.131972 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1431/2863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:44 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:45.138333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:45.140864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:45.147676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.148385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.149485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.151083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.151703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.152287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.583118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:45.592813 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e29a1f9f-c790-4c7f-923f-82259ee29fc6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.458973 Oct 18 16:12:45.593498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1432/2864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:45 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:45.682190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:45.685456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:45.694233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.694886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.695440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.696244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.696804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.703060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.177446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:46.190249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:46.192405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:46.194270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-194115df-5ce6-4d12-a7ed-8a7fca7cf1b5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.518501 Oct 18 16:12:46.196938 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1433/2865] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:45 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:46.202503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:46.203351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:46.211586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.213094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.213740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.214645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.215329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.216090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.586193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:46.587196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:46.587883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:46.588499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:46.589200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:46.603408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.604404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.605540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.607234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.608413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.609563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.633504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:46.643201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for user 5bd4aa75ffc54e5f840a70d8a901da15 and project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:46.669011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:46.678727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:46.735679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a32308c2-a556-45da-9c06-c65b07c2f07a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.646729 Oct 18 16:12:46.736930 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1433/2866] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:12:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:12:46.741626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:46.742452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:46.752938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.753640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.755356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.756255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:46.756867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:46.757463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:46.796715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:46.804373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:46.808009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b027d80-1784-4417-8908-af2f5a1a1f9c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.609688 Oct 18 16:12:46.821553 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1434/2867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:46 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:46.842673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73e79094-4c3f-40ad-b5da-1e7381196226 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:46.843603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73e79094-4c3f-40ad-b5da-1e7381196226 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:46.992207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73e79094-4c3f-40ad-b5da-1e7381196226 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.004613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73e79094-4c3f-40ad-b5da-1e7381196226 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1240 microversion: 2.1 time: 0.165888 Oct 18 16:12:47.005223 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1435/2868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:46 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:47.018213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "e8acfc01-a36e-4749-933d-0d6b80196941"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:47.036592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.037109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.044702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.078300 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] Creating event network-changed:e8acfc01-a36e-4749-933d-0d6b80196941 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:47.094852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-11256495-c6a7-44c6-9133-c7ec17a8ff3d req-2f2e5292-b314-4f13-8789-463d9f4fa01d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088375 Oct 18 16:12:47.095718 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1436/2869] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:47.227031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:47.227765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:47.239113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.249888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.250716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.251512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.252015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.252456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.423358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.439075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e61f4097-dcac-4bac-9ac9-53314f034edb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.698484 Oct 18 16:12:47.440962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1434/2870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:46 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:47.696404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.712136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.713779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.714971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff92a5a7-965b-46af-b441-b799240d3549 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.492611 Oct 18 16:12:47.715539 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1437/2871] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:47 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:12:47.849209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:47.850558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:47.880307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.881984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.882685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.885175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.885942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.886851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.032131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:48.032777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:48.045653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.047842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.048322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.049097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.051464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.052563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.199994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:48.210648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3f2030d-fd98-476e-86ff-109741132fb2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1292 microversion: 2.1 time: 0.183011 Oct 18 16:12:48.212144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1438/2872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:48 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:48.463029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:48.463920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:48.477447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.484620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.490015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.491161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.491808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.492400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.922047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:48.937608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57eadf48-db79-48b6-aa2f-3a420a66d5fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.477816 Oct 18 16:12:48.955156 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1439/2873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:48 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:48.962787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:48.963693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:48.971393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.972535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.973278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.974541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.975224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.976403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.015065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.030172 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1d526c2-e3cc-41fc-b1ad-428d36d26aae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 1.188267 Oct 18 16:12:49.032011 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1435/2874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:47 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:49.247704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:49.252106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:49.258454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:49.259047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:49.259495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.260437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:49.260986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:49.261726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.372333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.392694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.395801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.401210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b20b23f3-8350-49ba-a0e5-d2bf2617d046 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.442459 Oct 18 16:12:49.402042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1440/2875] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:48 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:49.552214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.562513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-420ee543-2926-4f69-aa3a-dd39d6ed2c31 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1298 microversion: 2.1 time: 0.326555 Oct 18 16:12:49.578399 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1436/2876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:49 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1298 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:49.808107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:49.840013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:49.840499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:49.844848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.878198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] Creating event network-changed:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h2-858383-14 Oct 18 16:12:49.894525 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2e97c83c-4825-44ce-8f9a-c7419ab43fe4 req-35ae3c77-2ae4-4681-85ef-6ebf3676acc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094194 Oct 18 16:12:49.895990 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1441/2877] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:49.972000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:49.972782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:50.000929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.001839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.002487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.004008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.005089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.005988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.058526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:50.059688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:50.090542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.091180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.091640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.094718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.095222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.095666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.558827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:50.571695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c31d90a-9d33-4606-a9cf-688b2c803061 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.520309 Oct 18 16:12:50.574546 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1442/2878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:50 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:50.585433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:50.586063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:50.603885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.604383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.604817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.605544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.605979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.606656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.649320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:50.658706 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb3d1dec-1d94-4232-8f39-c85af090f8e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.696537 Oct 18 16:12:50.673420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1437/2879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:49 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:50.679809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:50.680649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:50.687156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.687868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.688469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.689397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.690100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.690750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.854147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:50.866786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6566ed34-4e38-4f34-bdf0-872fadd76670 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1298 microversion: 2.1 time: 0.191942 Oct 18 16:12:50.867391 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1438/2880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:50 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:51.017125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:51.032973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:51.035979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:51.037505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15ba0635-2622-46f5-80fc-6cc98fa8ada0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.462007 Oct 18 16:12:51.038885 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1443/2881] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:50 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:51.603300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:51.605084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:51.630290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.637678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.638232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:51.638877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.639337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.640362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:51.688105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:51.688662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:51.709902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.710402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.710842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:51.711554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.712012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.712436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.182790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:52.194199 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-59251463-e44d-4429-8df3-59cd13211649 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.511288 Oct 18 16:12:52.198648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1444/2882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:51 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:52.209402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:52.210535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:52.221433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.223118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.224909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.226372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.227801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.228571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.360922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:52.374897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecf0024b-d242-4a8a-94f3-c6666d38b054 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.776028 Oct 18 16:12:52.378411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1439/2883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:51 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:52.385813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "5dd3f60f-dabc-4452-8707-c140dc1935f9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:52.401030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.401873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.402638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.421372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] Creating event network-changed:5dd3f60f-dabc-4452-8707-c140dc1935f9 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:52.430304 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ae85ed74-4b4d-4fef-9d6a-3bc10118a062 req-e605988c-bc1a-420c-8deb-d30db4ee0cd7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050077 Oct 18 16:12:52.432065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1440/2884] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:52.439417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:52.440785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:52.448132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.448748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.449628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.450380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.450837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.452053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.653042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:52.666227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b89739f-b663-4a9a-a618-318e0450176d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.465627 Oct 18 16:12:52.666816 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1445/2885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:52 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:53.050982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.063944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.065348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.067129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0d3482a-ae42-4531-82e2-9697897fb757 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.633009 Oct 18 16:12:53.097163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1441/2886] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:52 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:53.228525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:53.232231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:53.243968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.244856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.245576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.248571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.251493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.253563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.401449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:53.402787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:53.416373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.417497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.418000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.418968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.419621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.421110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.680453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.691506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea28b279-b6f0-495d-a9e4-b6b4a158f06c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.475121 Oct 18 16:12:53.693651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1446/2887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:53 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:53.730622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:53.742035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:53.749876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.750663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.750974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.752041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.752781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.753459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.103333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:54.118909 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69b7a208-9206-436d-9e47-3f5cd0041fca tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1511 microversion: 2.1 time: 0.721015 Oct 18 16:12:54.120188 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1442/2888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:53 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1511 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:54.130176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:54.132197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:54.154656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:54.157137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:54.157979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.158946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:54.159677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:54.160368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.295736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:54.310234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-594681bd-eaa9-4b26-a647-3bf2698c17aa tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.597932 Oct 18 16:12:54.311419 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1447/2889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:53 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:54.843775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-710599228", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:54.972803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] validate_networks() for [('e2fc8fd5-660e-4eb7-83ed-3cf04241534b', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:12:55.804764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:55.831911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:55.834301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:55.839221 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d5afd29-2b72-4739-b379-967c13dedd15 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 1.717632 Oct 18 16:12:55.842217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1443/2890] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:54 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:55.858250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:55.863121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:55.892230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:55.892868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:55.895519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:55.903990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:55.905573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:55.906688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.254666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:56.255139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:56.255563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:56.256393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:56.257014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:56.280104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:56.282492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:56.283672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.286949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:56.287472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:56.287914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.322880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Getting quotas for project 940a12592e50434793075265c3a1f9ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:56.329964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Getting quotas for user fd4567c0f0b244e4a39a5dabdaa88ee8 and project 940a12592e50434793075265c3a1f9ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:56.353189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:56.358784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:56.395395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:56.422234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa595815-c5f6-4e90-b17c-f70dcdaa43f2 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.889055 Oct 18 16:12:56.424005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1448/2891] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:12:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:12:56.451915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "0550edd3-33e0-43ef-8b64-433a50dea17b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:56.494234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:56.495976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:56.496980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.534339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] Creating event network-changed:0550edd3-33e0-43ef-8b64-433a50dea17b for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:12:56.546116 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-920b2fb0-3d04-4ea0-9eb9-421523d71549 req-48a2fe35-6ebd-4f46-9fe3-817e330b7eb5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119665 Oct 18 16:12:56.547184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1449/2892] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:56.553202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:56.554511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:56.563889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:56.564531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:56.564982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.565722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:56.566475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:56.578668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:56.623738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:56.655113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=14 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:57.285392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:57.310649 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d96bb132-1f0d-41ab-911c-8bd6c1229892 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 1.463761 Oct 18 16:12:57.340690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1444/2893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:55 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:57.367817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:57.374516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:57.377401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:57.379101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-929edb04-f0c1-4c3f-bcc1-82bd12188314 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1488 microversion: 2.1 time: 0.830369 Oct 18 16:12:57.379573 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1450/2894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:56 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1488 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:57.405545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:57.408590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:57.410109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:57.411212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de4d6bfc-9dfc-4659-81cc-7e9868bcf487 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:57.411930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de4d6bfc-9dfc-4659-81cc-7e9868bcf487 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:57.412530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:57.416010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:57.416474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:57.576849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de4d6bfc-9dfc-4659-81cc-7e9868bcf487 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:57.594283 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de4d6bfc-9dfc-4659-81cc-7e9868bcf487 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1222 microversion: 2.1 time: 0.197039 Oct 18 16:12:57.603329 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1451/2895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:57 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:57.612844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:57.621582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:57.652605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:57.652957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:57.653791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:57.671546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:57.674225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:57.677363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.412049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:58.423631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:58.430523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:58.440768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-635de7f7-375d-4ac5-8569-ddf2bdf5a557 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.836006 Oct 18 16:12:58.441682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1452/2896] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:57 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:58.458992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:58.461687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:58.472780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.475553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.477577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.478583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.479260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.479918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.562304 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8f05560-46cf-4c68-b7f0-1ba55372872a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 200 len: 142 microversion: 2.1 time: 0.119037 Oct 18 16:12:58.562972 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1453/2897] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:12:58 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 142 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:58.568338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:58.572598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:58.585262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.585761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.586207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.588170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.588659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.592356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.754693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:58.770650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a419b16-1621-43c7-96ea-9d4db43bbccf tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 1.423786 Oct 18 16:12:58.778128 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1445/2898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:57 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:58.792306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:58.792936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:58.806489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.806977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.807421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.810459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.811183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.814364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.870986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:58.882461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67ba9fca-10b3-48a6-8d9c-9fd90e84aff7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.318247 Oct 18 16:12:58.893624 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1454/2899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:58 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:58.901174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:58.902948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:58.912058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.913400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.914075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:58.915067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:58.915961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:58.916616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.038892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.054375 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f208895e-7efb-4fc9-b7d1-47dfd07f1315 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1274 microversion: 2.1 time: 0.159184 Oct 18 16:12:59.055570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1455/2900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:58 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:59.187450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2603c5-2558-440d-b5cd-20f1bfe8e2c5", "tag": "db6de071-a155-4edb-a8c2-648432406189"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:59.197509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.198084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.198585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.211090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] Creating event network-changed:db6de071-a155-4edb-a8c2-648432406189 for instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 on n-h1-858383-14 Oct 18 16:12:59.215973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7a6a9e6e-10d5-46df-a8a9-fe82e8cdcad6 req-977c43cd-e215-42d5-8005-1ef9d93876bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032366 Oct 18 16:12:59.217583 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1456/2901] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:12:59.473670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:59.474382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:59.487571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.488062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.488495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.489298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.497749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.498884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.510388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:59.562330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.573900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cedf407b-cc09-4350-9ad3-d16fedccdcf5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.793317 Oct 18 16:12:59.583788 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1446/2902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:58 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:59.611171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:59.612165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:59.620291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.620928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.621493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.623791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.624650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.627465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.925626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.942473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.949595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.954869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:59.957296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66b931c1-e057-4ff9-8531-e102adbd50cb tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.489172 Oct 18 16:12:59.958867 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1457/2903] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:12:59 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:12:59.962035 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3ce759c-d189-49e4-ba83-cf27c2fb3d65 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.353605 Oct 18 16:12:59.962702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1447/2904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:59 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:59.967586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:59.971371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:59.984022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:59.985023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:59.986656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.987003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.987452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.988165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.988630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.991515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.992019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.992457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:59.993191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:59.993650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:59.994072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.001171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.239962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:00.248780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f45d49cd-9d62-4b77-a636-f09d8a7054c0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.284866 Oct 18 16:13:00.261018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:00.262685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1448/2905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:59 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:00.270872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:00.271383 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df427914-6766-464d-b18c-076cd597fed3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.307931 Oct 18 16:13:00.272033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:00.285019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1458/2906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:59 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:00.285019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:00.285019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:00.296949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.300594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.301285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.301919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.303919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.304367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.305111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.305581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.306010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.308188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.308922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.309388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.447532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:00.468711 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-53174259-41d8-4475-b344-fe1625041250 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1274 microversion: 2.1 time: 0.193967 Oct 18 16:13:00.473200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1459/2907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:00 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:00.648110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:00.654480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:00.669214 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-034d44a3-a491-4016-8cb9-f5d2565bcb4a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.405276 Oct 18 16:13:00.671520 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1449/2908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:00 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:00.697955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:00.700144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:00.713271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.714028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.715898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.718037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:00.718700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:00.719302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:00.989740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:00.991042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:01.004846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:01.005427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:01.005911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:01.006633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:01.007447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:01.008042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:01.245580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:01.264209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c72befc1-1d1a-4ac2-b186-e70189463c27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.573435 Oct 18 16:13:01.265057 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1460/2909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:00 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:01.279289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "21efc73e-c465-4129-916d-cfb89b7cb6dd"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:01.324587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:01.325177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:01.325633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:01.360471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] Creating event network-changed:21efc73e-c465-4129-916d-cfb89b7cb6dd for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:01.370685 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2846dfab-c7f2-45da-af76-cc48542778a3 req-679c540f-d4ac-4b0f-93f4-33fdea705434 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096940 Oct 18 16:13:01.376022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1461/2910] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:01.382972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:01.389959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:01.402557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:01.403066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:01.403526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:01.408787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:01.411168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:01.412052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:02.271128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:02.286790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:02.291618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:02.294474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b86aa7f-3e98-4893-a4be-1c160863795b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 1.311179 Oct 18 16:13:02.296948 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1450/2911] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:00 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:02.305261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:02.306668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:02.310159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:02.317423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:02.318129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:02.319580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:02.320457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:02.321125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:02.322338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:02.326516 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f633575f-d17d-49a9-a6df-3cba3c39c93b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.947649 Oct 18 16:13:02.327122 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1462/2912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:01 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:02.355484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "name": "network-vif-plugged", "status": "completed", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:02.378908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:02.379562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:02.380152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:02.395263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] Creating event network-vif-plugged:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h2-858383-14 Oct 18 16:13:02.401477 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-84dd7073-1b5e-4a44-9cf8-5d1407d0bb62 req-1dad88e4-269b-4f8b-9e34-5c27b6f89bbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053943 Oct 18 16:13:02.402829 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1463/2913] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:02.419840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2141228216", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b4a50421-5452-4e65-84ea-78b361222489"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:02.542218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] validate_networks() for [('b4a50421-5452-4e65-84ea-78b361222489', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:13:03.037677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:03.046053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a983aaab-9a20-4262-88ad-fee2025ce9b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.747123 Oct 18 16:13:03.062952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1451/2914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:02 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:03.068339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:03.069214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:03.075951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.077305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.077934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.078817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.079533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.080119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.315998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:03.324007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9df846ee-da5e-43ea-b538-0e5bd1b1f07a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1280 microversion: 2.1 time: 0.259603 Oct 18 16:13:03.324612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1452/2915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:03 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:03.329890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:03.343984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:03.350243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.350744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.351191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.351890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.360313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.360936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.661175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:03.661791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:03.662048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:03.663796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:03.664859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:03.673125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=15 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:03.689528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.690298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.690907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.691801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.692417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.693050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.746972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:03.766772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:03.797458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:13:03.802627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:13:03.909545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b45a2e14-857e-4365-80b8-327bf8fe28c6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501970 Oct 18 16:13:03.926204 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1464/2916] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:13:03.947486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:03.948469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:03.956748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.957618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.958228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:03.959112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:03.959746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:03.960326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:04.335335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:04.356890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:04.367224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:04.370208 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fcf92c2-6314-45cb-9d1c-f88cc0882bb1 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 1.044534 Oct 18 16:13:04.371568 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1453/2917] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:03 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:04.384648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d1fad61-1bb8-4472-b011-b3f4eb36a17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:04.385582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d1fad61-1bb8-4472-b011-b3f4eb36a17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:04.508474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:04.518067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-172c3a22-4713-40d8-8791-2b91ed0b1753 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1313 microversion: 2.1 time: 0.590195 Oct 18 16:13:04.518658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1465/2918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:03 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:04.544541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:04.548177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:04.565346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:04.566046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:04.566663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:04.567545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:04.568155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:04.568723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:04.735441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d1fad61-1bb8-4472-b011-b3f4eb36a17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:04.756661 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d1fad61-1bb8-4472-b011-b3f4eb36a17d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1215 microversion: 2.1 time: 0.381477 Oct 18 16:13:04.781812 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1454/2919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:04 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:04.799005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:04.803933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:04.826876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:04.827377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:04.832627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:04.833498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:04.834159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:04.836363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:05.168254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:05.182380 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4e1a953c-c6ea-4404-83d3-62ec81988753 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.662653 Oct 18 16:13:05.182974 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1466/2920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:04 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:05.398116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:05.398668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:05.431711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:05.433433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:05.434874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:05.436847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:05.437510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:05.438422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:05.477398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:05.492890 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-489553f1-b858-405d-9c9a-969977f8f2bb tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.707707 Oct 18 16:13:05.493919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1455/2921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:04 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:05.551480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:05.552384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:05.565193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:05.566247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:05.568051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:05.568941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:05.572342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:05.573231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.394409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:06.407088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:06.411998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:06.422596 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-201bd80b-c9b3-4e7e-95a4-50b4c4aab797 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 1.028244 Oct 18 16:13:06.427831 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1467/2922] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:05 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:06.439945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:06.446835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:06.454294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.455182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.455879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.460863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.461613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.462284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.602102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:06.619317 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-680325a2-85a0-41da-a12d-de91257ea335 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1273 microversion: 2.1 time: 0.190056 Oct 18 16:13:06.619903 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1468/2923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:06 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:06.637542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:06.639934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:06.646323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.646819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.647250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.658679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.659177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.660036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.761022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:06.773744 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d31bd11-3a9b-454c-ad74-a6f424f46e5e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1462 microversion: 2.1 time: 1.232170 Oct 18 16:13:06.789022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1456/2924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:05 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1462 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:06.789022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:06.789022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:06.792246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.793142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.793771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:06.795522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:06.796130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:06.796799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:07.089572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:07.099559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f2cc5b3-dd63-4e58-8e77-efd221547638 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.478433 Oct 18 16:13:07.101961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1469/2925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:06 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:07.109293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2603c5-2558-440d-b5cd-20f1bfe8e2c5", "name": "network-vif-plugged", "status": "completed", "tag": "db6de071-a155-4edb-a8c2-648432406189"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:07.124362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:07.125172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:07.126983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:07.151368 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] Creating event network-vif-plugged:db6de071-a155-4edb-a8c2-648432406189 for instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 on n-h1-858383-14 Oct 18 16:13:07.158558 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b3de0bbe-343b-45bb-90fc-968c7879406b req-2a4312ac-76c8-4c9a-9d5f-a03b686305a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054438 Oct 18 16:13:07.159811 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1470/2926] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:07.346394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:07.362056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2ee0bc8-28c5-4926-82f9-7f76668b7e86 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.586257 Oct 18 16:13:07.378392 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1457/2927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:06 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:07.431392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:07.432429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:07.445762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:07.447274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:07.448331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:07.449932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:07.451071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:07.451762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:07.464158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:07.464777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:07.476892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:07.477701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:07.478318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:07.480017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:07.480662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:07.481288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.070509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.082355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.083790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.088843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a357bb26-0a0c-4b7a-96ad-2884c8522ed7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.624776 Oct 18 16:13:08.092682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1458/2928] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:07 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:08.105983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:08.107828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:08.128485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.129900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.130596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.131326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.131783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.132212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.151540 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b4781a6-1f19-4eaf-981e-2cb38073d56b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1615 microversion: 2.1 time: 0.990311 Oct 18 16:13:08.152320 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1471/2929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:07 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1615 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:08.165640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:08.197242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.198606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.205755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.221175 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] Creating event network-changed:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:13:08.227145 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-eda644b0-1812-4432-93f2-bdb61a246846 req-17feb101-921c-41a2-8fca-e6ea6b68af77 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073521 Oct 18 16:13:08.228781 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1472/2930] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:08.235701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:08.236499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:08.246166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.253142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.253922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.254698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.255175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.255614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.377296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.387352 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cdaf0eff-ac16-41e9-bf7e-7eca95593109 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1273 microversion: 2.1 time: 0.293174 Oct 18 16:13:08.401993 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1459/2931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:08 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:08.409882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:08.410457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:08.417770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.418509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.419129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.420427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.421098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.421929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.608587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.621583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8252ee4a252a44e9ae8794892bfadaea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c378fdcfd8543489f0b99fda82d836b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.622497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] flavor_id is None. Assuming migration. {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 16:13:08.624201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:13:08.641237 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-041830ac-055e-47cb-852a-b5d46114feba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1365 microversion: 2.1 time: 0.406044 Oct 18 16:13:08.641237 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1473/2932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:08 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:08.646161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:08.647009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:08.654793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.655556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.656166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.657077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:08.657871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:08.658457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:08.880830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:08.896140 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21662db2-1005-420d-a91f-b6954bb50d27 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.257880 Oct 18 16:13:08.911567 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1474/2933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:08 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:09.081812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-299252756", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:09.229646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] validate_networks() for [('9b68f1d4-28d9-491e-8ede-2b1411932ce7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:13:09.326488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4d0f096-2788-4c1f-8e6e-84c112ecb53e tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c/action" status: 202 len: 0 microversion: 2.1 time: 0.921905 Oct 18 16:13:09.327947 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1460/2934] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:08 2022] POST /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c/action => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:13:09.481169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f85ffc7b-fc0c-4439-b804-780f3c4356b4 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Action: 'create', calling method: .version_select at 0x7f5fd163c700>, body: {"keypair": {"name": "tempest-keypair-1758121770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEHwuVBEeeI1W5pH/Clt2BurWeQDFsMb0ADdGKONU4lrUAiO/4ERjgSuGv60MlvKVLEd0VvwWxCWyFSUpE61HIt43HwcBSEni7tG7y8ZvrieB7qHCTcN1NFSKDoRVYItA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:09.523403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f85ffc7b-fc0c-4439-b804-780f3c4356b4 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for project d5ae35d217ff427ebcc72138f864cffc. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:09.544636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f85ffc7b-fc0c-4439-b804-780f3c4356b4 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for user 705dd668b8344cea9a74069c202cbe64 and project d5ae35d217ff427ebcc72138f864cffc. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:09.608115 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f85ffc7b-fc0c-4439-b804-780f3c4356b4 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276837 Oct 18 16:13:09.610682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1461/2935] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:13:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:09.615968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:09.617393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:09.624853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:09.625731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:09.626362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:09.627712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:09.628743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:09.629451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:09.966323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:09.966995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:09.968968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:09.969441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:09.970057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:09.990793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:09.991578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:09.992214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:09.993866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:09.996449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:09.997174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:10.072164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Getting quotas for project 26cf3f81f9b74f23a21ddf195abe07e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:10.081031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Getting quotas for user a99e18a574be45d59ebbdc64b5effc7a and project 26cf3f81f9b74f23a21ddf195abe07e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:10.117183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:13:10.127044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:13:10.243668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c852f00e-2912-4e6e-b608-31d4ea35d940 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319283 Oct 18 16:13:10.245351 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1475/2936] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:13:10.257312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:10.259360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:10.274070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:10.276857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:10.290320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:10.293165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:10.295993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:10.297612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:10.820544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:10.828599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ce259d8-cade-4b6d-ad27-e457d042c4c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1471 microversion: 2.1 time: 0.581853 Oct 18 16:13:10.829217 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1476/2937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:10 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:10.847998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:10.848924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:10.861615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:10.862887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:10.863880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:10.865755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:10.867172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:10.869460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:11.263853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:11.275138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:11.285485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:11.286967 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f350853-3ad6-430e-b309-558160b42c22 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 1.675088 Oct 18 16:13:11.296363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:11.301370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:11.304461 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1462/2938] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:09 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:11.308346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b49c9517-17b7-4d17-af47-fdd419f6bca6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.474206 Oct 18 16:13:11.314589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:11.333399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1477/2939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:10 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:11.345969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:11.351119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:11.351738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:11.357724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:11.359251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:11.359738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:11.360239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:11.360869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:11.361330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:11.366137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:11.366572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:11.367055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:11.367689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:11.371466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:11.378674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:11.381589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.009454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:12.019797 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d7d79c3-76f3-4c7f-95e9-f3f2244076d6 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.685169 Oct 18 16:13:12.026872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1478/2940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:11 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:12.054166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:12.056394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:12.078095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.078900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.079538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.080500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.081245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.081900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.225030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:12.237600 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7aae6eb5-f062-40f6-90df-58b5e7b0adb0 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1556 microversion: 2.1 time: 0.927474 Oct 18 16:13:12.264100 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1463/2941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:11 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1556 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:12.269991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:12.271552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:12.281641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.282296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.282740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.283457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.283914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.284341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.421894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:12.437661 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de124403-7fc0-4b5a-8158-478c09d9f570 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1275 microversion: 2.1 time: 0.388198 Oct 18 16:13:12.449073 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1479/2942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:12 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:12.449073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:12.449073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:12.455152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.455887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.456483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.457388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.458000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.458580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.570326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:12.584573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ba4bf36-1051-43e7-90c8-870f59f4e07a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1471 microversion: 2.1 time: 0.317964 Oct 18 16:13:12.598169 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1464/2943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:12 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:12.615008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:12.615965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:12.624433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.625279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.625936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.626864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.628206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.628914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.748488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e82ab8e6-4b87-497b-9182-9b8df605386d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.307578 Oct 18 16:13:12.749651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1480/2944] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:13:12 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-interface => generated 285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:12.754729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:12.755886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:12.768892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.773772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.776547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:12.780380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:12.780880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:12.783912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.178380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.187192 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9017222-0231-48d9-bb5e-12128b3aa538 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.436093 Oct 18 16:13:13.188409 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1481/2945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:12 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:13.198133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:13.199136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:13.211786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.212400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.212908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.214027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.214558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.215218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.378723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.420767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.422795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.426223 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b4427fc-56c1-4971-a8d8-2729004de226 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.822752 Oct 18 16:13:13.430302 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1465/2946] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:12 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:13.447080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69351565-cf4d-4d96-8624-0d8d46c953af", "tag": "7ce66c86-c944-42a5-a343-9dab7f31f106"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:13.481461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.483363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.484535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.490397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.498990 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84f869b0-fe48-40e9-9a45-fd34f4c2ab47 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.309046 Oct 18 16:13:13.517447 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1482/2947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:13 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:13.530778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] Creating event network-changed:7ce66c86-c944-42a5-a343-9dab7f31f106 for instance 69351565-cf4d-4d96-8624-0d8d46c953af on n-h2-858383-14 Oct 18 16:13:13.541407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:13.541407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:13.541407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:13.543582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.545414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.546292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.547314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.556959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.557888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.566236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-73b93e22-ff4d-4a3e-b1eb-ece99929df82 req-7a3db697-78be-4ba8-a01d-a031f703fc54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129726 Oct 18 16:13:13.570115 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1466/2948] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:13.615410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:13.617241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:13.645062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.645748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.646407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.649958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:13.650666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:13.654667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:13.677130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:13.827761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:13.851016 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26d7f35a-f8f5-4f37-959e-96d2cae43811 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1281 microversion: 2.1 time: 0.331598 Oct 18 16:13:13.851651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1483/2949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:13 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:13.883010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-713909799", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bed9a19f-5703-486c-9024-88f1184de4af"}], "security_groups": [{"name": "tempest-securitygroup--89577022"}], "key_name": "tempest-keypair-1758121770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:14.079864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] validate_networks() for [('bed9a19f-5703-486c-9024-88f1184de4af', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:13:14.891912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for project d5ae35d217ff427ebcc72138f864cffc. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:14.901629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:14.914314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb1237d0-1e2d-48b3-b619-75c4cac2f409 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1471 microversion: 2.1 time: 1.304301 Oct 18 16:13:14.914808 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1467/2950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:13 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1471 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:14.943501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for user 705dd668b8344cea9a74069c202cbe64 and project d5ae35d217ff427ebcc72138f864cffc. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:14.953169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:14.954203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:14.969581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:14.973572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:14.982076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:14.986564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:14.987002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:14.987480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:14.987894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:14.988307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:14.990277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:14.990778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:14.991240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.013073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.016290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.019451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.021170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.023951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.024580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.061992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for project d5ae35d217ff427ebcc72138f864cffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:15.074900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Getting quotas for user 705dd668b8344cea9a74069c202cbe64 and project d5ae35d217ff427ebcc72138f864cffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:15.105979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:13:15.110488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:13:15.176752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be898737-b5bd-4991-a8c1-fc6f8c1b1002 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.322509 Oct 18 16:13:15.177781 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1484/2951] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:13:15.187089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:15.188177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:15.199947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.201419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.202122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.203470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.204499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.205179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.572023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:15.585452 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a98493cb-13c3-4d5e-b3c0-c9d808968bf7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.669514 Oct 18 16:13:15.586054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1468/2952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:14 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:15.600773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:15.605659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:15.619267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.622290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.623637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.624978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.628462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.629276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.931877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:15.951567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:15.953425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:15.955153 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b585500-a10a-468c-bb23-55625c467f01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.775487 Oct 18 16:13:15.955932 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1485/2953] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:15 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:15.968968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:15.969960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:15.976371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.976866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.977347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:15.978250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:15.979139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:15.979728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.193898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:16.221235 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f514395b-8ee1-44ce-be3e-82584deff71b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.262607 Oct 18 16:13:16.237016 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1486/2954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:15 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:16.237016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:16.240692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:16.254682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.255325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.255876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.256969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.259074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.261418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.269376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:16.278644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6383b18-dde4-421b-bed9-702da97cc082 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.689769 Oct 18 16:13:16.279472 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1469/2955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:15 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:16.286759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:16.287588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:16.314491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.316062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.317890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.319423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.320078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.320577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.386723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:16.399269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1353ea79-9993-4956-84f6-46e31fe0419a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1329 microversion: 2.1 time: 0.173141 Oct 18 16:13:16.401841 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1487/2956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:16 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1329 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:16.409017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab11bbff-68ce-4847-bc2a-ba006c2ea12c", "tag": "96cd6e24-402f-410a-b04e-f06e124a9dfb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:16.420845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.422036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.422694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.438972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] Creating event network-changed:96cd6e24-402f-410a-b04e-f06e124a9dfb for instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c on n-h2-858383-14 Oct 18 16:13:16.444305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0c2e9e9d-9e66-48c6-a2df-5edb686f246a req-1a4e7c6b-5432-44c2-99ff-d25716a6f26f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041033 Oct 18 16:13:16.449196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1488/2957] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:16.610548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:16.611253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:16.617392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.617873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.618308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.619023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.619472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.619888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.671207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:16.685714 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93b8702b-42fb-4668-84b1-dcde2d343214 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1471 microversion: 2.1 time: 0.404263 Oct 18 16:13:16.686598 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1470/2958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:16 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:16.692388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2603c5-2558-440d-b5cd-20f1bfe8e2c5", "tag": "db6de071-a155-4edb-a8c2-648432406189"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:16.705671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.706446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.707089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.727499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] Creating event network-changed:db6de071-a155-4edb-a8c2-648432406189 for instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 on n-h1-858383-14 Oct 18 16:13:16.733175 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-853e3591-db35-418f-ac48-523e8a0715cc req-b617ade5-3d49-45d4-a537-af4282957407 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044021 Oct 18 16:13:16.733945 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1471/2959] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:13:16.799877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:16.809635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0556f751-3934-4f83-b758-4fad2d5103a5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.203618 Oct 18 16:13:16.811213 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1489/2960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:16 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:16.983377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:16.983996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:16.996499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.997026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:16.997531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:16.998246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:16.998708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.005106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.249154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:17.250484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:17.256860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.257683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.258333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.259254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.259949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.260582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.738126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:17.753588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe1e4c44-3d7b-4779-b9cd-7c331d97a44f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.508302 Oct 18 16:13:17.754749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:17.756775 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1490/2961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:17 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:17.781746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:17.784973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:17.788106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:17.789502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:17.793488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9235d2a0-5623-48d6-9450-fc2969f74856 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.814615 Oct 18 16:13:17.795594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1472/2962] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:16 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:17.808211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.809014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.811414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.811784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:17.812780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.814504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:17.817306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.818137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.829872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.835274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.837330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.839444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:17.846026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:17.846639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:17.972458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:17.988581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ed9f406-5bf7-4150-a904-e401c200be4d tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1335 microversion: 2.1 time: 0.191041 Oct 18 16:13:18.007529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1473/2963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:17 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1335 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:18.013994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:18.014888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:18.021807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.023031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.023660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.024691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.025340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.026042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.199670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:18.208393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-573d53d2-45d3-428b-ab7d-b564d3625672 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.449492 Oct 18 16:13:18.209289 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1491/2964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:17 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:18.229332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:18.230382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:18.237956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.238768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.239407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.240463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.241431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.242374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.376689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:18.388826 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd341136-fa1d-4521-94e2-c067e812730e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1471 microversion: 2.1 time: 0.379761 Oct 18 16:13:18.389731 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1474/2965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:18 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:18.514698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "name": "network-vif-plugged", "status": "completed", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:18.526807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.527599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.528138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.541542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] Creating event network-vif-plugged:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:13:18.548032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f0eeac2e-97ed-4e77-b50e-d7c6702dcee9 req-f6a2350a-efc0-45a2-91fd-c8befe6fb137 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Oct 18 16:13:18.549345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1475/2966] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:13:18.697510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:18.705967 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8258909c-14d7-4082-9a7b-9476967579d0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.495416 Oct 18 16:13:18.707966 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1492/2967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:18 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:18.784823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:18.785577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:18.800255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.800748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.801787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.802535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.803066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.805829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.828551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:18.829932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:18.846905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.848142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.849036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:18.850415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:18.851203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:18.851818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.029223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.037658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a491051-2aca-4b1e-8616-940906fc1548 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.257875 Oct 18 16:13:19.038789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1476/2968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:18 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:19.044219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:19.045175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:19.051556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.052050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.052489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.053228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.053681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.054106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.237677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.248794 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f3505a59-5643-4bdb-95f3-1a1c023ff765 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.207894 Oct 18 16:13:19.261017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1477/2969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:19 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:19.261017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:19.261017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:19.261566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.262221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.262800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.264021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.265588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.266619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.276015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.287411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.288867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.290208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc1cbcbf-28ca-4275-a56d-34d253719f64 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.467137 Oct 18 16:13:19.291166 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1493/2970] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:18 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:19.413664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:19.414279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:19.415321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.420826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.421334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.421807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.422707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.423162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.423587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.424369 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f26b289-644d-436e-a375-d5a156b65fc8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.173431 Oct 18 16:13:19.425049 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1478/2971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:19 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:19.556303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:19.564858 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad70cc11-e560-44b5-ae33-57acacdf31b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.155237 Oct 18 16:13:19.565740 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1494/2972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:19 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:19.729357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:19.730101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:19.734298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:19.741255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.741255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.741255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:19.742082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:19.743096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:19.743675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.043012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.051498 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbae0d22-03cc-4bc6-b15c-aebd32ff6ad1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.326272 Oct 18 16:13:20.052088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1479/2973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:19 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:20.059878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:20.060987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:20.067198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.067900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.068331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.069225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.069675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.070545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.274514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:20.274758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.275136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:20.282962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.283455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.283686 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9409360a-28d3-4582-9180-832fe417a342 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.227691 Oct 18 16:13:20.283895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.284266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1495/2974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:20 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:20.299595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.300132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.300580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.317195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:20.317817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:20.324189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.324609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.325073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.327040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.327515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.327946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.332659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:20.516472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.525814 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f92c4465-afe9-4b9f-aa36-93de8fa48ad8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.255635 Oct 18 16:13:20.526395 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1480/2975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:20 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:20.540712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5efc66c-e521-4a0c-9416-2636eec7193e", "tag": "0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:20.550114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.550581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.551005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.562578 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] Creating event network-changed:0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378 for instance b5efc66c-e521-4a0c-9416-2636eec7193e on n-h1-858383-14 Oct 18 16:13:20.567390 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-34509435-697b-4f6e-8f82-0aff80541d3c req-befd2903-0758-46fe-8d91-6f3a327d983b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039613 Oct 18 16:13:20.567826 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1481/2976] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:20.569865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.572740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:20.573451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:20.580094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.580458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.580579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.580986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.581694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.581958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.582161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.582557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.583125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c740c4b-421f-4836-8cec-44eb92639a39 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.269860 Oct 18 16:13:20.584270 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1496/2977] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:20 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:20.588488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:20.589128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:20.595880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.596366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.596805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.597528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.597985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.598622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.720850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.728806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-397e0fb9-f93d-4390-898a-50fb675dc2cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1322 microversion: 2.1 time: 0.159871 Oct 18 16:13:20.729418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1482/2978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:20 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:20.738594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:20.746569 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40cfb172-be14-4cab-bd0e-50f13e44abe0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.161626 Oct 18 16:13:20.747131 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1497/2979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:20 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:20.928338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69351565-cf4d-4d96-8624-0d8d46c953af", "name": "network-vif-plugged", "status": "completed", "tag": "7ce66c86-c944-42a5-a343-9dab7f31f106"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:20.941984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:20.942467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:20.942895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:20.955280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] Creating event network-vif-plugged:7ce66c86-c944-42a5-a343-9dab7f31f106 for instance 69351565-cf4d-4d96-8624-0d8d46c953af on n-h2-858383-14 Oct 18 16:13:20.960350 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c2ae1483-ca12-46da-8f6f-f0324307c3d9 req-f39b480d-536b-462a-ada2-38c0d86decdd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Oct 18 16:13:20.960947 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1483/2980] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:21.078242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:21.078907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:21.085847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.086340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.087308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.087608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.088077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.088508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.273393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:21.281518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54a86e34-76f1-45d6-8274-487831d5e041 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.207827 Oct 18 16:13:21.282104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1498/2981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:21 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:21.306983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:21.307768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:21.315732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.316218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.316688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.317434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.317869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.318570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.455705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:21.463584 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-819d096c-87b5-4ab8-a485-b1a2b960e1b2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.160734 Oct 18 16:13:21.464163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1484/2982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:21 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:21.548659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:21.549508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:21.556043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.556714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.557301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.558197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.558780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.559330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.610080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:21.610972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:21.617340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.617984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.618515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.619666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.619822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.620340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.829820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:21.840038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:21.841801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:21.843009 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d616b065-c191-4165-8feb-0c035f9c0cb0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.237505 Oct 18 16:13:21.843585 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1485/2983] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:21 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:21.848144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:21.848761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:21.855487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.855971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.856408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:21.857552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:21.858051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:21.858602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.000089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.002541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:22.009778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-57a31f6d-a285-406b-b03d-c8d56720c5d3 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1515 microversion: 2.1 time: 0.165170 Oct 18 16:13:22.010555 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1486/2984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:21 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:22.016883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:22.017517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.023352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.024118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.024555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.025267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.025709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.026123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.127114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.135188 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de6d02ff-5c5f-4ac9-af1e-5d13cd8da56b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.591262 Oct 18 16:13:22.151983 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1499/2985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:21 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:22.151983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:22.151983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.152802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.153349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.154547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.155392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.155855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.156313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.173674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.182525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lazy-loading 'flavor' on Instance uuid 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:13:22.188832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04d32e45-37fc-4f0d-ba64-dfe97b3110e3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.177090 Oct 18 16:13:22.189466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1487/2986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:22 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:22.251423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b63cd63-a37a-4534-b208-48b9d583d2c4 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action" status: 200 len: 32 microversion: 2.1 time: 0.114374 Oct 18 16:13:22.251930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1500/2987] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:22 2022] POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:22.261598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:22.262263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.268837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.269350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.269786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.270469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.270928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.271987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.304538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:22.305291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.311896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.312387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.312819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.313548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.314004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.314427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.410071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.417827 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-854ed60b-29e1-4b24-a6d7-70678f08aced tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.160102 Oct 18 16:13:22.418602 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1488/2988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:22 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:22.449366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.457855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3aa868b1-5bd5-46d0-9733-8721d3be8d59 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.157433 Oct 18 16:13:22.458424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1501/2989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:22 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:22.487546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:22.488143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.494439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.494938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.495372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.496062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.496515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.496940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.636209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:22.644543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1e867ee-88cb-4c61-b7ea-fba96d1a2765 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.161147 Oct 18 16:13:22.645127 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1489/2990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:22 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:22.869150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:22.869774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:22.876181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.876667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.877139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:22.877834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:22.878396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:22.878715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.067422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.077178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.078621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.079790 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33ffefe7-bc6d-4d29-8e8b-44973a49066a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.214617 Oct 18 16:13:23.080368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1502/2991] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:22 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:23.160737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:23.161380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:23.167380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.167866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.168343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.169099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.169633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.170057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.211951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:23.212645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:23.221327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.221918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.222351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.223045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.223497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.223988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.309235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.319941 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24eaa870-a311-4cca-b247-0b1ac761f416 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.163439 Oct 18 16:13:23.320519 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1490/2992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:23 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:23.365612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.374223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b0c32bc-1713-47fc-852a-d9f6c4ba461f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.166459 Oct 18 16:13:23.374822 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1503/2993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:23 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:23.441980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:23.442594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:23.448620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.449135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.449573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.450268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.451476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.451914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.480792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:23.481501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:23.488164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.488647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.489107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.489798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.490254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.490674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.591573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.603270 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d23675c-f18d-4d70-86e5-b7ea3f62424e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.165015 Oct 18 16:13:23.604056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1491/2994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:23 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:23.636038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.644025 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f340c3c-dcd1-413e-9ccf-7f45b0aa6a03 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1315 microversion: 2.1 time: 0.166996 Oct 18 16:13:23.644633 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1504/2995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:23 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:23.667271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:23.667888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:23.674652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.675139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.675576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.676271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:23.676724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:23.677187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:23.813009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:23.821012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc210a47-b66f-4d51-9cad-dec9d036ea4b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.157542 Oct 18 16:13:23.821605 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1492/2996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:23 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:24.106364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.108347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.114431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.114912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.115347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.116035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.116490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.116914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.300558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.309763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.311209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.312643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11a53345-e330-4897-9ba8-d1373f4591d6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.209918 Oct 18 16:13:24.313275 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1505/2997] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:24.347418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.348036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.354817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.355321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.355755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.356439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.358312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.358740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.400519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.402619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.410146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.410771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.411311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.412275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.412925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.413384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.557548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.567106 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2bdcea1-aeeb-428d-b5e5-1152cf790a6c tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.223399 Oct 18 16:13:24.568522 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1493/2998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:24.627778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.634824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.635575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.639416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc51cb41-3519-4131-a85c-43d6b26df74d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.245194 Oct 18 16:13:24.640585 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1506/2999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:24.643089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.643696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.644229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.645108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.645699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.646266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.667180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.668462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.676108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.676597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.677059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.677794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.678257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.678724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.788142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.796441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f839daab-7b62-41bd-8fc5-701336834c92 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.172543 Oct 18 16:13:24.797248 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1494/3000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:24.820132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:24.828576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-058ed546-2e3a-4578-8612-45d26fc3c753 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1502 microversion: 2.1 time: 0.165906 Oct 18 16:13:24.829198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1507/3001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:24.852212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:24.853334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.865090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.865830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.866425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.867364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.867968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.869081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.877871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:24.878613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:24.893167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.893671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.894117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.894842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.895288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.895715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.969141 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64e226c7-63c6-4994-854d-361c4e32317d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.107169 Oct 18 16:13:24.970123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1508/3002] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:24 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:24.975206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab11bbff-68ce-4847-bc2a-ba006c2ea12c", "name": "network-vif-plugged", "status": "completed", "tag": "96cd6e24-402f-410a-b04e-f06e124a9dfb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:24.986375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:24.986763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:24.987185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:24.999411 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] Creating event network-vif-plugged:96cd6e24-402f-410a-b04e-f06e124a9dfb for instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c on n-h2-858383-14 Oct 18 16:13:25.004219 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b25b9482-8604-4f7f-b979-3d80c406b3be req-abebb85e-2dc7-450e-87d6-dc7c07c81f1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Oct 18 16:13:25.005350 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1509/3003] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:25.027489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.036628 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f13836f9-9bd6-401f-b556-0a262ebcf912 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.188828 Oct 18 16:13:25.037292 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1495/3004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:24 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:25.336963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:25.338765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=21 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:25.347133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:25.347864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:25.355221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.355706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.356140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.357377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.357836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.358256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.592660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:25.593441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:25.601682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.602307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.602844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.603796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.604539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.605095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.652682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.664000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.665477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.666698 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49ccea8f-df72-442d-9a64-9d8dd7be6c38 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.331862 Oct 18 16:13:25.667461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1510/3005] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:25 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:25.692015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:25.692670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:25.698680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.699169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.699611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.700328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.701033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.701313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.758262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.768574 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d50eae4-4c0a-4c81-8b85-d4a31281d594 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.181401 Oct 18 16:13:25.773038 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1496/3006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:25 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:25.821287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:25.821906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:25.828148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.828647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.829118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.829825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.830281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.830737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.839163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.843137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:25.848294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5621ef4-d81e-4e0e-92d0-5c8c7f4e5184 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.169231 Oct 18 16:13:25.848869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1511/3007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:25 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:25.960965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:25.969421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a87c1a7-fdd8-4a60-8ec2-6e21b341617e tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.152067 Oct 18 16:13:25.969999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1497/3008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:25 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:25.979608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:25.982225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:25.989187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.989668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.990101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:25.990777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:25.991228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:25.991650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.060893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:26.061529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:26.067473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.067947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.068379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.069147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.069605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.070023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.132383 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b9f6aaa-fd4c-4cb1-a87c-2bc20709c28f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.156374 Oct 18 16:13:26.134114 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1512/3009] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:25 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:26.206076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:26.213613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24850d4e-6856-472d-8edc-8c59b85569e7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1323 microversion: 2.1 time: 0.156928 Oct 18 16:13:26.214178 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1498/3010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:26 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:26.698271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:26.698916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:26.706743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.707223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.707656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.708349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.708829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.709351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.794447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:26.795253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:26.802383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.803010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.803516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.804280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.804831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.805351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.900534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:26.910804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:26.912363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:26.913635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b390add-bb3d-4979-8ea3-d286fb9e5c0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.219736 Oct 18 16:13:26.914303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1513/3011] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:26 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:26.918965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:26.919843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:26.926136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.926387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.926897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.927670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.928202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.928724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.952305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:26.962056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e75977b-55b9-47f2-8da9-9da48a4a2181 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.171867 Oct 18 16:13:26.962819 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1499/3012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:26 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:26.993991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:26.994861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.002533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.003282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.003887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.004614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.005260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.005684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.071115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:27.080399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82728ac8-7b1b-4b89-8aa9-06e311e82767 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.164919 Oct 18 16:13:27.081206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1514/3013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:26 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:27.144551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.146935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.152829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.153380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.153603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:27.153812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.154502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.154976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.155396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.161823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b64b3881-2cb0-4e53-a7fa-5ee81030ba48 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.171838 Oct 18 16:13:27.162483 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1500/3014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:26 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:27.214354 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50a9e0a0-dc0c-41a0-84b6-734868b49f11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.073400 Oct 18 16:13:27.214888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1515/3015] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:13:27.236929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.237560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.243769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.244237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.244667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.245364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.245812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.246236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.377626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:27.385648 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9187fcd-2312-416c-8c51-53fd2e9480d4 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1518 microversion: 2.1 time: 0.152560 Oct 18 16:13:27.386226 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1501/3016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:27 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:27.448730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7890f2f3-f22a-4266-80f2-1630c12795f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1767256051", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7890f2f3-f22a-4266-80f2-1630c12795f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 243 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1767256051", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1767256051', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9b68f1d4-28d9-491e-8ede-2b1411932ce7'}]}}} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.453014 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7890f2f3-f22a-4266-80f2-1630c12795f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7890f2f3-f22a-4266-80f2-1630c12795f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010041 Oct 18 16:13:27.457652 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1516/3017] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers => generated 175 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:13:27.467140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.467567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: 41ea28f3-6917-4207-b5eb-ee24d5ba4300] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.473512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] HTTP exception thrown: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/41ea28f3-6917-4207-b5eb-ee24d5ba4300/metadata HTTP/1.1 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '41ea28f3-6917-4207-b5eb-ee24d5ba4300'} Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.484650 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 404 to user: Instance 41ea28f3-6917-4207-b5eb-ee24d5ba4300 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa85ec67-6875-41a5-9128-94a531eb57f7 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/41ea28f3-6917-4207-b5eb-ee24d5ba4300/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025043 Oct 18 16:13:27.489075 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1502/3018] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:13:27 2022] GET /compute/v2.1/servers/41ea28f3-6917-4207-b5eb-ee24d5ba4300/metadata => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:13:27.536767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97a1ffc4-a149-431b-b4f0-91a3e550fc2b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1017225911", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97a1ffc4-a149-431b-b4f0-91a3e550fc2b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 499 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1017225911", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1017225911', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b68f1d4-28d9-491e-8ede-2b1411932ce7'}]}}} Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:13:27.540947 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97a1ffc4-a149-431b-b4f0-91a3e550fc2b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97a1ffc4-a149-431b-b4f0-91a3e550fc2b tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009953 Oct 18 16:13:27.545556 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1517/3019] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers => generated 687 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:13:27.590157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26e2838b-aa21-42fb-aa34-7d05c60c6bd2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1516963210", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26e2838b-aa21-42fb-aa34-7d05c60c6bd2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 500 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1516963210", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1516963210', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b68f1d4-28d9-491e-8ede-2b1411932ce7'}]}}} Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:13:27.594472 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26e2838b-aa21-42fb-aa34-7d05c60c6bd2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26e2838b-aa21-42fb-aa34-7d05c60c6bd2 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009574 Oct 18 16:13:27.597982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1503/3020] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:13:27.644474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-754804d9-4691-4c53-832a-40840e30fe88 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-704086164", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-754804d9-4691-4c53-832a-40840e30fe88 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 753 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-704086164", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-704086164', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b68f1d4-28d9-491e-8ede-2b1411932ce7'}]}}} Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:13:27.648644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:13:27.651451 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:13:27.654470 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.654470 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.654470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-754804d9-4691-4c53-832a-40840e30fe88 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.654470 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-754804d9-4691-4c53-832a-40840e30fe88 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009872 Oct 18 16:13:27.654470 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1518/3021] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 18 16:13:27.699700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18b3f227-edea-4875-bac4-f618ed9bad3d tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1740102548", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18b3f227-edea-4875-bac4-f618ed9bad3d tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 1266 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1740102548", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b68f1d4-28d9-491e-8ede-2b1411932ce7"}]}} Oct 18 16:13:27.704093 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1740102548', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b68f1d4-28d9-491e-8ede-2b1411932ce7'}]}}} Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.706587 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:13:27.707810 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:13:27.709708 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:13:27.709708 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.709708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18b3f227-edea-4875-bac4-f618ed9bad3d tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.709708 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18b3f227-edea-4875-bac4-f618ed9bad3d tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010908 Oct 18 16:13:27.709708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1504/3022] 10.222.0.78 () {60 vars in 1148 bytes} [Tue Oct 18 16:13:27 2022] POST /compute/v2.1/servers => generated 2221 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 16:13:27.716822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.717578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: b8106e7e-1fcc-4db0-9e2a-50cddcca4b82] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.723814 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] HTTP exception thrown: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b8106e7e-1fcc-4db0-9e2a-50cddcca4b82/metadata/test2 HTTP/1.1 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': 'b8106e7e-1fcc-4db0-9e2a-50cddcca4b82', 'id': 'test2'} Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:27.725493 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 404 to user: Instance b8106e7e-1fcc-4db0-9e2a-50cddcca4b82 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1872f202-89f1-44d7-9eb8-36d8aca1fd2f tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/b8106e7e-1fcc-4db0-9e2a-50cddcca4b82/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015335 Oct 18 16:13:27.729420 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1519/3023] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 18 16:13:27 2022] GET /compute/v2.1/servers/b8106e7e-1fcc-4db0-9e2a-50cddcca4b82/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:13:27.741607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.742098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.748274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.748750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.749276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.749953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.750402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.750820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.775625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:13:27.801948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:27.853646 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d2e0454-4c0f-49fa-aa60-6cf900ab2316 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 204 len: 0 microversion: 2.1 time: 0.115198 Oct 18 16:13:27.854475 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1505/3024] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:13:27 2022] DELETE /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:13:27.864322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.865041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.871696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.872211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.872685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.873394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.873846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.874265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.941406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:27.942120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:27.948194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.948678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.949150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:27.949953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:27.950677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:27.951001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.008856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.016559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-276a0063-0cff-4e70-a7da-da95388ba206 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1524 microversion: 2.1 time: 0.156233 Oct 18 16:13:28.017155 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1520/3025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:27 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:28.021576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:28.022188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:28.028086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.029096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.029541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.030240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.030706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.031328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.147966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.158022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.159488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.160875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ebd1198c-2e24-4c73-ace8-b7e8c4807d6d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.224776 Oct 18 16:13:28.161476 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1506/3026] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:27 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:28.165940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:28.166915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:28.168664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.173477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.173964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.174405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.175102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.175590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.176017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.181943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ca5eaea-96cb-47a9-b5be-fdc5da39152a tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.163765 Oct 18 16:13:28.182535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1521/3027] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:28 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:28.188006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:28.188656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:28.195174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.195673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.196120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.196817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.197316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.197745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.328658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.330790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:28.338881 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1daa9de0-50c6-4a42-a93b-313d85dc087c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.176234 Oct 18 16:13:28.339201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f1ad735f-b5ee-4927-b146-6402e04987a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.155682 Oct 18 16:13:28.340020 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1507/3028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:28 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:28.340153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1522/3029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:28 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:28.354481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:28.357527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:28.363839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.364408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.364843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.365607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.366052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.366724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.481187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5efc66c-e521-4a0c-9416-2636eec7193e", "name": "network-vif-plugged", "status": "completed", "tag": "0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:28.492337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:28.492832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:28.493350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:28.505692 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] Creating event network-vif-plugged:0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378 for instance b5efc66c-e521-4a0c-9416-2636eec7193e on n-h1-858383-14 Oct 18 16:13:28.510653 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-88d577ea-ff82-4f8e-beff-e7812bc8cecf req-87ecb3da-4e58-4de4-9640-25ecef24fdd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033187 Oct 18 16:13:28.511648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1523/3030] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:13:28.947812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c89ac192-5ead-48b9-bb53-1254857152f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.598686 Oct 18 16:13:28.952033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1508/3031] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:28 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:29.041106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:29.041813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.043773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:29.049396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.049892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.050335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.051036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.051496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.051923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.187681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:29.188440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.190836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.195634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.196229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.196674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.197397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.197855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.198286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.198774 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f5db423-b145-4518-9b3f-54dd8dfd73c8 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1524 microversion: 2.1 time: 0.162943 Oct 18 16:13:29.199343 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1524/3032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:29 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1524 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:29.214261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:29.215273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.222956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.223667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.224100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.224792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.225410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.225832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.365916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.374137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e628050b-d214-4939-8598-e9c83e0b49b7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1401 microversion: 2.1 time: 0.163497 Oct 18 16:13:29.375085 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1525/3033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:29 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1401 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:29.379792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:29.380401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.386472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.386959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.387406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.388792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.389484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.389913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.411770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.422200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.423646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.424807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4826d152-867b-497f-ad0c-778b2afebf4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.241527 Oct 18 16:13:29.425411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1509/3034] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:29 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:29.447503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:29.448071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.454197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.454689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.455130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.455829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.456283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.456708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.521574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.529668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f76d427e-96bf-472d-bf1d-728b8e446373 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.153503 Oct 18 16:13:29.530251 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1526/3035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:29 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:29.590216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:29.598841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1366662-4e34-47c4-8177-5369c026c9cc tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.155179 Oct 18 16:13:29.599417 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1510/3036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:29 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:29.960144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:29.962830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:29.970250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.970907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.971428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:29.972244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:29.972762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:29.973218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.040786 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26b38cae-eb51-449c-98ad-6d8cccb46f9e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.084435 Oct 18 16:13:30.041485 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1527/3037] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:29 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:30.065967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab11bbff-68ce-4847-bc2a-ba006c2ea12c", "name": "network-vif-deleted", "tag": "96cd6e24-402f-410a-b04e-f06e124a9dfb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:30.079565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.080053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.081397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.095745 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] Creating event network-vif-deleted:96cd6e24-402f-410a-b04e-f06e124a9dfb for instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c on n-h2-858383-14 Oct 18 16:13:30.102754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-447bb8cf-0eed-440a-9715-53e98b424ef5 req-b60262b7-9719-4575-b16c-9dafa9bba34f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040499 Oct 18 16:13:30.103368 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1511/3038] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:30.223451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.224189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.231397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.232225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.232627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.233381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.233842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.234277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.280837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.281595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.281916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.282366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lazy-loading 'fault' on Instance uuid ab11bbff-68ce-4847-bc2a-ba006c2ea12c {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:13:30.331707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99e18a574be45d59ebbdc64b5effc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cf3f81f9b74f23a21ddf195abe07e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.339925 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2582295-2283-47e6-aef6-3c490ec44777 tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 200 len: 1313 microversion: 2.1 time: 0.120720 Oct 18 16:13:30.340597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1528/3039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 1313 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:30.399369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.400098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.402069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:30.408344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.408673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.409135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.409822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.410264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.410681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.451477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.452337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.459754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.460243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.460684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.461659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.462210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.462681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.551301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.559071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-058a1359-939b-4eaf-892a-0480bb05dcb8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1588 microversion: 2.1 time: 0.164396 Oct 18 16:13:30.559799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1512/3040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1588 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:30.565186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.565186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.570423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.570897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.571324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.571994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.572437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.572969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.653225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.663917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.665639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.667043 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e70ae928-e9c7-42f4-a0ed-0184179d777b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.220569 Oct 18 16:13:30.667805 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1529/3041] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:30.672327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.672825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.678852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.679527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.679967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.680656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.681303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.681731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.718512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.727119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27a8cfe4-71e4-4489-91a1-f8a9dc425d78 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.166175 Oct 18 16:13:30.727741 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1513/3042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:30.733829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:30.734431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:30.742939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.743707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.744371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.745375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:30.745831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:30.746252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:30.783679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31b16271-14c0-4c72-a929-f7c25b6715e7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114938 Oct 18 16:13:30.784701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1530/3043] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:30.896356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:30.904377 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e51d71f-db16-4953-9bba-f72f39d8bcd8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.174459 Oct 18 16:13:30.904961 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1514/3044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:30 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:31.052846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:31.055208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:31.062734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.063238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.063673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.064366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.064813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.065324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.126827 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e263617a-eaf7-4d00-aea7-c2c96c5dbf2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.078574 Oct 18 16:13:31.127639 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1531/3045] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:31 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:31.365094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:31.365716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] [instance: ab11bbff-68ce-4847-bc2a-ba006c2ea12c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:31.372226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.372707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.373180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.373874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.374330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.374783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.389821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] HTTP exception thrown: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Request method failure captured: Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c HTTP/1.1 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtCUtdWD3vzflKPy_AJfyBefREblsP0pCJyRo-SQIBzAcPAaK11D3eQeRj8wJ8NYtNn0cUXXhEA5YZJBv6ErOibSv72i1M4X_MBfzHxu92NqmLGXmucfZHMTmmyUqnjXUuauZnk78PBEQdJQ4laf1IrnPzUy2OuGg2vd1kfLhkUq6uU Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_26cf3f81f9b74f23a21ddf195abe07e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/26cf3f81f9b74f23a21ddf195abe07e2"}]}] Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 26cf3f81f9b74f23a21ddf195abe07e2 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1203730971 Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a99e18a574be45d59ebbdc64b5effc7a Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1203730971-project Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'ab11bbff-68ce-4847-bc2a-ba006c2ea12c'} Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:31.391485 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] Returning 404 to user: Instance ab11bbff-68ce-4847-bc2a-ba006c2ea12c could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:31.395796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee7810d5-9f85-47cd-9ced-f0327de0eecc tempest-ServerMetadataNegativeTestJSON-1203730971 tempest-ServerMetadataNegativeTestJSON-1203730971-project] 10.222.0.78 "GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c" status: 404 len: 111 microversion: 2.1 time: 0.031753 Oct 18 16:13:31.396978 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1515/3046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:31 2022] GET /compute/v2.1/servers/ab11bbff-68ce-4847-bc2a-ba006c2ea12c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:13:31.697211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:31.698185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:31.706365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.707365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.708160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.708872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.709358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.709947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.751309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:31.752098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:31.761878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.763318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.764250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.765616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.766416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.767139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.934113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:31.946469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:31.949178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:31.951021 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-332c604f-f1b9-4254-a411-9967123cf237 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.257913 Oct 18 16:13:31.951671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1532/3047] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:31 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:31.974808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:31.976077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:31.982411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.983156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.983693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:31.984492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:31.985098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:31.985818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.012342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:32.021023 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-54bc108f-73d7-46cc-9497-5a9aac6d014e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.274225 Oct 18 16:13:32.033398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1516/3048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:31 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:32.042095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:32.043329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:32.050290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.050777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.051215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.051918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.052365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.052788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.154731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:32.162809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1ed7782-9529-44cf-b5fb-11e0ee77aadd tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1588 microversion: 2.1 time: 0.196707 Oct 18 16:13:32.163583 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1533/3049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:31 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1588 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:32.168264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5efc66c-e521-4a0c-9416-2636eec7193e", "tag": "0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:32.178993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.179729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.180956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.197960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] Creating event network-changed:0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378 for instance b5efc66c-e521-4a0c-9416-2636eec7193e on n-h1-858383-14 Oct 18 16:13:32.208450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-533a1585-b22a-486f-94df-db2decaf30c7 req-fd926b60-5b10-4ae0-9b91-b9ea16a584cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043246 Oct 18 16:13:32.209432 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1534/3050] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:32.216563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:32.219222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:32.225568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.226062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.226504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.227211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.227672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.228110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.232605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:32.292975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:32.303801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20e28fad-86a2-4bb4-bf09-3597e7cabbdd tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.269230 Oct 18 16:13:32.304099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9df9aa0-526b-42e9-9caf-ee8a72e7dbf9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.087857 Oct 18 16:13:32.305061 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1535/3051] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:32 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:32.305988 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1517/3052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:32 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:32.982430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:32.983090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:32.991489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.992246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.992853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:32.993593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:32.994044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:32.994460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.050927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:33.051923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:33.067497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.067995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.068428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.069164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.069618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.070040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.221766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:33.232080 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cb63ab0-2a57-4e62-b4a1-bf4e927d7272 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.187539 Oct 18 16:13:33.232866 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1536/3053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:33 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:33.317087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:33.319302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:33.327617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.328112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.328741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.331780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:33.335885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.336361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.336965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.346502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:33.349310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:33.350627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a60beca4-8806-468e-9cbb-29dcf3581916 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.374488 Oct 18 16:13:33.351607 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1518/3054] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:32 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:33.358489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:33.359393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:33.365744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.366475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.367133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.368046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:33.368709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:33.369398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:33.454698 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1340add-0f6b-4147-bf27-1766f2d700c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.141931 Oct 18 16:13:33.456375 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1537/3055] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:33 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:13:33.609110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:33.619707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47830c69-27f1-4f23-83aa-8f897b251c97 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.266817 Oct 18 16:13:33.620473 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1519/3056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:33 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:34.257466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:34.258172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:34.265717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.266196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.266637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.267328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.267777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.269424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.383907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:34.384949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:34.401330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.401816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.402250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.402985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.403626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.404055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.510334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:34.520166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f80576a3-3763-474f-ba10-c9a5ac650693 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.267461 Oct 18 16:13:34.521620 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1538/3057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:34 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:34.526606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:34.529610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:34.535723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.536206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.536630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.537339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.537962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.538384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.604055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:34.614609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:34.616301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:34.617627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a241ad59-f733-4577-9a21-b3f744502d52 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.238536 Oct 18 16:13:34.618189 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1520/3058] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:34 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:34.644557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:34.645406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:34.651715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.652266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.652782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.654311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:34.654896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:34.655405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:34.750812 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-95ce51e9-c3bb-4526-8d80-3a24a8921b45 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.227724 Oct 18 16:13:34.751785 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1539/3059] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:34 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:35.041759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:35.049568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff274248-d652-4c48-8e1e-37b07ec91d6b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.409416 Oct 18 16:13:35.050148 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1521/3060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:34 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:35.451844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:35.461091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:35.461875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Searching by: {'deleted': False, 'project_id': 'a26e133352f14345a82cf54eb512f1be'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:13:35.474244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.474548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.474993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.484506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.485033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.486673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.520090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:13:35.544014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:35.545364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:35.557530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.558319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.558766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.560317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.560788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.561264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.562062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2fe2cdd-1a77-4ccf-9781-97e11b92de97 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.130008 Oct 18 16:13:35.563379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1540/3061] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:13:35 2022] GET /compute/v2.1/servers => generated 334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:35.577860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:35.586462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:35.587136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Searching by: {'deleted': False, 'project_id': 'a26e133352f14345a82cf54eb512f1be'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:13:35.593261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.593749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.594179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.595430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.596224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.596824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.631390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:13:35.675205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:35.682508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.683062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.683566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.839581 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f69e954-bea9-4c39-868c-842980fd7a1e tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.268068 Oct 18 16:13:35.840370 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1541/3062] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:13:35 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:35.847903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:35.849303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:35.853339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:35.857169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.858353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.859130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.860310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.860983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.861658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.868058 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7af5c393-0c6f-4878-9d1f-38339c9233e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1476 microversion: 2.1 time: 0.326028 Oct 18 16:13:35.869042 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1522/3063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:35 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:35.875625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:35.878540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:35.886319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.886866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.887308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.888580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:35.889075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:35.889705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:35.895993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:36.066102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:36.076468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:36.077994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:36.079163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0da11217-5a18-4b0c-ba6b-31211f6c4fe0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.236999 Oct 18 16:13:36.079753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1542/3064] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:35 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:36.092617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-582ead20-12ba-4a16-9ad0-528297781157 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:36.092617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-582ead20-12ba-4a16-9ad0-528297781157 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011235 Oct 18 16:13:36.092927 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1543/3065] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:13:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:36.097272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:36.098066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:36.104943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.105702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.106146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.107463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.107804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.108333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.233450 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-351ca77a-095e-4656-80fe-82ee2fad42ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 14 microversion: 2.1 time: 0.362983 Oct 18 16:13:36.233998 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1523/3066] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:35 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 14 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:13:36.259380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:36.269061 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fdc8fec-c2b9-4878-ad27-39012ac380a0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.175168 Oct 18 16:13:36.269648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1544/3067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:36 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:36.595849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:36.596441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:36.603939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.604421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.604857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.605571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.606018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.607200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.634705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:13:36.719139 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa2dff3f-6911-424e-aa4c-c875a1fbd020 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "DELETE /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 204 len: 0 microversion: 2.1 time: 0.127451 Oct 18 16:13:36.720037 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1524/3068] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:13:36 2022] DELETE /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:13:36.730014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:36.731035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:36.739320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.739804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.740259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.741023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.741420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.741838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.876424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:36.887130 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ec1f182-6c24-49e4-933c-1b8e878cdac5 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1699 microversion: 2.1 time: 0.161419 Oct 18 16:13:36.888781 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1545/3069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:36 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:36.901234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:36.901953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:36.910092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.911275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.911729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:36.912431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:36.912893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:36.913421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.054332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.063129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78029d27-945a-4434-89a5-1f616ab09a87 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1475 microversion: 2.1 time: 0.166118 Oct 18 16:13:37.063912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1525/3070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:36 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1475 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:37.096637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2144062059", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:37.108564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.109310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.115892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.116939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.117173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.117953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.118481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.118980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.153059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:37.153809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:37.154270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:37.154842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:37.155624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:37.164486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.165165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.165614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.166354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.166843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.167279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.186112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Getting quotas for project 488805e986a248a6b9fef434664c9b14. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:37.191622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Getting quotas for user 9f02f6ad29744dd28e493ca3a14f5775 and project 488805e986a248a6b9fef434664c9b14. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:37.204588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:13:37.206955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:13:37.256390 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02b7d2b1-f1ea-467e-bf14-c2e91604bd61 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.276507 Oct 18 16:13:37.257531 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1546/3071] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 278 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 16:13:37.262380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:37.265118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.272029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.272703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.273180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.274690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.274690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.274900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.328827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.338542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.340250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.342079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c27dcbc-decf-4ae0-accf-508920adc302 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.238235 Oct 18 16:13:37.342649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1526/3072] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:37.347512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.348124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.360919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d2f11dc-c229-471b-9c2b-10ef2fd6b5c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action" status: 200 len: 8205 microversion: 2.1 time: 0.102238 Oct 18 16:13:37.362390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1547/3073] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:37 2022] POST /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af/action => generated 8205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:37.366544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.367262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.376215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.376711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.377187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.377882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.378335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.378758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.421573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.433652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.437527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.439107 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13d43a75-d4c5-419a-8e40-ec06e8f23e98 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1278 microversion: 2.57 time: 0.095141 Oct 18 16:13:37.439769 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1527/3074] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:37.445841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.447326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.454417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.455185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.455814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.456693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.457361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.458578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.538998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.550209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85c45eb1-1cdc-4d3e-a359-34e47d394aad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.187245 Oct 18 16:13:37.551325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1548/3075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:37.603796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.612835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a376da24-0e78-4f27-a3a2-1cf61ac4d56d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.171726 Oct 18 16:13:37.613512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1528/3076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:37.639979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.640588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.647405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.647885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.648315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.649024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.649683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.650201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.788118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.797170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4da85f7c-345b-44bd-987b-ab6937a8b82b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.161757 Oct 18 16:13:37.797733 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1549/3077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:37.819263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.819882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.826683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.827407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.827848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.828546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.829020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.829457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.912101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:37.912789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:37.919552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.920161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.920659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.921806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:37.922326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:37.922811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:37.979596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:37.990333 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9c139252-e9dd-4e49-88cc-7879f11fe772 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.174878 Oct 18 16:13:37.991007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1529/3078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:38.013538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.014232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.020236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.020725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.021212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.021922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.022383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.022898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.098999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.107457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a380fb26-490f-4481-a4e9-2e2cc7211f32 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1699 microversion: 2.1 time: 0.199155 Oct 18 16:13:38.108958 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1550/3079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:37 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1699 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:38.113655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.114268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.120426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.120916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.121388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.122172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.122645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.123066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.175631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.183502 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-050e8b88-2b97-49ca-bd7a-3592bfe09695 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.174479 Oct 18 16:13:38.184063 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1530/3080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:38.206915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:38.207498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.213693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.214174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.214611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.215381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.216417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.216835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.264269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Locking {{(pid=120571) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 18 16:13:38.277378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.286006 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4abb3c04-b40f-41e9-97f1-b2c4967b2d19 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1475 microversion: 2.1 time: 0.175908 Oct 18 16:13:38.297066 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1551/3081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:38.330120 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32da1bd8-36a9-4d83-9855-4db3442681c7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.127643 Oct 18 16:13:38.333032 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1531/3082] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:38 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:13:38.338973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.339733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.345917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.346480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.346926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.347622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.348083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.348508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.369287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.369913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.376687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.377233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.377677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.378378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.378841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.380549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.485138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.493182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a880669-bb14-42aa-86a5-d51e8176f84b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.158061 Oct 18 16:13:38.493758 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1552/3083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:38.502888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.502888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.506896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.507487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.507986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.508749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.509315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.510013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.582050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.586096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.589645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:38.592743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.594499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.595978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fefb05c4-fbfa-4672-9397-fc7844c0022f tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.230657 Oct 18 16:13:38.596132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.597489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1532/3084] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:38.598218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.599366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afee9514-53f7-4a6e-aded-965e739bb3b4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1330 microversion: 2.57 time: 0.104668 Oct 18 16:13:38.613227 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1553/3085] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:38.613441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:38.613892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.613892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.614102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.614102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.614102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.614360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.614360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.614360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.614945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.615467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.621033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.639566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action HTTP/1.1 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 15 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: {"os-stop": {}} Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'bf4345bc-4647-4ee4-95a1-716a7c6c4a96', 'body': {'os-stop': {}}} Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked Oct 18 16:13:38.641307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:13:38.646207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 409 to user: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 is locked {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:38.646207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f700f87a-d09f-4431-93f6-534267a391d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 409 len: 107 microversion: 2.1 time: 0.045049 Oct 18 16:13:38.646207 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1533/3086] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:38 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 107 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:13:38.654061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:38.654816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.661754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.662237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.662671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.663362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.663813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.664238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.711940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Unlocking {{(pid=120571) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 16:13:38.762222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:38.769754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0924d87-5333-4777-b34f-cf90626fad7b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.119652 Oct 18 16:13:38.773022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1534/3087] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:38 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:13:38.776955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:38.779639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:38.785992 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54d501d9-cd32-4a94-ae86-3f7ac0206f26 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.185095 Oct 18 16:13:38.786277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.786579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1554/3088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:38.786765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.787206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.809410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:13:38.850682 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6e0d9be-68f6-4f6e-bec1-686d450b0db7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.075883 Oct 18 16:13:38.851278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1535/3089] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:38 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:13:38.859860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:38.861111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:38.867129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.867628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.868107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:38.868878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:38.869460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:38.869905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.010540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.018884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca735754-4a84-427b-9d12-23931b3bcebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.163447 Oct 18 16:13:39.019446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1555/3090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:38 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:39.131235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:39.131852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:39.138804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.139284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.139716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.140400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.140848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.141293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.273149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.281488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-596794a4-a305-4429-86a3-2470c0001a19 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1699 microversion: 2.1 time: 0.154540 Oct 18 16:13:39.282051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1536/3091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:39 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:39.310800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:39.311436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:39.317576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.318063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.318506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.319197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.319651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.320079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.454083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.461861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15fcf4e2-e64e-42dc-bf41-ec5bb679b2fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1475 microversion: 2.1 time: 0.155607 Oct 18 16:13:39.462428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1556/3092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:39 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1475 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:39.625447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:39.626154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:39.630255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:39.630907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:39.632754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.633203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.633641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.634982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.635443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.635868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.637666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.638453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.638911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.639648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.640114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.640549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.725847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.735350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.736801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.737978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-767e6c75-a9ed-4aa5-883e-c5b775bafcf4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1336 microversion: 2.57 time: 0.111780 Oct 18 16:13:39.738772 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1557/3093] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:39 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:39.809621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:39.810244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:39.816777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.817511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.818175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.819039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:39.819661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:39.820091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:39.830130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.839788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.842140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:39.843351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52cd3e76-96aa-427b-af67-f6ef7e512a88 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.223310 Oct 18 16:13:39.844212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1537/3094] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:39 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:40.035750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.041778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:40.042627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:40.044372 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e36cea7-f8d5-4109-86ee-5feab3d5132d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.238244 Oct 18 16:13:40.045366 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1558/3095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:39 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:40.049544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.050036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.050471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.051164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.051617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.052071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.131437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "name": "network-vif-unplugged", "status": "completed", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:40.149369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.150124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.150522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.166023 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Creating event network-vif-unplugged:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h1-858383-14 Oct 18 16:13:40.175073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] Instance 968fd83b-f594-44e0-a813-34f5a92b126c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:13:40.187411 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2a1a4339-9179-4919-8d3b-fafce18d7fb5 req-1be7c42b-3d7a-41fd-9ac2-89ff589ed130 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061404 Oct 18 16:13:40.188276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1559/3096] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:40.195231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.203721 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-434705c6-069c-429f-86a4-42bdb7b02da2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.165802 Oct 18 16:13:40.204619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1538/3097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:40 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:40.305746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:40.306563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:40.313216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.313792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.314294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.315063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.315586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.316078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.486873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:40.487841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:40.495066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.496013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.496668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.498528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.499293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.499940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.521576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.533097 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d963de3d-9a73-49b6-8e11-bb6d1e00f14d tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1699 microversion: 2.1 time: 0.231566 Oct 18 16:13:40.550057 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1560/3098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:40 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1699 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:40.767324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:40.768748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:40.777369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.778441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.778924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.779868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.780650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.782298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.804015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.816723 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-256ebf5b-4579-450f-a6a1-f6bea77b5fa6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1475 microversion: 2.1 time: 0.335552 Oct 18 16:13:40.820719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1539/3099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:40 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:40.872929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:40.874212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:40.883348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.884339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.884974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.885912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:40.888192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:40.888853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:40.911320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.925665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.927380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:40.928639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da72fdf4-2717-4d52-a456-289ddb6080d0 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1336 microversion: 2.57 time: 0.168521 Oct 18 16:13:40.951213 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1561/3100] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:40 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1336 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:41.070739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:41.071354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:41.081385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.082075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.082859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.084297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.084940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.086511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.219244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.245939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.248914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.251951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e7ad17b-bf88-4a69-91e6-d35b82de86b4 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.383193 Oct 18 16:13:41.271422 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1540/3101] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:40 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:41.310744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:41.312071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:41.321571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.322212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.322737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.324175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.324721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.326044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.382656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.393385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df2d50d0-aa75-4fcd-ac67-49de7e037710 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.328871 Oct 18 16:13:41.395138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1562/3102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:41 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:41.558230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:41.558852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:41.566414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.566910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.567512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.568219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.569012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.569727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.610816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.618100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbbb5401-7f0c-495b-84c4-d078cd51e947 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.345327 Oct 18 16:13:41.633936 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1541/3103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:41 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:41.669359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:41.682679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93cede3a-df30-42b5-8f4e-5e91b647feb1 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1632 microversion: 2.1 time: 0.128333 Oct 18 16:13:41.683515 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1563/3104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:41 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1632 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:41.768375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb3dfc7-b536-4532-b613-8ccb0ad449b3", "name": "network-vif-deleted", "tag": "f83c1c15-79c0-49b5-8fc6-59d5e9ca1984"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:41.781665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.782266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.782781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.796296 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] Creating event network-vif-deleted:f83c1c15-79c0-49b5-8fc6-59d5e9ca1984 for instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 on n-h1-858383-14 Oct 18 16:13:41.802081 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d0627ed3-89a7-417f-a0bd-72f7ffd1e537 req-cb86e061-5e52-4d9d-bb37-36bc791c624e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038111 Oct 18 16:13:41.802778 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1542/3105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:41.845196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:41.846092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:41.854339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.855961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.859180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.860201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.860496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.860986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.958693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:41.960156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:41.969478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.970213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.970723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:41.971711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:41.972521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:41.973210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.020649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.032049 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7dff0f7-2679-40cc-af3f-20b0ab941238 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1473 microversion: 2.1 time: 0.192112 Oct 18 16:13:42.033676 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1564/3106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:41 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:42.055756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.067004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.068726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.069964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa27a1c0-b297-44a6-b5e8-ea99ca72549e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1336 microversion: 2.57 time: 0.115649 Oct 18 16:13:42.070525 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1543/3107] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:41 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:42.220152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:42.225089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:42.230534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.231033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.231484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.244582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Creating event network-changed:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h1-858383-14 Oct 18 16:13:42.250751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] Instance 968fd83b-f594-44e0-a813-34f5a92b126c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:13:42.261306 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d77e6a7a-e6e3-4ffb-906a-aee3ec5aaa8d req-cd9e5ea4-8218-4318-97ef-8491befe11d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044885 Oct 18 16:13:42.261922 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1565/3108] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:42.286038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:42.286786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:42.293225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.293926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.294424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.295211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.295672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.296092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.420350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:42.422058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:42.429317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.430321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.431038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.432175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.432853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.433532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.489173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.502015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.503793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.505019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dbb0a5d-8e3d-478d-a41b-c94374c579f6 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.223035 Oct 18 16:13:42.505582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1544/3109] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:42 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:42.609148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.617121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82d1607d-68fe-4cc1-99a9-173237e56b00 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.202108 Oct 18 16:13:42.617693 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1566/3110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:42 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:42.644439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:42.645173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:42.651825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.652382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.652829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.654370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.654735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.655167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.709673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:42.710365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:42.717578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.718118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.718685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.719471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:42.719995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:42.720512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:42.791544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.800357 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2748a27-2e5f-47a4-9816-f1e1466a1d2b tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1632 microversion: 2.1 time: 0.094708 Oct 18 16:13:42.801352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1567/3111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:42 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1632 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:42.830095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:42.842808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3335f36d-5c86-4914-adb1-8b4575ebc665 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.202116 Oct 18 16:13:42.843401 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1545/3112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:42 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:43.055329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.055953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.063203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.063691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.064165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.064836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.065319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.065748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.096936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.097580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.104341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.104860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.105332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.106028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.107335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.107820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.173503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.181771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.183233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.185105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a1d5afe-3312-41da-8a7d-265f09b520cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1357 microversion: 2.57 time: 0.091473 Oct 18 16:13:43.189867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1546/3113] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:43.210549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:43.213750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.220407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.220901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.221392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.222106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.222605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.223033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.252683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.261398 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0e1e182-379d-44a6-a2ad-f9cfff856602 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1473 microversion: 2.1 time: 0.209855 Oct 18 16:13:43.261991 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1568/3114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1473 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:43.303753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:43.304180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:43.304646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:43.305082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:43.305498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:43.372703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.378763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.379252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.379691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.380393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.380845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.381301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.415267 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c079062c-d9f7-4b39-8850-5f23cf0c682b tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "POST /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7/action" status: 202 len: 1138 microversion: 2.57 time: 0.208700 Oct 18 16:13:43.415886 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1547/3115] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Oct 18 16:13:43 2022] POST /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7/action => generated 1138 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 18 16:13:43.437720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.438346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.444765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.445288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.445732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.446430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.446887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.447317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.516804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.522616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.525078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.526292 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c8b49e1-ad5d-48b8-b556-1ec36bf43f4a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.092524 Oct 18 16:13:43.527096 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1569/3116] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:43.532773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.533503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.539421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.539903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.540341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.541111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.541567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.541995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.642191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.642968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.650022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.650852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.651351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.652319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.652850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.654145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.744599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.754441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.756124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.757542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5edd5fa3-839e-48d1-b312-179cd86b70df tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.229395 Oct 18 16:13:43.758362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1548/3117] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:43.803584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.811980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9fb6132-9646-46f8-863f-b5d1b33eb42f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.175967 Oct 18 16:13:43.812553 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1570/3118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:43.824866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.825644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.832302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.832790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.833260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.833953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.834410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.834845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.838955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:43.866902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:43.867509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:43.873514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.873995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.874427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.875113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:43.875563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:43.875984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:43.880224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:43.906977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:43.915535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1db8db6-7b22-4319-b1c4-66224f9ac769 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1632 microversion: 2.1 time: 0.094603 Oct 18 16:13:43.916111 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1549/3119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1632 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:44.008755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:44.017343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b9cbedd-82c2-4f9e-884d-d19f27325a7a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.154435 Oct 18 16:13:44.017906 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1571/3120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:43 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:44.284248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:44.284893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:44.291463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.291951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.292408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.293119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.293584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.294015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.436358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:44.444432 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cba68d69-1405-42a6-bb50-5532d8295a30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1473 microversion: 2.1 time: 0.164039 Oct 18 16:13:44.445241 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1550/3121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:44 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:44.551763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:44.552362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:44.558908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.559950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.560393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.561113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.561567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.561988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.634135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:44.644046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:44.645684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:44.647142 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f2c2341-25cd-4013-8852-9e67288fd638 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.099302 Oct 18 16:13:44.647711 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1572/3122] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:44 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:44.784510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:44.785177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:44.791455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.791946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.792389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.793116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.794367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.794817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.835356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:44.836277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:44.844027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.844516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.845366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.846073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:44.846529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:44.846958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:44.997052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.005706 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f6ed852-f819-42d5-986b-d38ac190a1f0 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.174155 Oct 18 16:13:45.006580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1573/3123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:44 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:45.011796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:45.012754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.019275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.019981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.020418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.021897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.022606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.022984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.056638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.057156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.057598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.058043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lazy-loading 'fault' on Instance uuid adb3dfc7-b536-4532-b613-8ccb0ad449b3 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:13:45.067961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.078143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.079690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.081042 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4745a2b9-b980-474c-be36-6502521ea2d3 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.300393 Oct 18 16:13:45.081705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1551/3124] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:44 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:45.086400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:45.087069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.093959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.094516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.095180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.095872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.096475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.097287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.100045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c66912f0ca4625a0cb274c1386cb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e133352f14345a82cf54eb512f1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.109721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c1f453c-d641-40cc-8db3-5dce018e3981 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 200 len: 1360 microversion: 2.1 time: 0.101928 Oct 18 16:13:45.110391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1574/3125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:45 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:45.272418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.281944 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-43528f8d-07c7-4b17-a13f-ca1f6eaf7f06 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.199013 Oct 18 16:13:45.283158 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1552/3126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:45 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:45.469275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:45.469901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.475854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.476350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.476886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.477611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.478076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.478507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.614513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.623035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fdb9be1-fa1f-4a1c-880d-068d697ff44a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1470 microversion: 2.1 time: 0.158580 Oct 18 16:13:45.623594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1575/3127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:45 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:45.644528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:45.645091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.651399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.651878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.652309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.653126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.653467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.653892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.674183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:45.674833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.680908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.681428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.681873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.682568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.683025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.683456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.720472 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d163bea0-19a5-4126-86df-90ff4ee32dc9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c/action" status: 204 len: 0 microversion: 2.1 time: 0.079552 Oct 18 16:13:45.721287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1553/3128] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:45 2022] POST /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:13:45.729769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:45.730584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:45.739218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.739748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.740221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.740960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:45.741507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:45.741956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:45.758265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.769145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.771078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.772343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bfdb16af-5fad-4929-8189-c2a57941b80a tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.102080 Oct 18 16:13:45.773203 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1576/3129] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:45 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:45.966267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:45.974936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e6fd31e-8b2e-4c8e-837e-ec4bc6e6843a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1470 microversion: 2.1 time: 0.249201 Oct 18 16:13:45.975522 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1554/3130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:45 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:46.029914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.030546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:46.036955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.038316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.039104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.039815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.040273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.040691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.109628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.110367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:46.117093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.117591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.118041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.118759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.119262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.119754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.285350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.293194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fed840b6-fe5c-4f43-876d-3c9037ab2cc5 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.267705 Oct 18 16:13:46.297181 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1577/3131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:46.301123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.301748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] [instance: adb3dfc7-b536-4532-b613-8ccb0ad449b3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:46.307113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.308430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.309484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.310047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.311570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.312149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.312681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.316779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.318479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.319847 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dadc8a5d-340a-4e85-a569-80726a7af14e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.216221 Oct 18 16:13:46.326740 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1555/3132] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:46.332037 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] HTTP exception thrown: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. Oct 18 16:13:46.333806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Request method failure captured: Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 HTTP/1.1 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtA8znP4WEKNXiV8M-q2bPRrCFvpLYfF0BcMQ3PZpAvhr9Jh_uWpXCOsTg1llJwR8HbidrQStjgQVVdCMtDuqT-2OUcEDF0nkXp4tF0FizQyUpwXmz6JP0oc_r7gHTTCoS4yvHeiIup6Fyb6fyiNJfRzPeeKQ_GIfyAXOR_MRdxodcI Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a26e133352f14345a82cf54eb512f1be Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1830672998 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a26e133352f14345a82cf54eb512f1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a26e133352f14345a82cf54eb512f1be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a26e133352f14345a82cf54eb512f1be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a26e133352f14345a82cf54eb512f1be"}]}] Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1830672998 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a26e133352f14345a82cf54eb512f1be Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1830672998 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1830672998-project Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e8c66912f0ca4625a0cb274c1386cb28 Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1830672998-project Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'adb3dfc7-b536-4532-b613-8ccb0ad449b3'} Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:13:46.334242 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. Oct 18 16:13:46.339063 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:13:46.339600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:46.339691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Returning 404 to user: Instance adb3dfc7-b536-4532-b613-8ccb0ad449b3 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:13:46.341285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb9dd523-5f91-409a-9e1a-388ea8039dd0 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3" status: 404 len: 111 microversion: 2.1 time: 0.045807 Oct 18 16:13:46.341507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:46.342153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1578/3133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/adb3dfc7-b536-4532-b613-8ccb0ad449b3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:13:46.343798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.344286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.344759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.345977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.346712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.347511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.350029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b207a6f0-9c03-47e1-8125-571eb5ecd3a4 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] Calling method '.version_select at 0x7f5fd64f5820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.370460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b207a6f0-9c03-47e1-8125-571eb5ecd3a4 tempest-ServersTestJSON-1830672998 tempest-ServersTestJSON-1830672998-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198593321" status: 202 len: 0 microversion: 2.1 time: 0.024108 Oct 18 16:13:46.371249 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1579/3134] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198593321 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:13:46.550145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.558283 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd1edeab-6c67-48e8-bb82-0b7042fd6063 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.230072 Oct 18 16:13:46.559250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1556/3135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:46.801192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:46.802047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:46.809832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.810371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.810839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.811712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:46.812067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:46.812501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:46.896863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.913271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.915826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:46.917339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4927522b-4f30-455f-8f7e-013716447ed9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.120752 Oct 18 16:13:46.918157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1580/3136] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:46.999819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:47.001032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:47.017394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.017893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.018335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.019043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.023122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.025801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.125065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "0147223d-48b4-4d3c-b607-26ce497fc0bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:47.136383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.136513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.137071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.153945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] Creating event network-vif-plugged:0147223d-48b4-4d3c-b607-26ce497fc0bc for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:47.161266 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-608b50c2-8431-437f-baea-a4ad2bd24954 req-0f4e89c0-81f0-440d-ab58-08714eeea35a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040381 Oct 18 16:13:47.162413 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1581/3137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:47.298858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:47.307749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-da059fa6-acd6-45d3-9e1d-7884cb2918d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1470 microversion: 2.1 time: 0.311858 Oct 18 16:13:47.308325 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1557/3138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:46 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:47.321038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:47.322153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:47.328084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:47.328803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:47.339101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.339820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.342405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.343312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.343935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.344504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.357514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:47.360041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:47.374429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.375286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.375898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.376906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.377784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.378412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.461546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:47.616691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:47.635659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33bd3adb-0f9e-460e-b35a-53cd667d589a tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.315551 Oct 18 16:13:47.654959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1582/3139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:47 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:47.660453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:47.661098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:47.668203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.669356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.670698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.671483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.672086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.672676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.826760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:47.842226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:47.845032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:47.847348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80029e51-d972-4d84-839b-4d46738dea01 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.499494 Oct 18 16:13:47.848223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1558/3140] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:47 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:47.945443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:47.946792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:47.955035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.955974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.956428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:47.957204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:47.957673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:47.958117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.038683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.052067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.053800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.055412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bed1ea26-39bc-4763-95ab-18ae454ec620 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.114116 Oct 18 16:13:48.056104 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1559/3141] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:47 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:48.308581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.317314 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a03cb122-798e-4609-93bd-38807b1d4ea8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.661174 Oct 18 16:13:48.317905 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1583/3142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:47 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:48.336196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:48.337040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:48.344173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.344380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.344754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.345504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.345961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.346416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.489852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.498439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca02ec19-b40d-46e0-bd0a-95499fa56454 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1462 microversion: 2.1 time: 0.166570 Oct 18 16:13:48.499030 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1560/3143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:48 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1462 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:48.520202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:48.520824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:48.527141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.527620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.528209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.529265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.529725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.530149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.663105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:48.663844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:48.671035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.671535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.671992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.672755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.673260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.673699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.742593 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b89787ae-afac-42a4-bbd1-c99d386be131 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1615 microversion: 2.1 time: 0.226056 Oct 18 16:13:48.743635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1584/3144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:48 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1615 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:48.773971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0a99967e-3265-4f20-8d80-a3ce8b322790 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '.version_select at 0x7f5fd65228b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:48.777414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a99967e-3265-4f20-8d80-a3ce8b322790 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.778819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a99967e-3265-4f20-8d80-a3ce8b322790 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.779432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a99967e-3265-4f20-8d80-a3ce8b322790 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.786434 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0a99967e-3265-4f20-8d80-a3ce8b322790 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.016267 Oct 18 16:13:48.787338 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1585/3145] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:13:48 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:48.827595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:48.836645 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-360b7d67-a858-4f44-93a0-753b5a57e64d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.177275 Oct 18 16:13:48.837269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1561/3146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:48 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:48.877590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:48.878119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:48.884095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.884686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.885025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.885883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:48.886336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:48.886757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:48.904502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1320562194", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:48.962021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:13:49.160069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.170284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.173108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.173720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c590c6da-8cfe-4e33-92ad-d9c5caefe6b7 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.300249 Oct 18 16:13:49.177399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1586/3147] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:48 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:49.184414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:49.185379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:49.189357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:13:49.189969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:13:49.190560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:13:49.191080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:13:49.191722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:13:49.192810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.193334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.193939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.194801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.195268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.195698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.204305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.204804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.205357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.206089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.206736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.207171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.225848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:13:49.231946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:13:49.246678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:13:49.251579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:13:49.270141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.280495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.281956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.283165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb228204-b4b9-4741-ad20-f08343a19bc9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.104771 Oct 18 16:13:49.283877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1587/3148] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:49 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:49.288471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "e8acfc01-a36e-4749-933d-0d6b80196941"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:49.297950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.298652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.299226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.311142 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] Creating event network-vif-plugged:e8acfc01-a36e-4749-933d-0d6b80196941 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:49.316688 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-78cad34f-3295-4817-8431-8eeb0845550a req-8d1c2f48-88c5-48bc-851c-ef3446db5aa3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031388 Oct 18 16:13:49.317685 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1588/3149] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:49.317877 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-905440e2-c20b-4b0e-b3f3-72df1586f97c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420113 Oct 18 16:13:49.318531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1562/3150] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:13:49.330892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4881d883-28e2-4478-8f9b-58c6f8d6ac11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:49.331605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4881d883-28e2-4478-8f9b-58c6f8d6ac11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:49.346705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:49.347653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:49.366569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.367194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.367903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.369384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.369953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.370486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.451996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4881d883-28e2-4478-8f9b-58c6f8d6ac11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.471728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4881d883-28e2-4478-8f9b-58c6f8d6ac11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1213 microversion: 2.1 time: 0.144994 Oct 18 16:13:49.472598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1589/3151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:49 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:49.564580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:49.573481 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa062d9d-e17c-491f-9728-3af139842b29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.233655 Oct 18 16:13:49.574174 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1563/3152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:49 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:49.863225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:49.863964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:49.880037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.880534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.880967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:49.882006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:49.882645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:49.883246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.110858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.120290 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d885387b-20f6-413b-ace4-fef6cc9608a7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.260691 Oct 18 16:13:50.121086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1590/3153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:49 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:50.207616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:50.209134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:50.240082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.244181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.245369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.248529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.249583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.250737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.310702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:50.311843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:50.332433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.332941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.333422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.339064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.341807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.342465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.492359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.506123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.511871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.522087 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c28b2f64-64ae-458b-871e-173de5558c8d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.215904 Oct 18 16:13:50.523576 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1591/3154] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:50 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:50.531016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:50.532087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:50.539842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.540625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.541361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.542256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.542869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.544013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.571651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:50.646334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.658164 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d4f6ec9-b788-4f0d-ba6c-ad1135753fab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1265 microversion: 2.1 time: 0.133298 Oct 18 16:13:50.659118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1592/3155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:50 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:50.670840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:50.671563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:50.687254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.687776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.688207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.689784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:50.690489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:50.690698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:50.803068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.814476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.822070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.825304 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ee317b1-47d5-4102-b6aa-e34c9b820c85 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.626747 Oct 18 16:13:50.834093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1564/3156] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:50 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:50.970902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:50.984668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94951bec-1e41-4256-9f05-440f62901f27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.324587 Oct 18 16:13:50.991630 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1593/3157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:50 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:51.147673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:51.148296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:51.156978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.157503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.157995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.158868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.159338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.159774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.172637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:51.552838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:51.555292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:51.556017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:51.568314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d742caa-fb14-40c9-87d6-22589b3cd3e1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.423732 Oct 18 16:13:51.569635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.571582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.574425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.577804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.578384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.584624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.585290 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1565/3158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:51 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:51.672448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:51.692429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:51.693332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:51.701259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:51.704952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:51.712744 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5944705-6e75-4717-85c0-89d9c2d163cb tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.160894 Oct 18 16:13:51.737505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1594/3159] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:51 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:51.739801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.743249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.743431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.745998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.748307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.749572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.854722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:51.855471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:51.877198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.878029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.878594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.879544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:51.880103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:51.880629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:51.984939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.001554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5764e47-4de0-4c32-a9ae-76e32fe20b38 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1271 microversion: 2.1 time: 0.315421 Oct 18 16:13:52.002693 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1566/3160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:51 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:52.011376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:52.012470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:52.019829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.020580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.021380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.022249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.022946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.023527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.249872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.263299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d99b47b-b673-40a3-ad84-ea9503621419 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.256219 Oct 18 16:13:52.278531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1567/3161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:52 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:52.400000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.411647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.413130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.414334 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bff5bd13-cfa0-4adf-aca3-debbc1e16a42 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.563545 Oct 18 16:13:52.415382 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1595/3162] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:51 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:52.594080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:52.594698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:52.602072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.602638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.603086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.604017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.604638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.605244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.751137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:52.753328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:52.767199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.769818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.770224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.770963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:52.771424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:52.771847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:52.774305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.783796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-603b7c75-645d-4928-9996-28c7a7e4437c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.194499 Oct 18 16:13:52.784531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1568/3163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:52 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:52.864109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.873169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.875372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:52.876620 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72c06c0b-76fa-44ec-8695-70ca820b9c51 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.136533 Oct 18 16:13:52.896530 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1596/3164] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:52 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:53.027366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:53.028152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:53.034891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.035465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.035893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.036814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.037522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.037944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.185928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.195930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51cd9ed9-9188-4d98-847a-a84c11ef3072 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.172132 Oct 18 16:13:53.212177 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1569/3165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:53 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:53.291630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:53.292768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:53.299503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.300464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.300671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.301756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.302301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.302744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.441532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:53.442399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:53.450203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.451290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.451928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.452813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.453450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.454033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.571330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.585057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02fe721c-f721-47de-8594-a5975e1c0124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.297816 Oct 18 16:13:53.604931 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1597/3166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:53 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:53.699463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.710535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.712354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.713674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f238480-8a16-466f-aee0-fbbb527da25d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.276049 Oct 18 16:13:53.714319 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1570/3167] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:53 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:53.756540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:53.772375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.773206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.773818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.788215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] Creating event network-changed:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h2-858383-14 Oct 18 16:13:53.795311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7c297546-6a1b-4c7c-8a07-27619c60b902 req-d7657e96-d249-482e-a279-d11c43a9e46b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044766 Oct 18 16:13:53.796720 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1598/3168] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:53.809832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:53.810527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:53.817612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.818209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.818726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.819324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.819781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.820360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.904660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:53.906005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:53.912154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.912636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.913091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.913789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:53.914238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:53.914659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:53.976182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.988658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-445fec92-7f91-4a2f-a41e-20aef52a412f tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.184629 Oct 18 16:13:53.989370 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1571/3169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:53 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:53.989506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:53.998799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:54.000234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:54.001425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-58c234b1-326e-4224-a096-7b176470d551 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.102090 Oct 18 16:13:54.002154 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1599/3170] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:53 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:54.221362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:54.221990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:54.228699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.229238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.229688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:54.230395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.230915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.231359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:54.467947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:54.479153 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-438ed988-6e50-4d0b-8c19-daf16bb2c9d3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.263946 Oct 18 16:13:54.482847 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1572/3171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:54 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:54.613780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:54.614732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:54.624034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.624534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.625232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:54.626102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.626719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.627291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:54.740905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:54.742135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:54.765902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.768058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.770426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:54.771332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:54.773223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:54.773826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.116250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.132246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.139027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.141023 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-74a87627-c865-4706-8699-bbf741b8da72 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.404961 Oct 18 16:13:55.141770 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1573/3172] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:54 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:55.155086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "d545d154-d29a-4721-974e-2346990757e0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:55.169878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.170418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.171007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.186058 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] Creating event network-vif-plugged:d545d154-d29a-4721-974e-2346990757e0 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:55.194394 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3affdce8-af81-4a33-b653-0f71cec9d3b4 req-db468f47-82ea-42f0-8cae-1e2aa32d0d42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042819 Oct 18 16:13:55.196269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1574/3173] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:55.208705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:55.210110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:55.220890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.221678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.222373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.223332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.224152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.224681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.308879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.317498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a84b7c3-4b06-4035-a770-37cb1ac4eda4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1656 microversion: 2.1 time: 0.707913 Oct 18 16:13:55.318609 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1600/3174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:54 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1656 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:55.326000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:55.326961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:55.342174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.342984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.344949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.345863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.346550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.349682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.436614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.447502 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb66517e-3db9-4e6b-9ed2-71651d831b0b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.249109 Oct 18 16:13:55.448420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1575/3175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:55 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:55.454681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:55.465121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.488596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.492172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.493038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.493736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.494326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.494789 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7955f97-ee18-44e1-9c37-185035d373bf tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.174447 Oct 18 16:13:55.497783 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1601/3176] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:55 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:55.505418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:55.506235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:55.519414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.519925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.520371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.521184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.521646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.522081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.536468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Going to try to start instance {{(pid=120571) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:13:55.594972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bcc6f51f-4d71-44ee-b1c3-b92747cd8f4e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.145377 Oct 18 16:13:55.595591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1576/3177] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:55 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:13:55.604215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:55.604984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:55.612225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.612772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.613428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.614140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:55.614652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:55.615260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:55.768104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.777915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:55.778172 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5abfe373-a32f-46ff-b964-52ebb027059f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.177925 Oct 18 16:13:55.779212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1577/3178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:55 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:55.789985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-527d5e73-e272-42d8-8bce-9040e1437bf0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.288057 Oct 18 16:13:55.791147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1602/3179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:55 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:56.168834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.169982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.176906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.177668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.178290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.181018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.181713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.182382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.395966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.409434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.412684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.414685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e697c8ac-3ea9-4165-ad19-7f549de940a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.249933 Oct 18 16:13:56.429046 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1578/3180] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:56.473304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.474720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.484897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.485680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.486293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.487270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.487893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.488488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.524305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.525316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.532969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.534016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.534550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.535517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.536067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.536563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.609366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.620384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.623079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.624396 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2ebd791-bbad-4457-8212-857c2a6779ab tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.104315 Oct 18 16:13:56.625348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1579/3181] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:13:56.704942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.714432 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49715481-338a-4068-bf45-3846ce3a5bad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.246232 Oct 18 16:13:56.715937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1603/3182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:56.801574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.802200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.808269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.809176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.809908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.810805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.811434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.812043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.815769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.816641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.829214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.830109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.830938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.832044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.832735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.833536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.976062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.987315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ded30bd-d25a-4b49-b8e2-bb8900dfb092 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.189502 Oct 18 16:13:56.988269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1580/3183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:57.147161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.155616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e41ced38-f325-48e9-8faf-a5aa73e40cf3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.345849 Oct 18 16:13:57.156580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1604/3184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:57.237845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "5dd3f60f-dabc-4452-8707-c140dc1935f9"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "0550edd3-33e0-43ef-8b64-433a50dea17b"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "21efc73e-c465-4129-916d-cfb89b7cb6dd"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-plugged", "status": "completed", "tag": "d69b5074-0fd6-4391-9702-d54fc28d744e"}, {"server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "name": "network-vif-plugged", "status": "completed", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:57.251964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.252850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.253572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.272608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Creating event network-vif-plugged:5dd3f60f-dabc-4452-8707-c140dc1935f9 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:57.273153 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Creating event network-vif-plugged:0550edd3-33e0-43ef-8b64-433a50dea17b for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:57.273653 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Creating event network-vif-plugged:21efc73e-c465-4129-916d-cfb89b7cb6dd for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:57.274168 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Creating event network-vif-plugged:d69b5074-0fd6-4391-9702-d54fc28d744e for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:13:57.274636 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] Creating event network-vif-plugged:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h1-858383-14 Oct 18 16:13:57.283749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c897224e-ba9d-4492-aa0d-d31220583d7a req-184906d6-50e0-4247-8345-6458a67f84db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.054222 Oct 18 16:13:57.284594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1581/3185] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:13:57.442554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:57.443171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.451777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.456261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.456261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.456981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.457588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.458004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.654375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:57.655134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.663656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.664396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.665045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.665924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.666571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.667286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.701284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:57.752394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.771380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.773291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.777601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f2f80866-9edb-49da-81c2-a61de78c470d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.338969 Oct 18 16:13:57.794013 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1605/3186] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:57 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:57.816703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.820829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:57.823705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.832032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.833649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:57.837205 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12449c14-cb1c-489a-b8cc-1965efc06703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.188514 Oct 18 16:13:57.837748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.838589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.839237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.840356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.844323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.845292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.852693 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1582/3187] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:57 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:58.011905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:58.013414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:58.033024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:58.034136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:58.034590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:58.035409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:58.035935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:58.036372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:58.349878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:58.362162 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e59750aa-9920-4261-9aa2-3a4d425ac71b tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.558028 Oct 18 16:13:58.369994 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1606/3188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:57 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:58.377526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:58.378141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:58.395500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:58.396428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:58.399107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:58.400236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:58.401083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:58.401755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.017672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.033597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.073836 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3089b15-f6d5-4646-97b8-261eb3ce0054 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.696428 Oct 18 16:13:59.075024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f1fcf7d-9422-4fd9-b786-9071079e2e3f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 1.063290 Oct 18 16:13:59.092254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1583/3189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:58 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:59.097892 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1607/3190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:58 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:59.110558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:59.111318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:59.115372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:59.116827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:59.137935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.139271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.140005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.142671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.143164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.144138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.144829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.147478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.147973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.148653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.149510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.153810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.232427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:59.241741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:59.291732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.302659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.304105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.305358 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2209ff23-140d-4e24-ab77-02ad1957c290 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.206316 Oct 18 16:13:59.316175 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1608/3191] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:59 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:13:59.387017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:59.389186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:59.396122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.397768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.399003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.399851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:59.401358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:59.401907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:59.434742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:59.470902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:59.593949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.603254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-132e4add-4004-4aa1-82ef-6296c2fc06ad tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.219892 Oct 18 16:13:59.613662 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1609/3192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:59 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:13:59.732821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.746007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.748986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:59.750302 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c73df168-375d-4094-a3c4-8a81272d83a5 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.672769 Oct 18 16:13:59.751393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1584/3193] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:13:59 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:00.109464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:00.110228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:00.114873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:00.117482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:00.127882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.128241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.128374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.128807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.129556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.130012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.130498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.130669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.131320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.132585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.133211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.134027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.303355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:00.313679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6db85213-9f7c-4f1c-a350-71c259b7d0c5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.216759 Oct 18 16:14:00.333425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1610/3194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:00 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:00.339147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:00.340611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:00.347341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.348408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.349018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.349902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.350516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.351093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.363787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:00.377415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e6293adb-3ea7-45d6-84b6-dc975cb0318d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.274533 Oct 18 16:14:00.387986 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1585/3195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:00 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:00.458790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:00.469815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:00.471449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:00.472731 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f853407-e041-487a-9d85-199038932703 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.137921 Oct 18 16:14:00.485029 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1611/3196] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:00 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:00.629643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:00.630463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:00.639382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.640593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.641670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.642684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.643616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.644715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.778454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:00.779339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:00.790975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.791548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.792001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:00.792841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:00.794020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:00.794436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.048971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.060627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-919f2a7a-fd00-4c8b-9bc0-a839afdc86a9 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1521 microversion: 2.1 time: 0.435349 Oct 18 16:14:01.061347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1586/3197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:00 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:01.092525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.109944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.111411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.112624 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c450647-a61d-4f56-a1d6-63c230f9c204 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1874 microversion: 2.42 time: 0.338873 Oct 18 16:14:01.113461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1612/3198] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:00 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1874 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:01.343046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:01.344933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:01.352260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.352759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.353232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.354196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.354658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.355089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.402641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:01.404856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:01.412382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:01.416921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.417816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.418991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.419976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.420677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.421567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.743734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.759070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2888e87-40d2-40be-9bad-dc6f7365f11a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.360767 Oct 18 16:14:01.760168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1613/3199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:01 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:01.766625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:01.767637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:01.775485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.776071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.776572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.781918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.782597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.782785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.783605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.791568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b63f3cd-bb7b-4652-a42c-625b8586b5cb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.454175 Oct 18 16:14:01.792401 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1587/3200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:01 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:01.821201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:01.821879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:01.831463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.831953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.833166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.834373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.835075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.835922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.885616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.895762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.897558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.898774 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd2b10b8-67b6-478a-85d8-4013711634cd tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.137376 Oct 18 16:14:01.899531 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1614/3201] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:01 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:02.006832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "name": "network-vif-plugged", "status": "completed", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:02.019459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.020854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.021560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.036882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] Creating event network-vif-plugged:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h2-858383-14 Oct 18 16:14:02.045376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-880b0bbc-765d-49fb-8fb5-d966e556c3ec req-811fb78b-baea-4dea-808d-46cd5b498d15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043003 Oct 18 16:14:02.047261 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1615/3202] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:02.097695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:02.098761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:02.115939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.116518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.117022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.118157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.118651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.119728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.264808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.280181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53e25e54-e437-4cca-8c49-51d21c4b8e54 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.465877 Oct 18 16:14:02.298529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1588/3203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:01 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:02.304088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:02.305286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:02.315015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.315716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.316161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.316872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.317363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.317780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.658364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.669144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.670636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.671936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7a1e509-abf2-4c61-95b7-8f708a7d849a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2831 microversion: 2.42 time: 0.372126 Oct 18 16:14:02.672548 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1589/3204] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:02 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2831 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:02.677269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:02.678017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:02.686239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.686981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.687617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.688498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.689166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.689782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.741378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.748505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Unlocking {{(pid=120571) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 16:14:02.753328 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ab69ce5-3be2-4129-a598-6f50025d93ae tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1501 microversion: 2.1 time: 0.669224 Oct 18 16:14:02.757192 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1616/3205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:02 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1501 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:02.809415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-374cd710-e0c7-4c84-9373-dd0913ecb77b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.135329 Oct 18 16:14:02.810825 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1590/3206] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:02 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:02.825579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:02.826080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:02.832312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.833742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.834358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.835072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.835513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.836160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.916082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2081937103", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a24de80b-6b72-4a1a-97a4-67ad948202db"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:03.004956 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c622830b-1fc6-4379-8065-6ca2a530e720 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.192747 Oct 18 16:14:03.005592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1591/3207] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:14:02 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f/os-interface => generated 1830 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:03.007672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] validate_networks() for [('a24de80b-6b72-4a1a-97a4-67ad948202db', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:14:03.011663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80b47a5b-7491-4933-b990-e095a340e581 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'create', calling method: .version_select at 0x7f5fd6570430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-383438839", "description": "tempest-description-1245988293"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:03.416793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80b47a5b-7491-4933-b990-e095a340e581 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.409890 Oct 18 16:14:03.417748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1592/3208] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 18 16:14:03 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:03.423499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:03.424218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:03.438737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.439244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.442456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.445272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.445827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.446284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.518851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:03.525988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:03.526652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:03.527806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:03.529358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:03.545141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.546052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.546697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.549087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.549786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.550478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.589059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Getting quotas for project 8c5c1a9259f64a7e937a160a7967f708. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:03.597185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Getting quotas for user 818cfb3b5ddc4838a93a0d301ac89e22 and project 8c5c1a9259f64a7e937a160a7967f708. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:03.617747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Going to run 2 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:03.628602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:03.686827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=4f1718f3-9725-4e2a-bb5c-8af9e25ca11e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:03.800274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adb3cf96-88b7-454b-84c2-6999d36478e3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043999 Oct 18 16:14:03.807680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1617/3209] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:14:03.812026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:03.812724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:03.822233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.822729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.823165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.823873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.824438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.825046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.104833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.114282 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-498eb061-cce8-468c-bb97-94b5dbe24a7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.312507 Oct 18 16:14:04.114988 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1618/3210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:03 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:04.138586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.139558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.146255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.147056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.147890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.148907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.150539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.151197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.179725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.189295 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-22f9f5cd-4673-45f3-92aa-b92c87ed318b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1313 microversion: 2.1 time: 0.769943 Oct 18 16:14:04.190023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1593/3211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:03 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:04.219554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-383438839"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:04.220516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.233503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.234515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.235492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.237283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.237938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.238987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.268111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.283427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.285153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.286505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-194f18b1-9ce5-4d59-9166-88bd03a9e1de tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.155698 Oct 18 16:14:04.316793 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1619/3212] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:04.330324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.340724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.341668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Searching by: {'deleted': False, 'project_id': '8c5c1a9259f64a7e937a160a7967f708'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:14:04.360518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.361350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.361980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.362715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.363167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.363748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.391888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e1535873-2450-4fef-b99c-3722162c5af6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.071876 Oct 18 16:14:04.399394 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1620/3213] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers => generated 677 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:04.404724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.406645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.413343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.414087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.415318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.416209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.416839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.417453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.604037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.616882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe106dbb-639f-4816-a47d-21eec99bec37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.215922 Oct 18 16:14:04.618530 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1621/3214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:04.638452 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.network.security_group_api [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Adding security group b2da1aee-d47a-4866-af8a-2bf0edb83909 to port 7a15a71b-2801-42c2-ad2e-d53e5ffa277a Oct 18 16:14:04.641641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa7d31c9-82ae-4032-8f44-53e837a0a588 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.642499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa7d31c9-82ae-4032-8f44-53e837a0a588 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.711091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa7d31c9-82ae-4032-8f44-53e837a0a588 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.719869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa7d31c9-82ae-4032-8f44-53e837a0a588 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1220 microversion: 2.1 time: 0.083230 Oct 18 16:14:04.720882 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1622/3215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:04.725789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.726468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.733763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.734324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.735054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.736658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.737429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.738010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.979572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:04.991497 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67cbfb12-6e52-481d-b64e-885211843af1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.269229 Oct 18 16:14:04.997918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1623/3216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:05.017041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:05.018329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.037692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.038958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.039646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.040750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.047592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.051925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.186263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b862102b-ba32-49ea-8c89-96f624a3f224 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.173782 Oct 18 16:14:05.187566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1624/3217] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:05 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:14:05.197322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:05.199711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.212568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.213167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.213765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.214492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.215650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.217499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.396043 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e581b001-c898-4442-896c-ed981693c690 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action" status: 202 len: 0 microversion: 2.1 time: 1.203640 Oct 18 16:14:05.401563 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1594/3218] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:04 2022] POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action => generated 0 bytes in 1211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:05.408861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.426178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:05.428618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9add97dc-f05f-47c5-9839-ac381f2c5ae8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1674 microversion: 2.1 time: 0.237253 Oct 18 16:14:05.436173 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1625/3219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:05 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:05.450535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.458509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:05.467177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.482752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.483451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.484132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.485229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.485525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.486274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.486910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.487992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.492211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.493083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.498164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.498773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.667779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.682488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.689042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.691134 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b45e935-9983-4617-ba43-f6e3e0e5eeea tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.239751 Oct 18 16:14:05.693610 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1626/3220] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:05 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:05.698473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-383438839"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:05.699335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.706146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.707604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.708263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.709206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.710143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.710806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.839384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.856552 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a1d35c5-6dad-4e41-974d-72033840f6b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1462 microversion: 2.1 time: 0.451817 Oct 18 16:14:05.857701 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1595/3221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:05 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1462 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:05.863209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:05.880008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.880575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.881271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.900257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] Creating event network-changed:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:14:05.911355 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-52f273af-e07c-496e-b060-e3f242d9230d req-86464bc1-3ada-4730-86c5-b78dd128deb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052168 Oct 18 16:14:05.916007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1596/3222] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:05.923179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:05.924321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:05.932662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.933411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.933711 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Removing security group b2da1aee-d47a-4866-af8a-2bf0edb83909 from port 7a15a71b-2801-42c2-ad2e-d53e5ffa277a Oct 18 16:14:05.936553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.937582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:05.938233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:05.939035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.033955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:06.044797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18e104e8-23dd-4ebb-908d-811db23273b5 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1272 microversion: 2.1 time: 0.127131 Oct 18 16:14:06.045477 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1597/3223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:05 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:06.050878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:06.053807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:06.062994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.063794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.064423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.065559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.066218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.066858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.233969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:06.247452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Old instance type m1.heat2, new instance type m1.heat {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:14:06.264144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:06.267458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:06.268159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:06.268855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:06.269482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:06.270115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:06.276516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:06.583680 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df39d118-e946-4725-bdca-c2df0978bb72 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30/action" status: 202 len: 0 microversion: 2.1 time: 0.536731 Oct 18 16:14:06.584723 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1598/3224] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:06 2022] POST /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:06.591527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:06.592832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:06.620546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.621844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.622464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.623319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.623983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.624706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.848357 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50fc7631-02a3-4640-9a85-7ce49497455d tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action" status: 202 len: 0 microversion: 2.1 time: 1.151702 Oct 18 16:14:06.849783 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1627/3225] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:05 2022] POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action => generated 0 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:06.870014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:06.872171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:06.883741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.884588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.885392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.887966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.888940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.889906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.948543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:07.160432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.181019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5247896-af1c-4586-9c46-f9d5858b4615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1654 microversion: 2.1 time: 0.594721 Oct 18 16:14:07.198512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1599/3226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:06 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1654 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:07.205808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:07.207476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:07.250754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.251254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.252084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.252976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.253988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.254731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.254861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.264256 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba66c538-51a2-46d2-816c-ddc1015397df tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1471 microversion: 2.1 time: 0.412593 Oct 18 16:14:07.272771 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1628/3227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:06 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:07.297732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdf73e69-a44c-4b4a-81e4-30ffe78faae8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'create', calling method: .version_select at 0x7f5fd638ee50>, body: {"pool": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:07.412123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.426486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.427935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.442767 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d46ed51-b60a-43bf-99a7-760009466b30 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.242333 Oct 18 16:14:07.443923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1600/3228] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:07 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:07.449017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:07.471890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.472685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.473163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.500960 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] Creating event network-changed:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:14:07.517849 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ef60c8cb-9bc8-48c6-8204-80aa0bb102d3 req-b3cbe3c2-9957-4e02-a731-e695687c7876 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069964 Oct 18 16:14:07.518713 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1601/3229] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:07.530920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:07.532895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:07.550541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.550541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.550872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.558415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.559113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.559705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.696269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.714698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0eb437d9-5d83-4a81-8870-1b26981604a1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1278 microversion: 2.1 time: 0.193163 Oct 18 16:14:07.729684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1602/3230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:07 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:07.740955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:07.747963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:07.772412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.774015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.775321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.779353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.788763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.789654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.937739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1ed06d4-edae-420f-98ae-b5c0400db356 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.202741 Oct 18 16:14:07.939237 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1603/3231] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:07 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:07.953434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:07.954299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:07.963693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.964916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.966007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.967535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.968186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.969044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:08.855114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:08.867219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ff3dccc-ec1d-45d7-8d29-192060b58724 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1661 microversion: 2.1 time: 0.922829 Oct 18 16:14:08.875017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1604/3232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:07 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1661 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:08.882046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "tag": "d69b5074-0fd6-4391-9702-d54fc28d744e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:08.910860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:08.913402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:08.924901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:08.955353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] Creating event network-changed:d69b5074-0fd6-4391-9702-d54fc28d744e for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:14:08.962836 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c06f0aca-7913-4ebb-bff5-4e48f011d103 req-e9fddffa-d110-4408-9b45-880c05455d91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086235 Oct 18 16:14:08.969897 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1605/3233] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:08.975741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:08.981545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:08.991598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.001811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.002281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.003085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.003761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.004384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.420468 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdf73e69-a44c-4b4a-81e4-30ffe78faae8 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.133186 Oct 18 16:14:09.431699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1629/3234] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:14:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:09.442528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:09.447955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:09.481461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.482165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.483691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.486718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.487313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.493249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.547473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:09.565972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d40d93b-1a14-4a0a-9ef8-148f58958534 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1471 microversion: 2.1 time: 0.594377 Oct 18 16:14:09.567437 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1606/3235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:08 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1471 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:09.572700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:09.573705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:09.596162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.598338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.600277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.607448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.608534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.609226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.617456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:09.635882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:09.637967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:09.644694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4a532455-6780-42c1-a2e8-28ec98d6df1c tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.208568 Oct 18 16:14:09.645600 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1630/3236] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:09 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:09.686468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.254"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:09.695561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:09.711736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.716358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.717303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.720332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.720897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.722638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.759473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:14:09.760360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquired lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:14:10.163602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:10.178061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ead80c0-b786-4d2b-87de-bd3143d43a5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.609358 Oct 18 16:14:10.181769 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1607/3237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:09 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:10.188049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:10.189720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:10.198090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.200756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.201802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.204189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.204874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.205485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.613769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:10.623541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c7f3a23-be1d-43e2-82b2-d9eff95920df tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.440195 Oct 18 16:14:10.630478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1608/3238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:10 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:10.665229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:10.670415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:10.690779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.691290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.691752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.692943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.692943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.693405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.955301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:10.970657 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37b8f8fd-2763-4c72-b2eb-3597f24c32c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1471 microversion: 2.1 time: 0.338089 Oct 18 16:14:10.973983 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1609/3239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:10 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:10.980601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:10.983157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:10.991252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.994145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.994840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.995807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.996585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.997525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.244700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.272930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc5d24c5-10e4-4225-aea9-c78736a131b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.297011 Oct 18 16:14:11.281293 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1610/3240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:10 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:11.287621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:11.289091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:11.298463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.299835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.300799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.301766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.302380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.303037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.437336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.460540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.462584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.463881 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c49bcaa-168c-4690-86da-51472260817e tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.180984 Oct 18 16:14:11.465791 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1611/3241] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:11 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:11.494973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:11.496511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:11.507232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.507787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.508274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.509287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.509858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.510899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.725556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.734910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b4bc7bb-d196-40ba-8786-c81bc0a84fb3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.265911 Oct 18 16:14:11.735229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1612/3242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:11 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:11.740869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35271d9-7ccd-4129-a8f7-98632d13fa6d", "tag": "c18d922b-18bb-433a-8c2e-3e6888d59f0b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:11.753026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.753535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.753973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.766180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] Creating event network-changed:c18d922b-18bb-433a-8c2e-3e6888d59f0b for instance f35271d9-7ccd-4129-a8f7-98632d13fa6d on n-h2-858383-14 Oct 18 16:14:11.771090 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d79b033f-6bb5-43f1-9dfc-9cd61eb4a781 req-ee3a64ce-3c33-4ee3-9c0e-b2364761097e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034715 Oct 18 16:14:11.771702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1613/3243] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:11.777873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:11.778605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:11.786867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.787548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.788071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.788959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.789467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.789971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.046380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.054837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-364a4f4a-cc6c-4f47-81e7-79c38a566ebb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.281877 Oct 18 16:14:12.056600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1614/3244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:11 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:12.064115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.065728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.073095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.075032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.075731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.077134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.077919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.078495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.082091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:12.250277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.258528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61672686-2aa1-4926-8748-890352c9132e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.200519 Oct 18 16:14:12.259131 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1615/3245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:12.265581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.266484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.273475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.274273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.274928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.276550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.277412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.278020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.431436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.442144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-772eadc5-4a31-46e6-b764-232dd45875e2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.181411 Oct 18 16:14:12.442930 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1616/3246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:12.460969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1718f3-9725-4e2a-bb5c-8af9e25ca11e", "tag": "13665978-92cf-48e9-b8e3-dec08c9b68d0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:12.474139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.474939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.475381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.499316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] Creating event network-changed:13665978-92cf-48e9-b8e3-dec08c9b68d0 for instance 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e on n-h1-858383-14 Oct 18 16:14:12.503860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Building network info cache for instance {{(pid=120570) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:14:12.505804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d8f63f28-0892-4376-9462-57de99a8c56b req-5ca581f3-07f2-4c9c-a528-c04023e7e319 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060841 Oct 18 16:14:12.506432 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1617/3247] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:12.511943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.513116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.521340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.521841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.522470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.523385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.524013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.524465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.690598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.700834 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f7b816b-9be0-408b-89f6-1dcadbdb1d14 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.192963 Oct 18 16:14:12.701939 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1618/3248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:12.707785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.708746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.716696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.717558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.718115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.719707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.720171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.720709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.796042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.805325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.806875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:12.808168 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d258334-8dc3-40e2-a8bf-c2f9e06ad26d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.105137 Oct 18 16:14:12.818440 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1619/3249] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:12.818440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.818440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.821872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.822015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.822550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.823327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.823789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.824814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.994636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.006064 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e22cea8-38ca-46af-bf4f-b36acfe9fe79 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.195479 Oct 18 16:14:13.006969 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1620/3250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:13.015929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:13.016663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:13.024559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.025288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.025871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.026775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.027982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.028571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.209083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.223098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c48091fb-8513-4ffc-842f-59c1a3551276 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.211735 Oct 18 16:14:13.238210 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1621/3251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:13 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:13.284954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:13.285680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:13.292535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.294448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.294913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.295807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.296277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.296701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.335369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Updating instance_info_cache with network_info: [{"id": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a", "address": "fa:16:3e:3f:a0:bb", "network": {"id": "e2fc8fd5-660e-4eb7-83ed-3cf04241534b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-88443842-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "940a12592e50434793075265c3a1f9ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a15a71b-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:14:13.353639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Releasing lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:14:13.354862 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f758fa2-0bd2-40bc-aaf7-bd434362617c tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action" status: 202 len: 0 microversion: 2.1 time: 3.706237 Oct 18 16:14:13.356458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1631/3252] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:09 2022] POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action => generated 0 bytes in 3708 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:14:13.366056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.254"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:13.469270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.481449 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4e4fcca-4c77-4c35-96bf-3c7c2f2fdf0a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.200471 Oct 18 16:14:13.485838 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1622/3253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:13 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:13.540555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:13.548963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.549541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.549994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.550908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.551372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.551805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.803707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:14:13.804192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquired lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:14:13.838032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:13.838755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:13.847206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.847783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.848304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.849176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.849710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.850226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.944218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.958654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.960450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:13.961773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb4bdc93-64a5-4b6f-909b-1416a8b42cf9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.127951 Oct 18 16:14:13.962889 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1623/3254] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:13 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:14.251573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:14.252611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:14.260207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:14.260817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:14.261506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:14.262915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:14.263454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:14.264128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:14.369637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:14.415109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:14.423208 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5d6526a-d2c0-4254-8c96-29a01c3c907e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.176055 Oct 18 16:14:14.423818 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1624/3255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:14 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:14.510972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:14.512259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:14.519585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:14.520080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:14.520526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:14.521275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:14.521742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:14.522174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:14.685162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:14.693735 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f40aaf1f-6675-4fcf-b073-2cf18188abba tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.186738 Oct 18 16:14:14.694335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1625/3256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:14 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:14.715693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:14.801196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:14.813516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:14.814103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:14.814542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:14.836667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] Creating event network-changed:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:14:14.845150 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f9114967-a705-4fea-99a9-79ec8b2d68c9 req-742c620a-e2fd-4d5f-8ca8-46fde2c93c14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047808 Oct 18 16:14:14.845764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1626/3257] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:14.865696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Building network info cache for instance {{(pid=120570) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:14:14.990655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:14.993222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:15.004332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.005059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.005666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.006547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.007132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.007789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.093354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:15.101883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:15.103335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:15.104528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3cf7500c-131d-479f-af6a-352746ffc2d9 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1366 microversion: 2.57 time: 0.118462 Oct 18 16:14:15.106530 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1627/3258] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:14 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:15.402103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Updating instance_info_cache with network_info: [{"id": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a", "address": "fa:16:3e:3f:a0:bb", "network": {"id": "e2fc8fd5-660e-4eb7-83ed-3cf04241534b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-88443842-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "940a12592e50434793075265c3a1f9ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a15a71b-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:14:15.415994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Releasing lock "refresh_cache-3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:14:15.417263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29d26fdf-e344-406e-ab17-653a2a5a9f65 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action" status: 202 len: 0 microversion: 2.1 time: 2.055287 Oct 18 16:14:15.421697 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1632/3259] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:13 2022] POST /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92/action => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:14:15.427547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a9dff2a-2396-409c-8687-e836fa904167 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '.version_select at 0x7f5fd223a9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:15.448650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:15.450574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:15.457466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.458393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.458946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.459759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.460323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.460849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.613944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:15.622599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e04f595-8be1-41ff-a179-bf20fa9284df tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.179246 Oct 18 16:14:15.623303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1633/3260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:15 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:15.730791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:15.731923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:15.739133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.740099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.740762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.741604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:15.742362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:15.742954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:15.983704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:15.994910 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33fd83ee-aedb-4d64-aaa5-2433ae882cd0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.268405 Oct 18 16:14:15.996738 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1634/3261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:15 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:16.138841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:16.139474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:16.156148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:16.161772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:16.163510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:16.164535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:16.165193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:16.165843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:16.274940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:16.292189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:16.293852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:16.295068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f33bb1d6-a599-4f76-97f4-7673a348d42d tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1372 microversion: 2.57 time: 0.166387 Oct 18 16:14:16.309188 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1635/3262] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:16 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:16.646952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:16.647562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:16.655234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:16.655717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:16.656152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:16.656846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:16.657323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:16.657744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:16.797874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:16.807181 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97a40cc1-6f20-4c57-8444-b99a4c6e4993 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.163969 Oct 18 16:14:16.807792 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1636/3263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:16 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:16.862032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:16.872305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:16.873112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:16.873568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:16.887499 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] Creating event network-changed:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:14:16.892757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7786eb02-9d4c-4eab-8269-494c86e462bf req-c869dd19-d802-4fe6-87b9-f8b9c72362bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034428 Oct 18 16:14:16.893415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1637/3264] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:17.021319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.022153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:17.030875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.031374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.031818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.032560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.033041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.033473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.183883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:17.186366 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a9dff2a-2396-409c-8687-e836fa904167 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/d6eca8bd-0a67-436a-9f3f-2896736d65e5" status: 202 len: 0 microversion: 2.1 time: 1.762892 Oct 18 16:14:17.187533 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1628/3265] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:14:15 2022] DELETE /compute/v2.1/os-floating-ips/d6eca8bd-0a67-436a-9f3f-2896736d65e5 => generated 0 bytes in 1765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:14:17.195548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52ad7d51-d442-486a-9e5e-f013f7b3d515 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.179259 Oct 18 16:14:17.196129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1638/3266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:17 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:17.198108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b8e8bc6-14c1-46f6-bb50-fae4492a2624 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '.version_select at 0x7f5fd143fe50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.322799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.323375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:17.329665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.330150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.330585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.331278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.331736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.332159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.401507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:17.410682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:17.412120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:17.413325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f46f9f9e-7744-45bf-913b-6bd740aee2f1 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1372 microversion: 2.57 time: 0.095071 Oct 18 16:14:17.413919 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1639/3267] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:17 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:17.501260 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b8e8bc6-14c1-46f6-bb50-fae4492a2624 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b2da1aee-d47a-4866-af8a-2bf0edb83909" status: 202 len: 0 microversion: 2.1 time: 0.306818 Oct 18 16:14:17.502415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1629/3268] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:14:17 2022] DELETE /compute/v2.1/os-security-groups/b2da1aee-d47a-4866-af8a-2bf0edb83909 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:14:17.510910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.511439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:17.520242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.520242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.520242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.520242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.520926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.520926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.550745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:17.662224 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a50fa1f2-6175-4fb4-a647-5cde3ec20b55 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 204 len: 0 microversion: 2.1 time: 0.154985 Oct 18 16:14:17.666657 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1640/3269] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:17 2022] DELETE /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:17.673288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.673955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:17.682445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.682951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.684090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.684714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.685278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.686226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.832767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:17.834421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:17.846222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.846681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.847117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.848008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:17.848624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:17.849390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:17.854096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:17.863163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32c9ffad-fa83-446e-b1f1-d53f08f2ee56 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1507 microversion: 2.1 time: 0.195648 Oct 18 16:14:17.863811 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1630/3270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:17 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:18.004165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:18.012041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b16b59be-5aa7-4bb6-af06-57e25bb3f0a8 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.184232 Oct 18 16:14:18.012613 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1641/3271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:17 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:18.220025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:18.220660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:18.226684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.227162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.227594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:18.228275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.228726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.229190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:18.366229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:18.374522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87551b34-4d6c-4158-88a6-4abcee6dc39a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.158477 Oct 18 16:14:18.375102 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1631/3272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:18 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:18.441883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:18.442776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:18.449518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.450301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.450751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:18.451485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.451943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.452460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:18.521439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:18.530441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:18.531885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:18.533086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdb2e37d-237c-4d48-ad3a-251335ea9ec7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1372 microversion: 2.57 time: 0.095181 Oct 18 16:14:18.533645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1642/3273] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:18 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:18.889241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:18.889862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:18.898957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.899449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.899896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:18.900598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:18.901089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:18.901523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.035593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:19.036847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:19.044779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.045518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.046218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.047008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.047562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.048061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.069067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:19.073482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.085692 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66ca66d4-f550-4a04-bdb8-515ffb223d66 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1507 microversion: 2.1 time: 0.201501 Oct 18 16:14:19.095960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1632/3274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:18 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:19.209862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.218332 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c61053f-86b5-448e-94df-6812c9b5f17b tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.186764 Oct 18 16:14:19.219126 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1643/3275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:19 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:19.399133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:19.399745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:19.405935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.406411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.406850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.407532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.407987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.408401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.547873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.557126 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75c76301-fad2-43a2-9afc-9a2c7ea24380 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.161757 Oct 18 16:14:19.557865 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1633/3276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:19 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:19.560276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:19.561217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:19.567401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.568006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.568746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.569496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.570075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.570703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.642025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.650389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.651826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:19.653677 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-44665826-f417-458d-9648-7195c95c2f86 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1372 microversion: 2.57 time: 0.098304 Oct 18 16:14:19.654458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1644/3277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:19 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:19.702259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35271d9-7ccd-4129-a8f7-98632d13fa6d", "name": "network-vif-plugged", "status": "completed", "tag": "c18d922b-18bb-433a-8c2e-3e6888d59f0b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:19.712624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:19.713120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:19.713555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:19.725594 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] Creating event network-vif-plugged:c18d922b-18bb-433a-8c2e-3e6888d59f0b for instance f35271d9-7ccd-4129-a8f7-98632d13fa6d on n-h2-858383-14 Oct 18 16:14:19.731767 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8475e2f2-62dd-42cd-89a7-1563eecf6f63 req-940f5c67-ffae-44b4-a5d3-a6db09d27c9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Oct 18 16:14:19.732670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1634/3278] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:20.109796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:20.110403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:20.116934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.117438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.117872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.118656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.119112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.119536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.243340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:20.244053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:20.251906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.252402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.252846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.254044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.254209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.254491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.254811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.262953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2add3b81-03b3-4caa-b1ad-ed081b1e8888 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1507 microversion: 2.1 time: 0.157351 Oct 18 16:14:20.263539 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1645/3279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:20 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:20.397677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.399996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:20.407045 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f225dd6-e49e-4dbf-bd6b-b66b0ef9b9f6 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.168871 Oct 18 16:14:20.407645 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1635/3280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:20 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:20.581933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:20.582537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:20.589074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.589595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.590034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.590716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.591162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.591583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.679847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:20.680489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:20.687953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.688436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.688941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.689829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:20.690284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:20.690711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:20.721303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.729294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b257f153-16ba-4d17-b7fa-046346370893 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.151257 Oct 18 16:14:20.729881 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1646/3281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:20 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:20.754968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.763494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.764950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:20.766156 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f242d1f2-ac74-46ef-bddb-dfa7c8874cb4 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1372 microversion: 2.57 time: 0.090188 Oct 18 16:14:20.766728 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1636/3282] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:20 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:21.290803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:21.294430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92", "name": "network-vif-deleted", "tag": "7a15a71b-2801-42c2-ad2e-d53e5ffa277a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:21.295003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:21.301536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.302030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.302477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.303182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.303640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.304400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.304879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.305037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.305392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.317411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] Creating event network-vif-deleted:7a15a71b-2801-42c2-ad2e-d53e5ffa277a for instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 on n-h1-858383-14 Oct 18 16:14:21.322936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2178ea3d-895d-4b16-a610-3ff315b07254 req-6194f4a8-8452-4332-89dc-83c1e0730b96 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Oct 18 16:14:21.323583 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1637/3283] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:21.377390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4567c0f0b244e4a39a5dabdaa88ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a12592e50434793075265c3a1f9ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.385664 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b4a8135-9ac9-4e6b-bea8-6222e6ff36d7 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 200 len: 1465 microversion: 2.1 time: 0.103111 Oct 18 16:14:21.386760 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1647/3284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:21 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:21.430665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:21.431386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:21.438800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.439450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.440008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.440820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.441379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.441959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.591549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.599770 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e64fbf18-ece0-47ae-9458-36f62c21f381 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1320 microversion: 2.1 time: 0.173867 Oct 18 16:14:21.600353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1638/3285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:21 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:21.753329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1718f3-9725-4e2a-bb5c-8af9e25ca11e", "name": "network-vif-plugged", "status": "completed", "tag": "13665978-92cf-48e9-b8e3-dec08c9b68d0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:21.754429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:21.755045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:21.762632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.763346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.763834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.764420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.764553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.764898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.765033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.765355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.765472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.777169 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] Creating event network-vif-plugged:13665978-92cf-48e9-b8e3-dec08c9b68d0 for instance 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e on n-h1-858383-14 Oct 18 16:14:21.781984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-285a3c4b-4960-419d-a689-ef7796b814f7 req-433c5100-f7bf-4e0e-b072-e33df95434c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Oct 18 16:14:21.783033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1648/3286] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:21.791653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:21.792373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:21.798911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.799986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.800421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.801342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.801794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.802502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.875506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.883991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.885502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.887270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-226583be-8e12-4a88-af9c-fb0eab3388e3 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1357 microversion: 2.57 time: 0.098971 Oct 18 16:14:21.887924 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1649/3287] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:21 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:21.914498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:21.919627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:21.919627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:21.924182 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-602d99e9-fb71-40df-9285-d3f06128159b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.174880 Oct 18 16:14:21.924762 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1639/3288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:21 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:21.926194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.926779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.927302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.928003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:21.928464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:21.928921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:21.957999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:22.034670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:22.057981 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7771d69b-314f-4d04-9a9e-07eb403f39b7 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 204 len: 0 microversion: 2.57 time: 0.142872 Oct 18 16:14:22.058592 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1650/3289] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:14:21 2022] DELETE /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 16:14:22.069266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:22.070119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:22.077490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.078046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.078493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.079215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.079675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.080199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.172674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:22.189848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:22.192128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:22.193801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c146e51-b057-44f2-90a5-02612ec7bd36 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1363 microversion: 2.57 time: 0.129295 Oct 18 16:14:22.195051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1640/3290] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:22 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1363 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:22.410030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:22.410764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] [instance: 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:22.417202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.417687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.418123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.418841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.419358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.419912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.435882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] HTTP exception thrown: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Request method failure captured: Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 HTTP/1.1 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCGQBStdHhC9NGcfQxiekCk5nNx4Nj0LdwMfBJ5p-W4p1BktGADpuhXTgArq-eBETYTHSXUFbKscEr71519A-B3Xk7Ecc4x5YRKX199mS4vgPp5M4x0yN8yrrcN9BJmRn9OCEyM5DjGLSXsraOn3KSJBrVM7RdHKJNE8cEv_ZiJvi0 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 940a12592e50434793075265c3a1f9ce Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-60756533 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/940a12592e50434793075265c3a1f9ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/940a12592e50434793075265c3a1f9ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_940a12592e50434793075265c3a1f9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/940a12592e50434793075265c3a1f9ce"}]}] Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-60756533 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 940a12592e50434793075265c3a1f9ce Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-60756533 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueTestJSONUnderV235-60756533-project Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: fd4567c0f0b244e4a39a5dabdaa88ee8 Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-60756533-project Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92'} Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:22.437751 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] Returning 404 to user: Instance 3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c2811f5-0a16-47d7-849c-87d747ece5f1 tempest-ServerRescueTestJSONUnderV235-60756533 tempest-ServerRescueTestJSONUnderV235-60756533-project] 10.222.0.78 "GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92" status: 404 len: 111 microversion: 2.1 time: 0.034006 Oct 18 16:14:22.442766 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1651/3291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:22 2022] GET /compute/v2.1/servers/3dbb2ee3-cdaf-42f1-ab1c-275459c9fa92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:14:22.624778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:22.625431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:22.633237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.634036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.634656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.635704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.636896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.637837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.872212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:22.881580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71157ddd-fad0-45d2-ba75-a82806ceb6ac tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 200 len: 1507 microversion: 2.1 time: 0.261553 Oct 18 16:14:22.882466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1641/3292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:22 2022] GET /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:22.909703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:22.910444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:22.917913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.918848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.919515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.921334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.921699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.922214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.949511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:22.950629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:22.956610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.957142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.957586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.958285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.958737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.959344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:23.094378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.102187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d0d7c54-a358-48c8-9b90-610a71fd35d4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.157175 Oct 18 16:14:23.102770 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1642/3293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:22 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:23.154764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.162398 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bba38d45-f9a3-4d7e-a4ea-e26b6e3059f0 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e" status: 200 len: 1320 microversion: 2.1 time: 0.257067 Oct 18 16:14:23.163204 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1652/3294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:22 2022] GET /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:23.221941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:23.222467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:23.228614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:23.229153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:23.229622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:23.230320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:23.230859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:23.231287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:23.295940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.304254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.305713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.306883 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d25f6bbd-7dce-4822-9ae0-fe52057efad5 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1363 microversion: 2.57 time: 0.088978 Oct 18 16:14:23.307439 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1643/3295] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:23 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:24.126032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.126760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.134762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.135381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.135892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.136964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.137535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.137979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.187841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.188854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.200022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.200558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.201069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.201880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.202390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.202883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.380660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.391162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.398741 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7e3b485-0448-411c-9e70-75684f238e13 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.276803 Oct 18 16:14:24.399424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1653/3296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:24 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:24.408097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.409192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.415584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.419034 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab5176c0-c8bc-4301-884c-0ebc50ab2e78 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e" status: 200 len: 1507 microversion: 2.1 time: 0.237043 Oct 18 16:14:24.419863 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1644/3297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:24 2022] GET /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:24.420023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.420435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.421429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.422704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.423294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.447290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.447785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.459468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.460279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.460889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.461937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.463131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.463570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.496798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:24.551822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.580116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.582615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.591089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d14c5ab3-fed2-46af-8c41-386d7d01f2b2 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1363 microversion: 2.57 time: 0.190344 Oct 18 16:14:24.591776 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a99a6a59-f3bd-4010-9da6-25d651b5c96a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e" status: 204 len: 0 microversion: 2.1 time: 0.147932 Oct 18 16:14:24.595796 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1645/3298] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:24 2022] DELETE /compute/v2.1/servers/4f1718f3-9725-4e2a-bb5c-8af9e25ca11e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:14:24.595969 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1654/3299] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:24 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:24.622111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.622689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.632146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.632665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.633273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.634312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.635164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.635287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.675345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: f35271d9-7ccd-4129-a8f7-98632d13fa6d] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:24.750126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:24.773472 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e814344-ff2a-47c9-a11f-9065051f2f0a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d" status: 204 len: 0 microversion: 2.1 time: 0.167556 Oct 18 16:14:24.774357 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1646/3300] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:24 2022] DELETE /compute/v2.1/servers/f35271d9-7ccd-4129-a8f7-98632d13fa6d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:24.827854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2098205052", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a24de80b-6b72-4a1a-97a4-67ad948202db"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:24.882988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] validate_networks() for [('a24de80b-6b72-4a1a-97a4-67ad948202db', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:14:25.377253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:25.377839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:25.378143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:25.378553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:25.378964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:25.388232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.388628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.389099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.389830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.390296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.390723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.408776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Getting quotas for project 8c5c1a9259f64a7e937a160a7967f708. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:25.414265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Getting quotas for user 818cfb3b5ddc4838a93a0d301ac89e22 and project 8c5c1a9259f64a7e937a160a7967f708. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:25.425921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:25.426642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:25.434227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.434710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.435157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.435863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.436543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.437003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.439706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Going to run 2 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:25.442075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:25.480693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=5aa81507-06e5-4e8b-824c-db125e70c225,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:25.538452 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97a53ebd-8542-453c-9715-001bbf128f71 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.715141 Oct 18 16:14:25.539431 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1655/3301] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:14:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 18 16:14:25.553465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:25.562220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.563313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Searching by: {'deleted': False, 'project_id': '8c5c1a9259f64a7e937a160a7967f708'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:14:25.588765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.590050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.591636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.597409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.598262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.598872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.634296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.634476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:14:25.656355 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc651b3d-50ea-4929-81b6-5470ffd0cffc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.228175 Oct 18 16:14:25.657353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1647/3302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:25 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:25.665648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:25.671334 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7101342-a375-48ba-9953-448876073037 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.127316 Oct 18 16:14:25.672013 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1656/3303] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:14:25 2022] GET /compute/v2.1/servers => generated 1337 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:25.672329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:25.682202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.682693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.683422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.683975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.692895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.693616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.694911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-719eba15-32d4-4f01-8d2c-19a0a35d8c15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:25.695635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-719eba15-32d4-4f01-8d2c-19a0a35d8c15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:25.752105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.752607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.753109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.753735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lazy-loading 'fault' on Instance uuid ca173e4b-28e5-4d0c-98ae-b5f808835ae7 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:14:25.790232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-719eba15-32d4-4f01-8d2c-19a0a35d8c15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.799237 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-719eba15-32d4-4f01-8d2c-19a0a35d8c15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1218 microversion: 2.1 time: 0.109752 Oct 18 16:14:25.801333 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1657/3304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:25 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:25.817249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.827660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.829121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f02f6ad29744dd28e493ca3a14f5775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488805e986a248a6b9fef434664c9b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.830457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d32c65c-76f7-4735-ad61-1ca2f5b1576f tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 200 len: 1368 microversion: 2.57 time: 0.171757 Oct 18 16:14:25.831375 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1648/3305] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:25 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:26.693869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:26.695744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:26.707731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.709635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.710279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.711162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.711781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.712383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.824706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:26.825369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:26.844538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.845116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.845657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.846792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.847614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.848406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.914037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:27.066988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:27.099204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a10278aa-66d2-4921-8d3f-fe64ad4129c4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.402205 Oct 18 16:14:27.100123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1658/3306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:26 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:27.126878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:27.130261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] [instance: ca173e4b-28e5-4d0c-98ae-b5f808835ae7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:27.137239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:27.138460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:27.139592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:27.141458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:27.149433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-374c547d-fb8b-4f8c-9fe8-4bc4a0512bc2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1270 microversion: 2.1 time: 0.329481 Oct 18 16:14:27.150419 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1649/3307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:26 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1270 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:27.158347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:27.161600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:27.162898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:27.187063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] HTTP exception thrown: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Request method failure captured: Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 HTTP/1.1 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtCwq8ksA1ON549m9nOin7P17C75-hPE0Od4l_rpDn-IovGmIawWgaGCtma39YtfhV_XOu2hgB0uyljHNpyY8Rpl9VJCe3lDsbK0wEIGGsOQEfcgyonAHOnkQzdOU93oysL5laIHf8OU4vACOWxz6I3JyTpRFoPabSsCnCBvso_oDJM Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.57 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 488805e986a248a6b9fef434664c9b14 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerShowV257Test-1037895130 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/488805e986a248a6b9fef434664c9b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/488805e986a248a6b9fef434664c9b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_488805e986a248a6b9fef434664c9b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/488805e986a248a6b9fef434664c9b14"}]}] Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerShowV257Test-1037895130 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 488805e986a248a6b9fef434664c9b14 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerShowV257Test-1037895130 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerShowV257Test-1037895130-project Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9f02f6ad29744dd28e493ca3a14f5775 Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerShowV257Test-1037895130-project Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ca173e4b-28e5-4d0c-98ae-b5f808835ae7'} Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:27.190357 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] Returning 404 to user: Instance ca173e4b-28e5-4d0c-98ae-b5f808835ae7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:27.196983 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f6b7ca6-8856-4939-bf34-c6533f121530 tempest-ServerShowV257Test-1037895130 tempest-ServerShowV257Test-1037895130-project] 10.222.0.78 "GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7" status: 404 len: 111 microversion: 2.57 time: 0.091103 Oct 18 16:14:27.198318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1659/3308] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:27 2022] GET /compute/v2.1/servers/ca173e4b-28e5-4d0c-98ae-b5f808835ae7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:14:27.924079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1718f3-9725-4e2a-bb5c-8af9e25ca11e", "name": "network-vif-deleted", "tag": "13665978-92cf-48e9-b8e3-dec08c9b68d0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:27.959051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:27.959925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:27.961325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:27.987303 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] Creating event network-vif-deleted:13665978-92cf-48e9-b8e3-dec08c9b68d0 for instance 4f1718f3-9725-4e2a-bb5c-8af9e25ca11e on n-h1-858383-14 Oct 18 16:14:28.008760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4e43e0cc-2a64-434f-b589-15a38d2d4b95 req-86e293ef-58a4-4b99-b4c5-ab88c89faa28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088323 Oct 18 16:14:28.013395 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1650/3309] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:28.127819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:28.128730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:28.138398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.138964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.139467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:28.140446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.141089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.141823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:28.178307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:28.181856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:28.192177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.192695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.193248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:28.194076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.194629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.195131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:28.288805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:28.300216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cdf5a973-1ddf-4e07-9990-baa2bd36892c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1276 microversion: 2.1 time: 0.126046 Oct 18 16:14:28.301455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1651/3310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:28 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:28.740070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:28.749855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab105443-386e-46dc-920e-eb2c37aee9bf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1476 microversion: 2.1 time: 0.626512 Oct 18 16:14:28.751139 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1660/3311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:28 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:29.340702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:29.342245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:29.360273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:29.361279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:29.362184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:29.363161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:29.363896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:29.364577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:29.780119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:29.780793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:29.795539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:29.797625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:29.801960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:29.802961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:29.803481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:29.803916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:30.060392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:30.069678 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c80de390-729a-4cc0-8cda-9c718f472fb2 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.735302 Oct 18 16:14:30.073325 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1652/3312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:29 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:30.078845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "name": "network-vif-unplugged", "status": "completed", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:30.107861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:30.108751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:30.109416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:30.141859 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Creating event network-vif-unplugged:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h1-858383-14 Oct 18 16:14:30.158200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] Instance eef0c003-ec76-4121-932f-80dda207dc30 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:14:30.180212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4beace60-1145-4325-843d-c818fc91eb51 req-8083ce75-7889-4441-a853-d3246c079293 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102902 Oct 18 16:14:30.184686 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1653/3313] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:30.211151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35271d9-7ccd-4129-a8f7-98632d13fa6d", "name": "network-vif-deleted", "tag": "c18d922b-18bb-433a-8c2e-3e6888d59f0b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:30.260648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:30.261832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:30.264348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:30.317162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] Creating event network-vif-deleted:c18d922b-18bb-433a-8c2e-3e6888d59f0b for instance f35271d9-7ccd-4129-a8f7-98632d13fa6d on n-h2-858383-14 Oct 18 16:14:30.334339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7e9b34e2-c262-495a-89d9-da73b1ca029f req-0cf6aba9-be13-4978-9ffa-c04eceec2713 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145094 Oct 18 16:14:30.335373 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1654/3314] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:30.466053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:30.481378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:30.490646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b05a5b4-60e2-4432-9341-385936b4ae86 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1475 microversion: 2.1 time: 0.715469 Oct 18 16:14:30.495524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1661/3315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:29 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1475 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:31.121557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:31.126501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:31.144324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.145137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.146385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.148385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.149936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.150605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.300212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d0eeb2-8a26-4666-8f1b-43a2b559c224", "tag": "1266326d-152f-43db-8d14-217eebaf5341"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:31.334201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.335212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.336118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.372084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] Creating event network-changed:1266326d-152f-43db-8d14-217eebaf5341 for instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 on n-h1-858383-14 Oct 18 16:14:31.379944 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c1b0f1d1-c689-4ccb-bef5-9e81f73a22e1 req-a0b552ba-3899-49c2-a2ca-4ec6c3d922d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086691 Oct 18 16:14:31.381165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1662/3316] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:31.533939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:31.535645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:31.600433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.602768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.604806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.611259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.615224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.616888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.874133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:31.885167 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95ef8439-7652-4b6c-86b9-ce49aca16153 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.782824 Oct 18 16:14:31.886658 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1655/3317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:31 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:32.088404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:32.102479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-749b4174-9f41-4fb3-8129-ee2f5079154a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1475 microversion: 2.1 time: 0.580489 Oct 18 16:14:32.117821 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1663/3318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:31 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1475 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:32.806757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:32.842097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.842978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.848575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:32.867606 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Creating event network-changed:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h1-858383-14 Oct 18 16:14:32.895689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] Instance eef0c003-ec76-4121-932f-80dda207dc30 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:14:32.913464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:32.914823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:32.923559 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b18b8225-ccb4-4dfa-9a12-75be98e58232 req-7b2afb54-eec6-459b-9127-2467edccff5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120262 Oct 18 16:14:32.927595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1656/3319] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:32.932484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.933846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.934228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:32.942022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.942632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.948689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:33.137140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:33.137895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:33.153455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:33.153964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:33.154718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:33.155150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:33.169744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:33.170630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:33.260837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:33.279623 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63b82742-0dc2-46a2-9f40-0e8d437a36f3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.371361 Oct 18 16:14:33.293632 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1664/3320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:32 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:34.307635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:34.309081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:34.317090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:34.317887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:34.318509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:34.319389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:34.320005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:34.320591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:34.497541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:34.531279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b85f475-c96a-4227-ab50-ae0eba6f3fb6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1475 microversion: 2.1 time: 1.397496 Oct 18 16:14:34.558856 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1657/3321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:33 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1475 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:34.914508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:34.926058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dd017f5-e2b5-49d1-8d2b-17b6cc512873 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.621550 Oct 18 16:14:34.927375 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1665/3322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:34 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:35.082003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf26764-7367-465e-810b-41552891804b"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:35.084523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:35.094751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.094956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.095407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.096195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.096658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.097160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.491060 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6765fd9-928f-4f2b-a6d0-e0a29e1f950b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "POST /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412813 Oct 18 16:14:35.491705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1658/3323] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:14:35 2022] POST /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:35.566631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:35.567517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:35.592289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.592784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.593257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.593975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.594440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.594871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.625549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:35.795745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:35.888542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa81507-06e5-4e8b-824c-db125e70c225", "tag": "e70b63b6-3cda-43e6-858e-8994465ee905"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:35.918891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.919390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.919843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.936901 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] Creating event network-changed:e70b63b6-3cda-43e6-858e-8994465ee905 for instance 5aa81507-06e5-4e8b-824c-db125e70c225 on n-h2-858383-14 Oct 18 16:14:35.947856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b0bdef4b-a83c-4198-95f1-85fdeaf32f30 req-aebfc8cc-425f-4e2a-b098-aa1e3f57b48f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071399 Oct 18 16:14:35.949120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1659/3324] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:35.956358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:35.957768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:35.965371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.966308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.966974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.967942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.968683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.969508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:36.085067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:36.095789 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0fc49c28-03e1-4457-8de6-8f5d4fc7bfab tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1475 microversion: 2.1 time: 0.538150 Oct 18 16:14:36.100160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1666/3325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:35 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1475 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:37.126398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:37.127842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:37.147258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:37.148171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:37.148839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:37.150521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:37.151259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:37.152020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:37.490718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:37.501101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:37.514293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dddbbb2b-97ab-4f50-841a-64ff64d77f4c tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 1.559432 Oct 18 16:14:37.520227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1ebe736f-e303-4801-9427-8eca09c029cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1473 microversion: 2.1 time: 0.398612 Oct 18 16:14:37.522572 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1667/3327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:37 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:37.534347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1660/3326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:35 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:38.547579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:38.548220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:38.548543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:38.549199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:38.561774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:38.564047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:38.565641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:38.566479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:38.567877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:38.568150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:38.568743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:38.569367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:38.569831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:38.570412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:38.571933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:38.577506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:38.900394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:38.912226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28f23786-8896-4093-ab38-906b151a9708 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1473 microversion: 2.1 time: 0.366850 Oct 18 16:14:38.918207 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1661/3328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:38 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:39.678106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:39.696008 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b91c50ab-ec68-4471-bc53-605daa604e50 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 1.158610 Oct 18 16:14:39.698123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1668/3329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:38 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:39.942925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:39.943543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:39.980937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:39.983140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:39.986296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:39.988084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:39.989318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:39.991621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:40.724805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:40.726319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:40.732978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:40.747541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6342f87e-4a68-4422-91f4-e8f0be7457f0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1473 microversion: 2.1 time: 0.809736 Oct 18 16:14:40.751205 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1662/3330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:39 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1473 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:40.764171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:40.768377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:40.769215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:40.770122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:40.772894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:40.773386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:41.166433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:41.183381 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b78e924-9a59-4359-b39e-231d2d9570c1 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.463542 Oct 18 16:14:41.184371 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1669/3331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:40 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:41.778184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:41.784548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:41.805451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:41.806402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:41.806708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:41.808214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:41.809068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:41.809815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:42.092430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1921369070", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:42.203695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:42.230349 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-953cca81-5b6f-4d4e-8010-ccdb6b442bcf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1470 microversion: 2.1 time: 0.452383 Oct 18 16:14:42.233353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1663/3332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:41 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:42.249154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:42.249824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:42.262253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:42.263071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:42.267019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:42.268384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:42.273794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:42.274676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:42.283321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] validate_networks() for [('337029b8-3a44-4243-882f-158968fa7ad7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:14:42.664404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:42.676266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0c7cc3d-9af7-4045-a38c-261f5272142a tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.441710 Oct 18 16:14:42.677154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1664/3333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:42 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:42.709531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:42.710365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:42.720682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:42.721580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:42.722174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:42.723056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:42.723667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:42.724253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:42.816126 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dce65bf-e7e4-460b-9395-50bd90b3a57c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30/action" status: 204 len: 0 microversion: 2.1 time: 0.118261 Oct 18 16:14:42.817387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1665/3334] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:42 2022] POST /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30/action => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:42.997166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2140720650", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "3b78d959-4762-4ebc-bc2d-16da7c131fa0"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:43.205060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] validate_networks() for [('3b78d959-4762-4ebc-bc2d-16da7c131fa0', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:14:43.243201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:43.244188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:43.244740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:43.246318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:43.248099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:43.274683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:43.280214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:43.281986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:43.285248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:43.287837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:43.290581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:43.364435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Getting quotas for project 09f13c8b99d641b0b30333ec27f72b9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:43.374547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Getting quotas for user 466ba2f759a34d11b6dd8887bb49554d and project 09f13c8b99d641b0b30333ec27f72b9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:43.418028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:43.423985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:43.532400 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-327c248f-d72f-4862-aae8-4d56329324df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698938 Oct 18 16:14:43.535751 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1670/3335] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:14:43.548187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:43.551985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:43.566858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:43.568205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:43.569937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:43.571260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:43.573793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:43.575837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:43.965785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:43.977511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-457d68dd-6940-4e40-a8e7-5f018a631cdb tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1470 microversion: 2.1 time: 0.440110 Oct 18 16:14:43.981633 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1671/3336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:43 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:43.993638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d0eeb2-8a26-4666-8f1b-43a2b559c224", "name": "network-vif-plugged", "status": "completed", "tag": "1266326d-152f-43db-8d14-217eebaf5341"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:44.009990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:44.011510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:44.012609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:44.062501 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] Creating event network-vif-plugged:1266326d-152f-43db-8d14-217eebaf5341 for instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 on n-h1-858383-14 Oct 18 16:14:44.085855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ea50b970-91f5-4679-8526-30a7a8e74cf7 req-366a3a7d-a640-46bf-9429-ec80848ff3c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098927 Oct 18 16:14:44.089442 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1672/3337] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:44.107030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb67c1aa-28fb-46ca-9197-ef9733652dc2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:44.108321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb67c1aa-28fb-46ca-9197-ef9733652dc2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:44.348161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb67c1aa-28fb-46ca-9197-ef9733652dc2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:44.359242 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb67c1aa-28fb-46ca-9197-ef9733652dc2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1217 microversion: 2.1 time: 0.267246 Oct 18 16:14:44.361813 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1673/3338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:44 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1217 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:44.375923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:44.377121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:44.391813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:44.393165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:44.394632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:44.399242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:44.400029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:44.400701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:44.775446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:44.786239 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10ef81bc-8b84-4e1f-ac15-82115add303e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 0.419754 Oct 18 16:14:44.786894 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1674/3339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:44 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:45.006566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:45.007214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:45.029106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.030196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.033336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.038112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.039341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.040065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.126111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:45.126637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:45.127056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:45.127785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:45.128580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:45.157770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.160036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.161810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.170102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.171473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.172081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.201520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:45.228611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Getting quotas for project 7bf4b812c55648ffb0442df492d45e18. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:45.251500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Getting quotas for user f6944b0e6c664113932ae3df467dc537 and project 7bf4b812c55648ffb0442df492d45e18. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:45.277825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:45.280547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:45.382696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:45.397763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cefa54af-1733-4926-b5b9-96a3b69d25e1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1470 microversion: 2.1 time: 0.396678 Oct 18 16:14:45.399067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1675/3340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:44 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:45.405138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:45.406096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:45.406395 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33c7f7fc-ed2b-4bbe-841d-d72ce9340e35 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.583741 Oct 18 16:14:45.412068 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1666/3341] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:14:45.431857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.437627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.437627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.439221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.439851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.441516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.466027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:45.469777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:45.566998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:45.578866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:45.586650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:45.592937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:45.594184 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bb29414-95db-4134-a6a9-3ce798e47357 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1262 microversion: 2.26 time: 0.158615 Oct 18 16:14:45.598046 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1667/3342] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:45 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:45.612635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-847083aa-c93c-4e5a-bca8-4c3c5252e290 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1269 microversion: 2.1 time: 0.212048 Oct 18 16:14:45.631825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1676/3343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:45 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1269 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:45.818093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:45.819183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:45.850141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.851297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.851948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:45.853032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:45.853691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:45.854636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:46.429117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:46.430609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:46.449930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:46.451573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:46.452254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:46.454587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:46.456428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:46.457156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:46.751510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:46.764571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1884067-d2fe-4258-92cf-660630d2bbc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1470 microversion: 2.1 time: 0.339996 Oct 18 16:14:46.778103 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1677/3344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:46 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:46.789971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:46.792974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:46.800009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:46.800923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:46.801644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:46.802642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:46.803337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:46.806604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:46.995302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:46.998693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:47.009976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d64805b2-de67-4b0c-879b-308a0c309d5e tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1318 microversion: 2.1 time: 1.198952 Oct 18 16:14:47.011776 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1668/3345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:45 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1318 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:47.017558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:47.018530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:47.028095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:47.028966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:47.029929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:47.030895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:47.031594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:47.032398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:47.035890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:47.040312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:47.041601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e63893a-0353-4b01-bfe6-05b5897ae0ef tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1258 microversion: 2.26 time: 0.262360 Oct 18 16:14:47.060921 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1678/3346] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:46 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1258 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:47.198735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:47.209826 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77f1b76e-5ea9-426c-ab88-609ee5c09be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1275 microversion: 2.1 time: 0.196586 Oct 18 16:14:47.211958 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1669/3347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:47 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:47.248347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa81507-06e5-4e8b-824c-db125e70c225", "name": "network-vif-plugged", "status": "completed", "tag": "e70b63b6-3cda-43e6-858e-8994465ee905"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:47.274620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:47.275085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:47.275512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:47.303810 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] Creating event network-vif-plugged:e70b63b6-3cda-43e6-858e-8994465ee905 for instance 5aa81507-06e5-4e8b-824c-db125e70c225 on n-h2-858383-14 Oct 18 16:14:47.323457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-39fd8cdc-434a-499f-93c7-f9c618f58361 req-aa861f0b-e643-4b75-ab68-9c7b8724a529 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110976 Oct 18 16:14:47.327532 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1679/3348] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:47.798482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:47.799868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:47.812761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:47.813727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:47.815051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:47.816103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:47.817302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:47.818355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.043786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:48.044517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:48.068502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.069387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:48.083088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.084922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.085429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.086367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.087345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.092580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.101393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb3428be-f547-47dd-9dd5-1bde9b681fdc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1462 microversion: 2.1 time: 0.311732 Oct 18 16:14:48.104669 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1670/3349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:47 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1462 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:48.175768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:48.176501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:48.203901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.204799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.205902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.207043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.208517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.209257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.457721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.473405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.475083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.476485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32f9bbe3-57cc-4a5c-8307-ccbe4201ab7b tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1314 microversion: 2.26 time: 0.367958 Oct 18 16:14:48.486577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1671/3350] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:48 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:48.494437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:48.497779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:48.504553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.505606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.506219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.507312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.508402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.509098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.563866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.584154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5292f606-588d-4a06-9987-f5b63ca6f6da tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 200 len: 1505 microversion: 2.1 time: 0.548451 Oct 18 16:14:48.587852 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1680/3351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:48 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:48.609255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:48.610289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:48.623505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.624330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.626228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.627260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.627818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.628354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.906169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.920069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51f6fa75-7709-4c3c-82cb-51449804fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1462 microversion: 2.1 time: 0.432156 Oct 18 16:14:48.921386 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1672/3352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:48 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1462 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:48.926528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:48.927461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:48.934107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:48.944894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7733429f-4f9d-4cf7-80ab-567d1224a25d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.354684 Oct 18 16:14:48.950054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1681/3353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:48 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:48.954606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.955037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.955507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.956192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:48.956649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:48.957110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:48.959181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5c0b79c-73e3-481c-90ea-731b7dc124e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'create', calling method: .version_select at 0x7f5fd1984040>, body: {"keypair": {"name": "tempest-keypair-861424518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGAHKGkBzq/r1t3AEBDuOZL0rlNo0VAF7uVifeb9v7IDwZWqCLSSyJKIMHn9bUAbHs/oav0bsCi28Eu3Ao0nxyJEnGlMggiwys9bC1so7Z/d7kua8wYqpAL/uXld8JJ9A=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:48.992770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c5c0b79c-73e3-481c-90ea-731b7dc124e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:49.000512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c5c0b79c-73e3-481c-90ea-731b7dc124e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:49.044091 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5c0b79c-73e3-481c-90ea-731b7dc124e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091870 Oct 18 16:14:49.045632 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1682/3354] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:14:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:49.372222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:49.386626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "name": "network-vif-plugged", "status": "completed", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:49.397627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35f31690-9b92-4bd7-8cff-abc82cb36566 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1318 microversion: 2.1 time: 0.474111 Oct 18 16:14:49.401560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1673/3355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:48 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:49.405599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:49.406706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:49.407355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:49.415096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:49.426832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] Creating event network-vif-plugged:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h1-858383-14 Oct 18 16:14:49.435073 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-17f3beb1-d731-4424-a3e4-7f4a482fd067 req-18454ba4-e258-4d43-b655-f09aeec9806d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053053 Oct 18 16:14:49.435950 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1683/3356] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:49.524258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:49.525431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:49.535921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:49.537416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:49.538887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:49.540449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:49.544749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:49.546647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:49.890266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:49.908490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:49.925619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:49.928862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41ea65af-5b5b-4f8e-8bac-4edf43387586 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.410171 Oct 18 16:14:49.930991 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1674/3357] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:49 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:49.977958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:49.978651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:49.997240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:49.999368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.000696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.003584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.004258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.005882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.069441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:50.079642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.080447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.081129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.102062 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] Creating event network-changed:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:14:50.116667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e3c96a73-f99f-4434-b9ff-bcabcfc5fb7b req-db9bb27f-51a3-452e-9588-c773bc36b48c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052817 Oct 18 16:14:50.122055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1675/3358] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:50.289023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:50.298557 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e31d7218-1869-4790-a9ee-318ed3f8f685 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.325891 Oct 18 16:14:50.299660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1684/3359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:50.446499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:50.448360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:50.466224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.467693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.468791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.470399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.471543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.472709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.786569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:50.809153 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-096e92cb-90c6-47c5-9893-77e6439b6069 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1505 microversion: 2.1 time: 0.386195 Oct 18 16:14:50.811722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1676/3360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:50 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:50.841648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:50.842518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:50.850294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.851066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.853483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.854973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.855705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.856546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.891232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:50.959773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:50.960644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:50.971819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.972691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.973377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.974602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:50.975304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:50.975891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:50.995839 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd351253-2f9a-475c-9043-d0dfbe3dfd15 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 204 len: 0 microversion: 2.1 time: 0.157531 Oct 18 16:14:50.996745 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1685/3361] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:50 2022] DELETE /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:51.018648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:51.021863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:51.033884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.034697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.035303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.036242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.036855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.037453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.077928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:51.188538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:51.206611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:51.208687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd738c1f-07dd-4996-8bde-dd4bf1444125 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 204 len: 0 microversion: 2.1 time: 0.202500 Oct 18 16:14:51.208929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:51.212159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a5191f18-b35c-4059-9426-0c0a77c54932 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.257385 Oct 18 16:14:51.212947 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1686/3362] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:51 2022] DELETE /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:51.215116 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1677/3363] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:50 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:51.221355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:51.222180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:51.231043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.231752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.232351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.233787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.234287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.234721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.253095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddc0bca-caba-4738-87b4-0201ff51cbee", "tag": "0de726e1-fb55-4cfa-a485-302fc57e45b7"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:51.280419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.281277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.283102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.316478 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] Creating event network-changed:0de726e1-fb55-4cfa-a485-302fc57e45b7 for instance 0ddc0bca-caba-4738-87b4-0201ff51cbee on n-h1-858383-14 Oct 18 16:14:51.350524 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5602965f-bf47-4e41-9d6a-363d4d979768 req-85465f8c-a4db-40b2-98a3-0019090ecc97 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108112 Oct 18 16:14:51.351782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1687/3364] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:51.358563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:51.367006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:51.384250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.387735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.388400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.389380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.390037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.393235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.537898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:51.547309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa831ffe-0805-46da-9d23-cb5384d99b72 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1511 microversion: 2.1 time: 0.330841 Oct 18 16:14:51.547963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1678/3365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:51 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:51.725405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:51.734361 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbb58938-78c1-4502-ad21-fd1549e63e9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.381105 Oct 18 16:14:51.735057 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1688/3366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:51 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:51.908777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08a28f48-4fac-4ec5-948d-4799c9f76cab tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '.version_select at 0x7f5fd223a280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:51.912249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a28f48-4fac-4ec5-948d-4799c9f76cab tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:51.912729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a28f48-4fac-4ec5-948d-4799c9f76cab tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:51.913195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a28f48-4fac-4ec5-948d-4799c9f76cab tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:51.922613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08a28f48-4fac-4ec5-948d-4799c9f76cab tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.017477 Oct 18 16:14:51.923611 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1679/3367] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:14:51 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:51.948316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72c73bb2-09f7-48a1-b15e-357a30cc963f tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:51.956627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72c73bb2-09f7-48a1-b15e-357a30cc963f tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012320 Oct 18 16:14:51.957331 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1689/3368] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:14:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:51.970988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2262cfc5-c1e0-4fe4-b02d-6659a1ac932b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-833570302", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:51.994537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2262cfc5-c1e0-4fe4-b02d-6659a1ac932b tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.027544 Oct 18 16:14:51.996268 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1680/3369] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Oct 18 16:14:51 2022] POST /compute/v2.1/flavors => generated 498 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:52.009163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73ddd912-e1b0-43cd-ae68-5f3587b53816 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:52.018879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73ddd912-e1b0-43cd-ae68-5f3587b53816 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013439 Oct 18 16:14:52.019454 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1690/3370] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 18 16:14:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:14:52.130956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2114597955", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "918a074a-3430-4502-9ceb-bf32cca63858"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:52.190289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:14:52.241907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:52.242650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:52.250385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.251147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.251602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.252316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.253920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.254336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.412321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:52.423174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:52.425336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:52.426845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d40372d-3fa2-4b88-a48e-9c29811d8c0f tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.188964 Oct 18 16:14:52.427608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1691/3371] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:52 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:52.483442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:52.484034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:52.484821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:52.485098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:52.485675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:52.499674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.500374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.501011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.502082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.502927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.503497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.530087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:52.538596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:52.541350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:52.555291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:52.558476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:52.612322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c41b50ae-1623-40bc-a8c5-71030e179abc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485206 Oct 18 16:14:52.612982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1681/3372] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:14:52.617950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:52.618913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:52.626389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.627358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.628178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.629732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.630361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.631009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.744683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "88d406b2-ba8b-4f95-a0bc-d87d84f4c337"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:52.748462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:52.755089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.755732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.756266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.757192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.757802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.758410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.833215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:52.837764 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-79222475-23df-4312-b456-728c3b0d0281 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1511 microversion: 2.1 time: 0.223372 Oct 18 16:14:52.839493 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1682/3373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:52 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:52.844824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8c09401-1dbf-468e-a12e-01b50b7a5f55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:52.845643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8c09401-1dbf-468e-a12e-01b50b7a5f55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:52.902950 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] HTTP exception thrown: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. Oct 18 16:14:52.926531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8c09401-1dbf-468e-a12e-01b50b7a5f55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:52.934769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8c09401-1dbf-468e-a12e-01b50b7a5f55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1279 microversion: 2.1 time: 0.094252 Oct 18 16:14:52.935534 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1683/3374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:52 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:52.940378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:52.941327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Request method failure captured: Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: request: PUT /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments/2bf26764-7367-465e-810b-41552891804b HTTP/1.1 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 74 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtB1ZbvFtAm6wohZM2JD4tL8BOfBrqNcbsgYAVV7McZTE5nZGtm9qdzUBUdnV_Bv5I1wEQDRLfiHT8x-Q9FGwi-WPZ8hPoCb7KbOIzJer8oAGxJjg0z-NSi7aKpH956TG8YOmNcrgWqGtpglPP6hj_U8LxPmk7WWwWFKjG0aYV0qtO4 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a96557cf1ece4bea92d6aa56c1ae75f8 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a96557cf1ece4bea92d6aa56c1ae75f8"}]}] Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a96557cf1ece4bea92d6aa56c1ae75f8 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesAdminNegativeTest-1916651045-project-admin Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 8a6610a5b8564e59af27b1bab118db28 Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesAdminNegativeTest-1916651045-project-admin Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: {"volumeAttachment": {"volumeId": "88d406b2-ba8b-4f95-a0bc-d87d84f4c337"}} Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '9c2603c5-2558-440d-b5cd-20f1bfe8e2c5', 'id': '2bf26764-7367-465e-810b-41552891804b', 'body': {'volumeAttachment': {'volumeId': '88d406b2-ba8b-4f95-a0bc-d87d84f4c337'}}} Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. (HTTP 404) (Request-ID: req-e0c6e61e-71b0-4690-83c6-05ae9549490c) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:14:52.941834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:52.946494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Returning 400 to user: Volume 88d406b2-ba8b-4f95-a0bc-d87d84f4c337 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:52.950982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-099360f8-acad-46bd-8f08-a20789c2992e tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments/2bf26764-7367-465e-810b-41552891804b" status: 400 len: 107 microversion: 2.1 time: 0.384117 Oct 18 16:14:52.951084 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1692/3375] 10.222.0.78 () {60 vars in 1433 bytes} [Tue Oct 18 16:14:52 2022] PUT /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments/2bf26764-7367-465e-810b-41552891804b => generated 107 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:14:52.965428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.965928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.966480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:52.967086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:52.967502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:52.968100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.085783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.086936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:53.102838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.103503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.105091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.106653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.107587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.108372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.224459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.225909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lazy-loading 'services' on Instance uuid 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:14:53.238065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e24db425-4db6-4c84-b4c5-76ccdfd916fc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.301219 Oct 18 16:14:53.239971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1684/3376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:52 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:53.331858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:53.333982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f2d425f-8398-4246-8799-e5cda10d3b35 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments/2bf26764-7367-465e-810b-41552891804b" status: 202 len: 0 microversion: 2.1 time: 0.259887 Oct 18 16:14:53.334755 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1693/3377] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:14:53 2022] DELETE /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments/2bf26764-7367-465e-810b-41552891804b => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:53.348504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.352546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:53.364100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.364936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.365730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.366941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.367736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.368482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.425280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b04dd51f-3b12-45b9-b755-e60485516b06 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084136 Oct 18 16:14:53.426280 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1685/3378] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:53.459385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.460118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:53.468335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.468823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.469286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.469975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.470420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.470854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.571273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.579175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.580089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Searching by: {'deleted': False, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:14:53.586071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.586635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.587142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.588052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.589023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.589887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.624832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:14:53.657840 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3ce6629-6701-4829-8a36-6bb4736fd959 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.092805 Oct 18 16:14:53.659663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1686/3379] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers => generated 339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:53.679068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.685040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.685828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Searching by: {'deleted': False, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:14:53.692444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.693454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.693688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.694512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.695025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.695532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.708646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.718546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.719998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.721207 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-778686fa-b1a7-4b1f-b869-1917467f6588 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.266805 Oct 18 16:14:53.721795 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1694/3380] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:53.727982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:14:53.754792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:53.769793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:53.776322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.776811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.777297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.872170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.872785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:53.880176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.880722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.881358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.882187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.882738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.883177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.912012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02c5ff79-c654-416e-977c-9310dcc359d2 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.237162 Oct 18 16:14:53.912606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1687/3381] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:53.940981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17b9f94d-5cd8-476c-9a87-80b8cfdb5fe8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.950804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17b9f94d-5cd8-476c-9a87-80b8cfdb5fe8 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013913 Oct 18 16:14:53.951394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1688/3382] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:53.966322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:53.967000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:53.975524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.976251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.977094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:53.977990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:53.978606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:53.979075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.052030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:54.060343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:54.065904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5d867c0c-c49b-41d6-b6bf-c6ef38f82d04 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1511 microversion: 2.1 time: 0.198112 Oct 18 16:14:54.074311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-007821ee-a771-446f-83da-7a8ab0345d77 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1283 microversion: 2.1 time: 0.112300 Oct 18 16:14:54.075552 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1689/3383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:54.077717 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1695/3384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:53 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:54.270422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:54.271357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:54.284571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.287726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.288212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.288940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.290877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.291320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.439331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:54.441975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:54.450938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.451683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.452359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.453414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.454093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.454733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.496514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d098db8-8bd7-42a1-8a68-2e6b4844f020 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061834 Oct 18 16:14:54.501570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1696/3385] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:14:54 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:54.534036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:54.542384 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d2653e4-c84c-483e-b51c-0d0e6af01680 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.276736 Oct 18 16:14:54.543633 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1690/3386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:54 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:54.710148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:54.711128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:54.718343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.719081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.719766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.720781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.721651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.722364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.751620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:54.752334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:54.758124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:54.769757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.770614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.771408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.772717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.773595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.774291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.832819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:54.875029 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-27584a18-4e03-4bd8-b53e-acc3e09d8ab3 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 204 len: 0 microversion: 2.1 time: 0.168571 Oct 18 16:14:54.879486 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1697/3387] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:54 2022] DELETE /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:54.898184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:54.899003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:54.922888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.924271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.924733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:54.925529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:54.925992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:54.930762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.245552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.255027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.256701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.258306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5dda45d5-343c-4e4c-9e1a-cfb148467862 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.510589 Oct 18 16:14:55.258950 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1691/3388] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:54 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:55.268959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:55.270076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:55.277785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.278960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.278960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.285697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.287297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.287297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.287297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.295066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9711868-6e45-477f-bf69-7c138e1ddb4e tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1712 microversion: 2.1 time: 0.407623 Oct 18 16:14:55.297274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1698/3389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:54 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1712 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:55.303771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:55.304350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:55.312543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.313149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.313879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.315046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.316527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.316983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.465108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.474947 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4cf493ef-8627-4142-a386-cfa1edb45809 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1331 microversion: 2.1 time: 0.177476 Oct 18 16:14:55.477143 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1699/3390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:55 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:55.511057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:55.516034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:55.523199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.523966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.524890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.526569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.527518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.528226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.578757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.580082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-782c8583-9e89-40c6-b011-ab493ec42c11 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074234 Oct 18 16:14:55.581338 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1700/3391] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:14:55 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:55.589184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:55.590007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:55.590421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55f25bfe-d31e-4aac-97fe-f310683772d3 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1511 microversion: 2.1 time: 0.325337 Oct 18 16:14:55.591203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1692/3392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:55 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:55.601192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.601569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.603132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.604626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.605659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.606591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.728750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d0eeb2-8a26-4666-8f1b-43a2b559c224", "name": "network-vif-deleted", "tag": "1266326d-152f-43db-8d14-217eebaf5341"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:55.740135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:55.741790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:55.743144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:55.760117 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] Creating event network-vif-deleted:1266326d-152f-43db-8d14-217eebaf5341 for instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 on n-h1-858383-14 Oct 18 16:14:55.768619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0d2fc819-945e-4ea4-a7fb-40d95c0c80fd req-63e43c22-0155-41f6-a405-9d2a5f75172e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043584 Oct 18 16:14:55.769774 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1693/3393] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:55.910409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:55.923060 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db8cd26f-2f54-4538-a9d6-cd1a84717c60 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.340217 Oct 18 16:14:55.924278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1701/3394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:56.291133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:56.291802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:56.312479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.314505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.325694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.329185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.329690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.332325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.333798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:56.335013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:56.384241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.409144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.412444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.424213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.439063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.439853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.907207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:56.921269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4d8a28f-cdd3-4500-ab56-d04c0f3d076b tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1712 microversion: 2.1 time: 0.601017 Oct 18 16:14:56.929538 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1702/3395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:56 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1712 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:56.935504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:56.941834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:56.954050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.954985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.955782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.956649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:56.957037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:56.957962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:56.958581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:56.968924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:56.970976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:56.972627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9c1016fe-e505-4128-9260-4734108193a3 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.690135 Oct 18 16:14:56.973527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1694/3396] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:56 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:14:56.986472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:56.991242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:57.011285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.012022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.014132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.015941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.016456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.019217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.093333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:57.096342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a45d757-8e19-452c-9b85-eb9ea59907b7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121208 Oct 18 16:14:57.098635 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1695/3397] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:14:56 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:57.116777 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28d156cc-e889-4fe7-9fa4-8fbe404478a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1337 microversion: 2.1 time: 0.189137 Oct 18 16:14:57.118137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1703/3398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:56 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1337 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:57.125259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:57.131743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:57.145744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:57.145925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.145925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.145925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.153761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] Creating event network-vif-plugged:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:14:57.154749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.156763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.160234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c168d7e2-71a3-491e-aaad-e699f6384701 req-5a9c372b-82bf-499e-a52a-e87e5496bf51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039776 Oct 18 16:14:57.160732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.164360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.164463 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1704/3399] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:57.164724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.167494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.172338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:57.173514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:57.180977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.181501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.182701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.184288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.185256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.186700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.273909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.274656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.275431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.277491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lazy-loading 'fault' on Instance uuid 5aa81507-06e5-4e8b-824c-db125e70c225 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:14:57.730569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818cfb3b5ddc4838a93a0d301ac89e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5c1a9259f64a7e937a160a7967f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:57.751082 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3abdc60d-4208-4823-9713-fd735e29f2e9 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 200 len: 1308 microversion: 2.1 time: 0.650640 Oct 18 16:14:57.751691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1696/3400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:57 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:57.761956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:57.762301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:57.762611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:57.774563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-995a563d-3862-4d6f-a66c-0a9e278e303e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1317 microversion: 2.1 time: 0.608495 Oct 18 16:14:57.779062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.779575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.780072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.780803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.781381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.781624 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1705/3401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:57 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:57.793823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.801767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa81507-06e5-4e8b-824c-db125e70c225", "name": "network-vif-deleted", "tag": "e70b63b6-3cda-43e6-858e-8994465ee905"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:57.838648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.839342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.840381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.865792 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] Creating event network-vif-deleted:e70b63b6-3cda-43e6-858e-8994465ee905 for instance 5aa81507-06e5-4e8b-824c-db125e70c225 on n-h2-858383-14 Oct 18 16:14:57.878064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2f6f5eef-5d84-4c8b-a0f0-c5ae235579c1 req-509a902c-860a-4d66-abb9-830f06c80a9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082379 Oct 18 16:14:57.880141 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1706/3402] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:57.952946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:57.955087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:57.970632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.971994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.973151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:57.975093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:57.976201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:57.977160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:58.180746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:58.205865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:58.207797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:58.209293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41ed402a-515a-4b50-8867-1dee9c25f450 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2949 microversion: 2.42 time: 0.456372 Oct 18 16:14:58.210670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1697/3403] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:57 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2949 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:58.217349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:58.226368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:58.245706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:58.246386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:58.246987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:58.247813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:58.248300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:58.248739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:58.685665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:58.741219 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6968a7b-004c-4094-a27a-df21d8ee5cc7 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1712 microversion: 2.1 time: 0.783149 Oct 18 16:14:58.743307 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1707/3404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:57 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1712 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:58.761920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:58.771775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:58.801507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:58.805254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:58.805881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:58.811333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:58.811791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:58.812284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.003528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9eb4c45-8aa5-4c88-8d39-35df67be9d42 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253998 Oct 18 16:14:59.019495 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1708/3405] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:14:58 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:59.029229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.029873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.036960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:59.039791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.040295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.040737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.041517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.041981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.042544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.078920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:59.111356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:59.115208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:59.117829 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67ad7591-6af8-4226-bfed-13772a1fd514 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.905573 Oct 18 16:14:59.136794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1698/3406] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:14:58 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:59.146542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.147039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.154877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.155729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.156388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.157367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.158139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.159995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.422512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:59.449140 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a51a0305-81f3-481c-b0d1-60ea4a07236d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 0.427707 Oct 18 16:14:59.469099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1709/3407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:59.474469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.475256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 5aa81507-06e5-4e8b-824c-db125e70c225] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.486095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.486785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.487427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.488197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.488773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.489405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.508320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d71f418-f854-4f97-920a-0b8d1b9965ff tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.370051 Oct 18 16:14:59.521435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1699/3408] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f/os-interface => generated 1830 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:14:59.531280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.531280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.531699 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] HTTP exception thrown: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Request method failure captured: Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 HTTP/1.1 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDKc5GmJ-TapLNF92HNY6g3GBU_CoVGu7KZ2H0lWJdNphxHfh4UnIBlDOLQeet4wzXTAJoxTc37HDdAVhxnrPJv15Tct-g_BFtB8jYlTbvquLrl2t99-E5RDp-WlE0w6NCewgfCkEH4D0qQcCRHjAXNziW1bpbti9aev-j9zpsn85M Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 8c5c1a9259f64a7e937a160a7967f708 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c5c1a9259f64a7e937a160a7967f708"}]}] Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 8c5c1a9259f64a7e937a160a7967f708 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-MultipleCreateTestJSON-982550851-project Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 818cfb3b5ddc4838a93a0d301ac89e22 Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-MultipleCreateTestJSON-982550851-project Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5aa81507-06e5-4e8b-824c-db125e70c225'} Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:59.534804 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.561779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Returning 404 to user: Instance 5aa81507-06e5-4e8b-824c-db125e70c225 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:59.564410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.564659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4a968a9-d536-4ae1-89f9-38b455933e3f tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225" status: 404 len: 111 microversion: 2.1 time: 0.067501 Oct 18 16:14:59.565721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.565721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.566255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1710/3409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/5aa81507-06e5-4e8b-824c-db125e70c225 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:14:59.566546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.566546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.566546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.567351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.567351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] [instance: 76d0eeb2-8a26-4666-8f1b-43a2b559c224] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.584158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.584967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.586056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.590440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.593413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.594358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.632680 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] HTTP exception thrown: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Request method failure captured: Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 HTTP/1.1 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDKc5GmJ-TapLNF92HNY6g3GBU_CoVGu7KZ2H0lWJdNphxHfh4UnIBlDOLQeet4wzXTAJoxTc37HDdAVhxnrPJv15Tct-g_BFtB8jYlTbvquLrl2t99-E5RDp-WlE0w6NCewgfCkEH4D0qQcCRHjAXNziW1bpbti9aev-j9zpsn85M Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 8c5c1a9259f64a7e937a160a7967f708 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c5c1a9259f64a7e937a160a7967f708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c5c1a9259f64a7e937a160a7967f708"}]}] Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 8c5c1a9259f64a7e937a160a7967f708 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-MultipleCreateTestJSON-982550851 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-MultipleCreateTestJSON-982550851-project Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 818cfb3b5ddc4838a93a0d301ac89e22 Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-MultipleCreateTestJSON-982550851-project Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '76d0eeb2-8a26-4666-8f1b-43a2b559c224'} Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:59.640162 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] Returning 404 to user: Instance 76d0eeb2-8a26-4666-8f1b-43a2b559c224 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:59.648537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3d72d4b-bb72-4a4a-b741-a83e5aae7c75 tempest-MultipleCreateTestJSON-982550851 tempest-MultipleCreateTestJSON-982550851-project] 10.222.0.78 "GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224" status: 404 len: 111 microversion: 2.1 time: 0.095950 Oct 18 16:14:59.658066 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1711/3410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/76d0eeb2-8a26-4666-8f1b-43a2b559c224 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:14:59.770530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:59.771457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:59.783736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.784573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.786558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.787571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:59.788235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:59.790372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:59.972636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:59.983871 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08340f76-fd70-440e-9fc4-8fa8a3779270 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1646 microversion: 2.1 time: 0.218176 Oct 18 16:15:00.000579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1712/3411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1646 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:00.023006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:00.025643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:00.046435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.048251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.049201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.058599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.060266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.061438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.066151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:00.084752 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04f51337-72bb-48a2-a361-b56e72306bc4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.566308 Oct 18 16:15:00.085452 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1700/3412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:59 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:00.142106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-124c1981-6b70-44e5-bcd5-e51b1454afc8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125512 Oct 18 16:15:00.143980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1713/3413] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:15:00 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:15:00.174009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:00.174744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:00.202240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2066063296", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:00.209256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.210134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.210821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.211959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.212675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.214517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.327774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] validate_networks() for [('337029b8-3a44-4243-882f-158968fa7ad7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:15:00.924348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:00.941830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:00.945629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:00.947154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c40e6672-d910-4f94-8782-c9ca0cba1054 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.779306 Oct 18 16:15:00.953478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1701/3414] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:00 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:00.997222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5efc66c-e521-4a0c-9416-2636eec7193e", "name": "network-vif-deleted", "tag": "0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:01.021087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.021860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.024125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.042433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] Creating event network-vif-deleted:0dda5f1c-54bc-4046-b3ed-0fbd5a1e2378 for instance b5efc66c-e521-4a0c-9416-2636eec7193e on n-h1-858383-14 Oct 18 16:15:01.075219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-837426b9-4ba9-42df-8fac-e5100670adb6 req-a14f2090-649c-4914-bb1d-72d3310c7ceb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106069 Oct 18 16:15:01.078636 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1702/3415] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:01.103010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:01.104572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:01.131086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.132356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.139455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.141197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.142064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.142836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.727114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:01.729050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:01.730390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:01.738066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:01.740839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:01.776479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.776479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.781904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.783633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.784611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.785479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.831477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:01.866833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Getting quotas for project 09f13c8b99d641b0b30333ec27f72b9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:01.889206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:01.897767 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35009873-8a68-423c-8b04-bae04109ffca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 0.814753 Oct 18 16:15:01.899283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Getting quotas for user 466ba2f759a34d11b6dd8887bb49554d and project 09f13c8b99d641b0b30333ec27f72b9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:01.909817 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1703/3416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:01 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:01.914984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:01.915817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:01.965508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.966417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.974374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.975798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:01.976648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:01.977441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:01.979818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:01.986853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:02.093534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.094375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.094983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.095810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lazy-loading 'fault' on Instance uuid b5efc66c-e521-4a0c-9416-2636eec7193e {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:02.162799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddb0abe9-5ba6-4a5b-b1a3-f911301f8267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967416 Oct 18 16:15:02.178974 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1714/3417] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:15:02.211605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705dd668b8344cea9a74069c202cbe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ae35d217ff427ebcc72138f864cffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:02.216253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:02.229634 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4818d385-ad38-47fd-b3fa-e21bf0846a95 tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 200 len: 1367 microversion: 2.1 time: 0.317866 Oct 18 16:15:02.231653 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1704/3418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:01 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:02.233495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:02.247197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:02.253595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.254793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.259041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.262327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.263467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.264514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.303369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.305295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.305817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.353572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] Creating event network-changed:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:15:02.366093 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-55f51419-ea7f-47cf-a42e-66d39aaa9ed9 req-472a1cc8-7173-450e-bfb5-b119205b55d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131327 Oct 18 16:15:02.369107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1705/3419] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:02.380825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:02.384237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:02.392025 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-175246b6-b750-48ff-94d9-c36e451277cd tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211105 Oct 18 16:15:02.399642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.400648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1715/3420] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:15:02 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:02.403759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.409876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.410767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.411240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.411773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.426305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d552ed03-232d-4668-bdba-819c1ed9bc3d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:02.427415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d552ed03-232d-4668-bdba-819c1ed9bc3d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:02.617538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d552ed03-232d-4668-bdba-819c1ed9bc3d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:02.654831 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d552ed03-232d-4668-bdba-819c1ed9bc3d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1217 microversion: 2.1 time: 0.249769 Oct 18 16:15:02.656064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1716/3421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:02 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:02.956545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:02.957452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:02.967393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.970581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.973052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.974548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.974548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.981494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.125805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.135307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:03.140537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.142056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.143242 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d76d878a-0182-4c7a-b659-eb1756d13923 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.772958 Oct 18 16:15:03.143809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1706/3422] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:02 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:03.260016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:03.260714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] [instance: b5efc66c-e521-4a0c-9416-2636eec7193e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:03.276731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.281338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.284827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.287156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.287988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.290415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.349096 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] HTTP exception thrown: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Request method failure captured: Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e HTTP/1.1 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtCUH3110O2J2-nuBOKl6lj93RHm6eaPsTvNnGZGdrNT5AMyXsg_Moh9lVSNPMjBtGFkYYuwlinluQlOQzD9QaPV9aH4KloOpgAuoEk2tSEjryfGouY4yFBTdPLuqrAj4azKq1ZmV0Dior5XcLS3l2AD0qKTRks6kJ17xMxrEdwI80A Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d5ae35d217ff427ebcc72138f864cffc Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestManualDisk-771641024 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d5ae35d217ff427ebcc72138f864cffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5ae35d217ff427ebcc72138f864cffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d5ae35d217ff427ebcc72138f864cffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5ae35d217ff427ebcc72138f864cffc"}]}] Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestManualDisk-771641024 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d5ae35d217ff427ebcc72138f864cffc Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestManualDisk-771641024 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestManualDisk-771641024-project Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 705dd668b8344cea9a74069c202cbe64 Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestManualDisk-771641024-project Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b5efc66c-e521-4a0c-9416-2636eec7193e'} Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:03.351668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Returning 404 to user: Instance b5efc66c-e521-4a0c-9416-2636eec7193e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90862757-6c83-4884-b2ec-d1388a4de3ce tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e" status: 404 len: 111 microversion: 2.1 time: 0.100565 Oct 18 16:15:03.363184 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1707/3423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:03 2022] GET /compute/v2.1/servers/b5efc66c-e521-4a0c-9416-2636eec7193e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:15:03.373056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de74ca2b-93c1-4d5a-8441-994e005781df tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] Calling method '.version_select at 0x7f5fd2828a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:03.415486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.422683 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de74ca2b-93c1-4d5a-8441-994e005781df tempest-ServersTestManualDisk-771641024 tempest-ServersTestManualDisk-771641024-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758121770" status: 202 len: 0 microversion: 2.1 time: 0.060125 Oct 18 16:15:03.423266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1708/3424] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758121770 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:15:03.427984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:03.432920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f82557f-99ac-4916-9fed-1af8eacedbda tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 0.480024 Oct 18 16:15:03.438430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:03.451222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.451589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.452031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.452759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.453247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.453651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1717/3425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:02 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:03.453871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.506952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5eec8260-ba58-4e61-9d86-696cc4a38577 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082494 Oct 18 16:15:03.507733 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1709/3426] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:15:03 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:03.702837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:03.706411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:03.721568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.722398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.723080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.724024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.724720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.725406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.836292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.841341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:03.848745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-602b257f-8edd-48cc-9d2e-c5061199b6bc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1269 microversion: 2.1 time: 0.153150 Oct 18 16:15:03.862276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1718/3427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:03 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:04.174588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:04.174588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:04.178570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:04.180369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=18 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:04.185966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.187024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.188684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.190112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.190971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.191629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.463953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:04.465871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:04.478204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.479453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.480428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.482287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.483636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.484525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.859999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:04.869339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:04.871788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:04.873254 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e3fc1c7-35d0-4dfa-82f7-39c9d2058aaf tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.703711 Oct 18 16:15:04.892490 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1710/3428] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:04 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:04.902118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:04.904710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:04.911366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.912121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.912717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.913680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.914298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.914890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.966320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6f31f62-5ec4-4490-b0b4-a84302a18ab9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072072 Oct 18 16:15:04.967545 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1711/3429] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:15:04 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:15:04.972717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:04.973579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:04.996138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.003322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.004088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.005018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.008970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.009794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.205757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:05.214370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8ea905b7-963b-4ff9-ab5d-d8e8b93a0143 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 0.758393 Oct 18 16:15:05.214953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1719/3430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:04 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:05.244278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:05.262399 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d6cdb91-ff93-4a52-af31-a1112ea3a3c7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1275 microversion: 2.1 time: 0.293592 Oct 18 16:15:05.262976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1712/3431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:04 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:05.328780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1587211109", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "f4e54443-b052-449e-b9db-065b05a2a7a2"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:05.438489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] validate_networks() for [('f4e54443-b052-449e-b9db-065b05a2a7a2', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:15:05.611315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddc0bca-caba-4738-87b4-0201ff51cbee", "name": "network-vif-plugged", "status": "completed", "tag": "0de726e1-fb55-4cfa-a485-302fc57e45b7"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:05.651728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.652692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.653463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.706462 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] Creating event network-vif-plugged:0de726e1-fb55-4cfa-a485-302fc57e45b7 for instance 0ddc0bca-caba-4738-87b4-0201ff51cbee on n-h1-858383-14 Oct 18 16:15:05.724406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2b98b8d1-0f85-4bb6-bbb0-7d65c8de4672 req-217f3e29-5dae-4f3d-bb88-6d813639d4a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120835 Oct 18 16:15:05.727327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1713/3432] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:05.741971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:05.751385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:05.769669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.770993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.771600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.772530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.773181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.773764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.931915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d32174d-a3ab-4361-ba8a-3bb44600cc2c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.202680 Oct 18 16:15:05.932874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1714/3433] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:05 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:15:05.939690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:05.940083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:05.949633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.950333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.950571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.951450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.961104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.961588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:06.493223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:06.518419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:06.520069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:06.525337 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1cd6e0a3-e012-4f42-bc92-44a27912c6e8 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.591140 Oct 18 16:15:06.526125 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1715/3434] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:05 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:06.531063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:06.536065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:06.556883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:06.558983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:06.559973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:06.561793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:06.562492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:06.563251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:06.989613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.001630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b85bb368-10e2-46d8-a7d2-ea8b9a81ab2d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1671 microversion: 2.1 time: 0.473183 Oct 18 16:15:07.017992 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1716/3435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:06 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1671 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:07.029820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:07.030798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:07.038223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.039220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.039904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.040957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.042498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.043264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.071679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:07.072732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:07.073400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:07.073982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:07.074555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:07.093212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.093992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.094596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.095500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.096133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.096724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.157636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:07.165245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Getting quotas for user 5bd4aa75ffc54e5f840a70d8a901da15 and project 8ad06f3c29294b01ba67eb5d5a1ea59c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:07.195204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:07.200780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:07.324366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2b00176-0aa9-4af7-87c2-20480bfa3156 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000007 Oct 18 16:15:07.332485 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1720/3436] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:15:07.340438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:07.358491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:07.390002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.391858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.393584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.394758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.395584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.397578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.544122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.553859 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e8bffbd-a8b4-4263-9366-d9eb478cef79 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 0.534257 Oct 18 16:15:07.554558 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1717/3437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:07 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:07.578370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d96b3e67-7bfa-41e1-9585-1e9754c25bfc tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:07.582803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d96b3e67-7bfa-41e1-9585-1e9754c25bfc tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:07.694618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d96b3e67-7bfa-41e1-9585-1e9754c25bfc tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.709839 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d96b3e67-7bfa-41e1-9585-1e9754c25bfc tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1218 microversion: 2.1 time: 0.139754 Oct 18 16:15:07.721200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1718/3438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:07 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:07.721200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:07.721200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:07.731196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.731769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.732423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.733441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:07.734060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:07.736027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:07.969230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.981713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.985054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:07.986973 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fba5f123-1145-48c9-976d-81cd4f619137 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1362 microversion: 2.26 time: 0.274243 Oct 18 16:15:07.988209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1719/3439] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:07 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:08.033828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:08.034536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:08.044256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.044256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.044665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.046471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.048946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.050824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.168206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:08.189532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca078a3f-8ce4-45e5-b77b-f054228445eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.855265 Oct 18 16:15:08.191257 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1721/3440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:07 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:08.300137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:08.338925 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb560268-a963-4b6e-bffb-0c273ea9660b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1671 microversion: 2.1 time: 0.307059 Oct 18 16:15:08.357748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1720/3441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:08 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:08.584303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:08.585457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:08.601330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.602381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.602381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.602989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.603456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.605115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.717866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-plugged", "status": "completed", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:08.744818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.747844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.750279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.790146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] Creating event network-vif-plugged:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:15:08.806423 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5324c9f7-db73-41f3-a7bd-a94035c18d27 req-326bbb0a-f612-4f79-a871-ff6d50f037a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093248 Oct 18 16:15:08.807706 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1721/3442] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:15:08.814127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:08.815249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:08.824341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:08.826633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.828555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.829273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:08.830211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:08.830877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:08.831537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.282394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:09.293918 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16dff0cb-fc03-44af-8cf1-297a9014c012 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1270 microversion: 2.1 time: 0.484643 Oct 18 16:15:09.297564 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1722/3443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:08 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1270 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:09.317925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:09.319095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:09.342684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.343295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.343808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.344714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.345862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.346367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.731497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:09.749654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:09.755697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:09.761062 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a4d3e52-42a1-421a-9bbd-d4a286efd84d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1546 microversion: 2.26 time: 0.451644 Oct 18 16:15:09.764020 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1723/3444] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:09 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1546 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:09.775809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:09.778266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:09.794319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.795249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.796093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.797513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.798437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.799243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.824594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:09.839457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6545d258-e0b5-40f7-88aa-8533593f6d05 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 1.259040 Oct 18 16:15:09.841865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1722/3445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:08 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:09.851136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:09.851998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:09.878066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.878719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.879287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:09.880094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:09.881029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:09.881954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.175513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:10.219859 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bf66e976-abbf-4ee2-88a8-49550223c8e3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.448771 Oct 18 16:15:10.236093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1724/3446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:09 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:10.277213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd642a9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.319275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.320658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.324556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.326037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:10.351875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.353110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.354596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.366907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.368307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.372017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.515024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.516018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.516695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.583436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.583996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.584492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.588013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:10.602046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f5acb15-2588-45df-bbca-9f67b338f73f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1676 microversion: 2.1 time: 0.756156 Oct 18 16:15:10.603252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1723/3447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:09 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1676 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:10.615093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.615905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:10.620341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:10.636443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.638386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.639115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.645624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.646448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.647726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.668721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:10.702478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad5b6109-13ec-419c-a10f-5ccaa70e8429 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-253926598" status: 201 len: 0 microversion: 2.26 time: 0.462152 Oct 18 16:15:10.708746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1725/3448] 10.222.0.78 () {62 vars in 1377 bytes} [Tue Oct 18 16:15:10 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-253926598 => generated 0 bytes in 469 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 16:15:10.716055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04c0b6a2-dbcf-4d59-8b1d-61b80da5905d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd653f550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.726987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04c0b6a2-dbcf-4d59-8b1d-61b80da5905d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.727701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04c0b6a2-dbcf-4d59-8b1d-61b80da5905d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.728399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04c0b6a2-dbcf-4d59-8b1d-61b80da5905d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.745072 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04c0b6a2-dbcf-4d59-8b1d-61b80da5905d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-253926598" status: 204 len: 0 microversion: 2.26 time: 0.034304 Oct 18 16:15:10.750594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1726/3449] 10.222.0.78 () {60 vars in 1358 bytes} [Tue Oct 18 16:15:10 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-253926598 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:10.756278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd646cf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.767644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.768471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.769133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.769817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:10.783668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.787154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.789971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.790964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.792645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.795763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.840647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:10.851997 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81456644-a425-470e-85be-585e24878cba tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1276 microversion: 2.1 time: 0.247445 Oct 18 16:15:10.852909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1724/3450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:10 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:10.871821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.872437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:10.882450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.883239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.884012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.887958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.891372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.899886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.902705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.903413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.904093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.920863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:10.943957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d476494-1f52-4581-8e7c-b60170cf73ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 204 len: 0 microversion: 2.26 time: 0.191549 Oct 18 16:15:10.955358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1727/3451] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Oct 18 16:15:10 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 16:15:10.968923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1870fa6-2e9a-4e2f-9673-61451803ffc2 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd646ca60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:10.983601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1870fa6-2e9a-4e2f-9673-61451803ffc2 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.984783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1870fa6-2e9a-4e2f-9673-61451803ffc2 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.985447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1870fa6-2e9a-4e2f-9673-61451803ffc2 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.004377 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1870fa6-2e9a-4e2f-9673-61451803ffc2 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 12 microversion: 2.26 time: 0.047126 Oct 18 16:15:11.012649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1728/3452] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 16:15:10 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:11.019248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd19aa790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:11.032345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.033133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.033592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.034098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:11.041925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.042564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.043428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.044292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.044862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.045412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.118834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.120737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.121312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.146962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.148068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.149118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.243103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:11.291366 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aae3b012-350e-41dd-8d1f-acef95910f3d tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1704134203" status: 201 len: 0 microversion: 2.26 time: 0.273421 Oct 18 16:15:11.294896 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1729/3453] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Oct 18 16:15:11 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1704134203 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 16:15:11.330381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:11.331662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:11.355729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.358449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.360978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.361929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.362456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.365625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.795920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:11.805712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c5e7af9-448c-4492-bbb8-4a4f58e0f980 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.498769 Oct 18 16:15:11.809024 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1730/3454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:11 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:11.825151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24f5e200-fbb2-43e6-9ea4-9db814b03ec6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd1858a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:11.842368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24f5e200-fbb2-43e6-9ea4-9db814b03ec6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.843452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24f5e200-fbb2-43e6-9ea4-9db814b03ec6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.845309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24f5e200-fbb2-43e6-9ea4-9db814b03ec6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.872467 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24f5e200-fbb2-43e6-9ea4-9db814b03ec6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 36 microversion: 2.26 time: 0.064342 Oct 18 16:15:11.874282 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1731/3455] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 16:15:11 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 36 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:11.880935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:11.881833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:11.892344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.893649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.894847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:11.897790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:11.898423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:11.900253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.276803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:12.292751 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5da5cf71-493d-48da-85e7-b5d0d065d906 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.416340 Oct 18 16:15:12.293977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1732/3456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:11 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:12.301419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc12c05-0954-4f24-bdb6-701a67b55471", "tag": "777a5121-1a82-4603-81c6-6f4813169b1e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:12.318529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.319217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.320029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.358140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] Creating event network-changed:777a5121-1a82-4603-81c6-6f4813169b1e for instance 7fc12c05-0954-4f24-bdb6-701a67b55471 on n-h1-858383-14 Oct 18 16:15:12.372202 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ec624705-5a3b-4b26-bde5-95581873a876 req-901a3afb-25ae-4906-986b-aea483908a68 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076670 Oct 18 16:15:12.373163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1733/3457] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:12.383814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:12.387275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:12.399004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.399716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.400671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.401643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.402425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.402937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.441834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:12.463166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77f2c018-b595-4fbf-9e3b-e42ab25342d8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1379 microversion: 2.1 time: 1.595795 Oct 18 16:15:12.469422 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1725/3458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:10 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1379 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:12.476607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd193d700>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:12.546799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.548147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.548909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.550322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:12.564375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.565352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.566105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.567531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.568312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.573570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.642138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.643972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.644604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.661415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:12.676022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-049cacb7-ba2a-41bf-b5f6-dd28c2e52c4d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1276 microversion: 2.1 time: 0.300548 Oct 18 16:15:12.686651 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1734/3459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:12 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:12.708230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:12.735883 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03c84e7a-26d4-4880-a3a9-3f026a8a32ac tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1704134203" status: 204 len: 0 microversion: 2.26 time: 0.264067 Oct 18 16:15:12.737494 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1726/3460] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Oct 18 16:15:12 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1704134203 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:12.747151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a0f0f88-bf66-41cc-9341-5c256ee604c6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd19d1430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:12.766541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a0f0f88-bf66-41cc-9341-5c256ee604c6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.768280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a0f0f88-bf66-41cc-9341-5c256ee604c6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.769131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a0f0f88-bf66-41cc-9341-5c256ee604c6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.785120 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a0f0f88-bf66-41cc-9341-5c256ee604c6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 12 microversion: 2.26 time: 0.042681 Oct 18 16:15:12.792749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1735/3461] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 16:15:12 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:12.802339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd18cc940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:12.816650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.817468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.818699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.819465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:12.829243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.830205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.830912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.831787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.831917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:12.832936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:12.833687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.834401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.847228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.849065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.850061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.852457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.853134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.858830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.873628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:12.874964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:12.875587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:12.902558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:12.957657 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84fffec8-8cd4-4056-9ed8-0eedaf2ad617 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 204 len: 0 microversion: 2.26 time: 0.161770 Oct 18 16:15:12.962059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1727/3462] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Oct 18 16:15:12 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:12.978895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd1929e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.011893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.018380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.022211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.023353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:13.033351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.034113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.034713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.035671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.036434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.037302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.079348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.080116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.080749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.099030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.099615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.100073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.142206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:13.163734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7162e8b9-587b-4b95-bcb7-556b8f1b9c63 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1706387144" status: 201 len: 0 microversion: 2.26 time: 0.195549 Oct 18 16:15:13.165326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1728/3463] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Oct 18 16:15:12 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1706387144 => generated 0 bytes in 198 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 16:15:13.185251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd18d58b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.226135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.228414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.230307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.230827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:13.237471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.238004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.238422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.239141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.239812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.240406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.280869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.281427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.281782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.294414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.295265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.296037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.299467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:13.314785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb850b2d-1214-4a4b-a65f-4963ef4ab0a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.486023 Oct 18 16:15:13.321206 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1736/3464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:12 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:13.370234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:13.401424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6340e839-aad8-418d-8ed6-a8d288ba3712 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1446627048" status: 201 len: 0 microversion: 2.26 time: 0.224615 Oct 18 16:15:13.405032 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1729/3465] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Oct 18 16:15:13 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1446627048 => generated 0 bytes in 230 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 16:15:13.425465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd1858280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.442648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.444033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.445519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.446764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:13.467145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.468018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.469105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.470642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.471812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.473386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.504048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.505497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:13.535654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.537245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.539326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.553114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.554483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.555452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.583622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.583622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.583622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.615698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:13.638849 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ed9d335-d25f-46f2-b660-468949de685a tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 204 len: 0 microversion: 2.26 time: 0.225182 Oct 18 16:15:13.641162 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1737/3466] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Oct 18 16:15:13 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:13.651541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f1f3973-227c-45c5-83fe-f020a76e9716 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd2151310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.663715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f1f3973-227c-45c5-83fe-f020a76e9716 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.665060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f1f3973-227c-45c5-83fe-f020a76e9716 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.666123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f1f3973-227c-45c5-83fe-f020a76e9716 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.687156 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f1f3973-227c-45c5-83fe-f020a76e9716 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 12 microversion: 2.26 time: 0.041088 Oct 18 16:15:13.689962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1738/3467] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 16:15:13 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:13.719345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:13.721477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:13.742849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.744730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.746008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.747583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:13.748969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:13.750131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:13.964894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:13.976367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76bf4e43-6f16-420c-984e-ec32541d398a tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.266215 Oct 18 16:15:13.977429 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1739/3468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:13 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:13.986992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd2111700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.003452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.005266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.007044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.008222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.018934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.020233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.021283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.022412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.023191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.023983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.059672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.060968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.062127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.076930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:14.101356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de3f5a37-18c9-4695-8a60-4f01f0fb4d45 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 204 len: 0 microversion: 2.26 time: 0.122112 Oct 18 16:15:14.109652 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1740/3469] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Oct 18 16:15:13 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:14.115566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd23f38b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.127811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.128806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.129501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.130148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.136590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.137348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.137956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.138789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.139434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.139918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.144414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:14.177244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.177740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.178179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.191327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.192533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.193437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.227603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:14.243449 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d33185c-949d-4020-8dcc-4d8e83e4d268 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1529 microversion: 2.1 time: 0.753861 Oct 18 16:15:14.249230 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1730/3470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:13 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1529 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:14.252307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:14.270623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea6b4eff-d6bb-44ab-b856-5ff0b67872ec tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-65197851" status: 201 len: 0 microversion: 2.26 time: 0.159530 Oct 18 16:15:14.276915 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1741/3471] 10.222.0.78 () {62 vars in 1374 bytes} [Tue Oct 18 16:15:14 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-65197851 => generated 0 bytes in 166 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 18 16:15:14.283249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd646c9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.285860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.286473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.294469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.294952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.295649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.297117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.303825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.304002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.304446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.304825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.304951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.305556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.305735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.306046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.306481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.307693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.312746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.313593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.323026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:14.373622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.378711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.379494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.394110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.394601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.395038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.436563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:14.465316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9185633-2424-4bf6-a7f1-94a7d5d552ba tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1368038227" status: 201 len: 0 microversion: 2.26 time: 0.186771 Oct 18 16:15:14.470901 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1742/3472] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Oct 18 16:15:14 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags/tempest-tag-1368038227 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 16:15:14.477608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.478234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.507249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.508182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.508627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.512716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.513269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.513720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.782461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:14.793348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-efdc4bf4-f6ae-4534-bb9f-80a403cef007 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.319971 Oct 18 16:15:14.799841 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1743/3473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:14 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:14.799841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Action: 'update_all', calling method: .version_select at 0x7f5fd65325e0>, body: {"tags": ["tempest-tag-1261177747", "tempest-tag-1521762048"]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:14.814737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.815800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.816632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.817574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:14.829634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.830540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.831355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.832798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.833706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.834498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.887118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.887540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.888178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:14.919304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:14.951434 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d79fe1c-15f4-45ab-9d0c-0f62296269a5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 62 microversion: 2.26 time: 0.155006 Oct 18 16:15:14.952396 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1744/3474] 10.222.0.78 () {62 vars in 1312 bytes} [Tue Oct 18 16:15:14 2022] PUT /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 62 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:14.968979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78a441f7-dca7-413c-9e67-0c6ba7af27a6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd1858280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:14.985180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78a441f7-dca7-413c-9e67-0c6ba7af27a6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:14.986231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78a441f7-dca7-413c-9e67-0c6ba7af27a6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:14.986906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78a441f7-dca7-413c-9e67-0c6ba7af27a6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.004451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78a441f7-dca7-413c-9e67-0c6ba7af27a6 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 200 len: 62 microversion: 2.26 time: 0.043476 Oct 18 16:15:15.005789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1745/3475] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 18 16:15:14 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 62 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:15.017173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '.version_select at 0x7f5fd1865790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.027743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.028344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.028952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.030035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.036562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.037352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.037787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.038483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.039121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.039544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.073823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.074724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.075717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.105488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lazy-loading 'flavor' on Instance uuid 0ddc0bca-caba-4738-87b4-0201ff51cbee {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:15.125938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc8359e4-9f46-47fa-844c-c20c8c04fa66 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags" status: 204 len: 0 microversion: 2.26 time: 0.113467 Oct 18 16:15:15.126568 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1746/3476] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Oct 18 16:15:15 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee/tags => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 16:15:15.134205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.135596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.142503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.142991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.143751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.144662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.145153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.145604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.150136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.167815 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7da29f5-c6fd-4976-9b95-f03a7853d8cf tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1529 microversion: 2.1 time: 0.887650 Oct 18 16:15:15.182368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1731/3477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:14 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1529 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:15.209068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.209068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.223387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.223866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.224356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.225616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.226384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.227054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.271064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:15.374579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.396323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddc0a76e-9bdd-4f2d-9ddc-b3da3b13983c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.268013 Oct 18 16:15:15.408039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1747/3478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:15 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:15.413999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9841429-a894-4c37-a1c8-4d0168fd52c8 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.441323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-738ac620-9033-4407-bdc5-f80c02e4af76 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 204 len: 0 microversion: 2.26 time: 0.256627 Oct 18 16:15:15.442084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9841429-a894-4c37-a1c8-4d0168fd52c8 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/918a074a-3430-4502-9ceb-bf32cca63858" status: 202 len: 0 microversion: 2.1 time: 0.032040 Oct 18 16:15:15.446442 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1748/3479] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:15 2022] DELETE /compute/v2.1/flavors/918a074a-3430-4502-9ceb-bf32cca63858 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:15:15.446636 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1732/3480] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:15:15 2022] DELETE /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:15.460704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.461374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e23a00a-0480-4c6e-82ab-4faa3ae2a109 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.465498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.476477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.478081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.479568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.481426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.482742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.484038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.491068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e23a00a-0480-4c6e-82ab-4faa3ae2a109 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038593 Oct 18 16:15:15.492203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1749/3481] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:15:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:15.516983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:15.520078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.537119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.537639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.538073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.538818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.539274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.539897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.595073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.602807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Old instance type tempest-test_resize_flavor_-833570302, new instance type m1.heat {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:15:15.613028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:15.613455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:15.613957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:15.615089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:15.615508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:15.768890 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d6ee6121-9b79-49f5-969a-f99e45520bca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9/action" status: 202 len: 0 microversion: 2.1 time: 0.257983 Oct 18 16:15:15.770301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1750/3482] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:15 2022] POST /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:15:15.788065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.793412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.829486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.832852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.835482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.837545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.839419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.841309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:15.954871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.969192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.970993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:15.972471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54f2fe15-7526-4162-b5b8-3b5c5617f6b5 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1552 microversion: 2.26 time: 0.522853 Oct 18 16:15:15.973755 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1733/3483] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:15 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1552 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:15.980853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:15.982278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:15.991968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:15.992760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:15.994026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:16.006772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:16.007743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:16.011140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:16.312911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:16.368411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8098e97-7cd0-4b2a-96b5-a8c61b833371 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1538 microversion: 2.1 time: 0.592334 Oct 18 16:15:16.388772 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1751/3484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:15 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1538 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:16.395151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8eb5a6-1bc5-4df4-a2ae-824323483266", "tag": "7ccfa1ff-f5b5-467a-909e-830518a09488"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:16.438053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:16.438939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:16.439758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:16.491875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] Creating event network-changed:7ccfa1ff-f5b5-467a-909e-830518a09488 for instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 on n-h2-858383-14 Oct 18 16:15:16.499756 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2cea54be-f3c8-4eb6-a8ed-a512e02d4150 req-82143c3e-5912-48da-84b5-427492937e18 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114976 Oct 18 16:15:16.500554 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1752/3485] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:16.506370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:16.507337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:16.515275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:16.515774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:16.516274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:16.516910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:16.517401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:16.517965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:16.570148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:16.585819 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-702db039-ee5b-466f-8780-48097283be15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.610182 Oct 18 16:15:16.586971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1734/3486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:15 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:16.720432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:16.730495 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33ed551f-7632-4792-bf9b-2465050673d1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.228160 Oct 18 16:15:16.731100 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1753/3487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:16 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:17.034429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:17.037975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:17.052128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.054001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.054935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.057841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.058399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.059235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.135954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:17.182102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=14 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:17.414906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:17.416422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:17.432104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.433673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.434447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.435503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.436675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.437435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.508124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:17.627799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:17.647668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:17.649181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:17.650489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f706fee0-26ba-47ca-a1b7-adb52f899ae7 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1552 microversion: 2.26 time: 0.625617 Oct 18 16:15:17.651435 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1735/3488] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:17 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1552 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:17.664615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:17.665311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:17.687581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.689110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.692849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.695718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.695718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.695718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.706043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:17.885736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:17.900462 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a400d662-38a6-40d6-851b-f2b0ea7a2094 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1538 microversion: 2.1 time: 0.490068 Oct 18 16:15:17.902103 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1754/3489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:17 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1538 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:17.912716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:17.914031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:17.940429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.941041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.944895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:17.946386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:17.946696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:17.947483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:18.330002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:18.339170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4d3e13c-6dba-473f-b5a3-676c0662d106 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.435341 Oct 18 16:15:18.339764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1755/3490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:17 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:18.369132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:18.380205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50992c70-d61c-4b06-a4ba-4d90e60c75f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.727973 Oct 18 16:15:18.381137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1736/3491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:17 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:18.687131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:18.687951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:18.705388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:18.707978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:18.708458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:18.719215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:18.719719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:18.720406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:18.731096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddc0bca-caba-4738-87b4-0201ff51cbee", "name": "network-vif-deleted", "tag": "0de726e1-fb55-4cfa-a485-302fc57e45b7"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:18.757065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:18.757821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:18.763248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:18.794864 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] Creating event network-vif-deleted:0de726e1-fb55-4cfa-a485-302fc57e45b7 for instance 0ddc0bca-caba-4738-87b4-0201ff51cbee on n-h1-858383-14 Oct 18 16:15:18.805935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6cfe5135-16c9-4640-aae3-4ec2dd121dcf req-dc734540-bc28-4570-92d5-682994ade6c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081227 Oct 18 16:15:18.807197 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1737/3492] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:18.874029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:18.884153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:18.887049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6944b0e6c664113932ae3df467dc537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf4b812c55648ffb0442df492d45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:18.888900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3382c5f7-86c2-48ea-afd3-dba410225efa tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 200 len: 1510 microversion: 2.26 time: 0.207733 Oct 18 16:15:18.908806 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1756/3493] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:18 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:18.926300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:18.927154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:18.954277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:18.955189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:18.955914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:18.957039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:18.957716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:18.958479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:19.266376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:19.281904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9966a439-89d6-4647-b951-75520c5c517d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1538 microversion: 2.1 time: 0.361484 Oct 18 16:15:19.283113 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1738/3494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:18 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1538 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:19.376917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:19.377836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:19.389925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:19.390674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:19.391328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:19.392243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:19.392868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:19.394637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:19.425963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:19.432395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:19.444972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:19.445507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:19.445954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:19.446671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:19.452894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:19.454869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:19.834467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:19.876173 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c38a21f-6270-4b26-8fe2-4bfd093cc445 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.505965 Oct 18 16:15:19.878875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1757/3495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:19 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:19.934493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:19.935928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:19.939598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] [instance: 0ddc0bca-caba-4738-87b4-0201ff51cbee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:19.960034 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c0ecb35-f9dc-4e97-a514-013e93c84ff2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 0.546773 Oct 18 16:15:19.961151 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1739/3496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:19 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:19.972898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:19.976563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:19.995885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.001037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.003394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.004315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.005434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.084507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] HTTP exception thrown: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Request method failure captured: Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee HTTP/1.1 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDywFGQ2VF_K8TyVcBLIZFNF5COfkn1MNB3EqZRZJs2m2TVFFvrP9m_seWrR9izk6DBCNaJzIojpEwfls7cFozDVlZ4Jkj0Rs07zYvs205E-SJRMxmViOEIoDMsSTQI9nip-zwwBtU1xY5A3N8v4nt1meYbFfGY4NrwocWqxqKihyk Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.26 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7bf4b812c55648ffb0442df492d45e18 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerTagsTestJSON-838056461 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bf4b812c55648ffb0442df492d45e18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bf4b812c55648ffb0442df492d45e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bf4b812c55648ffb0442df492d45e18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bf4b812c55648ffb0442df492d45e18"}]}] Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerTagsTestJSON-838056461 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7bf4b812c55648ffb0442df492d45e18 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerTagsTestJSON-838056461 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerTagsTestJSON-838056461-project Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f6944b0e6c664113932ae3df467dc537 Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerTagsTestJSON-838056461-project Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0ddc0bca-caba-4738-87b4-0201ff51cbee'} Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:20.088259 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. Oct 18 16:15:20.093049 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:20.095380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] Returning 404 to user: Instance 0ddc0bca-caba-4738-87b4-0201ff51cbee could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:20.097730 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-381005bf-dc2c-4186-81c8-be7932639cc1 tempest-ServerTagsTestJSON-838056461 tempest-ServerTagsTestJSON-838056461-project] 10.222.0.78 "GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee" status: 404 len: 111 microversion: 2.26 time: 0.182664 Oct 18 16:15:20.100177 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1758/3497] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:19 2022] GET /compute/v2.1/servers/0ddc0bca-caba-4738-87b4-0201ff51cbee => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:20.320617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:20.323699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:20.409403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.413802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.416102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.418251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.418910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.419487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.781868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc12c05-0954-4f24-bdb6-701a67b55471", "name": "network-vif-plugged", "status": "completed", "tag": "777a5121-1a82-4603-81c6-6f4813169b1e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:20.838499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.845893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.846927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.893906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] Creating event network-vif-plugged:777a5121-1a82-4603-81c6-6f4813169b1e for instance 7fc12c05-0954-4f24-bdb6-701a67b55471 on n-h1-858383-14 Oct 18 16:15:20.903977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1687ea97-0891-4818-a246-5fd27b058747 req-1d37523f-8f3c-4762-9a7e-7788c619cb3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148427 Oct 18 16:15:20.905615 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1759/3498] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:20.936209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:20.945430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:20.960576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.960576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.961067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:20.963032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:20.964080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:20.965459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:21.378017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:21.394512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2386cf81-f00f-493c-8dc6-e551e5305858 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1538 microversion: 2.1 time: 1.088092 Oct 18 16:15:21.405826 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1740/3499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:20 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1538 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:21.425476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:21.426513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:21.435060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:21.435881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:21.436524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:21.437525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:21.438401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:21.439038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:21.475406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:21.500576 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80a51880-4975-4e30-a932-85d85af6db99 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.575202 Oct 18 16:15:21.513033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1760/3500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:20 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:22.434666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:22.438428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:22.466005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:22.481130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:22.485294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:22.505105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:22.513724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:22.524382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:22.815858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:22.838630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-884c7e8d-93c4-4b4a-81f8-635fdf8f92e6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1317 microversion: 2.1 time: 1.430509 Oct 18 16:15:22.839248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1741/3501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:21 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1317 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:22.863713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:22.879252 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4b60967-e177-4f6a-8bc1-34620b0d4403 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1538 microversion: 2.1 time: 0.452060 Oct 18 16:15:22.882068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:22.883041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:22.889922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1761/3502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:22 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1538 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:22.900253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:22.901383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:22.902674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:22.904155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:22.905038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:22.905501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:23.816422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:23.831299 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b9025b1-5088-4520-9698-cd036502bc49 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.976129 Oct 18 16:15:23.835075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1742/3503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:22 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:23.878317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:23.878936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:23.895129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:23.895627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:23.899428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:23.907491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:23.908481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:23.909182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:23.914633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:23.918820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:23.941546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:23.953756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:23.964910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:23.965297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:23.965753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:23.966200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.397690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:24.409630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d88dd8b-88a3-4904-b7f4-ccb303eede3f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1506 microversion: 2.1 time: 0.537246 Oct 18 16:15:24.423136 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1762/3504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:23 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:24.447329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:24.449553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:24.469051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.470011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.470727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.471798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.472428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.473140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.496522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:24.521176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7d363db-3b0f-4889-bace-f82015a42d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.614882 Oct 18 16:15:24.521940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1743/3505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:23 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:24.535006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:24.680614 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d550f7b4-8980-4b2d-b5ba-cb0cc8aa5be2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 204 len: 0 microversion: 2.1 time: 0.239485 Oct 18 16:15:24.683330 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1763/3506] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:24 2022] DELETE /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:24.693404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:24.694068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:24.696313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:24.713981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.714588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.715038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.716113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.716815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.717604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.878151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:24.879927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:24.899613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.901723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.909974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:24.911234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:24.912017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:24.912795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:25.200699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:25.220753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e047233-e388-4c4e-bc54-79b9e00877fa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1512 microversion: 2.1 time: 0.531861 Oct 18 16:15:25.227798 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1744/3507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:24 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:25.311675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:25.326075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ae5eaef-d27c-4de0-92df-accd15c9357d tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.464408 Oct 18 16:15:25.330707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1764/3508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:24 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:25.413425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8eb5a6-1bc5-4df4-a2ae-824323483266", "name": "network-vif-plugged", "status": "completed", "tag": "7ccfa1ff-f5b5-467a-909e-830518a09488"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:25.437211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:25.437695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:25.438134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:25.476377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] Creating event network-vif-plugged:7ccfa1ff-f5b5-467a-909e-830518a09488 for instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 on n-h2-858383-14 Oct 18 16:15:25.488697 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-26a7eb60-0efb-4a76-8c41-d13e82d33322 req-c15700e9-1826-4010-99af-2ffe51211e69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079818 Oct 18 16:15:25.493241 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1745/3509] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:25.565983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:25.566635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:25.579147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:25.588107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:25.588888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:25.589923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:25.590685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:25.591333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.192265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:26.204191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3cf06864-d48d-46e9-821e-60cf1d77c87d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.642614 Oct 18 16:15:26.221381 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1765/3510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:25 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:26.269775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:26.270675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:26.282015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.287893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.288645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.289954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.290648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.292255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.370435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:26.371574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:26.398616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.402214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.403185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.404496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.405376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.413270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:27.291589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:27.330098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85210f02-2a0f-4da3-a2e8-93febc74f351 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 0.968235 Oct 18 16:15:27.331780 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1766/3511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:26 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:27.338814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:27.340240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:27.354849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:27.355837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:27.356551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:27.358426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:27.359180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:27.360194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:27.436530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:27.461771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6497df9f-55d2-41d9-88c2-c44d04b68f06 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1512 microversion: 2.1 time: 1.198169 Oct 18 16:15:27.467048 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1746/3512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:26 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1512 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:27.854930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:27.875698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c5f0d30-999c-46fc-9f4b-8503f8174178 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.542149 Oct 18 16:15:27.881384 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1767/3513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:27 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:28.367086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:28.368448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:28.414358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:28.419029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:28.419500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:28.425057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:28.425559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:28.431097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:28.502436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:28.509917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:28.511239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:28.539175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:28.542654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:28.546696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:28.550691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:28.553459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:28.556342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.153719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:29.167030 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e01f895-3d75-4f14-97e9-57e03aeadded tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1512 microversion: 2.1 time: 0.672339 Oct 18 16:15:29.169893 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1768/3514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:28 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1512 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:29.178548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:29.180723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:29.194182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:29.195171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:29.195929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.197039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:29.198056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:29.198814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.425844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:29.441698 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5db476c-c98d-4608-9f2d-14af4933bf74 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1318 microversion: 2.1 time: 1.077992 Oct 18 16:15:29.445835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1747/3515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:28 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:29.564859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc12c05-0954-4f24-bdb6-701a67b55471", "name": "network-vif-deleted", "tag": "777a5121-1a82-4603-81c6-6f4813169b1e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:29.652290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:29.652856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:29.653347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.718440 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] Creating event network-vif-deleted:777a5121-1a82-4603-81c6-6f4813169b1e for instance 7fc12c05-0954-4f24-bdb6-701a67b55471 on n-h1-858383-14 Oct 18 16:15:29.733318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5de07050-488a-4652-8e60-2457632ea61e req-b77bda6b-b917-4a9c-b142-fd2ded6cb3b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187716 Oct 18 16:15:29.734948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1748/3516] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:15:29.908118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:29.925339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4261d5e8-54f8-4f8f-9751-e7a382f277ef tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.752738 Oct 18 16:15:29.926526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1769/3517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:29 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:30.233488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:30.234844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:30.250738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.250738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.251398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.252345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.253571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.254607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.354864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.355844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.356614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.357676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lazy-loading 'fault' on Instance uuid 7fc12c05-0954-4f24-bdb6-701a67b55471 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:30.362162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:30.437289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:30.451115 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea0366f8-0612-4c4a-8d7f-2fdaf112f901 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 200 len: 1307 microversion: 2.1 time: 0.227342 Oct 18 16:15:30.452573 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1770/3518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:30 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:30.476052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-695047690", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "d401f5a0-eb19-4190-92cb-778245bea36a"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:30.480264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:30.480888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:30.491275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.491677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.492811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.494676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.495521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.496527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.634879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] validate_networks() for [('d401f5a0-eb19-4190-92cb-778245bea36a', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:15:30.971729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:30.986996 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-730cd3a5-bac5-4cba-af70-69df2ce8f25b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1509 microversion: 2.1 time: 0.513281 Oct 18 16:15:30.988184 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1771/3519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:30 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1509 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:31.000199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:31.000840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:31.009781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.013973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.014635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.015408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.016061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.017109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.311226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:31.351179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f511c794-0b49-42a1-b664-bffa4e813cac tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.361335 Oct 18 16:15:31.353262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1772/3520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:30 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:31.487399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:31.488849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:31.502843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.508740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.510552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.514286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.515059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.515883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.544058 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 HTTP/1.1 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7fc12c05-0954-4f24-bdb6-701a67b55471'} Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:31.546428 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:15:31.552241 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:31.554827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:31.556072 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef4a7271-2c5e-41c7-9989-3966d13dac89 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 404 len: 111 microversion: 2.1 time: 0.073924 Oct 18 16:15:31.562007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1773/3521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:31 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:31.583190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:31.584467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:31.599440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.600295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.601511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.603541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.606355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.607573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.952428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:31.976647 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-22bba6c2-f094-4885-970e-ac8f1e143a97 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.404063 Oct 18 16:15:31.978400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1774/3522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:31 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:32.187804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a52481d2-fda6-47b5-80ff-187af6b03016 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a52481d2-fda6-47b5-80ff-187af6b03016 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 163 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": 12345, "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 12345 Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:15:32.194113 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 16:15:32.200465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:32.203847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a52481d2-fda6-47b5-80ff-187af6b03016 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:32.206127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a52481d2-fda6-47b5-80ff-187af6b03016 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025972 Oct 18 16:15:32.207197 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1775/3523] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:32 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:15:32.220119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:32.221070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:32.234303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.235604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.243821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:32.245595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.251145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.251870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:32.610774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:32.623861 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a1a3131-5a7b-49e6-80b7-46058c73a3ea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.412498 Oct 18 16:15:32.625100 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1776/3524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:32 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:32.631597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:32.632734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:32.642585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.643084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.643734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:32.645048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.645672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.646327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.008110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:33.008929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:33.009526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:33.009936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:33.010870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:33.032337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.032811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.033293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.036276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.036737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.037209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.085270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Getting quotas for project b2d7b38c393e4700b102c1045a7dea8c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:33.108621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Getting quotas for user 0a2ebaf04b014f60a9772029677fb02e and project b2d7b38c393e4700b102c1045a7dea8c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:33.110264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:33.130031 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15fd7757-5739-405a-9147-60ca8237c050 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.502693 Oct 18 16:15:33.132710 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1777/3525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:32 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:33.142520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:33.144132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:33.155316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.156484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.157502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.159308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.160372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.160566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:33.161771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.165582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:33.299447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0eb32d98-d9bc-48b3-9c7e-758a9320a718 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.119173 Oct 18 16:15:33.328860 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1749/3526] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:15:33.340622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3102f48e-d1b9-436c-91e8-7e8f922751fc tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:33.341510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3102f48e-d1b9-436c-91e8-7e8f922751fc tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:33.459233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:33.477490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe743488-978f-4859-a214-ee332a9787f0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.342363 Oct 18 16:15:33.479385 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1778/3527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:33 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:33.513640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3102f48e-d1b9-436c-91e8-7e8f922751fc tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:33.536274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3102f48e-d1b9-436c-91e8-7e8f922751fc tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1224 microversion: 2.1 time: 0.206835 Oct 18 16:15:33.539301 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1750/3528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:33 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:34.036153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "19e7017c-89b5-4eeb-8e54-b4eba70a5496"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:34.051549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:34.097722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.101220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.105153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:34.111707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.114781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.117396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:34.162795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:34.166175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:34.216675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.217571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.222163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:34.225287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.229903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.232442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:34.354902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] HTTP exception thrown: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Request method failure captured: Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266/os-volume_attachments/dc037f80-57f3-49fd-b14b-3cfc49c01445 HTTP/1.1 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 74 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB1ZbvFtAm6wohZM2JD4tL8BOfBrqNcbsgYAVV7McZTE5nZGtm9qdzUBUdnV_Bv5I1wEQDRLfiHT8x-Q9FGwi-WPZ8hPoCb7KbOIzJer8oAGxJjg0z-NSi7aKpH956TG8YOmNcrgWqGtpglPP6hj_U8LxPmk7WWwWFKjG0aYV0qtO4 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a96557cf1ece4bea92d6aa56c1ae75f8 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a96557cf1ece4bea92d6aa56c1ae75f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a96557cf1ece4bea92d6aa56c1ae75f8"}]}] Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a96557cf1ece4bea92d6aa56c1ae75f8 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1916651045 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesAdminNegativeTest-1916651045-project-admin Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 8a6610a5b8564e59af27b1bab118db28 Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesAdminNegativeTest-1916651045-project-admin Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: {"volumeAttachment": {"volumeId": "19e7017c-89b5-4eeb-8e54-b4eba70a5496"}} Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: exception: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '8d8eb5a6-1bc5-4df4-a2ae-824323483266', 'id': 'dc037f80-57f3-49fd-b14b-3cfc49c01445', 'body': {'volumeAttachment': {'volumeId': '19e7017c-89b5-4eeb-8e54-b4eba70a5496'}}} Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. (HTTP 404) (Request-ID: req-9e51d86b-0098-47d2-b384-194ffbf23f81) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:15:34.359673 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] Returning 404 to user: Volume dc037f80-57f3-49fd-b14b-3cfc49c01445 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f1739c6-4dc2-405e-a1fe-16e8320c7e52 tempest-VolumesAdminNegativeTest-1916651045 tempest-VolumesAdminNegativeTest-1916651045-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266/os-volume_attachments/dc037f80-57f3-49fd-b14b-3cfc49c01445" status: 404 len: 109 microversion: 2.1 time: 0.334283 Oct 18 16:15:34.373784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1779/3529] 10.222.0.78 () {60 vars in 1433 bytes} [Tue Oct 18 16:15:34 2022] PUT /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266/os-volume_attachments/dc037f80-57f3-49fd-b14b-3cfc49c01445 => generated 109 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:34.575809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:34.576713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:34.595122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.597273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.598005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:34.600564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:34.603518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:34.604273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:35.043744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:35.059909 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1cb38981-32cf-495e-b200-f2437da7f296 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.904770 Oct 18 16:15:35.063957 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1751/3530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:34 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:35.199421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:35.244834 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9726710c-83d6-4a88-87b0-65cf729e61ab tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1228 microversion: 2.1 time: 0.643719 Oct 18 16:15:35.249810 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1780/3531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:34 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1228 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:35.534136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Action: 'create', calling method: .version_select at 0x7f5fd1863a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:35.598922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Getting quotas for project aadf3f3058d14aa29e908f51d70bca8b. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:35.622501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Getting quotas for user 0e289f4845b44324a447ec0fb303b29b and project aadf3f3058d14aa29e908f51d70bca8b. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:35.742391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Getting quotas for project aadf3f3058d14aa29e908f51d70bca8b. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:35.761930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Getting quotas for user 0e289f4845b44324a447ec0fb303b29b and project aadf3f3058d14aa29e908f51d70bca8b. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:35.800502 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e151b4f8-ab21-4915-8074-7d4febe01954 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.378394 Oct 18 16:15:35.805266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1752/3532] 10.222.0.78 () {62 vars in 1214 bytes} [Tue Oct 18 16:15:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:15:35.827621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b48d3a8c-cc82-4262-8c6a-e2fa620556cf tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:35.859320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b48d3a8c-cc82-4262-8c6a-e2fa620556cf tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.040127 Oct 18 16:15:35.872585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae221a44-fdff-450f-b668-b255c88ee335 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:35.878233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1781/3533] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 18 16:15:35 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:15:35.887746 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae221a44-fdff-450f-b668-b255c88ee335 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec" status: 200 len: 235 microversion: 2.64 time: 0.019778 Oct 18 16:15:35.909421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01fb28d1-d3e7-477f-8b50-7a15b3c9ebaf tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:35.917667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1753/3534] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 18 16:15:35 2022] GET /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec => generated 235 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:15:35.975848 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01fb28d1-d3e7-477f-8b50-7a15b3c9ebaf tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec" status: 204 len: 0 microversion: 2.64 time: 0.076424 Oct 18 16:15:35.977574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1782/3535] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Oct 18 16:15:35 2022] DELETE /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:15:35.991631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ca0513c-c13f-4793-b434-ee79ddc779e7 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:36.019764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3ca0513c-c13f-4793-b434-ee79ddc779e7 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] HTTP exception thrown: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ca0513c-c13f-4793-b434-ee79ddc779e7 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Request method failure captured: Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec HTTP/1.1 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtEnBsw1O7Pb9urRi3-WkL_3lWe_HW-A9o7kdyRuflZrtI2T4jfLn0sFWPm3Z63FhJsiSHJJsc-G9LxSe-rqg1eGKEy998ql1VxC4EZTPHdrGrA1gKdqOuM1UZLKhLDoCkZkDJqz9YVcJQcbTes625jzoYeJ5H-y5Z7KbEM1KsQovxY Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.64 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: aadf3f3058d14aa29e908f51d70bca8b Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerGroup264TestJSON-1481895166 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aadf3f3058d14aa29e908f51d70bca8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadf3f3058d14aa29e908f51d70bca8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aadf3f3058d14aa29e908f51d70bca8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadf3f3058d14aa29e908f51d70bca8b"}]}] Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerGroup264TestJSON-1481895166 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: aadf3f3058d14aa29e908f51d70bca8b Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1481895166 Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerGroup264TestJSON-1481895166-project Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0e289f4845b44324a447ec0fb303b29b Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerGroup264TestJSON-1481895166-project Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '48ff8771-25fb-48b2-8f19-74d772a900ec'} Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:36.028564 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ca0513c-c13f-4793-b434-ee79ddc779e7 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] Returning 404 to user: Instance group 48ff8771-25fb-48b2-8f19-74d772a900ec could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ca0513c-c13f-4793-b434-ee79ddc779e7 tempest-ServerGroup264TestJSON-1481895166 tempest-ServerGroup264TestJSON-1481895166-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec" status: 404 len: 117 microversion: 2.64 time: 0.046004 Oct 18 16:15:36.039474 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1754/3536] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Oct 18 16:15:35 2022] DELETE /compute/v2.1/os-server-groups/48ff8771-25fb-48b2-8f19-74d772a900ec => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:36.089158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:36.090828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:36.124579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.127813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.130727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.133851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.136251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.137874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.289877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:36.291009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:36.330332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.330836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.331275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.344134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.344644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.346585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.698413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:36.714595 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6a316ee-055e-4ec3-bc5d-4078c8179e51 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1282 microversion: 2.1 time: 0.430190 Oct 18 16:15:36.722328 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1755/3537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:36 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:37.279490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:37.294889 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c69ff0c-ce46-4ff8-aa0d-3b145dcd0fc7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 1.213050 Oct 18 16:15:37.295764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1783/3538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:36 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:37.349246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42b0d8a8-978c-4326-b387-09ba3136771b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1669867853", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "758d5074-54f1-42c6-bf9b-8b59f10cb60c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:37.511339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-42b0d8a8-978c-4326-b387-09ba3136771b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42b0d8a8-978c-4326-b387-09ba3136771b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 358 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1669867853", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "758d5074-54f1-42c6-bf9b-8b59f10cb60c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: exception: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1669867853', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '758d5074-54f1-42c6-bf9b-8b59f10cb60c'}], 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:37.522875 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. Oct 18 16:15:37.538182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:37.545139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42b0d8a8-978c-4326-b387-09ba3136771b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Block Device 758d5074-54f1-42c6-bf9b-8b59f10cb60c is not bootable. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:37.548182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42b0d8a8-978c-4326-b387-09ba3136771b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.209397 Oct 18 16:15:37.550011 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1756/3539] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:37.565880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:37.574346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:37.585448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.588329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.588934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:37.589934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.593684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.594249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:37.753127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:37.757771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:37.786514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.791467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.792789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:37.797345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.798853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.804358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.414624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:38.454531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36f21278-a93d-477f-bbe2-51e1e6e307d1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.887661 Oct 18 16:15:38.457199 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1784/3540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:37 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:38.478824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:38.479605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:38.510085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.515973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.516890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.528436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.529071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.529690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.667881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:38.682639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf59af8b-46e4-4e4d-a8c3-68562aa3e38c tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.935621 Oct 18 16:15:38.699161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1757/3541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:37 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:38.719367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:38.720481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:38.729526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.734234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.735378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.744556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.746135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.747431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:39.206255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:39.219680 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-303cb993-03ad-4ac3-ab7b-50606a24e483 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.758479 Oct 18 16:15:39.245186 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1785/3542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:38 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:39.366067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:39.408818 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-efbdc1a8-7edf-4ea0-9d46-b2ad2573097b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.702461 Oct 18 16:15:39.414842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1758/3543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:38 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:39.725771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:39.726695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:39.751891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:39.762872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:39.769387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:39.776725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:39.777631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:39.778413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:40.687125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-44814568", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:40.876192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:40.876945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:40.877825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:40.878593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:40.879345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:40.933481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:40.934315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:40.934878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:40.935871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:40.936452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:40.937012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:40.964925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Getting quotas for project 20d7bce2e1f94ba98eda27d65b4fd20b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:41.010526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Getting quotas for user 4563ea21e17d4d9da3a2e10d64f7351c and project 20d7bce2e1f94ba98eda27d65b4fd20b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:41.038232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.062212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be336aab-387d-4e09-bb76-c55fd7ddd38e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 1.340375 Oct 18 16:15:41.063150 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1786/3544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:39 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:41.093442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:41.094469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:41.104737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:41.120192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:41.147344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.148073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.148684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.151636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.152514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.153640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.311111 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b054a106-6a15-4ef3-a072-b1ed204fd242 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.178734 Oct 18 16:15:41.313929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1759/3545] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:15:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 16:15:41.332358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d008f1-403d-4dea-8f80-98aab7015174", "tag": "3b1cfd54-52e0-47de-a63f-94fb6d0e95be"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:41.369353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.369854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.370342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.403098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] Creating event network-changed:3b1cfd54-52e0-47de-a63f-94fb6d0e95be for instance b4d008f1-403d-4dea-8f80-98aab7015174 on n-h1-858383-14 Oct 18 16:15:41.410725 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b02c6cb9-2b28-4d4c-a862-7fb195d395d2 req-31d4ae09-7436-4e24-a081-c962bc2ad53a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095447 Oct 18 16:15:41.411455 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1760/3546] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:41.426303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:41.427049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:41.626653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.639882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.661105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.662898 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c727c728-ad26-4bcd-b8e8-b0fd9ae0a60b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 200 len: 1276 microversion: 2.47 time: 0.248790 Oct 18 16:15:41.663936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1761/3547] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:41 2022] GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:41.834039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-336363048", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:41.999971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:42.000693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:42.001389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:42.001988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:42.002564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:42.023082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.024032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.024713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.025693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.026334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.027609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.125447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Getting quotas for project 20d7bce2e1f94ba98eda27d65b4fd20b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:42.141147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:42.145880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Getting quotas for user 4563ea21e17d4d9da3a2e10d64f7351c and project 20d7bce2e1f94ba98eda27d65b4fd20b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:42.183992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:42.187347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:42.352251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b211184f-fff8-472d-9da4-b45f6aa00a17 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.521861 Oct 18 16:15:42.354838 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1762/3548] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:15:42.377177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:42.383068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:42.391177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92a63768-b24a-4137-ac7c-540c407d8517 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 1.323866 Oct 18 16:15:42.393422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:42.428031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.430310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.433164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.434940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.440696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.440900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1787/3549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:41 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:42.441920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.452855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:42.453519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:42.498737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.499423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.508473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.515806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.522508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.530900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.561132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:42.966608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c782025-2a2b-46ea-b794-8e00c93ac015 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 204 len: 0 microversion: 2.1 time: 0.582611 Oct 18 16:15:42.966608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1763/3550] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:42 2022] DELETE /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:42.998800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f600aaa2-b3b1-404e-b6cb-6529e6753d26 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:43.010866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f600aaa2-b3b1-404e-b6cb-6529e6753d26 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.136232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f600aaa2-b3b1-404e-b6cb-6529e6753d26 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "PUT /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 991 microversion: 2.47 time: 0.167555 Oct 18 16:15:43.138008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1764/3551] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Oct 18 16:15:42 2022] PUT /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 991 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:15:43.157132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:43.158273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.174451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.175491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.177126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.179020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.180144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.182942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.484291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.512916 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bb7dfd9-6e59-4dce-8afa-ecbde76f00b9 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1515 microversion: 2.1 time: 0.368110 Oct 18 16:15:43.517232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1765/3552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:43 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:43.537559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:43.539477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.702863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.728242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.738187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.742070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.747953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c59aef6-80b2-458d-9a3c-a0c93f312a09 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1277 microversion: 2.47 time: 0.222136 Oct 18 16:15:43.749080 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1766/3553] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:43 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:43.756027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:43.757154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.769882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.771711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.774152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.775296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.786776 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd471b56-4f68-458b-93ba-4c64403a94b5 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 1.340878 Oct 18 16:15:43.786936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.787283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.798105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1788/3554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:42 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.124826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:44.133163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6f9f960-46ce-403d-80e2-fde47531e947 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.381789 Oct 18 16:15:44.133749 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1767/3555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:43 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.377898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e3ded6e-039a-4cf5-aa0e-7597d73dc1b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1858650040", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "716a8cb0-5725-40db-af07-5a18594590ce", "destination_type": "local"}, {"source_type": "volume", "uuid": "d3c3fb2c-f2cd-4ef3-865e-0c7b5ccc0af1", "destination_type": "invalid"}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e3ded6e-039a-4cf5-aa0e-7597d73dc1b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 495 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1858650040", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "716a8cb0-5725-40db-af07-5a18594590ce", "destination_type": "local"}, {"source_type": "volume", "uuid": "d3c3fb2c-f2cd-4ef3-865e-0c7b5ccc0af1", "destination_type": "invalid"}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1858650040', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '716a8cb0-5725-40db-af07-5a18594590ce', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd3c3fb2c-f2cd-4ef3-865e-0c7b5ccc0af1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:44.382494 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e3ded6e-039a-4cf5-aa0e-7597d73dc1b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e3ded6e-039a-4cf5-aa0e-7597d73dc1b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010063 Oct 18 16:15:44.388443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1789/3556] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:44 2022] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:44.398862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.400136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.418042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.418903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.419567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.420538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.421227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.421814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.566420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.568078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.584154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.585083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.585764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.586711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.587426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.588254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.650463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:44.680248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a410fc3-0e1b-4b26-9693-58f93cee67b8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.285461 Oct 18 16:15:44.685783 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1768/3557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:44.720915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.721626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.744380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.745933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.746891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.748884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.749985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.750973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.064334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.074601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a69efec2-8707-4a0b-b658-45db6623949e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.359828 Oct 18 16:15:45.077203 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1769/3558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:45.083543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:45.085870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:45.116757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.119020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.119784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.121140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.122008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.122783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.240610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.256301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.258556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.261514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11284af8-14ea-4fd4-aa20-a5f49cf7dde0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1281 microversion: 2.47 time: 0.181986 Oct 18 16:15:45.263466 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1770/3559] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:45 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:45.276799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.311016 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65ac43d1-e3de-4501-8763-8d838efdf717 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1515 microversion: 2.1 time: 0.770381 Oct 18 16:15:45.313406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:45.314434 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1790/3560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1515 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:45.316670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:45.325481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1e969f4-2cef-48dc-8d16-fda350eb9ab8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18826614", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1e969f4-2cef-48dc-8d16-fda350eb9ab8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 490 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18826614", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-18826614', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.331546 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 16:15:45.335833 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:45.339313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1e969f4-2cef-48dc-8d16-fda350eb9ab8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:45.340969 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1e969f4-2cef-48dc-8d16-fda350eb9ab8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.024734 Oct 18 16:15:45.342280 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1791/3561] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:45.348683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.350390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.351073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.354239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.354838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:45.355091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.355582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.357046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:45.369723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.370797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.371616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.373323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.374191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.374880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.773266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.786036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa74c56a-a35e-4207-bc91-1827a5911e9b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.521033 Oct 18 16:15:45.789946 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1771/3562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:45 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:45.824220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:45.826414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:45.844223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.848159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.848828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.850043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.850820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.851573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.240110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.263674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1870fef7-ce88-487a-b999-a7bc64c4ef9b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.470506 Oct 18 16:15:46.282947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.283726 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1772/3563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:45 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:46.295487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-caffebfc-cf13-4083-98f3-9169dae9e73c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1543 microversion: 2.1 time: 0.949591 Oct 18 16:15:46.301295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:46.302286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:46.311523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.312373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.312842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.313659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.314441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.314591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1792/3564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:45 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1543 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:46.315424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.322928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:46.323561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:46.370985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.375588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.378893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.379943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.383876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.385466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.417418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:46.640787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.661127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.672024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.681030 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73e4f134-bbc7-48f9-9cda-b677cfeaf617 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1273 microversion: 2.47 time: 0.364858 Oct 18 16:15:46.686212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1793/3565] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:46 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:46.698534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:46.699992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:46.715422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.716949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.718034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.721260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.722399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.723540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.320954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:47.341942 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec804304-81bc-45d8-9f01-ae784bd361b1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1515 microversion: 2.1 time: 0.653919 Oct 18 16:15:47.342743 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1794/3566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:46 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:47.369654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:47.373264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:47.386671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-633d1654-2d95-4b87-90f9-659ece13bd32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 1.094221 Oct 18 16:15:47.386990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:47.387285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1773/3567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:46 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:47.410934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:47.412862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:47.413540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:47.431540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.432052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.435862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.439813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.441641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.445402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.447142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.447932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.448350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.449312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.450344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.451481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.016818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.034608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-362cfe26-701b-40a1-a785-713234fc4c49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1542 microversion: 2.1 time: 0.631758 Oct 18 16:15:48.049760 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1774/3568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:47 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1542 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:48.068443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8eb5a6-1bc5-4df4-a2ae-824323483266", "name": "network-vif-deleted", "tag": "7ccfa1ff-f5b5-467a-909e-830518a09488"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:48.083721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.084226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.084675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.107075 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] Creating event network-vif-deleted:7ccfa1ff-f5b5-467a-909e-830518a09488 for instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 on n-h2-858383-14 Oct 18 16:15:48.115121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-21fbcd4b-26e0-422a-9993-e932eef53089 req-ffc3ec97-8c56-475c-80c9-954f5018b8a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063442 Oct 18 16:15:48.122901 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1775/3569] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:48.130714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09e705d8-f1b8-4f42-bd02-f4600145dda6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09e705d8-f1b8-4f42-bd02-f4600145dda6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 416 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.135890 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09e705d8-f1b8-4f42-bd02-f4600145dda6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09e705d8-f1b8-4f42-bd02-f4600145dda6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014626 Oct 18 16:15:48.140900 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1776/3570] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:48 2022] POST /compute/v2.1/servers => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:48.158144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:48.159502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:48.169388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.170560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.171019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.171749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.172217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.172773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.256446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.267985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.269792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.271144 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5914b63e-c287-4317-90f4-7f47cdbcf435 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1337 microversion: 2.47 time: 0.121731 Oct 18 16:15:48.272709 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1777/3571] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:48 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1337 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:48.278967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:48.279498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:48.286527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.287035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.287567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.288644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.289134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.290108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.343356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.357306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-662e8037-9321-4da1-a8c9-426bb213cfed tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.981168 Oct 18 16:15:48.359605 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1795/3572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:47 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:48.374085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:48.375885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:48.389601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.391157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.392319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.394031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.394934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.395732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.464096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.465574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.466364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.467096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lazy-loading 'fault' on Instance uuid 8d8eb5a6-1bc5-4df4-a2ae-824323483266 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:48.560730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.582035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-539003fb-95f4-44c2-a03f-14971407b97f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.307546 Oct 18 16:15:48.584349 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1778/3573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:48 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:48.614024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:48.614973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:48.626648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.627846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.628556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.629557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:48.630305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:48.631068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:48.663669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.703861 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d563c87-e672-4ee6-9458-6af4dd5ae917 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 200 len: 1308 microversion: 2.1 time: 0.331543 Oct 18 16:15:48.721099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1796/3574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:48 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:48.894356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.907283 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-029ac88d-f7c1-420c-b560-462519368d70 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.297208 Oct 18 16:15:48.908143 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1779/3575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:48 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:49.020326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55f3c10c-f001-4ca2-a66d-f56b38d3fc8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-64082605", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": -1, "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:49.068373 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-55f3c10c-f001-4ca2-a66d-f56b38d3fc8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Flavor -1 could not be found. Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55f3c10c-f001-4ca2-a66d-f56b38d3fc8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 204 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-64082605", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": -1, "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor -1 could not be found. Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-64082605', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': -1, 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:49.072455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 18 16:15:49.077373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:49.078530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.078618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55f3c10c-f001-4ca2-a66d-f56b38d3fc8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:49.078697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.078785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55f3c10c-f001-4ca2-a66d-f56b38d3fc8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068332 Oct 18 16:15:49.078785 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1797/3576] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:49 2022] POST /compute/v2.1/servers => generated 73 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:49.092113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.092395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.093090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.093623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.094272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.095634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.098320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.099164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.104132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.104936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.106153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.107415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.109358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.110154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.325806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.340489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-565950bb-a917-4410-9b33-9fcb181a654c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1542 microversion: 2.1 time: 0.276553 Oct 18 16:15:49.341461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1780/3577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1542 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:49.367179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.370054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.382290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.383004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.383717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.385547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.386526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.387545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.513381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.531923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.535295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.537713 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ce4929b-69bf-42b7-8ce4-109da90c8613 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1337 microversion: 2.47 time: 0.178795 Oct 18 16:15:49.538838 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1781/3578] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1337 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:49.548763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.549767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.559564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.560475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.561344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.564013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.565374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.566772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.597501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.611971 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc8585a9-a5c0-49a7-8045-7a0063cf0408 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.530150 Oct 18 16:15:49.614128 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1798/3579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:49.655164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.656789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.685498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.686024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.686826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.687693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.691424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.692007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.974243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.993226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7cc25a8d-5477-49ed-9e82-9834c73a201b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.452734 Oct 18 16:15:50.000144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1782/3580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:50.017984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.019061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 8d8eb5a6-1bc5-4df4-a2ae-824323483266] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.031447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.031940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.032376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.046893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.048564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.049595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.085044 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] HTTP exception thrown: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Request method failure captured: Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 HTTP/1.1 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtBfPBQO2KTO1jJChTnuOwefd-_UkZM319xhBv0Yi4eCuXKGj5Gw8zaUhSXgOYTGqpJeAOKdu79GXdqROnQpbieRZLMtqEZ29dV29ugBVDqGzSHuccRKOpgF_x81xQgc8cXRwW62TObRhuB4Fig36PqzayARhjug0N8hxWWvY8Xnrf4 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 8ad06f3c29294b01ba67eb5d5a1ea59c Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}] Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 8ad06f3c29294b01ba67eb5d5a1ea59c Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesAdminNegativeTest-846187192-project Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 5bd4aa75ffc54e5f840a70d8a901da15 Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesAdminNegativeTest-846187192-project Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '8d8eb5a6-1bc5-4df4-a2ae-824323483266'} Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:50.088641 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. Oct 18 16:15:50.095794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.100599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Returning 404 to user: Instance 8d8eb5a6-1bc5-4df4-a2ae-824323483266 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:50.103180 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f9e5a3f-67c2-49b7-b70a-87e08f67f224 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266" status: 404 len: 111 microversion: 2.1 time: 0.100676 Oct 18 16:15:50.105791 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1783/3581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/8d8eb5a6-1bc5-4df4-a2ae-824323483266 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:50.136553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:50.147225 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63220af8-a30d-4146-803a-010664cacaaa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.507052 Oct 18 16:15:50.149928 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1799/3582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:50.174383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-unplugged", "status": "completed", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}, {"name": "network-changed", "server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:50.191289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.192034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.192499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.210866 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Creating event network-vif-unplugged:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h1-858383-14 Oct 18 16:15:50.211588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Creating event network-changed:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h1-858383-14 Oct 18 16:15:50.219826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:15:50.279098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-298c8229-8329-4902-a8b6-1d42bb4b0e5b req-d0584443-c077-4101-82e4-83e6acb0ee34 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.110130 Oct 18 16:15:50.280158 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1784/3583] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:50.337921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1b4e811-f1b4-461c-a190-ce8526ca9a2d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113489263", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1b4e811-f1b4-461c-a190-ce8526ca9a2d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 173 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113489263", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2113489263', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi -1 Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:15:50.342207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1b4e811-f1b4-461c-a190-ce8526ca9a2d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:50.348089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1b4e811-f1b4-461c-a190-ce8526ca9a2d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009860 Oct 18 16:15:50.353089 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1800/3584] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:50 2022] POST /compute/v2.1/servers => generated 145 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:50.367789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.373774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.388967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.389603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.390401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.391220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.391788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.392302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.392633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.393450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.395787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:50.406017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.407214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.408167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.409333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.410124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.411000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.750011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:50.768045 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13b3a2ab-a8c5-4f77-ab52-f5e822763c56 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.416938 Oct 18 16:15:50.780037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1785/3585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:50.795519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.796604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.809320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:50.814803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.815314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.815763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.816486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.816953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.820116 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-908ccfc0-669e-4745-bc56-47b7360a9e40 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1542 microversion: 2.1 time: 0.438537 Oct 18 16:15:50.833333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.833980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1801/3586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:50.844754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.845719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.855352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.856262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.856877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.858015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.859005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.859648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.027002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.048810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.053057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.057179 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d4c6d07-af89-4bf4-a6c0-8c94d23cd173 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.274075 Oct 18 16:15:51.059512 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1786/3587] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:51.072457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:51.074539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:51.095336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.096892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.098424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.101392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.103553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.104970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.313746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.385475 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a0e32b6-88c8-4f5c-b712-0c843099b0e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.545835 Oct 18 16:15:51.389084 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1802/3588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:51.401375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d008f1-403d-4dea-8f80-98aab7015174", "name": "network-vif-plugged", "status": "completed", "tag": "3b1cfd54-52e0-47de-a63f-94fb6d0e95be"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:51.434185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.436148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.436843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.459538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] Creating event network-vif-plugged:3b1cfd54-52e0-47de-a63f-94fb6d0e95be for instance b4d008f1-403d-4dea-8f80-98aab7015174 on n-h1-858383-14 Oct 18 16:15:51.479425 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ad935bd6-912c-4074-8e59-afb8e2208062 req-75f1cf4e-4c82-4372-a53c-663cfdcfceb3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088574 Oct 18 16:15:51.485860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1803/3589] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:51.597540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.628182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f01251b1-0c79-4791-bbd4-fa922f2bd43f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.565872 Oct 18 16:15:51.638737 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1787/3590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:51 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:51.684774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-835d6a2d-e3fb-4a2d-bf1b-70c70bde2ada tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1928595077", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:51.692400 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-835d6a2d-e3fb-4a2d-bf1b-70c70bde2ada tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-835d6a2d-e3fb-4a2d-bf1b-70c70bde2ada tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 216 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1928595077", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1928595077', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:51.694590 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 16:15:51.700692 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:51.705174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-835d6a2d-e3fb-4a2d-bf1b-70c70bde2ada tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:51.707506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-835d6a2d-e3fb-4a2d-bf1b-70c70bde2ada tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027702 Oct 18 16:15:51.727050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:51.729338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:51.730090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1804/3591] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:51 2022] POST /compute/v2.1/servers => generated 123 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:51.741695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.742861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.754233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.761631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.762579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.763261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.857916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:51.903086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:51.949123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.952004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.955696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.966180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.967450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.968494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.070907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.086155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:52.092141 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-764b0c93-71e2-4e76-b9ad-3805dc6bba8f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.374895 Oct 18 16:15:52.100976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1788/3592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:51 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:52.114608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:52.115252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:52.128861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.129383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.129996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.130977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.131629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.132070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.277260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.279865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.288463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.291129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.292455 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13a4ec65-7f1d-4f3b-a4fa-117451b24748 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.182997 Oct 18 16:15:52.294271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d6e4c5b-398b-48c5-a6a3-7f09502df537 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1542 microversion: 2.1 time: 0.448362 Oct 18 16:15:52.294476 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1789/3593] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:52 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:15:52.294898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1805/3594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:51 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1542 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:52.332020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:52.333418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:52.343824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.344354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.344805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.345771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.346529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.347266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.576377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.590319 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-052e8791-137d-42ee-be18-c39dd725e849 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.269653 Oct 18 16:15:52.591648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1790/3595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:52 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:52.665867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:52.666488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:52.672673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.673466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.674072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.674975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.675596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.676200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.736423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1915026800", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-key-1515369775", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:52.818067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] validate_networks() for [('337029b8-3a44-4243-882f-158968fa7ad7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:15:52.911473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.920117 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e6880f1-7265-4c0b-a839-e0deb93c577f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.258615 Oct 18 16:15:52.921013 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1806/3596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:52 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:53.259573 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Invalid key_name provided. Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 247 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1915026800", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-key-1515369775", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid key_name provided. Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1915026800', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'key_name': 'tempest-key-1515369775', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1515369775 not found for user 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:53.265204 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid key_name provided. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:53.269312 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fbc01ae-394c-40de-ada7-ee667276dd62 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.536041 Oct 18 16:15:53.275727 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1791/3597] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:52 2022] POST /compute/v2.1/servers => generated 70 bytes in 545 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:53.282048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.282678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.289476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.290568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.291270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.291987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.292723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.293488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.322199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.323032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.339263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.340234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.341147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.342594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.343729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.344607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.475573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.492582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.495992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.497350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d6bc2be-cb24-4121-a284-4f5efcc20cfd tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.181035 Oct 18 16:15:53.498382 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1792/3598] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:15:53.503165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.503918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.518065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.519249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.521270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.523335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.524424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.525434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.610383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.624366 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db0f0f1c-de39-4788-84c3-ae6c0525505f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.347307 Oct 18 16:15:53.626236 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1807/3599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:53.660696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.662238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.687048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.687785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.688364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.690223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.691416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.692132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.721895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=32 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:53.795665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.819856 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d479ef07-8322-4a31-91a6-b33af1dd344a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1542 microversion: 2.1 time: 0.320590 Oct 18 16:15:53.821208 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1793/3600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:53.971524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.973364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.987695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.989076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.990166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.991764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.993106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.994068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.001310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:54.006613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:54.018206 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-682b279a-12a0-4e4d-bccf-b48c6721b80a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.364051 Oct 18 16:15:54.042751 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1808/3601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:54.181901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705970682", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:54.344797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.security_group_api [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Neutron security group does_not_exist not found {{(pid=120571) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 18 16:15:54.347766 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 258 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705970682", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1705970682', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 18 16:15:54.363785 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 18 16:15:54.368727 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:54.372637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:54.372637 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f4c6619-e27d-4067-b7c8-239378d97fea tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.196324 Oct 18 16:15:54.372637 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1809/3602] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:54 2022] POST /compute/v2.1/servers => generated 106 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:15:54.395300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:54.402034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:54.416629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.418130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.419383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.420641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.423054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.423880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.541794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:54.558316 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1265b4b4-cdfb-45fa-a67f-6e99f01c2aa0 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.598008 Oct 18 16:15:54.574001 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1794/3603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:54.603371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:54.604508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:54.624388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.625416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.626756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.626908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.627289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.627730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.783945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:54.816474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecbe81e7-62db-4919-800a-3b4ccf1383eb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.434910 Oct 18 16:15:54.859474 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1810/3604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:54 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:54.888378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:54.895159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:54.974757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.976123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.977843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:54.979653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:54.980753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:54.981642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.020513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.033050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.035383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.036839 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f378b0f6-e49e-450a-be36-192ab1757ab3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.461301 Oct 18 16:15:55.059232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1795/3605] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:54 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:55.071246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:55.072280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.081290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.082277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.082949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.084611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.085370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.086185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.263602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.289502 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34ce78ed-b0a9-41f1-a100-e59d85c47549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.426869 Oct 18 16:15:55.291118 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1811/3606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:54 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:55.416297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.427004 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4afa2190-ad96-4a03-9579-e8c36d41a678 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.360584 Oct 18 16:15:55.445168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1796/3607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:55.452591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:55.453310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7bce9e1b-adfe-4358-8e77-923da297e61b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.462827 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/7bce9e1b-adfe-4358-8e77-923da297e61b HTTP/1.1 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7bce9e1b-adfe-4358-8e77-923da297e61b'} Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:55.466943 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. Oct 18 16:15:55.472203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:55.473733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7bce9e1b-adfe-4358-8e77-923da297e61b could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:55.476218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-531d040d-32fe-4f04-9846-5337d703d982 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7bce9e1b-adfe-4358-8e77-923da297e61b" status: 404 len: 111 microversion: 2.1 time: 0.027931 Oct 18 16:15:55.495303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:55.496550 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1812/3608] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:55 2022] DELETE /compute/v2.1/servers/7bce9e1b-adfe-4358-8e77-923da297e61b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:55.497867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.510885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.511761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.512917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.513889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.514773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.515633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.606055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:55.607265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.621274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.622269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.623043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.624416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.625253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.625990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.856804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.884791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-678a3b5b-168f-4415-83bc-9f239af04a32 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.399071 Oct 18 16:15:55.898212 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1797/3609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:55.939781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:55.941128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.952162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.955610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.956402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.957800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.962389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.963159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.079446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.111798 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eccf3d1b-4033-40c6-a650-93c76f5690be tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1324 microversion: 2.1 time: 0.513758 Oct 18 16:15:56.117183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1813/3610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:55 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1324 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:56.122051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.123001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.147580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.148175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.148697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.151254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.151799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.152310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.206739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:56.233099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:56.361620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c3a3bd4-53f3-4fb4-b068-817800f3f9e7 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 204 len: 0 microversion: 2.1 time: 0.246974 Oct 18 16:15:56.362310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1814/3611] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:56 2022] DELETE /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:56.371903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.375270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.379053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.379552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.380115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.381057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.381358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.381931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.418007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.432356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ebb57f4-c0fb-4441-b654-191829983e04 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.503772 Oct 18 16:15:56.433947 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1798/3612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:56.439673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.440379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.449712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.450148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.450558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.451930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.453152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.453900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.526919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.536261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.537799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.538991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05d3797a-b7a5-4d32-86c3-7654c3792240 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.171653 Oct 18 16:15:56.540134 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1815/3613] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:56 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:56.560763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.563792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.573207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.573887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.574321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.575032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.575491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.575926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.790743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.800513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5507b4ba-1e2b-4c08-8039-ac08673e11e2 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.259298 Oct 18 16:15:56.801142 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1816/3614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:56 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:56.807524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.808000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:15:56.808504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9223372036854775808 could not be found. Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9223372036854775808'} Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:56.810226 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-277a1d37-7624-4e9e-bfbe-28e8d5df3420 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009503 Oct 18 16:15:56.815265 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1817/3615] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Oct 18 16:15:56 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:15:56.832090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.832716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.840924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.841443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.841884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.842923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.843384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.843813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.849437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.860052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66224bb2-4c1f-46a9-a8fa-510f05fcb335 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.424847 Oct 18 16:15:56.865070 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1799/3616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:56 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:57.018332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.028837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-291281bc-a98f-44a2-a9e0-96f26306a155 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.200668 Oct 18 16:15:57.029491 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1818/3617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:56 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:57.057107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.058320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.070614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.072319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.072671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.076000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.076770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.078953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.156326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.157433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.173797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.174518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.174789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.176578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.177341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.178103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.363605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.376524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5aa28e6-ef93-4e6f-8072-4dee919b508b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1521 microversion: 2.1 time: 0.236834 Oct 18 16:15:57.381109 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1819/3618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:57.409720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.410262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.419759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.420701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.421827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.422821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.423393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.424072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.478752 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] HTTP exception thrown: Action 999 not found Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Request method failure captured: Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174/os-instance-actions/999 HTTP/1.1 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtEhQDN3V9K-JlmvBEoK2KijV2yJE-_c9yTUeUpTSF3Hh64aH6sVYk5SpwfW1eB4HQWph0uvfbQ6zfO7YrUIloX29fAlFE-vd5EA3tolo4VQMFj1W2LFlBE5cSiETM02AM1p6tXpsOz1trt7TPC7fe9BBl5QuTeupmWD_mkie47jYsE Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}] Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0a2ebaf04b014f60a9772029677fb02e Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: exception: Action 999 not found Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': 'b4d008f1-403d-4dea-8f80-98aab7015174', 'id': '999'} Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 18 16:15:57.487873 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.497920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Returning 404 to user: Action 999 not found {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:57.497920 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8d10871-cdef-459b-a1bc-c3cf3a640c00 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.086619 Oct 18 16:15:57.497920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1820/3619] 10.222.0.78 () {58 vars in 1308 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174/os-instance-actions/999 => generated 66 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:15:57.502748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '.version_select at 0x7f5fd182aca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.503319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: 48496e57-b2a2-431b-aca9-67af49538951] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.511192 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] HTTP exception thrown: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. Oct 18 16:15:57.513245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Request method failure captured: Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/48496e57-b2a2-431b-aca9-67af49538951/os-instance-actions HTTP/1.1 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtEhQDN3V9K-JlmvBEoK2KijV2yJE-_c9yTUeUpTSF3Hh64aH6sVYk5SpwfW1eB4HQWph0uvfbQ6zfO7YrUIloX29fAlFE-vd5EA3tolo4VQMFj1W2LFlBE5cSiETM02AM1p6tXpsOz1trt7TPC7fe9BBl5QuTeupmWD_mkie47jYsE Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}] Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0a2ebaf04b014f60a9772029677fb02e Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '48496e57-b2a2-431b-aca9-67af49538951'} Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:57.513734 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Returning 404 to user: Instance 48496e57-b2a2-431b-aca9-67af49538951 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9e84165-314b-4565-a36f-59816d0f1b8a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/48496e57-b2a2-431b-aca9-67af49538951/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016689 Oct 18 16:15:57.524257 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1821/3620] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/48496e57-b2a2-431b-aca9-67af49538951/os-instance-actions => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:57.531533 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcec3333-5685-4dab-bc21-1ff7c40a7fd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.479400 Oct 18 16:15:57.532433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.533164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.541660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.542489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.542931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.543705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.544167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.544593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.562022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1800/3621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:57.574270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.574772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Failed to fetch instance by id -1 {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:15:57.575305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance -1 could not be found. Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance -1 could not be found. Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '-1'} Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:57.580149 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:57.586950 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:57.586950 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:57.586950 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 18 16:15:57.586950 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:57.588570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:57.590225 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a06b2fe-d0c1-4616-bca0-b70309bc9e79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.022696 Oct 18 16:15:57.594983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:57.595587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1801/3622] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:15:57 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:15:57.601924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.603247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.612519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:57.616521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.617602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.619093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.620452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.621492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.622279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.720108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.742999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.747208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.750399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7618c003-ad0f-4da3-b989-8efed150cca1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1335 microversion: 2.47 time: 0.152210 Oct 18 16:15:57.751839 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1802/3623] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:57.773979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.775441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-edcd15a1-f80d-4a4f-bde0-a96004c2b96f tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 204 len: 0 microversion: 2.1 time: 0.252764 Oct 18 16:15:57.776638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.778032 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1822/3624] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:57 2022] DELETE /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:57.787753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.788359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.788762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.789619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.791504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.791917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.794241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.795255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.799552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.800296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.800733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.801654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.802183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.802485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.022565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.043613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c955f0e9-2619-4c47-ba91-4edf2d715ab6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.283576 Oct 18 16:15:58.044793 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1803/3625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:58.075813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.077485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.093589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.094601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.095339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.096368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.097238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.097685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.120055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.138095 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f76a84a-ff01-4265-a7a2-a40045693504 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1527 microversion: 2.1 time: 0.355431 Oct 18 16:15:58.139274 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1823/3626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1527 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:58.145579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.146487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.154949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.155721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.156336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.157181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.157644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.158074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.320250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.334588 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5d4020e9-c511-44db-b976-ec1c6b2c39ab tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.273510 Oct 18 16:15:58.336063 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1804/3627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:58.342530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.343889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.351208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.352850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.353829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.354844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.355765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.356658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.554034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.564101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cd785a1-33e3-4374-a8ae-3bb2e8c7032b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.225493 Oct 18 16:15:58.564649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1805/3628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:58.587999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:58.588534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 042d67f9-88b7-484e-b651-2fba5a4368e5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.595323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/042d67f9-88b7-484e-b651-2fba5a4368e5/action HTTP/1.1 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 19 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: {"forceDelete": {}} Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '042d67f9-88b7-484e-b651-2fba5a4368e5', 'body': {'forceDelete': {}}} Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:58.604163 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 042d67f9-88b7-484e-b651-2fba5a4368e5 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7aba938e-63b2-4b93-95d7-1cdd59adbadb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/042d67f9-88b7-484e-b651-2fba5a4368e5/action" status: 404 len: 111 microversion: 2.1 time: 0.023133 Oct 18 16:15:58.615283 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1806/3629] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:58 2022] POST /compute/v2.1/servers/042d67f9-88b7-484e-b651-2fba5a4368e5/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:15:58.620804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.635117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.658411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.659316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.660146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.661430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.662085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.662852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.871744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.881898 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-913d2549-ae0a-4613-a409-9daf23d6ad76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.266007 Oct 18 16:15:58.882550 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1807/3630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:58.895607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.896816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.909446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.910171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.910917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.912177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.912946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.913629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.012875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.024447 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae9bd2f4-d698-4bba-b66f-0fca3bb5dab4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.882726 Oct 18 16:15:59.025987 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1824/3631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.033267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.034397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.044730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.045617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.046016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.046968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.048460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.049822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.050903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.059475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.062199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.066536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d8fab98-ae96-4986-b739-c892de42e356 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1356 microversion: 2.47 time: 0.182356 Oct 18 16:15:59.070279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1808/3632] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:15:59.103506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:59.107563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.116434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.117357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.118377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.119773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.120460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.122905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.278286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:59.279194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:59.281535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:59.282381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:59.283765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:59.376821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.390068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76cfcf1e-18b8-48a2-bfef-fbc8a6370b43 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.362563 Oct 18 16:15:59.409141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.409457 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1825/3633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.419976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.421593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.423204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.426582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.427170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.428069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.430375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.430941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.449052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.450520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.451461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.452855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.455594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.456344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.509730 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34241f87-596f-4f3a-93aa-e5922f08c5b6 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "POST /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13/action" status: 202 len: 1078 microversion: 2.47 time: 0.410922 Oct 18 16:15:59.510340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1809/3634] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:15:59 2022] POST /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13/action => generated 1078 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 18 16:15:59.514910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.516008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.522102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.522743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.523184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.525015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.525015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.525308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.700582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.704181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:59.712351 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-831165a7-6f5c-424b-9ff2-00d3e4b8eee8 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.199811 Oct 18 16:15:59.716779 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1810/3635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.724368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:59.726800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: ca2c1b50-1e22-46a5-ac0b-35d287c5a111] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.735496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/ca2c1b50-1e22-46a5-ac0b-35d287c5a111/action HTTP/1.1 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 39 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: {"os-getConsoleOutput": {"length": 10}} Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ca2c1b50-1e22-46a5-ac0b-35d287c5a111', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:59.740978 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance ca2c1b50-1e22-46a5-ac0b-35d287c5a111 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:59.746210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96863c1f-ef08-4db6-b7f6-745289456dbb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/ca2c1b50-1e22-46a5-ac0b-35d287c5a111/action" status: 404 len: 111 microversion: 2.1 time: 0.024612 Oct 18 16:15:59.747454 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1811/3636] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:59 2022] POST /compute/v2.1/servers/ca2c1b50-1e22-46a5-ac0b-35d287c5a111/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:59.752686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.753469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.762276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.764273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.764273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.764273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.764273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.767534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.824023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.839289 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be8ae540-ab9f-4a50-8236-641d002c0bb2 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1527 microversion: 2.1 time: 0.427964 Oct 18 16:15:59.840261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1826/3637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1527 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.857141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.857691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.861648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.866327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.867395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.869682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.871054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.871834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.872439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.873863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.875787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.880616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8394fa0b-70ba-458d-b4f4-6e9b489a9076 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.129146 Oct 18 16:15:59.889589 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1812/3638] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:00.063413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.064041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.077770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.078272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.078731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.079659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.080126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.080743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.244553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.256828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6fa802ec-42b3-434d-a217-995874407b92 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.415066 Oct 18 16:16:00.257829 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1827/3639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:00.293313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.294614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.303621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.304818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.305867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.307399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.308456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.309257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.326844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.341455 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdc390f9-bcb5-4014-a0e8-da46a6c4e1a2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.281297 Oct 18 16:16:00.353681 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1813/3640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:00.744080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.745883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.754704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.755343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.755886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.756725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.757419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.758088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.772111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.786045 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37683c93-716b-4a57-bd76-751586f38b9d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.501962 Oct 18 16:16:00.786827 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1828/3641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:00.819766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.820789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: d0b24e9f-6e46-4d06-a942-2d70efdf7b18] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.828019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/d0b24e9f-6e46-4d06-a942-2d70efdf7b18 HTTP/1.1 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd0b24e9f-6e46-4d06-a942-2d70efdf7b18'} Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:00.833124 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:00.838331 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:00.838331 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:00.838331 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:00.838331 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. Oct 18 16:16:00.838331 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:00.839637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance d0b24e9f-6e46-4d06-a942-2d70efdf7b18 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:00.845964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e5c0682-40ec-4506-8c05-4616d748f9ec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/d0b24e9f-6e46-4d06-a942-2d70efdf7b18" status: 404 len: 111 microversion: 2.1 time: 0.031076 Oct 18 16:16:00.846608 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1829/3642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/d0b24e9f-6e46-4d06-a942-2d70efdf7b18 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:00.860436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.861242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.873113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.874029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.874551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.875387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.876112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.876619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.973266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.994465 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20ed004d-66cd-4c82-8801-56d3d75e5d95 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.254336 Oct 18 16:16:00.994831 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1814/3643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:01.002150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.003500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.015201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.015900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.016877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.018123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.018848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.019521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.143846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.153487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c4e983d-4651-4da2-b85f-f5684bee5c4e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.302100 Oct 18 16:16:01.154751 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1830/3644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:01.160302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.161356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.168277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.168904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.169501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.170303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.170858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.171443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.200723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:01.220740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.232298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b3e10a1-bc65-4f6b-8cbd-55c55454261a tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1527 microversion: 2.1 time: 0.235682 Oct 18 16:16:01.233727 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1815/3645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:01.240320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.244502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.252773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.253445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.254035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.254871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.255441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.255982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.310227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.325029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.327321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.329302 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cfedda11-afe6-4390-8d57-834917118920 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.173266 Oct 18 16:16:01.329873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1831/3646] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:01.375775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.376386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.384966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.385867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.386655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.387678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.388328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.388889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.429022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.449521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-892e3e73-7de0-4077-8c62-093555ded4b3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.213920 Oct 18 16:16:01.451770 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1816/3647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:01.557518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f10c1563-9956-4f6e-aa92-629c5291abd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1466852673", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f10c1563-9956-4f6e-aa92-629c5291abd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 238 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1466852673", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1466852673', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.588674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f10c1563-9956-4f6e-aa92-629c5291abd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f10c1563-9956-4f6e-aa92-629c5291abd3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039252 Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1817/3648] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:01 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.603441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.609634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.611837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.611837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.611837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.611837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.612484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.658332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.671550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d852ee3-b4c5-42cc-8dc8-5657630dc93e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.300915 Oct 18 16:16:01.685094 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1832/3649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:01.848429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.864072 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdcd4567-7f6f-4004-b08c-b93929ee45ee tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.266761 Oct 18 16:16:01.865184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1818/3650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:01.896398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.897434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.913702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.914205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.914742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.915485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.916777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.917268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.037609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.042299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.061978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.063383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.066634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.073398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.074542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.075998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.170820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.185117 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99f66d05-b7db-45c2-bfe8-77f4b0f29263 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.293486 Oct 18 16:16:02.186914 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1833/3651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:02.262753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.263685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.270577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.271325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.271944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.272646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.273386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.274831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.322820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.333822 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a70d1081-2a24-4fc6-997c-8bd1d1ab751f tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.319140 Oct 18 16:16:02.349040 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1819/3652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:02.349040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed2101c9-4050-4085-86c4-93454caee756 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1458220722", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed2101c9-4050-4085-86c4-93454caee756 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 235 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1458220722", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1458220722', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.353161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 16:16:02.357459 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:02.361122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed2101c9-4050-4085-86c4-93454caee756 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:02.361655 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed2101c9-4050-4085-86c4-93454caee756 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017669 Oct 18 16:16:02.367121 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1820/3653] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:02 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:16:02.532446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.544755 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8af3b60-86a4-4ed2-9374-c828b36ad244 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1527 microversion: 2.1 time: 0.286814 Oct 18 16:16:02.546884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1834/3654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:02.549829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1750369084", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:02.556306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.557961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.568009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.569349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.570445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.572685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.573526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.574187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.677983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] validate_networks() for [('8b15ddfd-50ce-4f21-a77f-c7e9e6ee19ae', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:02.704240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.715661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.717230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.718504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3856d93-28f3-48c9-9b7a-5bc6b0c766e2 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.170123 Oct 18 16:16:02.719202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1835/3655] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:02.724592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.725228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.732514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.732911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.733636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.734337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.734929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.735358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.893129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.906203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35418ed2-8597-48a8-955d-a6a433ae5db4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.185922 Oct 18 16:16:02.907144 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1836/3656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:02.925097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.925871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.938743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.939269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.939706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.940418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.940876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.941326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.152183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:03.166119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a61f2b41-5bf1-4bc6-8c38-b752aae689bc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1474 microversion: 2.1 time: 0.256306 Oct 18 16:16:03.167179 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1837/3657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:03.188611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:03.189582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:03.197227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.200327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.201827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.202909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.203353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.203844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.520081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:03.520641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:03.521110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:03.521535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:03.521962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:03.541681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.542232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.542709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.546659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.547190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.547646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.595510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:03.602184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for user 1cc60ef5fff74c2eab3f81450c33a4e7 and project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:03.619236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:03.622725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:03.700609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c0fce23-93ed-40bd-b70b-e21f4739e7df tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.331253 Oct 18 16:16:03.702715 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1821/3658] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:03.709824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:03.711603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:03.722792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.723885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.724748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.726080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.727735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.728741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.742416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:03.763228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d61b69e6-bb6e-43eb-b5f8-743552ab5101 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.579034 Oct 18 16:16:03.764228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1838/3659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:03 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:03.773732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:03.779176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:03.807309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.811949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.812767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.819786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.824127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.827817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.324913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.336643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.338842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa53fc56-8b81-45ad-93c2-810c1e374e6b tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1681 microversion: 2.1 time: 0.631538 Oct 18 16:16:04.339638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1822/3660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:03 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1681 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:04.350154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e64e7a40-7b10-4391-a1c9-80e771482f90 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:04.351216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e64e7a40-7b10-4391-a1c9-80e771482f90 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.352630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41d11f87-62bf-465a-9ef0-cda502d9967e tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1527 microversion: 2.1 time: 0.585069 Oct 18 16:16:04.359822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1839/3661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:03 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1527 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:04.374117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:04.377164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.413069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.414026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.416120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.417661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.421833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.423639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.479845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e64e7a40-7b10-4391-a1c9-80e771482f90 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.496834 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e64e7a40-7b10-4391-a1c9-80e771482f90 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1222 microversion: 2.1 time: 0.152323 Oct 18 16:16:04.498355 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1823/3662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:04 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:04.505055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:04.506117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 518c2582-5ab8-4eeb-b66f-7887588b07ab] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.512695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/518c2582-5ab8-4eeb-b66f-7887588b07ab/action HTTP/1.1 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 13 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: {"pause": {}} Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '518c2582-5ab8-4eeb-b66f-7887588b07ab', 'body': {'pause': {}}} Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:04.515863 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:04.520830 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:04.520830 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:04.520830 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. Oct 18 16:16:04.520830 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:04.522971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 518c2582-5ab8-4eeb-b66f-7887588b07ab could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:04.525459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72a98ffc-5870-4de5-8879-904d979ba05f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/518c2582-5ab8-4eeb-b66f-7887588b07ab/action" status: 404 len: 111 microversion: 2.1 time: 0.024331 Oct 18 16:16:04.527755 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1824/3663] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:04 2022] POST /compute/v2.1/servers/518c2582-5ab8-4eeb-b66f-7887588b07ab/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:04.552738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:04.554965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.568126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.569751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.575845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.578988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.580124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.581143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.644598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.664077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.681178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.698334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-080e2f71-29c0-459d-ad57-c786d5756771 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.325207 Oct 18 16:16:04.724107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1840/3664] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:04 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:04.745279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:04.751058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.791225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.792289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.793259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.794706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.795676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.802229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.113349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:05.125840 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af7ef923-0173-4903-a9ee-487d44a4560d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1471 microversion: 2.1 time: 0.596744 Oct 18 16:16:05.128441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1825/3665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:04 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1471 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:05.142421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1583926366", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:05.249270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] validate_networks() for [('8b15ddfd-50ce-4f21-a77f-c7e9e6ee19ae', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:05.402316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:05.414715 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01682dc5-2d3c-4bb4-a27c-7d3a8455ed18 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.687919 Oct 18 16:16:05.424906 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1841/3666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:04 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:05.450326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:05.458021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:05.486766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.488745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.490728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.491880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.495906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.496726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.656270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.658312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.659145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.661680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.663168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.666301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.727654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:05.752582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:05.770069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:05.938498 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0194b970-be8d-40c4-a2d6-00fcddb30b43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9/action" status: 202 len: 0 microversion: 2.1 time: 0.511067 Oct 18 16:16:05.943626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1842/3667] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:05 2022] POST /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:05.950578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:05.951802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:05.966446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.967051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.968676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.970773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.983732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.984704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.404714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd4aa75ffc54e5f840a70d8a901da15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:06.421348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0579a8fc-2199-4c1c-86f9-2419ad51eda1 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 200 len: 1614 microversion: 2.1 time: 0.469532 Oct 18 16:16:06.422657 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1843/3668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:05 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 1614 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:06.438608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:06.439304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:06.465769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.472484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.473110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.473973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.474532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.475042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.731422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:06.732119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:06.732347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:06.732763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:06.733534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:06.752788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.753096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:06.755602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.756080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.759510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.761731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.762693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.780693 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c30b5a48-bc80-4649-a5c7-952420f0555b tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1485 microversion: 2.1 time: 0.341155 Oct 18 16:16:06.781924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1844/3669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:06 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1485 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:06.802306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:06.809533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:06.829168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.831984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.832207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:06.836827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.838052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.838792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.839517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.846881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:06.849883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for user 1cc60ef5fff74c2eab3f81450c33a4e7 and project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:06.889316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:06.891658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:07.026894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb274a40-01b8-454f-9810-d9b21a24e96a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.896295 Oct 18 16:16:07.028109 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1826/3670] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:07.046016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:07.050015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.058310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.059080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.061733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.063128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.063969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.064611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.207337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.250523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.260872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.263182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33c63aff-531e-4ff0-9e42-69ce498aab24 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.224242 Oct 18 16:16:07.264165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1827/3671] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:07 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:07.276745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:07.277411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.291766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.293188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.295329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.301440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.310179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.312532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.313626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.315199 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a932997-2ea6-43a9-8c70-a88351289db8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.531421 Oct 18 16:16:07.328248 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1845/3672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:06 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:07.343015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2603c5-2558-440d-b5cd-20f1bfe8e2c5", "name": "network-vif-deleted", "tag": "db6de071-a155-4edb-a8c2-648432406189"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:07.374393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.379674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.380297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.410618 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] Creating event network-vif-deleted:db6de071-a155-4edb-a8c2-648432406189 for instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 on n-h1-858383-14 Oct 18 16:16:07.421639 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4a78514a-ff56-48fe-b2ab-a17bd1c3f33d req-84845aac-7b21-4a87-87dc-bfe56cabb597 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089673 Oct 18 16:16:07.422577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1846/3673] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:07.651273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d008f1-403d-4dea-8f80-98aab7015174", "name": "network-vif-deleted", "tag": "3b1cfd54-52e0-47de-a63f-94fb6d0e95be"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:07.669014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.669474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.676829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.701484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] Creating event network-vif-deleted:3b1cfd54-52e0-47de-a63f-94fb6d0e95be for instance b4d008f1-403d-4dea-8f80-98aab7015174 on n-h1-858383-14 Oct 18 16:16:07.715409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-bede9aed-cd27-4af4-b284-d87a06a070b4 req-edb21d26-a860-403f-8877-57fae3f50cff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291178 Oct 18 16:16:07.716343 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1847/3674] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:07.728460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2a7323f-6e5a-46ca-9fa4-bba9bbda6cf7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:07.729417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2a7323f-6e5a-46ca-9fa4-bba9bbda6cf7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.887655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.902473 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-383486e8-ced8-44cc-a5b4-9d93222b7706 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1470 microversion: 2.1 time: 0.636715 Oct 18 16:16:07.903060 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1828/3675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:07 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:07.923426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:07.923970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.937899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d2a7323f-6e5a-46ca-9fa4-bba9bbda6cf7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.948480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.949631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.950081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.951935 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2a7323f-6e5a-46ca-9fa4-bba9bbda6cf7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1222 microversion: 2.1 time: 0.233774 Oct 18 16:16:07.953560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1848/3676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:07 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:07.954513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.956724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.957578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.966895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:07.969970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] [instance: 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.990564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.002429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.003453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.004822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.007569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.010265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.048086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] HTTP exception thrown: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Request method failure captured: Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 HTTP/1.1 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtBfPBQO2KTO1jJChTnuOwefd-_UkZM319xhBv0Yi4eCuXKGj5Gw8zaUhSXgOYTGqpJeAOKdu79GXdqROnQpbieRZLMtqEZ29dV29ugBVDqGzSHuccRKOpgF_x81xQgc8cXRwW62TObRhuB4Fig36PqzayARhjug0N8hxWWvY8Xnrf4 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 8ad06f3c29294b01ba67eb5d5a1ea59c Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ad06f3c29294b01ba67eb5d5a1ea59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ad06f3c29294b01ba67eb5d5a1ea59c"}]}] Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 8ad06f3c29294b01ba67eb5d5a1ea59c Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-846187192 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesAdminNegativeTest-846187192-project Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 5bd4aa75ffc54e5f840a70d8a901da15 Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesAdminNegativeTest-846187192-project Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9c2603c5-2558-440d-b5cd-20f1bfe8e2c5'} Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:08.053896 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. Oct 18 16:16:08.059065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:08.064507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Returning 404 to user: Instance 9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:08.069725 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63134f70-6151-4c8d-b8ba-2b6fbd19d3b3 tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5" status: 404 len: 111 microversion: 2.1 time: 0.113922 Oct 18 16:16:08.080877 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1849/3677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:07 2022] GET /compute/v2.1/servers/9c2603c5-2558-440d-b5cd-20f1bfe8e2c5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:08.097787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.100575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:08.119795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.120403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.120919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.121752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.122278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.122799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.177024 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d852ec57-0f68-4668-9c70-7a186c1c5412 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.256937 Oct 18 16:16:08.177882 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1829/3678] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:07 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:08.189780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-718e4249-5549-4c14-a621-9d8527481f4c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] Calling method '.version_select at 0x7f5fd2250ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.216505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.218167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.220574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.221383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lazy-loading 'fault' on Instance uuid b4d008f1-403d-4dea-8f80-98aab7015174 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:16:08.235799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-718e4249-5549-4c14-a621-9d8527481f4c tempest-VolumesAdminNegativeTest-846187192 tempest-VolumesAdminNegativeTest-846187192-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286292537" status: 202 len: 0 microversion: 2.1 time: 0.056395 Oct 18 16:16:08.252099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1830/3679] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286292537 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:08.272809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.273930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:08.294420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.300103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.301568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.303323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.305452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.309802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.503121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2ebaf04b014f60a9772029677fb02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7b38c393e4700b102c1045a7dea8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.514572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6aa33f3e-49cf-455a-b5da-819056b75d4d tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 200 len: 1314 microversion: 2.1 time: 0.429393 Oct 18 16:16:08.518459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1850/3680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:08 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:08.535330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.538229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:08.552181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.558581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.559758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.560954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.563369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.566348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.676543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.691049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.710511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6ed37df-d7ff-4477-a3aa-f5baa4bf28ff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1511 microversion: 2.1 time: 0.456733 Oct 18 16:16:08.713652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.715637 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1831/3681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:08 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:08.718325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.722283 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ccd07c97-6eba-4f19-a070-8a030d667daf tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.201032 Oct 18 16:16:08.723410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1851/3682] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:08 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:08.883307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-plugged", "status": "completed", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:08.903086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.903897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.904027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.925438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.926067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:08.940831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.949343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.950035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.950957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.951779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.952271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.963759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Creating event network-vif-plugged:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h1-858383-14 Oct 18 16:16:08.990657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:16:09.022390 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a2388dc9-d29c-4a35-8e1e-7ecea5d622d2 req-8a3b66c9-9af4-4561-81c6-b249bfe0a3ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143891 Oct 18 16:16:09.026853 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1832/3683] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:09.038590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:09.040359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:09.057779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.058347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.059281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.060485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.061148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.062599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.230429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:09.265559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:09.269351 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e7810f2-ed2e-426c-b2fb-18c1cddcdf9e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1274 microversion: 2.1 time: 0.240664 Oct 18 16:16:09.287504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1833/3684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:09 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:09.298970 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecda8e5a-a11e-45e6-b89d-f91774f41d11 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1470 microversion: 2.1 time: 0.377320 Oct 18 16:16:09.309145 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1852/3685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:08 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:09.545096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:09.545986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] [instance: b4d008f1-403d-4dea-8f80-98aab7015174] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:09.552592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.553621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.554272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.555782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.556438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.557507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.562698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:09.586386 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] HTTP exception thrown: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Request method failure captured: Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 HTTP/1.1 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtEhQDN3V9K-JlmvBEoK2KijV2yJE-_c9yTUeUpTSF3Hh64aH6sVYk5SpwfW1eB4HQWph0uvfbQ6zfO7YrUIloX29fAlFE-vd5EA3tolo4VQMFj1W2LFlBE5cSiETM02AM1p6tXpsOz1trt7TPC7fe9BBl5QuTeupmWD_mkie47jYsE Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2d7b38c393e4700b102c1045a7dea8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2d7b38c393e4700b102c1045a7dea8c"}]}] Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b2d7b38c393e4700b102c1045a7dea8c Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-421388014 Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0a2ebaf04b014f60a9772029677fb02e Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-421388014-project Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b4d008f1-403d-4dea-8f80-98aab7015174'} Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:09.589630 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. Oct 18 16:16:09.597337 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:09.601720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] Returning 404 to user: Instance b4d008f1-403d-4dea-8f80-98aab7015174 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:09.603576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f999720-440a-4117-8836-91c56d8dbd09 tempest-InstanceActionsNegativeTestJSON-421388014 tempest-InstanceActionsNegativeTestJSON-421388014-project] 10.222.0.78 "GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174" status: 404 len: 111 microversion: 2.1 time: 0.064061 Oct 18 16:16:09.606678 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1834/3686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:09 2022] GET /compute/v2.1/servers/b4d008f1-403d-4dea-8f80-98aab7015174 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:09.747864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:09.748395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:09.751636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:09.752373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:09.758241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.759554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.760280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.762180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.763197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.764247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.772718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.773255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.774030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.774761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:09.781288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:09.782203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:09.915661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:09.927648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:09.936402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:09.939560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7cdcf50-25a0-43f2-9fa5-49787d805be3 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.193121 Oct 18 16:16:09.941209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1835/3687] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:09 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:16:10.247466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:10.263026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01719080-4360-4a30-832c-de51adec3bd1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1491 microversion: 2.1 time: 0.526854 Oct 18 16:16:10.265070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1853/3688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:09 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1491 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:10.289686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:10.290881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.308718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:10.309692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.314422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:10.345516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.346598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.347311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.348181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.348919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.352299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.353271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.355639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.356787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.357572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.358801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.363339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.432920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'pause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state paused Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 13 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: {"pause": {}} Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'pause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state paused Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'pause': {}}} Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state paused. Cannot pause while the instance is in this state. Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state paused Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:10.434934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:10.440049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:10.440049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:10.440049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:10.440049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state paused Oct 18 16:16:10.440049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:10.448105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'pause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state paused {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:10.449392 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-abacf5f8-925e-4c78-b29d-1bb7cbedb46e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 143 microversion: 2.1 time: 0.164615 Oct 18 16:16:10.454111 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1836/3689] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:10 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 143 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:16:10.460598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:10.465748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.474658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.475798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.477361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.478906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.479981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.480948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.618107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:10.643413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d6fa81d3-81d3-4c95-8fbd-05799aaf0846 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1280 microversion: 2.1 time: 0.343698 Oct 18 16:16:10.645677 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1854/3690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:10 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:10.669078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:10.670158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.703351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.705885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.707700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.711925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.714154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.716081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.878185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:10.892923 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c56e0308-120d-46e9-99ca-8a9787302509 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.245383 Oct 18 16:16:10.894400 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8066694e-ac9f-4252-9ea1-a6eebca3d7d0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1470 microversion: 2.1 time: 0.438622 Oct 18 16:16:10.896172 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1837/3691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:10 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1470 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:10.910486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6370e14d-fed1-42dc-af35-c4a2309ddfaf", "tag": "43212c5c-29b1-4994-b693-f8defbdd7426"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:10.948345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1855/3692] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:10 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:10.948591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.949164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.949542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.975100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:10.988382 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] Creating event network-changed:43212c5c-29b1-4994-b693-f8defbdd7426 for instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf on n-h2-858383-14 Oct 18 16:16:10.990945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.997090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9ba9dbdd-5acd-4e60-8413-e7c3e9b9290a req-2b75a493-8163-461a-9509-17b12d71245a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098099 Oct 18 16:16:10.999865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1838/3693] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:11.007071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:11.008968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:11.017777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.018656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.019511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.020674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.021525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.022366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.029272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.033250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.035421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.040048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.044425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.045413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.160745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.169659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.171687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.173254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b9d4911-4ff4-4ddf-bf81-9bdd7d2b8b76 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.171804 Oct 18 16:16:11.174387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1839/3694] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:11 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:11.381607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.408264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9624c13e-28d7-40eb-b49f-234a77a25c76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1498 microversion: 2.1 time: 0.455486 Oct 18 16:16:11.426063 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1856/3695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:10 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1498 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:11.672726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:11.674300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:11.684040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.684702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.685291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.686450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.687043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.688469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.862237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.879170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-826e261d-0210-4fa5-8a0d-c2137ca3c14d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1280 microversion: 2.1 time: 0.209869 Oct 18 16:16:11.880202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1840/3696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:11 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:11.947750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:11.948821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:11.965727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.967407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.968055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.969169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.969882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.970519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.229678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:12.231859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:12.240891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.242388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.243353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.245738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.246519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.247377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.393868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.403964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-462c10a6-8808-401a-90d7-69a47790a716 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.468353 Oct 18 16:16:12.405549 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1857/3697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:11 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:12.443346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:12.444302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:12.451928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.453613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.453613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.454022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.454578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.455129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.479656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.493841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.497549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.500506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64bdcd5c-7161-4ce5-8ffc-b38a8726578a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.275163 Oct 18 16:16:12.501798 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1841/3698] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:12 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:12.768517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.777367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65e41dd4-51f3-4ff8-9f70-6829085a8ef5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.338516 Oct 18 16:16:12.778395 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1858/3699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:12 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:12.812163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:12.812784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:12.829289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.831082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.831898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.833919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.835016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.835714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.913135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:12.914734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:12.924436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.925224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.925877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.926977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.928025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.928690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.193912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:13.210668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18679dda-f6a5-48d3-bb83-fbab91f96dfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.302743 Oct 18 16:16:13.215589 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1859/3700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:12 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:13.231662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:13.246207 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-515c9b86-b551-4563-9ce1-483ebfdc6336 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.438430 Oct 18 16:16:13.247174 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1842/3701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:12 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:13.279531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:13.282216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:13.300587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.301145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.301600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.302308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.302769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.303199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.339054 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action HTTP/1.1 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 28 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: {"reboot": {"type": "SOFT"}} Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '7fc12c05-0954-4f24-bdb6-701a67b55471', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:13.340910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afbcbeb8-dd1a-44d3-8822-d91952e4f86e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action" status: 404 len: 111 microversion: 2.1 time: 0.067457 Oct 18 16:16:13.349077 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1843/3702] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:13 2022] POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:16:13.350966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:13.351591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:13.359054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.359550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.359997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.360708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.361240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.361678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.361954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-unplugged", "status": "completed", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:13.409471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.410138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.410618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.457039 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Creating event network-vif-unplugged:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:16:13.475736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:16:13.498591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6df3eb6e-53f5-4d6f-b7aa-0d754c7f4b59 req-e957ad59-95be-4323-aea5-f8624122a0fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.280110 Oct 18 16:16:13.500074 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1860/3703] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:13.513273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:13.514010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:13.528270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.529157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.529829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.530873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.531711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.532367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.725825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:13.737179 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62bf00b4-0e68-4e6b-bdde-d4a6018ba69d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.388743 Oct 18 16:16:13.740934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1844/3704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:13 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:13.746352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:13.757596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:13.772959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.774291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.775393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.782966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.783881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.784487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.930719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:13.951694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7ff1366-da32-4b9d-9ec8-8f8f622a2f12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.449660 Oct 18 16:16:13.953719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1861/3705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:13 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:13.986505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:13.987262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.002140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.004838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.009256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.010353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.011291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.013660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.059774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.100534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.104569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.114670 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-442d0046-9f1c-4825-86bc-5332ff78337d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.364873 Oct 18 16:16:14.129658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1845/3706] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:13 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:14.245682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:14.246615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.263247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.264102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.264956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.277503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.278001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.278447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.406264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.417891 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21a8e39d-cb00-4c93-bb24-2aea26d3e7f4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.461169 Oct 18 16:16:14.418747 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1862/3707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:13 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:14.441724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:14.444336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 6219bb01-0246-4794-a796-2a1203472303] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.451077 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/6219bb01-0246-4794-a796-2a1203472303/action HTTP/1.1 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 28 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: {"reboot": {"type": "SOFT"}} Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6219bb01-0246-4794-a796-2a1203472303', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. Oct 18 16:16:14.452986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. Oct 18 16:16:14.458346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:14.459746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 6219bb01-0246-4794-a796-2a1203472303 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:14.460775 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-120d6652-c3e8-476d-bd6c-0feb5f8feac3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/6219bb01-0246-4794-a796-2a1203472303/action" status: 404 len: 111 microversion: 2.1 time: 0.023311 Oct 18 16:16:14.466093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1863/3708] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:14 2022] POST /compute/v2.1/servers/6219bb01-0246-4794-a796-2a1203472303/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:14.471237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:14.472209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.482178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.483013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.483940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.484896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.485617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.486259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.606869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.639135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72268292-6abe-4b92-a3b3-1b9600687436 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.383256 Oct 18 16:16:14.668609 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1846/3709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:14 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:14.969360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.976038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:14.982225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:14.983913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.989572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e59d1110-3e8f-4b7e-b922-2c867165884c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.521723 Oct 18 16:16:15.000445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.001736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.002770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.004287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.005394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.006179 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1864/3710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:14 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:15.009537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.038205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:15.040521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.056897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.058847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.059813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.061264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.062770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.063791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.561322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:15.588770 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dfa852e7-8a9d-45e4-8bbe-3eb0afaae8a4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.557502 Oct 18 16:16:15.589782 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1865/3711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:15 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:15.596633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:15.597728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.607185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:15.608805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.609917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.610776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.612226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.613042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.614234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.623262 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-75076a6d-1cd8-4d3d-8084-87e492080d55 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.648664 Oct 18 16:16:15.624281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1847/3712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:14 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:15.641914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:15.659831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.662668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.663485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.703436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:15.708413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Creating event network-changed:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:16:15.737647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:16:15.787945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-44d97159-f11b-47e7-bf06-ad94091c7e6f req-3fd09df8-bb94-44ae-8bba-f81bba19dca5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158863 Oct 18 16:16:15.788891 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1848/3713] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:15.798153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:15.802655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.822153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.823267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.824598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.825636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.826229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.826957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.850902 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action HTTP/1.1 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 65 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '7fc12c05-0954-4f24-bdb6-701a67b55471', 'body': {'rebuild': {'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce'}}} Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 16:16:15.854612 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:16:15.864054 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:15.868544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:15.870356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a6b4f5b-2fb3-43cc-8732-c0b1582ea19b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action" status: 404 len: 111 microversion: 2.1 time: 0.079829 Oct 18 16:16:15.876390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1849/3714] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:15 2022] POST /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:15.880771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:15.881487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.892089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.892596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.895452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.896979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.900966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:15.909791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.910260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.914529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:15.915959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:15.917232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0757692d-366f-4c24-9d5e-47856ecdd782 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.325794 Oct 18 16:16:15.917809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1866/3715] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:15 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:15.930336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:15.939740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.964883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.965431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.965882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.966745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.967042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.973977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.674187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.701658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.704211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2e281de-3695-49b4-9ab3-fae258bd60c3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.827255 Oct 18 16:16:16.705195 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1850/3716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:15 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:16.728799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.731172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.747956 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dff78001-d91a-4dc8-8c54-823e3a0db8ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.821306 Oct 18 16:16:16.749388 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1867/3717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:15 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:16.766061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.766781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.767661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.768398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.768969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.780498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.781579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.783238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.784696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.785813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.786722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.790612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.791533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.792358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.793448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:16.876700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=14 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:17.226386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.241672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26efb583-6f72-40ad-84a5-4e8c8e2d6498 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.490553 Oct 18 16:16:17.242896 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1868/3718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:16 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:17.248660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:17.250557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:17.260828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.261586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.262250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.263120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.263673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.264192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.555752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.571629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99866901-45a5-4117-8d08-b3c2f0e35675 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.852494 Oct 18 16:16:17.572862 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1851/3719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:16 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:17.597295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:17.599184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:17.612094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.613112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.613827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.614829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.615537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.616201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.863027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.872641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.874135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.875767 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6b8d244-961f-4273-949e-a3c73abb655c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.301646 Oct 18 16:16:17.893462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.895094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1852/3720] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:17 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:17.903561 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11684142-2159-4783-8ce6-e657c40592ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.648239 Oct 18 16:16:17.905484 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1869/3721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:17 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:17.907954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:17.909180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:17.917716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.918467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.919053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.919933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.920690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.921158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.924301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:17.925769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:17.943871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.946954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.951703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.952709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.955012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.955734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.956817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:18.181321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.190258 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-773362b2-ff67-4d06-8124-b2f4586396e6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.281578 Oct 18 16:16:18.191199 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1870/3722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:17 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.196452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.197500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.205077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.205815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.206642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.207503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.208123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.208697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.373361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.381422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e06c28a-4dc1-4683-ae0c-5a38ba4cb58c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.189274 Oct 18 16:16:18.382010 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1871/3723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.387417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.388031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.394621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.395377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.396003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.396712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.397196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.397622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.453152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.462933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32de179a-6f5d-4bc7-ac51-c5d2e56e7ba8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.565577 Oct 18 16:16:18.477388 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1853/3724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:17 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.477388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.477388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.477388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.477388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.477940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.478567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.479033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.479458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.482414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:18.574712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.587753 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee7e5bab-265d-440a-b701-5e5d4c69f529 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.204304 Oct 18 16:16:18.588569 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1872/3725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.594340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:18.597621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: b6e96ce3-029f-48f7-82e6-0586d786c99d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.604004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/b6e96ce3-029f-48f7-82e6-0586d786c99d/action HTTP/1.1 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 65 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b6e96ce3-029f-48f7-82e6-0586d786c99d', 'body': {'rebuild': {'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce'}}} Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 16:16:18.605668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance b6e96ce3-029f-48f7-82e6-0586d786c99d could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c5083678-fe5c-46c6-bd34-4291dcb4df3a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/b6e96ce3-029f-48f7-82e6-0586d786c99d/action" status: 404 len: 111 microversion: 2.1 time: 0.017341 Oct 18 16:16:18.611762 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1873/3726] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:18 2022] POST /compute/v2.1/servers/b6e96ce3-029f-48f7-82e6-0586d786c99d/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:18.619539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.620373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.632161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.632161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.632433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.633783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.634725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.635102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.842788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.855759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5aecc65b-38b7-4b7f-b79d-0a9612345ede tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.390832 Oct 18 16:16:18.857139 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1854/3727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.910171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.911857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.925837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.926351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.926786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.927512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.927971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.928393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:19.123061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:19.171284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:19.183892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:19.194263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f5691c9-8d06-4312-9c54-7d89c21eefb4 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.285135 Oct 18 16:16:19.215906 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1855/3728] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:19.235279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a032d9f-0294-4fc2-9c24-be424e104d0c", "tag": "36874c11-5d80-4d7c-9b61-aa1cc3fd9d81"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:19.263385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:19.264205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:19.264806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:19.282630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] Creating event network-changed:36874c11-5d80-4d7c-9b61-aa1cc3fd9d81 for instance 2a032d9f-0294-4fc2-9c24-be424e104d0c on n-h2-858383-14 Oct 18 16:16:19.290764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-deef615f-cc53-4208-b0fc-7fbed00ee426 req-b5c0f73d-6c2b-4c95-9f73-f5dfdb64b66a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074167 Oct 18 16:16:19.292268 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1856/3729] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:19.298344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:19.299323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:19.307761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:19.308565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:19.309228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:19.310138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:19.310917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:19.311716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:19.357673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:19.370524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8f9a785-ba70-4c70-8659-4e8f9d8f026f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.756245 Oct 18 16:16:19.382979 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1874/3730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:19.403011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1710795363", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b4a50421-5452-4e65-84ea-78b361222489"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:19.471469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] validate_networks() for [('b4a50421-5452-4e65-84ea-78b361222489', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:19.777799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:19.786720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7d490f0-bd10-4258-9139-d19530c995b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.492862 Oct 18 16:16:19.801049 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1857/3731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:19 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:19.808726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:19.809619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:19.816677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:19.817468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:19.818065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:19.818919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:19.819535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:19.820148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.087295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.102195 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7cbeccbc-0627-4471-b9c4-b24f04f7b500 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.301942 Oct 18 16:16:20.103594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1858/3732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:19 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:20.163730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6370e14d-fed1-42dc-af35-c4a2309ddfaf", "name": "network-vif-plugged", "status": "completed", "tag": "43212c5c-29b1-4994-b693-f8defbdd7426"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:20.179756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.180538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.181190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.194952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] Creating event network-vif-plugged:43212c5c-29b1-4994-b693-f8defbdd7426 for instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf on n-h2-858383-14 Oct 18 16:16:20.201500 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-048f4e42-39b6-46d5-acd6-3a0cf4472dad req-836bfc19-de49-436a-8fa9-8ad3b81ffa6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048230 Oct 18 16:16:20.202765 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1859/3733] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:20.214283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:20.214991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.221941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.222434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.222981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.223679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.224128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.224761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.413442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:20.413442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:20.414109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:20.415431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:20.416453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:20.427351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.428087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.428684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.429690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.430733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.431174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.454460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:20.460674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:20.478456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:20.481551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:20.565854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be05ff48-a344-444b-9484-8643c684c3cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170848 Oct 18 16:16:20.567862 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1875/3734] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:20.575608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:20.576167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: b41cbe86-bf51-4856-9260-fb72d6f31369] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.583705 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/b41cbe86-bf51-4856-9260-fb72d6f31369/action HTTP/1.1 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 15 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: {"restore": {}} Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b41cbe86-bf51-4856-9260-fb72d6f31369', 'body': {'restore': {}}} Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:20.585521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance b41cbe86-bf51-4856-9260-fb72d6f31369 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c0e8534-29ab-4c44-a87d-798660fb4405 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/b41cbe86-bf51-4856-9260-fb72d6f31369/action" status: 404 len: 111 microversion: 2.1 time: 0.019188 Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1876/3735] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:20 2022] POST /compute/v2.1/servers/b41cbe86-bf51-4856-9260-fb72d6f31369/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:20.595408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.629377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.630609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.631207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.632338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.634262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.635166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.756971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.770178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4eaae235-68a4-4ac2-aec6-f33793a86679 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1536 microversion: 2.1 time: 0.565232 Oct 18 16:16:20.797712 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1860/3736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:20 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1536 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:20.823077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd517b22-39fa-43ac-a231-098186ce31e6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:20.827422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.833988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd517b22-39fa-43ac-a231-098186ce31e6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.848640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.850582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.855538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62fe26b7-3299-426f-91ec-7e2472cf8b47 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.263829 Oct 18 16:16:20.859119 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1877/3737] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:20 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:20.878227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:20.879645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.904484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.905611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.906453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.907876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.909227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.911248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.105354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd517b22-39fa-43ac-a231-098186ce31e6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.118039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd517b22-39fa-43ac-a231-098186ce31e6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1215 microversion: 2.1 time: 0.318503 Oct 18 16:16:21.134083 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1861/3738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:20 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:21.134083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:21.134083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.159772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.168609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.168609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.168609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.169607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.170107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.220582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.238281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f35aa87b-dd2b-4805-8c07-56c3517ec05d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.376941 Oct 18 16:16:21.257868 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1878/3739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:20 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:21.278074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:21.278697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.285173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.285662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.286087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.286880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.287476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.288409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.491344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.506962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e66a68a-d6a6-41c7-a16b-de77117c32cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.385074 Oct 18 16:16:21.508439 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1862/3740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:21.595134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.604824 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7155bad2-58ee-4a3a-85df-2ede61d0f2d8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.331009 Oct 18 16:16:21.606158 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1879/3741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:21.635398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:21.635957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.652595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.653143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.653591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.654314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.654767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.658865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.694940 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'restore' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 15 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: {"restore": {}} Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'restore' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'restore': {}}} Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state active. Cannot restore while the instance is in this state. Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:21.699026 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:21.704568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:21.704568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:21.704568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:21.704568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:21.704568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:21.705354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'restore' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:21.707012 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9fc16f6-46eb-4e07-9c21-8133d77e2721 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 145 microversion: 2.1 time: 0.077495 Oct 18 16:16:21.708667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1863/3742] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:21 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 145 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:16:21.718319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:21.718319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.726413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:21.728834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.731511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.731511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.732054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.732727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.733352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.822210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:21.823091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.830489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.831737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.832212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.833060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.833583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.834114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.981783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.993151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-015eafee-466d-42a8-88c8-58e4688b393f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.278294 Oct 18 16:16:21.994711 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1880/3743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:22.000016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.000927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.008361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.009565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.010210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.011152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.011967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.012588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.220392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.241555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.246879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.250025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0579198c-e7f7-4e74-a128-2b8b6a763e63 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.253756 Oct 18 16:16:22.253567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1881/3744] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:22.263243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.265115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.286147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.293349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.298911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.299901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.300520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.300959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.400244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.417118 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01482bb4-b5f5-416a-b722-63281ab311c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1529 microversion: 2.1 time: 0.597219 Oct 18 16:16:22.418108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1864/3745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1529 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:22.422991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.436985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.475179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.475994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.477397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.485163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.486183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.486896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.745489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.746593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.774403 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63f8b22c-932b-4e37-a184-e1eb1cb56ba7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.516156 Oct 18 16:16:22.779597 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1882/3746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:22 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:22.793350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4a0e716e-5668-44ca-8d90-6418aeba4149 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1267 microversion: 2.1 time: 0.367413 Oct 18 16:16:22.793350 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1865/3747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:22 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:22.809500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.817416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.818031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.818613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.841950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.845332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.846176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.848323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.850440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.851139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.852511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.854036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.854959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.877488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.878598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.879475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.292836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:23.306005 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e35d4f7-48f1-4800-9b13-38a2622cdc6e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1529 microversion: 2.1 time: 0.515544 Oct 18 16:16:23.312458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1866/3748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:22 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1529 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:23.321323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:23.322218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 05c922f3-ed58-4efe-b2b6-1bb727f2d991] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:23.334937 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/05c922f3-ed58-4efe-b2b6-1bb727f2d991/action HTTP/1.1 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 14 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: {"resume": {}} Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '05c922f3-ed58-4efe-b2b6-1bb727f2d991', 'body': {'resume': {}}} Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.346919 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.352000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:23.352000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:23.352000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. Oct 18 16:16:23.352000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.353784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 05c922f3-ed58-4efe-b2b6-1bb727f2d991 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:23.355572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31c25bea-6234-4c9d-a1c1-bb10ed2fbe5e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/05c922f3-ed58-4efe-b2b6-1bb727f2d991/action" status: 404 len: 111 microversion: 2.1 time: 0.041517 Oct 18 16:16:23.356806 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1867/3749] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:23 2022] POST /compute/v2.1/servers/05c922f3-ed58-4efe-b2b6-1bb727f2d991/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:23.368416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:23.374072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:23.395776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.396536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.397198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.398081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.400218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.400847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.485377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:23.501183 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cff1ca10-7305-4f60-8022-deded8fb1aa2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.703482 Oct 18 16:16:23.507575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1883/3750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:22 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:23.513529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e718e08-7777-44e6-aecc-3d145e157f34 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:23.523991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2e718e08-7777-44e6-aecc-3d145e157f34 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] HTTP exception thrown: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. Oct 18 16:16:23.535628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e718e08-7777-44e6-aecc-3d145e157f34 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Request method failure captured: Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/flavors/918a074a-3430-4502-9ceb-bf32cca63858 HTTP/1.1 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB1Ht3FPEbj75TylhgOC3OU8K1ADtyWrJZ9vaXnK_M0g4Aa81Kc8GHf-laAn1rUgvMW4ETkO9d5WQbK3F9Ibhwtvr9t92nEt4-v2Ro2XqJrG4yQULBhjPj-lC4Q6bVcZX4cIJnGcv3DQlZ-ZXvEymxhbA-fYtA39DZyLUV1aZDaPtU Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4c378fdcfd8543489f0b99fda82d836b Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MigrationsAdminTest-530628342 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c378fdcfd8543489f0b99fda82d836b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c378fdcfd8543489f0b99fda82d836b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c378fdcfd8543489f0b99fda82d836b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c378fdcfd8543489f0b99fda82d836b"}]}] Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MigrationsAdminTest-530628342 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4c378fdcfd8543489f0b99fda82d836b Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MigrationsAdminTest-530628342 Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MigrationsAdminTest-530628342-project-admin Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 8252ee4a252a44e9ae8794892bfadaea Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MigrationsAdminTest-530628342-project-admin Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '918a074a-3430-4502-9ceb-bf32cca63858'} Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.543997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. Oct 18 16:16:23.549737 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.553641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e718e08-7777-44e6-aecc-3d145e157f34 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Returning 404 to user: Flavor 918a074a-3430-4502-9ceb-bf32cca63858 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:23.555677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e718e08-7777-44e6-aecc-3d145e157f34 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/918a074a-3430-4502-9ceb-bf32cca63858" status: 404 len: 109 microversion: 2.1 time: 0.045346 Oct 18 16:16:23.555830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1884/3751] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:16:23 2022] DELETE /compute/v2.1/flavors/918a074a-3430-4502-9ceb-bf32cca63858 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:23.566164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:23.567915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:23.569165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3740d4f4-55be-4944-879e-57d2a1e1687d tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.211053 Oct 18 16:16:23.575950 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1868/3752] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:23 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:23.579011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:23.593911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:23.611461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.612151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.612668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.613735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.614633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.615614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.622646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:23.787384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-78421815", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:23.892123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:24.060659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:24.075743 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72ac4cd8-065e-4dff-b1c2-d872992075bb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.513629 Oct 18 16:16:24.077386 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1885/3753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:23 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:24.085513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:24.089629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:24.112026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.113386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.114844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.115788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.119292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.120142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.560642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:24.572772 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-debacdc6-216a-4c6a-b94e-13b40ca37a53 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1273 microversion: 2.1 time: 0.493789 Oct 18 16:16:24.574269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1886/3754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:24 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1273 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:24.598891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:24.603300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:24.624587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.626187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.626834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.628018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.629056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.629654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.647457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:24.649206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:24.649910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:24.650712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:24.651313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:24.671772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.672288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.672740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.675967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.676340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.676788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.728764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:24.737755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Getting quotas for user edf8e722c29b4428a12703b05e0ebc2a and project 9333cee966ee488888baa81cca159833. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:24.753447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:24.757180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:24.878515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57b4bf8a-2200-4ade-9d99-5662d8ab56c1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096879 Oct 18 16:16:24.887450 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1869/3755] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:16:24.905981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:24.911482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:24.941220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.941730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.942183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:24.948593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:24.956328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:24.957133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.168954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:25.186466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-871262f9-cb86-4c23-b8d7-363864074096 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.606394 Oct 18 16:16:25.193870 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1887/3756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:24 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:25.201582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:25.202386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:25.231794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.232330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.232819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.233831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.237754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.240683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.526487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:25.545728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:25.547640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:25.548913 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca03fd29-eca9-4ae1-9f9d-72706e7f9454 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.354050 Oct 18 16:16:25.551469 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1888/3757] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:25 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:25.560541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b33647e3-8939-4659-99d2-44a99e72499c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:25.561487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b33647e3-8939-4659-99d2-44a99e72499c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:25.668629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b33647e3-8939-4659-99d2-44a99e72499c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:25.685435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b33647e3-8939-4659-99d2-44a99e72499c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1211 microversion: 2.1 time: 0.131661 Oct 18 16:16:25.697197 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1889/3758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:25 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1211 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:25.706758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:25.707307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:25.714030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.714896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.715564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.716563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.717507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.718510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.756949 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'resume' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 14 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: {"resume": {}} Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: exception: Cannot 'resume' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'resume': {}}} Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state active. Cannot resume while the instance is in this state. Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:25.759610 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:16:25.765182 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:25.766796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'resume' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:25.769450 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7343a339-021d-4211-93d0-83781c1e0b7c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 144 microversion: 2.1 time: 0.069676 Oct 18 16:16:25.774641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1890/3759] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:25 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:16:25.780382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:25.781427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:25.795399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.797559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.800334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:25.802095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:25.802743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:25.803347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.112047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.141674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-436d6d90-4b40-4cae-b8b5-617ef9c98cb8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 1.249389 Oct 18 16:16:26.142393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1870/3760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:24 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:26.161507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:26.162408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:26.176089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.177588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.178248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.180941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.181625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.183592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.239997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.250785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e127a28-88a6-4900-aeb7-20df9e13ad25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.474401 Oct 18 16:16:26.254253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1891/3761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:25 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:26.415260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.434349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-plugged", "status": "completed", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:26.436010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b31a1fa-0a14-4eea-859d-9d9fd5b98908 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.286504 Oct 18 16:16:26.443387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1871/3762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:26 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:26.466214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.467319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.467745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.470344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:26.470516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:26.478097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.482482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.482482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.482482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.482482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.482482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.486835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] Creating event network-vif-plugged:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:16:26.492930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-aa81df2b-4b37-4c4b-8223-c631568a5a58 req-3294c968-1232-4674-9331-9eee2697dcbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063914 Oct 18 16:16:26.493894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1892/3763] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:26.582436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:26.583087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:26.590685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.591435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.592058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.593375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.594475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.595082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.725899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.748467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.750546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.753844 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbb3efba-6dbf-4b16-bc6b-96e409972082 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.174086 Oct 18 16:16:26.756895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1893/3764] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:26 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:16:26.766647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:26.768228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:26.778359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.779413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.781464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.784511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:26.787615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:26.789846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:26.842585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.864516 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf445286-44ba-4941-9a8c-0e55c4246ff8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.398236 Oct 18 16:16:26.866195 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1872/3765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:26 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:26.942184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:26.952867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dad93444-d522-4f78-8b1e-7f81097d283d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1263 microversion: 2.1 time: 0.193809 Oct 18 16:16:26.960478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1894/3766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:26 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:27.056791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f82af632-6629-4f24-858d-ebe76e4c7af4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f82af632-6629-4f24-858d-ebe76e4c7af4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 160 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "337029b8-3a44-4243-882f-158968fa7ad7"}]}} Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': '', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'networks': [{'uuid': '337029b8-3a44-4243-882f-158968fa7ad7'}]}}} Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '' Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:16:27.061148 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:27.072792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f82af632-6629-4f24-858d-ebe76e4c7af4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:27.077323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f82af632-6629-4f24-858d-ebe76e4c7af4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019276 Oct 18 16:16:27.084837 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1873/3767] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:27 2022] POST /compute/v2.1/servers => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:16:27.095060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:27.096628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:27.110010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.111027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.111888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.113358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.114287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.115798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.194770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:27.198678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:27.214727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.216454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.217397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.219524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.220849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.221506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.527921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:27.547167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-213135f2-45b0-42a0-bb23-39752375756d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.363824 Oct 18 16:16:27.547773 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1874/3768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:27 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:27.565027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:27.565915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:27.574695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.575450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.576178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.577077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.577704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.578386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.890225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:27.902241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62a6d236-d919-45ce-be45-3e04afc208f3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.352897 Oct 18 16:16:27.902766 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1875/3769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:27 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:27.924387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:27.930390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:27.931869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:27.947220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.948100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.949102 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0e7c523-2375-4748-b8f8-9ebe007a9ca2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.861702 Oct 18 16:16:27.950008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.950932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:27.951592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:27.952425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:27.960420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:27.972507 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1895/3770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:27 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:27.988332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:27.988332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.002085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.002779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.003379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.004286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.004910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.005521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.140333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.168985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.172946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.177282 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-abf3dfba-c90c-418f-b821-377b6044772f tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.253390 Oct 18 16:16:28.187027 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1876/3771] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:27 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:28.199602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:28.206370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.225063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.225561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.226186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.227095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.227889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.228482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.372634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.385862 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-772db59e-7201-49d1-881f-7d082f57fb5d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1269 microversion: 2.1 time: 0.196237 Oct 18 16:16:28.387477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1877/3772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:28 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:28.585112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:28.587558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.603375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.604450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.605878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.610439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.613244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.613913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.647224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.662530 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f113e417-d0f5-4b11-b1cc-472b6633e166 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.686891 Oct 18 16:16:28.664699 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1896/3773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:27 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:28.688698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:28.689106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 91159ad2-3f54-43d1-bf21-91b19ec418e5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.708222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/91159ad2-3f54-43d1-bf21-91b19ec418e5/action HTTP/1.1 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 14 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: {"shelve": {}} Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '91159ad2-3f54-43d1-bf21-91b19ec418e5', 'body': {'shelve': {}}} Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:28.710533 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 91159ad2-3f54-43d1-bf21-91b19ec418e5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34606685-707d-46ef-82ef-426d47e5bbc8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/91159ad2-3f54-43d1-bf21-91b19ec418e5/action" status: 404 len: 111 microversion: 2.1 time: 0.028129 Oct 18 16:16:28.717175 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1897/3774] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:28 2022] POST /compute/v2.1/servers/91159ad2-3f54-43d1-bf21-91b19ec418e5/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:28.720720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:28.721592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.738025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.739054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.739507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.740743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.741248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.741678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.872341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:28.955877 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17ebfdfc-f924-4be8-b232-86768c945f00 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.385082 Oct 18 16:16:28.958383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1878/3775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:28 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:28.964036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:28.965291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:28.969907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:28.977902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.978796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.979442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:28.980677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:28.981027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:28.981407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.267080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.285767 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7604111d-deca-47ba-b3c3-7b5418b8eab4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.325751 Oct 18 16:16:29.286953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1879/3776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:28 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:29.296372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:29.298042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:29.313117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.314706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.315585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.318152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.319006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.319690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.437122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.456615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.459460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.461597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-74e8dba9-57a1-42ab-a62b-0dd5c39e88fe tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.173271 Oct 18 16:16:29.462179 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1880/3777] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:29 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:29.478612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.496670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:29.497907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:29.509876 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f8a6b8a-2a60-4f3d-8792-b1b6fccf0770 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.792680 Oct 18 16:16:29.510754 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1898/3778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:28 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:29.516200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.517702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.517702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.518321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.519555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.520677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.546958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582ea8a4-b73e-4cb6-9b90-5b3f0664455d", "tag": "b28093cd-c4b6-4f34-a453-53c464e57ab5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:29.567278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.569358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.592240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.624575 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] Creating event network-changed:b28093cd-c4b6-4f34-a453-53c464e57ab5 for instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d on n-h1-858383-14 Oct 18 16:16:29.632219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b707598c-0899-47af-811a-8daeff34619e req-5ff174e6-7bc1-4dce-994e-b0e8a8c54e16 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089744 Oct 18 16:16:29.634607 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1899/3779] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:29.640525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:29.641654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:29.650133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.651215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.651925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.661511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.662710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.663565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.670346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:29.693376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30aac0f5-9ef3-4112-bc6b-e9926cb415e8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1269 microversion: 2.1 time: 0.206335 Oct 18 16:16:29.694904 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1881/3780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:29 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:29.983329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:29.984652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:29.993255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.994103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.994936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:29.995926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:29.996643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:29.997370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.149226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:30.175087 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-602e8f7e-b03d-4eb7-bba4-2573d77eac6f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.536860 Oct 18 16:16:30.175845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1900/3781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:29 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:30.207795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:30.208407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:30.225918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.227998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.228453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.232632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.234086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.234473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.262245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:30.276483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1076b364-2f57-425d-b628-d2773114c951 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.297283 Oct 18 16:16:30.279995 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1882/3782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:29 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:30.315663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lazy-loading 'flavor' on Instance uuid aee72ab8-e58d-4dfe-905b-47a5e377f50b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:16:30.323502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:30.326766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:30.335375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.338219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.338929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.340224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.340897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.342482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.444844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:30.684104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c297df08-c2ee-47af-aeef-c67e19453c79 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.483327 Oct 18 16:16:30.687748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1901/3783] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:30 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:16:30.694863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:30.700647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:30.701567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:30.711238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.712049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.712794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.714505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.715242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.715691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.719258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6fe4eca2-4d3b-4010-8c4f-dab1158a88cc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.403427 Oct 18 16:16:30.733067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1883/3784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:30 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:30.741255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:30.742024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:30.786842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.787411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.787914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:30.794597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:30.795444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:30.795904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.176343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.189613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d81361d-294b-4a69-8309-3100bda5ab91 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.467163 Oct 18 16:16:31.207056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1884/3785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:30 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:31.230398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.231537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:31.244127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.245428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.245984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.247909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.248501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.249206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.262830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.286261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.291370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.294613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-79b67c19-b7cc-4c19-b9dd-93c98329a192 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1365 microversion: 2.47 time: 0.604088 Oct 18 16:16:31.296181 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1902/3786] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:30 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1365 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:31.548499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.567458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-037850b2-25b4-43bd-b8ed-1fd044bee2b3 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.349626 Oct 18 16:16:31.569604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1885/3787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:31.582988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.585270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:31.603265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.605564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.610177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.612773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.613723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.614528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.675691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8d3ce8a-0025-46e3-9e3b-6f4c869e88bd tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.705703 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8d3ce8a-0025-46e3-9e3b-6f4c869e88bd tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.399154 Oct 18 16:16:31.735494 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1903/3788] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:31.743000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a032d9f-0294-4fc2-9c24-be424e104d0c", "name": "network-vif-plugged", "status": "completed", "tag": "36874c11-5d80-4d7c-9b61-aa1cc3fd9d81"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:31.756336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.756846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.757356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.772737 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] Creating event network-vif-plugged:36874c11-5d80-4d7c-9b61-aa1cc3fd9d81 for instance 2a032d9f-0294-4fc2-9c24-be424e104d0c on n-h2-858383-14 Oct 18 16:16:31.783213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-75f051be-3520-47ca-9985-d3dbe529c9d2 req-9a6b43e0-78a8-46fd-a616-9e1202f1d569 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045334 Oct 18 16:16:31.783925 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1904/3789] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:31.791170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3f56cbb-59f3-4831-a2b9-82596b08083e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.835053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3f56cbb-59f3-4831-a2b9-82596b08083e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.046478 Oct 18 16:16:31.850044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1905/3790] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:31.863822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.866129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:31.895100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.896153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.896955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.904595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:31.905495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:31.906036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:31.927639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:31.935852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:31.953580 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af62242c-beaa-42c3-b5f1-6436b81eabfa tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.381457 Oct 18 16:16:31.955246 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1886/3791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:31.970559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-634339fb-25db-4bc4-a085-aee919eede2a tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:31.995399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-634339fb-25db-4bc4-a085-aee919eede2a tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036399 Oct 18 16:16:31.997545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1887/3792] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.019869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11af46b7-0fa6-4db8-b5ff-f9570033a583 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.035759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11af46b7-0fa6-4db8-b5ff-f9570033a583 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023600 Oct 18 16:16:32.036667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1888/3793] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.050189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-05ed1ff7-25a4-48d0-abdb-4b63f9346313 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.080790 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-05ed1ff7-25a4-48d0-abdb-4b63f9346313 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034426 Oct 18 16:16:32.083963 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1889/3794] 10.222.0.78 () {58 vars in 1165 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.100718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d2e0bfe9-83f2-47a7-bc22-89cf0cd6b067 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.110805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d2e0bfe9-83f2-47a7-bc22-89cf0cd6b067 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014098 Oct 18 16:16:32.111755 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1890/3795] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:32.129019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9af8edfe-bda2-48a8-a220-41e0a4ac4436 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.165517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9af8edfe-bda2-48a8-a220-41e0a4ac4436 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.043525 Oct 18 16:16:32.166275 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1891/3796] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:32.183365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f5b5fc7-cc54-4ca3-b8e9-cd10d3b27be6 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.197821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f5b5fc7-cc54-4ca3-b8e9-cd10d3b27be6 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018729 Oct 18 16:16:32.198582 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1892/3797] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:32.216879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d89d3781-93d7-4aea-b8f3-5eb53f1175b1 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.225038 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d89d3781-93d7-4aea-b8f3-5eb53f1175b1 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015754 Oct 18 16:16:32.233899 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1893/3798] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:32.233899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.233899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:32.238651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.239134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.239625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.240331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.240782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.241273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.414382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:32.424717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca1aaa49-3b5d-43ef-8385-7514a7c8bd54 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.196778 Oct 18 16:16:32.426254 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1894/3799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.432753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43077f45-4582-4012-b2a9-ab99e114e76b tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.477195 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43077f45-4582-4012-b2a9-ab99e114e76b tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.049118 Oct 18 16:16:32.477881 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1895/3800] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.481940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:32.495673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b8855c4-abb4-4bcb-8c61-9be780e9c9b5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.644058 Oct 18 16:16:32.507759 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1906/3801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:31 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.513262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.514480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:32.518113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61269ea2-9488-4598-8b62-b647681659f4 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.526939 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61269ea2-9488-4598-8b62-b647681659f4 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017357 Oct 18 16:16:32.527119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.527636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.528087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.528471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1907/3802] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.528876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.533696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.534303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.543394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07dfc1ae-0657-4fc1-8528-2ad7007b242d tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.576728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07dfc1ae-0657-4fc1-8528-2ad7007b242d tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.039744 Oct 18 16:16:32.577337 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1908/3803] 10.222.0.78 () {58 vars in 1144 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.592460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b34b0e55-2ab6-42d2-bf35-d855e9f2dd5c tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.600903 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b34b0e55-2ab6-42d2-bf35-d855e9f2dd5c tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012290 Oct 18 16:16:32.602497 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1909/3804] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.614677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.615295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:32.625029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.631317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.634147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:32.635675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:32.637020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-856ff682-979b-47b9-b0f7-35d2f38479e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1371 microversion: 2.47 time: 0.157994 Oct 18 16:16:32.650018 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1896/3805] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:32.654846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33c9a084-3abd-4461-ba95-af3d45c134cc tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.682167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33c9a084-3abd-4461-ba95-af3d45c134cc tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030962 Oct 18 16:16:32.682992 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1897/3806] 10.222.0.78 () {58 vars in 1148 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.697584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-745c4bba-1f31-4f4f-95ce-5a5d75baf23e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.709447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-745c4bba-1f31-4f4f-95ce-5a5d75baf23e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016011 Oct 18 16:16:32.712019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1898/3807] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.723049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-929232f2-f541-479b-a2dc-5f164a0eedf4 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.732259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-929232f2-f541-479b-a2dc-5f164a0eedf4 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013000 Oct 18 16:16:32.740721 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1899/3808] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:32.745980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d2c9116-500e-4ab2-89d8-b395cd24161e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.774220 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d2c9116-500e-4ab2-89d8-b395cd24161e tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.031374 Oct 18 16:16:32.781605 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1900/3809] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.790653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e8c6bbf-fd9e-4e2d-a790-a878f82bde4b tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.812224 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e8c6bbf-fd9e-4e2d-a790-a878f82bde4b tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025995 Oct 18 16:16:32.825191 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1901/3810] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:32.832767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-355323be-aff9-4971-bfa2-caab77f4e846 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.841345 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-355323be-aff9-4971-bfa2-caab77f4e846 tempest-FlavorsV2TestJSON-1608528909 tempest-FlavorsV2TestJSON-1608528909-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012264 Oct 18 16:16:32.854732 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1902/3811] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:32.980022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:32.980641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:32.988155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.988904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.989650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.990354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:32.990968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:32.991232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:32.999807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:33.015256 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bf252f14-c186-4083-aad3-f9916dc1f7e4 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.404977 Oct 18 16:16:33.037396 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1910/3812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:33.150111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:33.160264 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6a3ed5b-9f1d-45e6-b158-9a22f586b529 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1322 microversion: 2.1 time: 0.184983 Oct 18 16:16:33.161473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1903/3813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:32 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:33.454175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:33.455609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:33.474327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.475241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.475903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.477966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.478672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.479319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.525997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:33.527591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:33.546888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.548019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.549066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.550522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.551624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.552265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.736564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:33.763485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a290730-dcbf-449c-bab7-8782f90c29df tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.304531 Oct 18 16:16:33.765764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1911/3814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:33 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:33.783067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:33.787216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:33.798071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.798701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.799226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.800833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:33.801890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:33.802501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:33.964599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:33.976067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77cdca13-f25b-4d4c-b2e0-24ebc030474d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.457675 Oct 18 16:16:33.976964 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1904/3815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:33 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:33.988903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:34.012794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.013333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.016337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.038736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.043639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] Creating event network-changed:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:16:34.051738 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0d8b619f-91b4-4115-bbbd-a9e5be3aa5b5 req-13bfbb6b-ed07-46a1-83f9-1e42827c7e6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072800 Oct 18 16:16:34.053795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.055676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.056891 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1517501-9ef6-4e1b-b3db-d8f294ea06e1 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1371 microversion: 2.47 time: 0.289439 Oct 18 16:16:34.057660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1905/3816] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:34.063117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:34.064317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1912/3817] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:33 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:34.064507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:34.072897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.073434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.073883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.074789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.075259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.075691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.186430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:34.187310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:34.198577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.199137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.199914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.201264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.201931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.202588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.400741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.410343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb3fdd5f-f963-43b3-9fbb-60b33d4c8a46 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1514 microversion: 2.1 time: 0.228462 Oct 18 16:16:34.411724 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1913/3818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:34 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:34.420279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.432572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5b14aae-0bca-41b4-83bc-7777eb451f15 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.373259 Oct 18 16:16:34.435587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:34.438510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:34.439535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1906/3819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:34 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:34.445914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.446652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.447305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.448197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.448835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.449503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.485143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'flavor' on Instance uuid 2a032d9f-0294-4fc2-9c24-be424e104d0c {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:16:34.617766 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32af7255-4609-400e-b9dc-f9fabfc21598 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action" status: 200 len: 32 microversion: 2.1 time: 0.187278 Oct 18 16:16:34.623086 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1914/3820] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:34 2022] POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 16:16:34.628361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:34.628924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:34.643370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.643935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.644327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.645081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.648068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.648068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.676462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:34.705422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:34.748451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:34.792127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:34.793389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:34.802110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.802597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.803036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.803736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:34.804181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:34.817723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:34.933579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:34.955420 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ec8c96b-6c2d-493c-bf1e-ba17dc0bdf5d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.330809 Oct 18 16:16:34.958939 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1907/3821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:34 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:35.002905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:35.005155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:35.024518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.025696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.028252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.041373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.047094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.049669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.447865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:35.463972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18d61495-4827-458a-b341-92c800e0f972 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.466247 Oct 18 16:16:35.466481 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1908/3822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:34 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:35.487683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:35.488596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:35.507949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.510567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.512472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.514363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.518429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.519855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.545154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:35.559522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d088d042-8e97-425c-9ae4-9c0ba9db390d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.772431 Oct 18 16:16:35.582050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1915/3823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:34 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:35.606606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:35.607287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:35.621659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.623609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.624346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.625463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:35.626698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:35.630722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:35.704470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:35.726422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:35.736587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:35.739555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:35.741518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fac06f20-da2c-4125-a3bf-28b5c36767af tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1371 microversion: 2.47 time: 0.272831 Oct 18 16:16:35.766660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1909/3824] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:35 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:35.987871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:35.993130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:36.014034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.015056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.020162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:36.022226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.024486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.028064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:36.161896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:36.193946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8757e45-8e1f-46dc-85f7-25f830bc9da0 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.608857 Oct 18 16:16:36.195446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1916/3825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:35 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:36.495662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:36.496288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:36.510776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.511262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.511890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:36.513474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.514125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.514728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:36.521664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:36.531000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a526f3e-4184-49a0-b00a-1d74e30fe14b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.549253 Oct 18 16:16:36.546045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1910/3826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:35 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:36.598166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:36.599690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:36.611657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.612801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.613726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:36.615013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:36.615998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:36.617563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.265533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.289964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa47ae46-377f-4211-833d-1ada453dd13d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.799024 Oct 18 16:16:37.291035 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1917/3827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:36 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:37.300052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:37.301276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:37.315145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.316051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.316841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.318173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.319019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.319872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.433747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.446870 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-913661bc-0c0d-4d4d-8743-a14caff7ffb0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.857839 Oct 18 16:16:37.471013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.473117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1911/3828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:36 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:37.484830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.486299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.486922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:37.487943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:37.488782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bc3a956-8ad0-4186-8a7e-e3d52eb15dfa tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1356 microversion: 2.47 time: 0.196370 Oct 18 16:16:37.489417 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1918/3829] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:37 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:37.501162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.502317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.503292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.505149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.506376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.507883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.522528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:37.536862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.538025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Searching by: {'deleted': False, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:16:37.550429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.551412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.552006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.552912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.553647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.554962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.778345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:16:37.919468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:37.934763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22050e65-d775-4cec-afe8-ba51a58851b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.458793 Oct 18 16:16:37.935661 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1912/3830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:37 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:37.941163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:37.941980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:37.952809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.953612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.954244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:37.955096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:37.955691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:37.956603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.050429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:38.069213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.069618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.070691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.109746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:38.111930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:38.196259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:38.204594 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-961927a5-e4a4-4551-8e0e-1a524b938dca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.267315 Oct 18 16:16:38.205835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1913/3831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:37 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:38.281573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5bfac09c-309d-4ecd-b627-92cc08244aac tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.762973 Oct 18 16:16:38.282846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1919/3832] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 18 16:16:37 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:16:38.316979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:38.317510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:38.324398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.329897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.330353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.331107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.331536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.331959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.393985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:16:38.443871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-855675138", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:38.562532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:38.611664 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e932065d-2e0c-46b0-8edd-12760997fb8e tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 204 len: 0 microversion: 2.47 time: 0.295992 Oct 18 16:16:38.614670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1920/3833] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:16:38 2022] DELETE /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 16:16:38.626811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:38.627525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:38.637622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.638180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.638619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.639328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.639776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.640198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.716065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:39.058756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:39.070528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17ef79a8-2106-4e0b-9053-ca9d80f53678 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.451679 Oct 18 16:16:39.071441 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1921/3834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:38 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:39.079740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:39.084717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:39.101818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.102477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.103133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.104000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.104570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.112139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.222134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:39.222906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:39.223709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:39.224423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:39.225116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:39.238568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.239700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.240382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.243174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.244539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.245281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.288358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:39.308140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:39.334137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:39.339587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:39.411137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-870077a2-27fb-4cf3-8808-d003912d9fdf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180311 Oct 18 16:16:39.412375 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1914/3835] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:39.426032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:39.427383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:39.448481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.453905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.476423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.483937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.488536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.490964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.675737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:39.696094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:39.698530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:39.700101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1427e8da-fa8a-448c-8967-9c66bf3e1253 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1362 microversion: 2.47 time: 0.286187 Oct 18 16:16:39.702571 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1915/3836] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:39 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:39.709276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:39.710235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:39.730712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.740860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.741701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.742834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:39.743535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:39.744523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:39.941474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:39.957767 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec3bf7b5-2680-48fd-accc-a26ef5fd7305 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.882658 Oct 18 16:16:39.961924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1922/3837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:39 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:39.973130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:39.980021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:40.019948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.025767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.026569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.030531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.035628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.037352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.055588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.067958 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dae6f03-1469-475c-bb6c-5bbb94b50862 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.363966 Oct 18 16:16:40.073468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1916/3838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:39 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:40.087331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98003ca9-02bd-4cc0-9df9-d1eb0483621e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:40.088005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98003ca9-02bd-4cc0-9df9-d1eb0483621e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:40.174125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98003ca9-02bd-4cc0-9df9-d1eb0483621e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.196232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98003ca9-02bd-4cc0-9df9-d1eb0483621e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1192 microversion: 2.1 time: 0.118425 Oct 18 16:16:40.214865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1917/3839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:40 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1192 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:40.246818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:40.251672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:40.267692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.268574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.269739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.276049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.277389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.279322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.566705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.581807 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03fff679-96ed-4fc1-a1cd-77e1007a4124 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.364941 Oct 18 16:16:40.583239 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1918/3840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:40 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:40.683428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.702265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d07ac31-a426-4277-8ee2-6e66eacfbd14 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.731099 Oct 18 16:16:40.719054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1923/3841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:39 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:40.735859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:40.738486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:40.765083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.776590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.777835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.780567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:40.781542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:40.784946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:40.933397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.956517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.968951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:40.971960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d887afa2-41bc-4e29-8011-07cbb5f3de0a tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1362 microversion: 2.47 time: 0.242411 Oct 18 16:16:40.989427 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1919/3842] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:40 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:40.993664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:40.994892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:41.020001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.020496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.021154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.021881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.022353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.022833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.100560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:41.101769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:41.107239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:41.129369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.129901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.135687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.136482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.139124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.141838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.432727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:41.444759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eceea034-fa66-43f6-896b-3f88b365bc37 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.348596 Oct 18 16:16:41.461962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1920/3843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:41 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:41.467753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:41.468703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:41.482304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.482821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.483298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.484324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.484810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.485316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.614849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:41.629384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d945bfd2-3215-434e-a1ab-2a2ae5645a43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1244 microversion: 2.1 time: 0.165810 Oct 18 16:16:41.630541 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1921/3844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:41 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1244 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:41.644917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:41.646004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:41.659444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.660223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.661232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.662677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.664692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.666898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.821522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:41.842342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6bd2585b-7170-4271-a86b-705656cc18de tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.853560 Oct 18 16:16:41.844115 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1924/3845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:40 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:41.850380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:41.851430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:41.868455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:41.874742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.875260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.875707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.882101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:41.888256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:41.888712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:41.891113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:41.904023 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db36b4e8-3822-4c09-a68d-6bc97b90e32b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.271894 Oct 18 16:16:41.905442 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1922/3846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:41 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:42.032598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:42.034233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:42.050194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.052290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.055371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.060002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.062628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.067220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.249301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.261755 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37361c38-ffcd-43de-9158-cbfbcec59459 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.415588 Oct 18 16:16:42.269189 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1925/3847] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:41 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:42.378295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.394473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.396090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.398821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d1958a7-4b88-4b68-a6fc-efa6356797f0 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1362 microversion: 2.47 time: 0.372519 Oct 18 16:16:42.399568 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1923/3848] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:42 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:16:42.475862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:42.476805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:42.484762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.486369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.487033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.487992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.488667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.489377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.668564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:42.677647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:42.693352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.693851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.694282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.695832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.696291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.696716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.863402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.876402 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf6683eb-28d6-40e7-9a7f-f4dc66505665 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1262 microversion: 2.1 time: 0.210291 Oct 18 16:16:42.879527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1924/3849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:42 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1262 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:42.897521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:42.899196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:42.911685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.912188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.912627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.913457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:42.918413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:42.924113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:42.982118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:42.997423 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c537fc9a-8179-4dcb-bf4b-cf1fd8e36878 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.526186 Oct 18 16:16:42.998718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1926/3850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:42 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:43.017691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:43.018674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:43.029983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.030811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.036326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.037842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.039254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.040060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.311220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.325468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.326096 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f3a349b-c55f-4bae-b8da-0aea69844120 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.321165 Oct 18 16:16:43.327258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1927/3851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:42 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:43.338125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:43.339096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:43.347489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:43.362053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.363520 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9de5256-f76c-460f-861c-4394e9b9541c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.480334 Oct 18 16:16:43.364349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.365540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.366813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.367119 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1925/3852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:42 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:43.367836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.368486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.435637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:43.436672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:43.464787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.466171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.468324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.469760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.474246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.474937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.629805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.648245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.651785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.653512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db672765-f97c-4414-a479-75a53b0e6fbb tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 200 len: 1362 microversion: 2.47 time: 0.228034 Oct 18 16:16:43.669049 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1926/3853] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:43 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:43.810051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:43.827921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8df524b0-4f40-4284-b248-9e159a81fc4c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.499334 Oct 18 16:16:43.829247 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1928/3854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:43 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:43.918273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:43.922775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:43.937626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.938927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.940545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:43.942484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:43.945827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:43.946918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.040087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:44.043929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:44.079329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.080102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.080857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.082170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.083283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.084287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.126051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:44.143609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ff1ae0f-b70c-4164-a4e3-5f7747a93008 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1250 microversion: 2.1 time: 0.241876 Oct 18 16:16:44.145075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1927/3855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:43 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1250 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:44.362489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:44.364521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:44.395144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.395568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.396450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.396751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.397255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.397775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.914009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:44.934021 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa6f55e3-a934-4228-9379-6c3fb9ea1c85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.577727 Oct 18 16:16:44.951658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1928/3856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:44 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:44.957852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:44.958916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:44.970223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.971972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.972641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:44.973613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:44.974340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:44.975345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.038997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:45.063958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-389120c0-ed7e-4bfb-b894-49af0d2663b7 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 1.030779 Oct 18 16:16:45.092344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1929/3857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:44 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:45.111963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.114887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 6222c8b8-c292-4f5d-a964-d1bdc1c76a13] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.131864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.137912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.139044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.141629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.142142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.142599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.168688 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] HTTP exception thrown: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Request method failure captured: Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 HTTP/1.1 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtErxAFJO_HWZycAUUw15wvYAFlg9hCvt5tbIkwU0zEGtCcRd49DbNr3gVm2c7zWwfAyowuKMgRlcfKVhD1t4nyusFK-9jy5w8Z0XctIHdc1mDs3KFv7-mCZ964kWl3p178EW1viY2865h75Y-Fo7J2OCrKtM8hhqhJFSMWBNymmEo4 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 20d7bce2e1f94ba98eda27d65b4fd20b Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20d7bce2e1f94ba98eda27d65b4fd20b"}]}] Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 20d7bce2e1f94ba98eda27d65b4fd20b Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerShowV247Test-1329335743-project Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4563ea21e17d4d9da3a2e10d64f7351c Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerShowV247Test-1329335743-project Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6222c8b8-c292-4f5d-a964-d1bdc1c76a13'} Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:45.170916 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. Oct 18 16:16:45.176414 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:45.178006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Returning 404 to user: Instance 6222c8b8-c292-4f5d-a964-d1bdc1c76a13 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:45.179895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e4dd143-2a51-4507-ae76-0c282fdb10c9 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13" status: 404 len: 111 microversion: 2.47 time: 0.083316 Oct 18 16:16:45.184591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1930/3858] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:45 2022] GET /compute/v2.1/servers/6222c8b8-c292-4f5d-a964-d1bdc1c76a13 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:16:45.191404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.192227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.202385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.203147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.203764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.204699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.205381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.207081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.484688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:45.510085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5aca548b-3543-4f3c-8bf0-2365369258a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.555906 Oct 18 16:16:45.513953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1929/3859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:44 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:45.529951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.534917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.558696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.559891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.563163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.564620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.568673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.569932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.580526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:45.601099 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c60f262-e7d3-434e-8c67-84861642abcf tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.414805 Oct 18 16:16:45.611721 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1931/3860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:45 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:45.618713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.630217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.649104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.649797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.650489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.651462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.652057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.653397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.709910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:16:45.915738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fcab7b9a-7a98-41e5-a2a7-c13af894337c tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 204 len: 0 microversion: 2.47 time: 0.301106 Oct 18 16:16:45.916860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1932/3861] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:16:45 2022] DELETE /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:16:45.940941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.942496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.957998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.959336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.960679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.961758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.962811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.963660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:45.965812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.004333 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f5bdea0-a66e-4e73-b078-8b645495c32a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.487714 Oct 18 16:16:46.005015 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1930/3862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:45 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:46.018994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:46.020151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:46.049763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.051492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.052474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.054604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.055687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.056642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.269828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.283582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.285112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.292413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd5d6abc-b383-4749-8bd0-534ef1d257be tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 200 len: 1361 microversion: 2.47 time: 0.370161 Oct 18 16:16:46.295087 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1933/3863] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:45 2022] GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:46.306487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:46.312575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:46.330652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.338337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.339021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.340003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.340661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.341373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.437686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.449978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c50e70bc-5d0b-4527-b4ac-7865bd79e4e3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.443107 Oct 18 16:16:46.451189 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1931/3864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:46 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:46.569331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-plugged", "status": "completed", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:46.581013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.581699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.582302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.611276 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] Creating event network-vif-plugged:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:16:46.621692 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-16bd28ad-9b4e-4238-bbba-914b58b8048e req-be59b195-2db1-4265-ba00-076fc1c6f94f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168668 Oct 18 16:16:46.628585 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1932/3865] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:46.635970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:46.637632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:46.647072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.648681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.649221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.649996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.650548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.651025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.868193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.877727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-009f4802-84fd-4e19-9db5-3af28d9f7c33 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.247344 Oct 18 16:16:46.893041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1933/3866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:46 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:46.893041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:46.893041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:46.900913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.901870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.904022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.905262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.907071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.907837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.980179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.998954 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b5c59d1-7b29-4360-a88a-a7d23fcdb5d9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.702192 Oct 18 16:16:47.001891 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1934/3867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:46 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:47.119147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-19b2a4d8-d99a-4318-a318-ac701754090b tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Action: 'create', calling method: .version_select at 0x7f5fd11c8280>, body: {"pool": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:47.146082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.155815 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84bd0dd3-2404-4237-84ea-43ce8d6365c1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.275247 Oct 18 16:16:47.156415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1934/3868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:46 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:47.170402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:47.172134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:47.186805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.187603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.188239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.189280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.189914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.190515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.405979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.416295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddf66974-ba8e-4d51-b1e6-2cb4311beaf7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.257277 Oct 18 16:16:47.417180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1935/3869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:47 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:47.422683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:47.422683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:47.434312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.435567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.436794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.437853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.438502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.439215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.550217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.562414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.566343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.570174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b75c1dd-5fa1-42bd-8e4b-09ae3539b978 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 200 len: 1361 microversion: 2.47 time: 0.149930 Oct 18 16:16:47.571862 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1936/3870] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:47 2022] GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:47.579978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:47.580783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:47.589351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.591436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.592907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.594432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.595241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.595979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.619456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:47.776709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.793261 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e6da13d-dc10-4486-bbcf-1e7c44c5050c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.216676 Oct 18 16:16:47.794821 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1937/3871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:47 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:47.918067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:47.918685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:47.926810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.927174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.927727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.929755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.930352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.930850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.028450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:48.134244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:48.145273 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd138cd5-69de-4b8c-b0f8-726798521032 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.229171 Oct 18 16:16:48.145273 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1938/3872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:47 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:48.151015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0e6a7f-e88b-41e8-a473-c02a113946a2", "tag": "45e269eb-28a2-4c34-9421-64ec536a58d0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:48.161970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.162741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.163893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.184128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] Creating event network-changed:45e269eb-28a2-4c34-9421-64ec536a58d0 for instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 on n-h2-858383-14 Oct 18 16:16:48.189535 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c6fb1701-3ad6-4108-9978-acae6ebd862b req-b3d52265-6485-4ab8-9803-ea74e0ed9311 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044889 Oct 18 16:16:48.190777 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1939/3873] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:48.197808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:48.198597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:48.210895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.211393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.211866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.212642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.213142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.213570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.387429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:48.399922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f436d1cf-beb4-442c-ad34-f7d28cccfa30 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1311 microversion: 2.1 time: 0.207362 Oct 18 16:16:48.400528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1940/3874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:48 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:48.417745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:48.418522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:48.425151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.425653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.426095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.431470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.432091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.432621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.593726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:48.605662 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b6d8aef-4690-4559-a928-2d51d2024415 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.203990 Oct 18 16:16:48.606486 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1941/3875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:48 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:48.619872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:48.620476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:48.627420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.627910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.628341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.629143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.629600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.630021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.818677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:48.829331 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6f69463-9b03-4c84-8e7f-29d54d4a6a0d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.221691 Oct 18 16:16:48.851974 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1942/3876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:48 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:48.858247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:48.859287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:48.867200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.867987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.868469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.869425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.869879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.870819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.986897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:48.989370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:49.001877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.003543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4563ea21e17d4d9da3a2e10d64f7351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d7bce2e1f94ba98eda27d65b4fd20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.005464 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f177994-ca01-4a34-85c9-1878a5fd7f46 tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 200 len: 1361 microversion: 2.47 time: 0.151782 Oct 18 16:16:49.019387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1943/3877] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:48 2022] GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:16:49.037083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:49.038173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:49.046468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.047308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.048161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.049138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.049947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.050447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.271469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.277436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:49.309224 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e4fdcf5-1372-4027-8254-4ffb974cea01 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.282584 Oct 18 16:16:49.324270 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1944/3878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:49 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:49.324270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:49.324270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:49.351138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.351730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.354951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.355315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.356959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.358485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.683261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.713238 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b88bd1b2-19ba-4bfc-b8b5-5ebfed52d081 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.395624 Oct 18 16:16:49.714387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1945/3879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:49.727529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:49.728630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:49.739770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.741378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.744176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.745871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.746993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.749254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.885972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-19b2a4d8-d99a-4318-a318-ac701754090b tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.872217 Oct 18 16:16:49.887570 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1935/3880] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:16:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:49.893365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582ea8a4-b73e-4cb6-9b90-5b3f0664455d", "name": "network-vif-plugged", "status": "completed", "tag": "b28093cd-c4b6-4f34-a453-53c464e57ab5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:49.905106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.905785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.906260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.923607 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] Creating event network-vif-plugged:b28093cd-c4b6-4f34-a453-53c464e57ab5 for instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d on n-h1-858383-14 Oct 18 16:16:49.936281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fa4c68e5-41c3-4e56-bbf9-77cf4fd3e72e req-ee467cb1-1e92-4d1a-be77-f73d9fe62fcb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046825 Oct 18 16:16:49.943494 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1936/3881] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:49.954129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:49.955071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:49.967965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.968878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.969598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.970354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:49.971153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:49.972019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.983402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.996515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bf9adc1-32b8-442a-89b6-32f7708e18b2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1461 microversion: 2.1 time: 0.280645 Oct 18 16:16:50.001225 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1946/3882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:49 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1461 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.003922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.005451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.014129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.014708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.015155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.015872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.016339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.016773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.172587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:50.183430 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ded0714b-67fb-4098-8d2f-5c756b570ab0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.237069 Oct 18 16:16:50.183972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:50.200052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1937/3883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:49 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.201798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4927175-8bd0-493b-aefa-14dc2eb90a2f tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd12c6310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.267535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:50.283610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5185dce8-6d1d-4a04-aef9-cdaf6a207873 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.283440 Oct 18 16:16:50.284464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1947/3884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:49 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.294338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.295182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.302260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.303069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.303725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.304653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.305446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.306052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.548707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bae53b59-050e-449f-9a2f-4b228772f65d tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1614 microversion: 2.1 time: 0.261449 Oct 18 16:16:50.549345 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1948/3885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1614 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.565916 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4927175-8bd0-493b-aefa-14dc2eb90a2f tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/d9230dd8-3aea-4e06-a53c-dd8addb5cfc2" status: 200 len: 141 microversion: 2.1 time: 0.377819 Oct 18 16:16:50.566516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1938/3886] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/os-floating-ips/d9230dd8-3aea-4e06-a53c-dd8addb5cfc2 => generated 141 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:50.571705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.572370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] [instance: 13cc1807-dccf-496f-b987-fc44e1f96f01] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.572486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.573206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.580638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.581804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.582254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.582977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.583441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.583873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.584009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.584419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.585137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.585857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.586311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.586737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.603059 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] HTTP exception thrown: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Request method failure captured: Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 HTTP/1.1 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtErxAFJO_HWZycAUUw15wvYAFlg9hCvt5tbIkwU0zEGtCcRd49DbNr3gVm2c7zWwfAyowuKMgRlcfKVhD1t4nyusFK-9jy5w8Z0XctIHdc1mDs3KFv7-mCZ964kWl3p178EW1viY2865h75Y-Fo7J2OCrKtM8hhqhJFSMWBNymmEo4 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 20d7bce2e1f94ba98eda27d65b4fd20b Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_20d7bce2e1f94ba98eda27d65b4fd20b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20d7bce2e1f94ba98eda27d65b4fd20b"}]}] Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 20d7bce2e1f94ba98eda27d65b4fd20b Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerShowV247Test-1329335743 Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerShowV247Test-1329335743-project Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4563ea21e17d4d9da3a2e10d64f7351c Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerShowV247Test-1329335743-project Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '13cc1807-dccf-496f-b987-fc44e1f96f01'} Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:50.604910 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] Returning 404 to user: Instance 13cc1807-dccf-496f-b987-fc44e1f96f01 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f4631899-bd79-4d5b-b3b3-bf5eaa78d75b tempest-ServerShowV247Test-1329335743 tempest-ServerShowV247Test-1329335743-project] 10.222.0.78 "GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01" status: 404 len: 111 microversion: 2.47 time: 0.038976 Oct 18 16:16:50.610748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1949/3887] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/servers/13cc1807-dccf-496f-b987-fc44e1f96f01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:16:50.611592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b66020a-d6d7-468c-abc1-02ef16c8545a tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd2a7ea60>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.826714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:50.837567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:50.843823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72a3168e-c036-4109-b658-39039b31a9ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1315 microversion: 2.1 time: 0.275696 Oct 18 16:16:50.844471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1939/3888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.864381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:50.865421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.875467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.876363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.877244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.878892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.879608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.880259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.991051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8252ee4a252a44e9ae8794892bfadaea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c378fdcfd8543489f0b99fda82d836b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:51.003870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] flavor_id is None. Assuming migration. {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 16:16:51.003870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:16:51.285127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-def391d8-49c9-47bc-9cbb-e9a810ba5150 tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17/action" status: 202 len: 0 microversion: 2.1 time: 0.437409 Oct 18 16:16:51.292018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1940/3889] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:50 2022] POST /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:51.300216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:51.302493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:51.313616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.314202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.314835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.315842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.316461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.317146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.393378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b66020a-d6d7-468c-abc1-02ef16c8545a tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.785395 Oct 18 16:16:51.395596 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1950/3890] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:51.401666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:51.403292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:51.411739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.412626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.413861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.415579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.416252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.417613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.626444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:51.638336 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb4e6cbe-342e-4c87-bc4c-07e72573dd97 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.241383 Oct 18 16:16:51.639102 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1951/3891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:51 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:51.645005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:51.645977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:51.655733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.657297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.658027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.658981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.659714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.660363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.818673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:51.838410 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9f3af1a-61f6-4748-8e83-cbb58fdd8df0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.544203 Oct 18 16:16:51.842020 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1941/3892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:51 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:51.850091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:51.851478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:51.860971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.862053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.862900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.864424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.865572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.867154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.996720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:52.004889 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e92bcd0-52db-4442-91c9-bcc4fec3ceff tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1470 microversion: 2.1 time: 0.364438 Oct 18 16:16:52.010544 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1952/3893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:51 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:52.017673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d80beb3-9971-4dcc-912d-a9debcb7b4cd tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd21748b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.025779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:53.042305 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-262eb9f1-95bc-4991-b024-6b6654131fe5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 1.197258 Oct 18 16:16:53.057778 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1942/3894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:51 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:53.061361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.065327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:53.097862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.098641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.099269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.100366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.106085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.108019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.505711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:53.525731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-439d6777-6ca9-4feb-b300-67ea7039b872 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1501 microversion: 2.1 time: 0.478063 Oct 18 16:16:53.546356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1943/3895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:53 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1501 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:53.565639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.566482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:53.587862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.588371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.588817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.589656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.590039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.590699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.665495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d80beb3-9971-4dcc-912d-a9debcb7b4cd tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/d9230dd8-3aea-4e06-a53c-dd8addb5cfc2" status: 202 len: 0 microversion: 2.1 time: 1.653224 Oct 18 16:16:53.667019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1953/3896] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:16:52 2022] DELETE /compute/v2.1/os-floating-ips/d9230dd8-3aea-4e06-a53c-dd8addb5cfc2 => generated 0 bytes in 1655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:53.696921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.698235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:53.727717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.728228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.728684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.729473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.730023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.730778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.860482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:53.871977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef71f0f7-2209-4484-a541-8555086d8022 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.323678 Oct 18 16:16:53.885789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1944/3897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:53 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:53.894476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.895120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:53.901955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.902468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.902903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.903755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.904112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.904554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:54.027149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:54.035899 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4380072d-fa29-4562-be70-4cb4f74ffacf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1533 microversion: 2.1 time: 0.366800 Oct 18 16:16:54.036916 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1954/3898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:53 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1533 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:54.043980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:54.044754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:54.051378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.052111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.052717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:54.053809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.054606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.055545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:54.108114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:54.118354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9557799b-1d6d-49d7-bcee-edac145c7578 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1470 microversion: 2.1 time: 0.231181 Oct 18 16:16:54.119262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1945/3899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:53 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:54.124642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc00a6d4-9cfb-403b-9db6-3c146e170a41 tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Action: 'create', calling method: .version_select at 0x7f5fd12adf70>, body: {"pool": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:54.277249 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Removing security group dd3fb70f-9f7c-4240-8381-3138b79eed0c from port b28093cd-c4b6-4f34-a453-53c464e57ab5 Oct 18 16:16:54.868131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c35519e5-3086-4506-916d-dad19fa025ac tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d/action" status: 202 len: 0 microversion: 2.1 time: 0.829645 Oct 18 16:16:54.875551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1955/3900] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:54 2022] POST /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:54.889073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:54.890670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:54.919929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.921303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.922373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:54.927483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.934243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.942320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.204694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:55.217245 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd11afe7-7c2f-43f7-bb5e-91d854eb5e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.336304 Oct 18 16:16:55.217245 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1956/3901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:54 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:55.223574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:55.225018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:55.239209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.240549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.241765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.243657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.244630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.245361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.369293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:55.380413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f4f83b3-dffd-4bae-8baa-4b16f1ff3515 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1459 microversion: 2.1 time: 0.163198 Oct 18 16:16:55.381033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1957/3902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:55 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:55.387666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:55.388608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:55.395383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.396438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.397171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.398451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.399138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.399723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.728107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:55.756676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fc1114e-ae0f-4290-8b61-37a2532794f0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.373623 Oct 18 16:16:55.766186 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1958/3903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:55 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:55.774112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582ea8a4-b73e-4cb6-9b90-5b3f0664455d", "tag": "b28093cd-c4b6-4f34-a453-53c464e57ab5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:55.806114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.819305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.820724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.854930 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] Creating event network-changed:b28093cd-c4b6-4f34-a453-53c464e57ab5 for instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d on n-h1-858383-14 Oct 18 16:16:55.874459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7fb8ad03-44c1-4368-911a-394a5a830803 req-970d299e-f20d-49a3-acdd-1adcd6ca3fdc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105428 Oct 18 16:16:55.877094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1959/3904] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:55.896202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:55.898174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:55.919274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.920885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.922375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.925608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:55.927260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:55.928067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.187307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:56.209632 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-078bf9fc-7e0b-481e-8248-a761f1541a16 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1533 microversion: 2.1 time: 0.329634 Oct 18 16:16:56.210870 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1960/3905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1533 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:56.216780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.217834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:56.226663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.227447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.228175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.229284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.230054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.233025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.452626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:56.462590 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60873576-37bd-42ba-85b4-251c6b8a6a12 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.250199 Oct 18 16:16:56.463183 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1961/3906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:56.469194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.470197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:56.477509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.478522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.479130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.480078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.480798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.481447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.657479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:56.669923 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1991cfef-a12f-42d8-bb73-935b3c10ce88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.205441 Oct 18 16:16:56.670773 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1962/3907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:56.682030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0e6a7f-e88b-41e8-a473-c02a113946a2", "name": "network-vif-plugged", "status": "completed", "tag": "45e269eb-28a2-4c34-9421-64ec536a58d0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:56.700126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.700851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.702101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.722457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] Creating event network-vif-plugged:45e269eb-28a2-4c34-9421-64ec536a58d0 for instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 on n-h2-858383-14 Oct 18 16:16:56.730204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fd37030c-763d-4579-a26e-de2c38563cfa req-a86653ad-0487-4ee5-a788-1644caf17a8d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056726 Oct 18 16:16:56.731378 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1963/3908] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:56.738337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.739757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:56.748403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.748893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.749720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.750434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.751064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.751654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.865609 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc00a6d4-9cfb-403b-9db6-3c146e170a41 tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.744950 Oct 18 16:16:56.867413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1946/3909] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:16:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:56.876200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.878342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:56.891142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.892304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.893042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.894687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.895577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.896210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.978394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:56.982699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:56.991838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28e884a9-6d9d-4134-839f-1704e42ae622 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.258825 Oct 18 16:16:56.992865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1964/3910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:56.997516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.998132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:57.006087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.006087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.006507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.008040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.008721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.009458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.205901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.212917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.217227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc9fb8f8-d793-4f31-90a0-9d5de5bb44a4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.223303 Oct 18 16:16:57.218178 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1965/3911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.222910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88723eaa-42c7-477d-ab34-8d3960264e66 tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd19d1820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.226932 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a70f5342-c536-4efb-89e1-87113db20835 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.358201 Oct 18 16:16:57.228425 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1947/3912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.242759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.243948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:57.252212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.252719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.253201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.253931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.254394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.254827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.447371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.455943 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01fb12e6-7d0c-4a96-99ab-2245b3403cff tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1533 microversion: 2.1 time: 0.218625 Oct 18 16:16:57.457053 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1948/3913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:57 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1533 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.463184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.464047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:57.470864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.471602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.472248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.473148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.473764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.474364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.717536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.728486 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0961e5ca-eec7-4ff2-9c1f-96e78a0dbefc tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.270112 Oct 18 16:16:57.729705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1949/3914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:57 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.735464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.736463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:57.748304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.749858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.751653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.752654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.753171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.753631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.976900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.986000 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-961542b9-2a4e-4911-ad0c-a620bc4209b8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.254894 Oct 18 16:16:57.986599 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1950/3915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:57 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.993185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.994191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:58.014517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.015398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.021751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.023132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.023970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.024434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.247999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:58.258371 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a533d9bb-d857-4d09-8d3c-d3a9d2a0dc29 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.270647 Oct 18 16:16:58.259193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1951/3916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:57 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:58.265704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.265704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:58.271214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.272017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.273625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.274583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.275225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.275821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.298201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88723eaa-42c7-477d-ab34-8d3960264e66 tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2" status: 202 len: 0 microversion: 2.1 time: 1.078429 Oct 18 16:16:58.299238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1966/3917] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:16:57 2022] DELETE /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:16:58.315160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.315160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:58.318068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.318897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.319702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.320755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.321404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.322117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.501930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:58.521191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95aa4db5-6873-40ad-a45c-0239748bdc7e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1292 microversion: 2.1 time: 0.259949 Oct 18 16:16:58.523282 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1952/3918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:58 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:58.538739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd12cbe50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.544488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:58.553365 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d56fef27-bcfd-4b3f-905f-8eca56c18560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.252764 Oct 18 16:16:58.554241 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1967/3919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:58 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:58.559455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-46541021", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b4a50421-5452-4e65-84ea-78b361222489"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:58.616542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 could not be found", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:16:58.618025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] HTTP exception thrown: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Request method failure captured: Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 HTTP/1.1 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFuSXCP_nl1-QPTYx7BoH2IpRAff20x4dOORFgoOgkntIh_5flWbDHs5LGroaKw2zjMoZ6yJL-DHYteSCKW_sq0tM8z2XbgYay0u4bOCeFltuO0XppvV00rSvlbmKdIx_5xUDDvojsBUchTWVswBxguL4lKoiwn4fmRGh-yb1FaexY Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 676b034a9d2542e8899af31605f2b7fe Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/676b034a9d2542e8899af31605f2b7fe"}]}] Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 676b034a9d2542e8899af31605f2b7fe Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsTestJSON-799165084-project Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: cfc3e5f2e86f41a69e3179c1c246d3a7 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsTestJSON-799165084-project Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: exception: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd345ed90-c9a7-45d4-84ae-abc78e7b5bc2'} Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 could not be found Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4422879e-40d9-46a8-9887-f8cdd3d8a8dd'] Oct 18 16:16:58.620160 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2. Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Returning 404 to user: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:58.624510 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b84b8111-62a6-4786-9598-e201cf1b2bbb tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2" status: 404 len: 111 microversion: 2.1 time: 0.097131 Oct 18 16:16:58.629300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] validate_networks() for [('b4a50421-5452-4e65-84ea-78b361222489', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:16:58.629499 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1953/3920] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:16:58 2022] GET /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:58.630438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.631296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:58.642692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.643806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.644641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.645701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.646315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.646900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.880315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:58.892227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb1268f2-9ce1-41bb-8c6b-3d1704c9dd15 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1533 microversion: 2.1 time: 0.267663 Oct 18 16:16:58.892919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1954/3921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:58 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1533 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:58.898286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Calling method '.version_select at 0x7f5fd11c88b0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.989122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 could not be found", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:16:58.992620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] HTTP exception thrown: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Request method failure captured: Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 HTTP/1.1 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFuSXCP_nl1-QPTYx7BoH2IpRAff20x4dOORFgoOgkntIh_5flWbDHs5LGroaKw2zjMoZ6yJL-DHYteSCKW_sq0tM8z2XbgYay0u4bOCeFltuO0XppvV00rSvlbmKdIx_5xUDDvojsBUchTWVswBxguL4lKoiwn4fmRGh-yb1FaexY Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 676b034a9d2542e8899af31605f2b7fe Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_676b034a9d2542e8899af31605f2b7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/676b034a9d2542e8899af31605f2b7fe"}]}] Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 676b034a9d2542e8899af31605f2b7fe Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsTestJSON-799165084 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsTestJSON-799165084-project Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: cfc3e5f2e86f41a69e3179c1c246d3a7 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsTestJSON-799165084-project Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: exception: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd345ed90-c9a7-45d4-84ae-abc78e7b5bc2'} Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 could not be found Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8684ba7-f8b4-44c4-a64c-38a4b44e24c6'] Oct 18 16:16:58.994874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2. Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] Returning 404 to user: Floating IP not found for ID d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26f822e0-9f4f-4ebd-9066-e5ba765c0aad tempest-FloatingIPsTestJSON-799165084 tempest-FloatingIPsTestJSON-799165084-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2" status: 404 len: 111 microversion: 2.1 time: 0.102527 Oct 18 16:16:59.001192 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1955/3922] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:16:58 2022] DELETE /compute/v2.1/os-floating-ips/d345ed90-c9a7-45d4-84ae-abc78e7b5bc2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:59.025789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:59.029931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:59.052523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.055363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.056303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.059119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.060134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.063801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.266371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:59.266816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:59.267569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:59.270330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:59.270756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:59.285914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.286395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.287022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.289343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.290458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.291224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.315505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:59.322803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Getting quotas for user f3bfadddfac24b69b7ae873925514f1a and project 6e1607209530428891cc7f9b2406e42c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:59.336836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:59.339139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:59.342550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:59.405255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-588c9b60-f813-41c4-b25d-f02ab9e65811 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849630 Oct 18 16:16:59.406503 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1968/3923] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:59.420560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5745a6f4-4eff-45db-89ba-c2b5d98291e7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:59.422958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5745a6f4-4eff-45db-89ba-c2b5d98291e7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:59.534577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:59.559937 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4e8a239-d54f-47d0-a65a-f9b7cf6be1ae tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.544356 Oct 18 16:16:59.560953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1956/3924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:59 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:59.582182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:59.588782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5745a6f4-4eff-45db-89ba-c2b5d98291e7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:59.618407 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5745a6f4-4eff-45db-89ba-c2b5d98291e7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1213 microversion: 2.1 time: 0.199095 Oct 18 16:16:59.623361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1969/3925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:59 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:59.660186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.661012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.661965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.674325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:59.676799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:59.685255 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] Creating event network-vif-plugged:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:16:59.691239 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-adf31bf8-613d-475c-a648-63625dccfd73 req-4cf953aa-01ef-42dc-a163-9a50df9fdaf9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121608 Oct 18 16:16:59.692455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1957/3926] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:59.699852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:59.700817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:59.707727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.708512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.709159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.710785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.711419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.712207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.731215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.732601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.739892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.744947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.747822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.751471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.770802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:00.095170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:00.127205 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fafe8e5-450e-45a8-9df3-6400b50f5b4d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1473 microversion: 2.1 time: 0.483373 Oct 18 16:17:00.140606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1970/3927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:59 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1473 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:00.158740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:00.159454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:00.174539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:00.175093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:00.176090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:00.177312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:00.178131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:00.179061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:00.457995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:00.473463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bac57638-10ce-456d-a3ee-891b55e87d47 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.330612 Oct 18 16:17:00.482283 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1971/3928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:00 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:00.500092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-31317336", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:00.606721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:17:01.322533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:01.335728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c270f6ff-e6c3-4d7b-8fdb-4d4228945329 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 1.641608 Oct 18 16:17:01.337840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1958/3929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:59 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:01.374951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:01.379084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:01.395740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.397446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.399170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.402248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.403357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.410742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.586681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:17:01.587835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:17:01.588530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:17:01.589182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:17:01.589808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:17:01.610977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.611893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.612808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.614439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.615174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.615850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.660441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:01.671987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:01.716849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:17:01.719721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:17:01.800569 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-89e92e7e-36d1-4182-aaf6-7aea45a1e5fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315650 Oct 18 16:17:01.802330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1972/3930] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:17:01.810878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:01.813456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:01.824323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.825609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.826358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.827680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.828440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.829412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.949270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:01.961714 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cadd0d0e-ce76-4c4b-a840-5dfd1c9a81ab tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1273 microversion: 2.1 time: 0.157612 Oct 18 16:17:01.962979 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1973/3931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:01 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:01.968590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:01.969409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:01.977116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.977947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.978573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.979430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:01.980095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:01.980680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:02.304942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:02.315232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec32101c-081e-4ff1-a366-de523691ad8c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.350834 Oct 18 16:17:02.341059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1974/3932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:01 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:02.352162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87f93ba7-a867-4e69-b4a6-7c9ba2a759e9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:02.353054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87f93ba7-a867-4e69-b4a6-7c9ba2a759e9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:02.379390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87f93ba7-a867-4e69-b4a6-7c9ba2a759e9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:02.556017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:02.602430 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59acfd93-aa6e-4df4-abdc-ff3164e2d632 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 1.240986 Oct 18 16:17:02.632606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1959/3933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:01 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:02.672832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:02.673666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:02.758137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:02.761569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:02.765700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:02.770719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:02.771178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:02.771638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:02.850787 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-87f93ba7-a867-4e69-b4a6-7c9ba2a759e9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Instance Mapping does not exist while attempting local delete cleanup. Oct 18 16:17:02.854973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87f93ba7-a867-4e69-b4a6-7c9ba2a759e9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102" status: 204 len: 0 microversion: 2.1 time: 0.512640 Oct 18 16:17:02.855755 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1975/3934] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:02 2022] DELETE /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:02.866934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:02.867859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:02.873762 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 HTTP/1.1 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a6a9f20b-6933-46db-b6e8-e801b2194102'} Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:02.875992 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:02.894109 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-286c0bed-d07f-4213-b517-3a70309b1c8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102" status: 404 len: 111 microversion: 2.1 time: 0.016936 Oct 18 16:17:02.897608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1976/3935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:02 2022] GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:02.994226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:02.995262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:03.003003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.004332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.005773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:03.007304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.008270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.009263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:03.175836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:03.195422 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca44e595-827e-41b6-acde-5e5437dc5e0b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1271 microversion: 2.1 time: 0.205307 Oct 18 16:17:03.198914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1977/3936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:02 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:03.209095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-61164220", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:03.306268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:03.331658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-30d2875d-d849-4733-9200-70c42628b33f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.684963 Oct 18 16:17:03.346630 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1960/3937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:02 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:03.347642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:17:03.360835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:03.362817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:03.373229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.373947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.375171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:03.376373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.377077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.377702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.036638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:17:04.037890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:17:04.038522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:17:04.038912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:17:04.039328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:17:04.052804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.056439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:04.060449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.067938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.068740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.069819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.070241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.071383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4cf97ad9-9365-4c3f-b8ee-599e1a788174 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.723400 Oct 18 16:17:04.090169 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1961/3938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:03 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:04.095356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:04.095981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:04.124502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.125019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.128342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.128884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.129420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.129857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.145391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:04.163165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:04.186461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:17:04.193928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:17:04.279152 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbac996f-1ddf-4330-9475-8514202d9861 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077880 Oct 18 16:17:04.281814 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1978/3939] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:17:04.290162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:04.291208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:04.301978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.302918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.304181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.305804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.306958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.307650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.447319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:04.459598 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36c15821-a046-479d-a47b-9da28ff9408a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1271 microversion: 2.1 time: 0.176226 Oct 18 16:17:04.481863 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1979/3940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:04 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:04.489812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5cb1e922-1b1a-4566-b9f7-be25e9ee8263 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:04.490881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cb1e922-1b1a-4566-b9f7-be25e9ee8263 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:04.570800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cb1e922-1b1a-4566-b9f7-be25e9ee8263 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:04.585410 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5cb1e922-1b1a-4566-b9f7-be25e9ee8263 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1219 microversion: 2.1 time: 0.101509 Oct 18 16:17:04.586733 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1980/3941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:04 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:04.592783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:04.593946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:04.601390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.602238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.602988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.604187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.605592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.606617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.878032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:04.898298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b3610f7-c53b-4382-84c7-75fe5c5f827d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.307590 Oct 18 16:17:04.899912 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1981/3942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:04 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:05.489258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:05.489258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:05.489258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.489258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.505310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.510072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.510947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.511581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.583328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:05.732031 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdd36fc2-bda0-43d4-84e2-8611c8867d07 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 204 len: 0 microversion: 2.42 time: 0.830225 Oct 18 16:17:05.733336 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1982/3943] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:17:04 2022] DELETE /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:17:05.742498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:05.744405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:05.755850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.758295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.760452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.761577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.762320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.763309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.859395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:05.870177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-010dc86b-b986-4f72-b1e0-7afa2c4c1e1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 1.778820 Oct 18 16:17:05.871384 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1962/3944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:04 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:05.880067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:05.880975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:05.891144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.891926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.892526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.893925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.894705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.895348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.059170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.087104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc112843-e0e4-43ce-bf01-8dc1587a27f5 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1271 microversion: 2.1 time: 0.208063 Oct 18 16:17:06.093417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.105432 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97f2655f-480d-46d9-b7c7-771d2946218f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.370316 Oct 18 16:17:06.106778 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1963/3945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:05 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:06.116413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:06.117456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:06.117683 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1983/3946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:05 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:06.125253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.125989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.127363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.128810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.129482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.130102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.135103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:06.149235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:06.170301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.171154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.171916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.173048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.173828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.174525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.267925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.290402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa783a66-660e-4178-b400-68175a5e0490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1271 microversion: 2.1 time: 0.179361 Oct 18 16:17:06.293938 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1964/3947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:06 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:06.311790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:06.313365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:06.322881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.324869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.325571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.326635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.327254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.327913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.584193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.597112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.610633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.612522 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69d0824c-063b-488b-9b33-d3282ee38c79 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2955 microversion: 2.42 time: 0.493603 Oct 18 16:17:06.638094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1984/3948] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:06 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2955 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:06.905125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:06.906191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:06.933856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.935124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.936894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.938470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.939880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.940880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.102575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:07.112813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b6c4451-c7e1-4b31-b19b-84159d449d3d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.817720 Oct 18 16:17:07.117906 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1965/3949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:06 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:07.137258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:07.138410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:07.149529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.150432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.160769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.161902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.162738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.164272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.330240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:07.357770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-901f04b5-f666-414b-9d70-37f71912ff94 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.458238 Oct 18 16:17:07.362523 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1985/3950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:06 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:07.378946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:07.379625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:07.405270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.405768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.406212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.411348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.411859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.412305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.657663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:07.673203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-101810bd-efea-4cc0-ba75-ec43b52ad7e4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.553773 Oct 18 16:17:07.677898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1966/3951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:07 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:07.687806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:07.709470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:07.728202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.729108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.729785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.731566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:07.733335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.735790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.736500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.759273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:07.765965 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07beb0ee-057e-41d3-814b-4656c533a443 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.401564 Oct 18 16:17:07.770654 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1986/3952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:07 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:07.809147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:07.810645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:07.828545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.829914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.830915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.832433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.833560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.835215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.901751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:07.912968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6777ca15-5a16-4a74-8729-22abf863f1c7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1271 microversion: 2.1 time: 0.226994 Oct 18 16:17:07.915829 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1967/3953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:07 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:08.155223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:08.156296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:08.185808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.190743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.195587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.199850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.201162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.205417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.442515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:08.473926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:08.476318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:08.478705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9451a022-2e54-44d8-b02f-2e2cbdd42c4c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2955 microversion: 2.42 time: 0.701607 Oct 18 16:17:08.479535 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1987/3954] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:07 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2955 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:08.486823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:08.487725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:08.495846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.496693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.497383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.498313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.498870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.499401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.737130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:08.790086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-131f16a2-110e-40d8-94ad-6b547efd22fa tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.309323 Oct 18 16:17:08.805406 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1988/3955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:08 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:08.812045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:08.812929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:08.820819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.821658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.822277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.823262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:08.824039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:08.824629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.070128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.087345 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06e7110a-e70f-4512-b0ce-8a24e61c0ca9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.276692 Oct 18 16:17:09.108390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1989/3956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:08 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:09.116845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.118104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.130219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.143735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.145974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.146718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.150853 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9dd1e655-f531-4eed-a73e-5ec9bde8d365 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.999663 Oct 18 16:17:09.151060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.151719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.152181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.154141 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1968/3957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:08 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:09.185934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.189505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.200206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.201737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.202342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.203247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.203854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.204456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.392144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.422245 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4c54959-2103-4ffb-898c-433438c64bec tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.312041 Oct 18 16:17:09.423448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1990/3958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:09.510508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.511127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.521801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.521801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.521801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.521801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.525557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.526052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.582495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.595571 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cc0e1b2-31b4-455e-9e87-511dc7c703b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1271 microversion: 2.1 time: 0.429163 Oct 18 16:17:09.598359 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1969/3959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1271 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:09.816364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.817030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.832873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.833403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.833851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.851315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.852795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.853298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.998408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.016982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.029491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.031108 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a0c5d2d7-3558-42cc-acee-f195d702212e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2955 microversion: 2.42 time: 0.524365 Oct 18 16:17:10.046692 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1991/3960] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2955 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:10.118080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:10.118843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:10.130026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:10.134854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.136771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.138488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.140952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.141762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.143412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.520350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.533956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b8dcb988-a8ca-42a6-a355-b5286b8a4fa3 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.422054 Oct 18 16:17:10.536464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1992/3961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:10 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:10.543717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:10.550380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:10.567712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.568652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.571426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.573085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.573739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.574700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.159886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.177788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b4a6efb-4216-4633-9dd3-85c9e66e31bd tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 1.364117 Oct 18 16:17:11.181107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1970/3962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:11.198924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:11.200243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:11.231262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.234226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.234965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.236024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.237327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.238016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.353745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.371702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5d70d89-1488-405f-ac6c-794a8417fc10 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1520 microversion: 2.1 time: 0.833298 Oct 18 16:17:11.374930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1993/3963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:10 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:11.379626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:11.380236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:11.399953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.400407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.402007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.402934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.405517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.406171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.530922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.548260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf64f871-da7b-4a37-9b88-09457b5fb586 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1277 microversion: 2.1 time: 0.167903 Oct 18 16:17:11.551405 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1994/3964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:11 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:11.569779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:11.578775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:11.592313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.599357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.601802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.603466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.605524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.608684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.978390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.992933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.994813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.998969 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d32094b-43dc-4a99-b682-223b6121a2da tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2934 microversion: 2.42 time: 0.442107 Oct 18 16:17:12.013685 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1995/3965] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:11 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2934 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:12.670721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:12.690470 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecaa66cc-88cb-48ab-a376-a8980efa8ffa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 1.507385 Oct 18 16:17:12.695008 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1971/3966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:11 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:12.707135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:12.709322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:12.731137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:12.737066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.737571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.740337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.741659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.746809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.747345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.809786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:12.810488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:12.824572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.825123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.827371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.828420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.829596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.830247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.379227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:13.395780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35653e23-d110-4219-b5c8-04d96a911bc5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.698828 Oct 18 16:17:13.397736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1972/3967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:12 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:13.420193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.421926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.443476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.444681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.451114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.454013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.455051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.455746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.670170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:13.707943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9029ba63-af7a-466d-b0ff-3dfef4f3d615 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 1.692809 Oct 18 16:17:13.714852 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1996/3968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:12 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:13.750352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.757650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.817880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.822079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.822576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.831343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.836319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.840266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:14.119774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:14.577307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=24 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:14.687366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:14.708580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f25b2944-9462-49f7-90d6-a4f1c99f55e5 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1500 microversion: 2.1 time: 1.308585 Oct 18 16:17:14.727541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1973/3969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:13 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1500 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:14.778083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:14.778925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:14.811293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:14.811880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:14.812406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:14.821691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:14.822725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:14.823789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:15.340939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:15.370479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-760ed842-6528-4ae8-b13b-4712c79f103d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 1.653942 Oct 18 16:17:15.377489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1997/3970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:13 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:15.399933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:15.402320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:15.445067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:15.447874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:15.454235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:15.456458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:15.458755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:15.465791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:16.050174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:16.149726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:16.160034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:16.170148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af9d0957-4676-4dad-bd29-b0db0c354566 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2913 microversion: 2.42 time: 1.428393 Oct 18 16:17:16.174688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1974/3971] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:14 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2913 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:16.213527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d490d464-852e-471c-ba03-a3ebe3d19b37", "tag": "284e36b2-05c9-4468-9fae-9ce34d64e1f1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:16.241885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:16.244800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:16.245930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:16.302553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:16.311351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] Creating event network-changed:284e36b2-05c9-4468-9fae-9ce34d64e1f1 for instance d490d464-852e-471c-ba03-a3ebe3d19b37 on n-h1-858383-14 Oct 18 16:17:16.334084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-32fa9b5f-e547-4586-ad86-ccae68c6c6e0 req-f4059be1-5b13-4c74-a7b9-e9cccdbbd625 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149531 Oct 18 16:17:16.340317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1975/3972] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:16.354101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:16.356949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:16.395033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:16.398031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:16.398756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:16.402447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:16.404516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:16.405611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:16.526739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:16.542090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ad80e12-62c7-44b3-a3e0-93b33332ed3e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 1.162672 Oct 18 16:17:16.544353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1998/3973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:15 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:16.567023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:16.567926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:16.574876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:16.577348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:16.579805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:16.580728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:16.585582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:16.586284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.171813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:17.188728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8533099e-a867-4be0-aa49-5c4f946e3b86 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.639808 Oct 18 16:17:17.192564 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 1999/3974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:16 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:17.201630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:17.203327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:17.216128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.219161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.220500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.222366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.223664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.229388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.825968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:17.840553 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39dc9d1a-41d9-4f14-aea9-64decbfc155c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1515 microversion: 2.1 time: 0.644830 Oct 18 16:17:17.841503 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2000/3975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:17 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1515 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:17.854475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd3f60f-dabc-4452-8707-c140dc1935f9"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:17.872101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.874878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.882452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.914319 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] Creating event network-vif-unplugged:5dd3f60f-dabc-4452-8707-c140dc1935f9 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:17.925894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-555fdca4-d756-4637-8853-ddb2ccc31ab1 req-9cd70e27-b96c-431b-b96f-5c7609676815 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082814 Oct 18 16:17:17.926905 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2001/3976] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:17.956693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:17.957538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:17.978495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.978970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.979415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.980344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.980971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.981592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.992770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.009478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-641feb0e-1508-4eff-9612-4d43cdc7eed5 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 1.657511 Oct 18 16:17:18.010450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1976/3977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:16 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:18.037447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:18.039323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:18.056261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.056985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.057641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.058537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.059172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.059874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.575619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.595765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62bba14a-aa6f-4ecc-b903-3213b16d5bd6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.658092 Oct 18 16:17:18.597231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2002/3978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:17 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:18.608052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:18.623079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.625464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:18.636844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.637034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.637477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.637977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.638654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.639906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.641326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.641843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.665145 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2859f0be-c29e-4507-9a05-f33572dff316 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2867 microversion: 2.42 time: 0.628918 Oct 18 16:17:18.672855 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1977/3979] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:18 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2867 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:18.695264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-deleted", "tag": "0550edd3-33e0-43ef-8b64-433a50dea17b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:18.749593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.750940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.752132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.791879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] Creating event network-vif-deleted:0550edd3-33e0-43ef-8b64-433a50dea17b for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:18.808860 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c0e54718-59e2-458e-9391-81df22dc9ac3 req-b97b24e4-7d69-4fed-b8b7-d485b31a3e08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132294 Oct 18 16:17:18.813185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1978/3980] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:18.819597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:18.822960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 3e1345b4-4949-49c7-b431-4f93b20fd7b3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:18.828872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/3e1345b4-4949-49c7-b431-4f93b20fd7b3/action HTTP/1.1 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 14 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: {"rescue": {}} Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3e1345b4-4949-49c7-b431-4f93b20fd7b3', 'body': {'rescue': {}}} Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:18.841516 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 404 to user: Instance 3e1345b4-4949-49c7-b431-4f93b20fd7b3 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b8bc5c2-0729-4fe5-9855-7c3a8896ba28 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/3e1345b4-4949-49c7-b431-4f93b20fd7b3/action" status: 404 len: 111 microversion: 2.1 time: 0.029807 Oct 18 16:17:18.847557 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1979/3981] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:18 2022] POST /compute/v2.1/servers/3e1345b4-4949-49c7-b431-4f93b20fd7b3/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:18.862564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:18.864875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:18.885054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.885619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.886708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.887660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.888307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.888881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.155157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:19.166401 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f07a1295-040d-4123-adf6-f4d3bdbe4102 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.564476 Oct 18 16:17:19.182791 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2003/3982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:18 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:19.195062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:19.196769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.213640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.214137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.214578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.215289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.215747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.216170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.220357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:19.267846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:19.297154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e24aa91-a958-47f9-a3fe-571399b11a85 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.444916 Oct 18 16:17:19.298388 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1980/3983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:18 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:19.324942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:19.333994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.378296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3dc9cf21-7084-48db-ab6c-aa39868e8f2d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.195763 Oct 18 16:17:19.378617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.382239 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2004/3984] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:19 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:19.387822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.391868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.392977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b261a7d9-572e-42c8-9249-cf712b2e72f7", "tag": "b2dc2d2a-c15a-4887-b9f3-31e1defd588a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:19.394358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.400489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.401303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.422121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.422820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.423505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.453570 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] Creating event network-changed:b2dc2d2a-c15a-4887-b9f3-31e1defd588a for instance b261a7d9-572e-42c8-9249-cf712b2e72f7 on n-h1-858383-14 Oct 18 16:17:19.468890 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-91e6e4dc-2c75-46d4-9716-c55655316993 req-fc2ed410-e00f-45a7-8958-619ec946c645 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085850 Oct 18 16:17:19.470164 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2005/3985] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:19.476973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:19.477959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.484934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.485781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.486460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.487398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.488072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.488749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.677918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:19.684740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:19.692517 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0fe3962-65da-483f-b82f-c41de6587182 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.381685 Oct 18 16:17:19.701318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e0873b64-4379-44ca-847f-e82f66816bc7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1520 microversion: 2.1 time: 0.229260 Oct 18 16:17:19.713528 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1981/3986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:19 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:19.715789 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2006/3987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:19 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:19.730547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:19.733013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.742900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:19.743565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.750402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.750900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.751344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.752061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.752528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.753061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.754000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.754492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.758401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.759496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.760178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.763463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.008272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.020953 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef19213d-7b0a-48dd-8b46-beccf183e4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.314171 Oct 18 16:17:20.022625 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1982/3988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:19 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:20.029389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "e8acfc01-a36e-4749-933d-0d6b80196941"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "0550edd3-33e0-43ef-8b64-433a50dea17b"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "21efc73e-c465-4129-916d-cfb89b7cb6dd"}, {"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "d69b5074-0fd6-4391-9702-d54fc28d744e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:20.052220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.053741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.055028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.102590 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Creating event network-vif-unplugged:e8acfc01-a36e-4749-933d-0d6b80196941 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:20.106028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Creating event network-vif-unplugged:0550edd3-33e0-43ef-8b64-433a50dea17b for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:20.106760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Creating event network-vif-unplugged:21efc73e-c465-4129-916d-cfb89b7cb6dd for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:20.107437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] Creating event network-vif-unplugged:d69b5074-0fd6-4391-9702-d54fc28d744e for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:20.130709 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0434afd3-5770-4742-978f-23febd182729 req-06541c87-402d-4d4f-8548-703b8a2945b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.106201 Oct 18 16:17:20.132268 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1983/3989] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:20.196520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.209745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:20.211069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:20.223357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.228078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.229556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6fc04e5-d938-4981-953f-4d76e514f092 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2821 microversion: 2.42 time: 0.512268 Oct 18 16:17:20.230738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.237900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.238559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.240383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.241625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.242378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.246272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2007/3990] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:19 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2821 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:20.338878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:20.339643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:20.355036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.355796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.356249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.356983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.357480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.357909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.504371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.517457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34aa8f4d-6d83-4849-9e30-6066f4ff4410 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.328027 Oct 18 16:17:20.520684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1984/3991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:20 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:20.723638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:20.724662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:20.737482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.737970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.748858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.749894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.750557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.751927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.822007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.837571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd2e4a47-1f8f-44e2-ba76-d571bf67215e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.505070 Oct 18 16:17:20.861475 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2008/3992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:20 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:20.872619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:20.878578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:20.889092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.895792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.897188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.898192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.898835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.899478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.406874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:21.421238 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-644e01d9-79b4-4b4b-87f0-0a16fcf523f8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 0.701943 Oct 18 16:17:21.433506 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1985/3993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:20 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:21.453298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-deleted", "tag": "21efc73e-c465-4129-916d-cfb89b7cb6dd"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:21.474110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.476779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.480641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.521312 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] Creating event network-vif-deleted:21efc73e-c465-4129-916d-cfb89b7cb6dd for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:21.536363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ce95c43c-daa4-49c8-8362-6b20268df5bd req-6bf7f74f-17e9-438d-8dcf-f5396b3805ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099268 Oct 18 16:17:21.542610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1986/3994] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:21.555295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:21.558339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:21.559713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:21.577419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.581411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.582445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.584920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bfcf8b05-54d8-4a58-aa3a-b6d9f7d03158 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1500 microversion: 2.1 time: 0.721258 Oct 18 16:17:21.585767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.586663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.588606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2009/3995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:20 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1500 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:21.589097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.600275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:21.605032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:21.626922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.628812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.634453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.636392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.637314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.639374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.990666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.027024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.028571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.029926 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6cb18399-6f58-4e1f-b806-234f2734476b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2707 microversion: 2.42 time: 0.440215 Oct 18 16:17:22.030507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2010/3996] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:21 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2707 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:22.049389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:22.050508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:22.063525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.070793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.071714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.072513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.073020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.076346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.313662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.331745 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-399699bc-4a9e-4a7a-89d3-1c1d243149bf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.787177 Oct 18 16:17:22.345535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1987/3997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:21 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:22.370051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:22.373055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:22.395115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.397911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.400298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.402188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.405906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.407001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.493194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'flavor' on Instance uuid 6370e14d-fed1-42dc-af35-c4a2309ddfaf {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:22.538993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Cannot 'rescue' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state paused Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action HTTP/1.1 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 14 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: {"rescue": {}} Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: exception: Cannot 'rescue' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state paused Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6370e14d-fed1-42dc-af35-c4a2309ddfaf', 'body': {'rescue': {}}} Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf in vm_state paused. Cannot rescue while the instance is in this state. Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state paused Oct 18 16:17:22.544232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state paused Oct 18 16:17:22.548877 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:22.555502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 409 to user: Cannot 'rescue' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state paused {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:22.556409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b068c8c-4043-46b5-86b1-cb464113b088 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action" status: 409 len: 144 microversion: 2.1 time: 0.209500 Oct 18 16:17:22.564376 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1988/3998] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:22 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action => generated 144 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:17:22.589434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:22.590123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:22.600525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.601448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.602172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.603120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.603768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.604387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.625781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.637982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e489939-f3c3-4424-ab28-2980e30223aa tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 0.605834 Oct 18 16:17:22.640426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2011/3999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:22 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:22.675170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:22.675796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:22.699447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.700453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.701291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.702261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.702983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.703717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.383412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:23.416246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a2d8078-cf40-4987-9e19-426750dc396d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.846141 Oct 18 16:17:23.418842 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1989/4000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:22 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:23.433906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:23.437882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:23.461377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.462661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.464092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.465482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.466812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.469011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.675477 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddd1f531-0f22-49b9-aeeb-028d8b62977d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.254780 Oct 18 16:17:23.683487 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1990/4001] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:23 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:23.698163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:23.702375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:23.723142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.723692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.725373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.730008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.730502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.733025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.086581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:24.111206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5481620-1bb1-44c0-8448-6131a98499e9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1475 microversion: 2.1 time: 1.451417 Oct 18 16:17:24.163039 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2012/4002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:22 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1475 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:24.190874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:24.193057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:24.203374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.204141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.204794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.205728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.206559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.207161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.664753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:24.676053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:24.686948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:24.689178 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7da7e51-5ce5-4584-84e5-5369eb1ec315 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2503 microversion: 2.42 time: 1.005460 Oct 18 16:17:24.690594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1991/4003] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:23 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2503 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:24.712164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:24.713297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:24.720151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.720901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.734563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.735351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.735830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.736319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.087538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:25.109369 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-377145a7-3e3a-4b7d-b13b-5ea0db5ec49c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.943496 Oct 18 16:17:25.110794 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2013/4004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:24 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:25.129809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:25.130866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:25.158201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.158939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.159708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.160629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.161351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.161944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.724193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:25.737575 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-965c8bf7-2701-4a73-b038-6ccf2f84192e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 1.042346 Oct 18 16:17:25.743268 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1992/4005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:24 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:25.762486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-deleted", "tag": "d69b5074-0fd6-4391-9702-d54fc28d744e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:25.786387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.787227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.788880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.845978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] Creating event network-vif-deleted:d69b5074-0fd6-4391-9702-d54fc28d744e for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:25.870532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f41c1f53-4341-40d4-9df7-75c6542be8e1 req-3b990d4b-f9d7-4e82-857d-6ecf3030a290 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125551 Oct 18 16:17:25.875762 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1993/4006] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:25.888142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:25.893047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:25.913105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.913931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.917421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.918697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.920729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.922520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.042868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:26.069861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fca2e2a-b512-44bf-96c2-dd61c046cb6f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1515 microversion: 2.1 time: 0.942896 Oct 18 16:17:26.071102 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2014/4007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:25 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1515 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:26.084685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:26.094541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:26.134387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.139596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.149440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.153994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.154767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.161632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.524832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:26.550507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab4219a3-dade-4814-aad9-48c9c7c1f46f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.673039 Oct 18 16:17:26.551232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1994/4008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:25 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:26.565145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:26.566148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:26.587008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.587733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.588268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.589438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.590097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.590408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.703335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:26.972372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:26.989471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:26.992786 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb211a39-e06d-4006-82f6-5e65d71f1c23 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1474 microversion: 2.1 time: 0.919766 Oct 18 16:17:26.993645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2015/4009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:26 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1474 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:27.002121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-unplugged", "status": "completed", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:27.015610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:27.021271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:27.026351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-490d1fd0-4081-497f-a70c-47ce26d57d9a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2457 microversion: 2.42 time: 0.474168 Oct 18 16:17:27.028890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1995/4010] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:26 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2457 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:27.033987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:27.036366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.038134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.038887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.042037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:27.067189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.067675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.070114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.071062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.071699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.072298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.092063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Creating event network-vif-unplugged:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h2-858383-14 Oct 18 16:17:27.120199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] Instance fbec4eba-b46d-4577-8783-23e0100e1f17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:17:27.152574 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5ea9281e-d6b8-4d34-ab74-3ecf0f536a01 req-d6f4bda7-0dbe-4d6a-8516-6e7c310af235 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156368 Oct 18 16:17:27.153601 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2016/4011] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:27.160886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:27.162702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:27.172643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.173610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.175129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.176168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.177020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.178201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.797270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:27.823782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5859fb4-009b-4f98-8969-a2dd7742579a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.793358 Oct 18 16:17:27.827988 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1996/4012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:27 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:27.848820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490d464-852e-471c-ba03-a3ebe3d19b37", "name": "network-vif-plugged", "status": "completed", "tag": "284e36b2-05c9-4468-9fae-9ce34d64e1f1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:27.872499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.879366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.880089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.923996 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] Creating event network-vif-plugged:284e36b2-05c9-4468-9fae-9ce34d64e1f1 for instance d490d464-852e-471c-ba03-a3ebe3d19b37 on n-h1-858383-14 Oct 18 16:17:27.947249 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c559ce65-9444-4a80-ab8d-5df2bc5d6732 req-8f0543f3-c0ed-491f-9833-863d1abb5cdd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110171 Oct 18 16:17:27.951820 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1997/4013] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:27.969455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:27.978783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:27.999532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.000546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.011650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.014032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.014637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.015301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.225139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.253670 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19bb5a51-51c1-4dad-9de1-8766a69aff0e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1528 microversion: 2.1 time: 1.094247 Oct 18 16:17:28.256864 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2017/4014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:27 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1528 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:28.284781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-deleted", "tag": "e8acfc01-a36e-4749-933d-0d6b80196941"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:28.334986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.335498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.335942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.349798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] Creating event network-vif-deleted:e8acfc01-a36e-4749-933d-0d6b80196941 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:28.366236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b520a549-5a68-4d73-948a-c34ba415267b req-e1031b87-08f9-42f5-95f3-2f3a6cdf60e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106317 Oct 18 16:17:28.367570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2018/4015] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:28.374866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:28.375571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:28.404293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.405610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.406913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.408149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.409948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.410720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.597902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.608276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3f09d48-7be9-47d1-8a15-48725e2b8210 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.654804 Oct 18 16:17:28.609141 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1998/4016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:27 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:28.622150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:28.630573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:28.647335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.648173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.649662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.651472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.652180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.652878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.958133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.985188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.987934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.989929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89ba5854-9c6a-4dab-bb77-0d283fa6bf46 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2053 microversion: 2.42 time: 0.371462 Oct 18 16:17:28.997469 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 1999/4017] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:28 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2053 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:29.014146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:29.015556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:29.033717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.034605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.037929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.039317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.040083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.041633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.227591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:29.236464 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8ea6f37e-31c5-4d3f-8480-80887081bbad tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1474 microversion: 2.1 time: 0.865822 Oct 18 16:17:29.257970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2019/4018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:28 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1474 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:29.270025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:29.300760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.305465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.306188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.320705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:29.336337 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e2a21ed-0186-4ad0-9757-4db7390290be tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.334806 Oct 18 16:17:29.355889 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2000/4019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:29 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:29.361733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:29.363193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Creating event network-changed:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h2-858383-14 Oct 18 16:17:29.366839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:29.378350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] Instance fbec4eba-b46d-4577-8783-23e0100e1f17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:17:29.382483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.386730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.387510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.388578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.389276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.391516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.404046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3b43d5be-5876-4d00-8101-8d3cb3de3ce4 req-3bddff4e-7bd3-456b-bbd3-23b6fe8e34a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144687 Oct 18 16:17:29.411739 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2020/4020] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:29.427595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:29.434997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:29.446488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.452597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.453457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.454475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.455194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.455862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.559289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'flavor' on Instance uuid 6370e14d-fed1-42dc-af35-c4a2309ddfaf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:29.565600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:29.665738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:29.678853 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99f0ce8e-542c-47c1-8436-5276b078ecf3 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1510 microversion: 2.1 time: 0.320170 Oct 18 16:17:29.679777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2001/4021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:29 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:29.686750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:29.687748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:29.697890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.698999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.699436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.700420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.701145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.701777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.750133 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7d1eaae-3ed9-415d-b9af-a83468258777 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action" status: 200 len: 32 microversion: 2.1 time: 0.332416 Oct 18 16:17:29.753290 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2021/4022] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:29 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:17:29.765632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:29.766357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:29.788459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.789927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.790768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.792408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.793305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.794116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.043508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.056051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2cfec8c-dfab-46d0-950f-04c9e5af03b7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1313 microversion: 2.1 time: 0.375030 Oct 18 16:17:30.056931 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2002/4023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:29 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:30.064082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:30.065173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:30.081899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.082814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.083429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.085306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.086070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.086671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.236926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.249050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.260429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.262359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff870bb3-ce31-49d6-8b9a-c1e9e92dad06 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 2662 microversion: 2.42 time: 0.204253 Oct 18 16:17:30.263310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2003/4024] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:30 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 2662 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:30.289866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:30.290535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:30.315470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.315964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.321735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.322644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.323128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.332131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.706102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.718135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b28a4ef-9967-4d06-a48f-4de078a12308 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1472 microversion: 2.1 time: 0.451517 Oct 18 16:17:30.718727 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2004/4025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:30 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:30.742443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:30.753291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:30.773175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.774095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.774752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.775843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.776316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.776757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.034000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.043322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c4d5c7e-09de-4681-bbaf-e63460e32fea tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 1.282375 Oct 18 16:17:31.044918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2022/4026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:29 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.062030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.062651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.078471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.087318 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d19ac5e-ac05-4596-9cfc-d5953243ece7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.363882 Oct 18 16:17:31.087876 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2005/4027] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:30 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.089913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.090628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.091249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.094660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.097597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.098054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.107073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136c0d-2c35-48a2-ad3d-18218bf72d6f", "name": "network-vif-deleted", "tag": "5dd3f60f-dabc-4452-8707-c140dc1935f9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:31.131627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.132641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.133294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.155088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] Creating event network-vif-deleted:5dd3f60f-dabc-4452-8707-c140dc1935f9 for instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f on n-h1-858383-14 Oct 18 16:17:31.162756 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-37434a08-23a5-40e6-b785-2edb921e37b2 req-8c841e90-1956-420d-a8ab-b1bc18727573 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070041 Oct 18 16:17:31.164001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2006/4028] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:31.178486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.180729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.192234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.194813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.195867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.197120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.197604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.198222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.426774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.445666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9212aae1-03a0-4604-baed-cc40049bc9e1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1510 microversion: 2.1 time: 0.398869 Oct 18 16:17:31.446554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2023/4029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.452562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.453422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.470122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.470614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.471054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.471763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.472221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.472654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.482454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.524675 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5beb042a-3222-4bd3-b959-15cbd7fc8dd4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1500 microversion: 2.1 time: 0.354644 Oct 18 16:17:31.542642 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2007/4030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1500 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.563542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:31.564387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.572392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.572891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.573421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.574200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.574711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.575239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.638239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.672684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.674986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.676694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-86588825-ea1b-46db-a0f1-274db186f2af tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.228925 Oct 18 16:17:31.678669 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2024/4031] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:31.703773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08c30ec3-2cbd-4c7d-8593-e450cccec393 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37/action" status: 202 len: 0 microversion: 2.1 time: 0.144061 Oct 18 16:17:31.705360 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2008/4032] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:31 2022] POST /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:31.720249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.725558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.737442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.747898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.749962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.759696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.760463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.762633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.767396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.768288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.768908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.769314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.770206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.770530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.771016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.772520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.101291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:32.114311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f94989bc-2b27-4eb1-8634-7dbc792afe92 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1472 microversion: 2.1 time: 0.360521 Oct 18 16:17:32.129150 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2009/4033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:32.129150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:32.129150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:32.150102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.150853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.151304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.153403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.153898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.155718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.441284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:32.461723 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b146c1c-5cdb-49b3-bdae-66c2c93b6093 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1505 microversion: 2.1 time: 0.750967 Oct 18 16:17:32.462487 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2025/4034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1505 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:32.485219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:32.486306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:32.495621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.496357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.497090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.499232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.500090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.500755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.534017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:32.547411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75f90ac8-0b5c-4d3e-9f71-dd06fc64db1f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.429204 Oct 18 16:17:32.553228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2010/4035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:32 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:32.590607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "name": "network-vif-unplugged", "status": "completed", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:32.622571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.623434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.624251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.640772 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] Creating event network-vif-unplugged:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:17:32.648224 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-df45187d-e514-4bcc-bbf0-493293e7c309 req-b0be7478-28eb-4af2-b191-ff92a857696f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081189 Oct 18 16:17:32.651944 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2011/4036] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:32.660655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:32.663610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:32.673451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.676238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.677038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.678818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.679675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.681305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.012380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.025901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-74eb0002-1d2f-4ea8-8c71-47320331d0c4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.561957 Oct 18 16:17:33.026889 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2026/4037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:32 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:33.043034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:33.043966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:33.064268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.065080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.065687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.066592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.067434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.068533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.271604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.278167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.284151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:33.290055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.294339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.298377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f578db0c-2f8e-4720-88d5-caf1829b43c0 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.262834 Oct 18 16:17:33.298814 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d06f5500-a467-42d1-84d0-9cb6e7dabe76 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1510 microversion: 2.1 time: 0.645040 Oct 18 16:17:33.302035 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2027/4038] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:33 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:33.312985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:33.314836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:33.335273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.336091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.336692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.337339 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2012/4039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:32 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1510 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:33.337766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.338369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.338963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.492721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:33.493996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:33.531879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.541425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.543431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.547602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.558670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.559801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.015147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.026855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa455003-72c8-44ff-ab6d-e0e8028f084a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1472 microversion: 2.1 time: 0.722498 Oct 18 16:17:34.027448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2028/4040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:33 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1472 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:34.043177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.045490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.062319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.062822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.063271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.063988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.064440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.064867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.240885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.266406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-31d867c1-7ac8-46b2-b785-8cafe4229fad tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1485 microversion: 2.1 time: 0.779663 Oct 18 16:17:34.267846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2013/4041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:33 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1485 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:34.282831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.284187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.301779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.303129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.305544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.306593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.308133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.308807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.483769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.499824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc734578-9ae1-4579-93b1-f09c10b8d46e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.470572 Oct 18 16:17:34.500435 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2029/4042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:34.517312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:34.518132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.529823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.530818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.530818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.531471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.531925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.532360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.614478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.616708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'flavor' on Instance uuid d490d464-852e-471c-ba03-a3ebe3d19b37 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:34.632292 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4bcf01f-07aa-4c62-9534-8807d8cf55fc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.361183 Oct 18 16:17:34.633962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2014/4043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:34.640334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.641313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.650342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.651734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.652766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.655261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.657039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.657159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.819722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.833117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.835685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.838413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8c4d70b-eebb-4dc8-906d-616d5e53928e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.201448 Oct 18 16:17:34.839576 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2015/4044] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:34.855766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.858303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.873611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.874509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.878819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.880142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.881711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.888915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.172555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a857823-dba1-41aa-afd0-55300e40feae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37/action" status: 202 len: 0 microversion: 2.1 time: 0.666315 Oct 18 16:17:35.174093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2030/4045] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:34 2022] POST /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:35.205808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261a7d9-572e-42c8-9249-cf712b2e72f7", "name": "network-vif-plugged", "status": "completed", "tag": "b2dc2d2a-c15a-4887-b9f3-31e1defd588a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:35.239735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.242135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.243540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.274053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] Creating event network-vif-plugged:b2dc2d2a-c15a-4887-b9f3-31e1defd588a for instance b261a7d9-572e-42c8-9249-cf712b2e72f7 on n-h1-858383-14 Oct 18 16:17:35.290461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-84e40442-d214-4f12-a366-aca863bf8e3f req-f1b2bf35-c831-48e1-a389-4d8f7ce520b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113778 Oct 18 16:17:35.297507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2031/4046] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:35.314225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:35.318564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:35.325571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:35.329187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c99a278a-8f8b-4485-9d8f-68e36e399118 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1510 microversion: 2.1 time: 0.483046 Oct 18 16:17:35.329944 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2016/4047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:35.339759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.339985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:35.340439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:35.340644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.341709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.343367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.344448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.345423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.367008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.368084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.368714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.369707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.370177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.370613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.805859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:35.818044 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6784d59c-49be-43db-89c4-6db35503e2d2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1469 microversion: 2.1 time: 0.517807 Oct 18 16:17:35.819022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2032/4048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:35 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1469 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:35.847896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:35.848526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:35.870151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.870649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.871083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.884709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.885499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.886796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.912475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:35.925841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d697abf8-c941-426f-9898-ce8f2bc8c656 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1491 microversion: 2.1 time: 0.594644 Oct 18 16:17:35.941358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2017/4049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:35 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1491 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:35.978815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:35.979532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:35.990157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.998023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.998940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.000140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.000856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.002371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.587604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:36.601808 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e8c3d37-9a96-4dbf-83da-3e96c2bcf948 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.758693 Oct 18 16:17:36.626052 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2033/4050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:35 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:36.636837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:36.637700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:36.657401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.657616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:36.659720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.660469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.661489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.662818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.663624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.670749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58d663da-9cf0-4ce3-9641-e51ba0c17d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1319 microversion: 2.1 time: 0.706098 Oct 18 16:17:36.672838 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2018/4051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:35 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:36.685168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:36.686728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:36.697651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.698994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.699681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.700736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.702257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.703012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.805267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:36.924185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61c15bb6-21eb-4d1e-abaa-c03d2ba5709f tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "POST /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17/action" status: 202 len: 0 microversion: 2.1 time: 0.296405 Oct 18 16:17:36.928844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2034/4052] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:36 2022] POST /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:36.965173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:36.971188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:36.975891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:36.992085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.992939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.993818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.004309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.008962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.011531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.012214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:37.035734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:37.045847 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1782fa2b-dfbc-42ed-9c9e-229d024aa55d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.363542 Oct 18 16:17:37.047270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2019/4053] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:36 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:37.080964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:37.082583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:37.105506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.106639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.107390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.110181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.111804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.113482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.638966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:37.653463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0f85619-cf80-4a7f-aee1-067d132b089a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.593840 Oct 18 16:17:37.654809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2020/4054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:37 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:37.663292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:37.664667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:37.686287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.686878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.688032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.689796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.690525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.691172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.213954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.234953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce12bffb-a2f5-40bc-b5e2-b562461c61a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1513 microversion: 2.1 time: 1.300964 Oct 18 16:17:38.249403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2035/4055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:36 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1513 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:38.250291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-plugged", "status": "completed", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:38.266160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.267079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.267728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.287779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Creating event network-vif-plugged:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h2-858383-14 Oct 18 16:17:38.306346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] Instance fbec4eba-b46d-4577-8783-23e0100e1f17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:17:38.353313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-96934795-867f-4711-bfb1-9e5d5024f9c4 req-83902a6b-a21e-4b74-8964-faa32c105783 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112549 Oct 18 16:17:38.355149 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2036/4056] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:38.366406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.367670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.387871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.388591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.389201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.390046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.390718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.391258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.674252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.687195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e343166d-b53c-4a2e-8077-4b66f99eef37 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1512 microversion: 2.1 time: 1.030922 Oct 18 16:17:38.688541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2021/4057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:37 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1512 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:38.706213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.707382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.718078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:38.720086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.720892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.725259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.726544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.727283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.733861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.735221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.750720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb660e46-3d9b-4d2c-b24b-1cd05f86f159 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.394112 Oct 18 16:17:38.752175 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2037/4058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:38 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:38.766839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.769261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.792391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.792921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.795773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.796509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.796975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.797436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.918558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.946711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.953645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.956890 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72326aa5-3960-4181-9e6f-c50ef9ce3b68 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.203310 Oct 18 16:17:38.960505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2038/4059] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:38 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:38.977527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.978824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.998244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.001174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.002457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.003870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.004576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.005235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.248117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:39.266058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2751ce7b-155a-4b16-8f41-d291c844fa01 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1453 microversion: 2.1 time: 0.300460 Oct 18 16:17:39.266058 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2039/4060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:38 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:39.354613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:39.370640 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75fd72f4-ae78-416e-8e42-57a56cf8ca05 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1500 microversion: 2.1 time: 0.680416 Oct 18 16:17:39.373037 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2022/4061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:38 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1500 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:39.792138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:39.792766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:39.796361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:39.797073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b520872-78d4-4be3-aa3c-127c8063fac1 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Calling method '.version_select at 0x7f5fd65225e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:39.810185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.810978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.812031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.815808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.816779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.819371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.894638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b520872-78d4-4be3-aa3c-127c8063fac1 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.519447 Oct 18 16:17:39.894900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2023/4062] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:17:39 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:17:39.900787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:39.903244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:39.916634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.919813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.920546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.921578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.923030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.924668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.990003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lazy-loading 'flavor' on Instance uuid aee72ab8-e58d-4dfe-905b-47a5e377f50b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:40.008492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'shelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state shelved_offloaded Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 14 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: {"shelve": {}} Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: exception: Cannot 'shelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state shelved_offloaded Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'shelve': {}}} Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:17:40.010733 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state shelved_offloaded Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state shelved_offloaded Oct 18 16:17:40.016288 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.018321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'shelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state shelved_offloaded {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:40.020026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-964f8055-da68-4974-9f78-5a9a7e59725b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 155 microversion: 2.1 time: 0.123551 Oct 18 16:17:40.025017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2024/4063] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:39 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 155 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:17:40.033215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.033855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.040328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.040824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.041436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.042002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.042461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.042997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.093211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.104552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91f76b5e-ca7f-432a-bf44-3c9a204d7fa2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.837483 Oct 18 16:17:40.105186 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2040/4064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:39 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:40.127945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.134786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.141719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.149474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.150221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.152445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.153129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.153756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.247197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.260773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9c01db7-c581-4c2b-afed-83ec1fe5a722 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1500 microversion: 2.1 time: 0.234314 Oct 18 16:17:40.265828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2025/4065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:40.283260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.287906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.294825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.295458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.296091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.297501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.298059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.298982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.401452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.420478 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-865218c2-e855-498d-a75f-a0618aed3a75 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1512 microversion: 2.1 time: 0.300935 Oct 18 16:17:40.421379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2041/4066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:40.437374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a88efed5-43ac-4549-a629-8ec020a5f968 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Action: 'create', calling method: .version_select at 0x7f5fd6384b80>, body: {"pool": "non_exist_pool"} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:40.489311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a88efed5-43ac-4549-a629-8ec020a5f968 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] HTTP exception thrown: Floating IP pool not found. Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a88efed5-43ac-4549-a629-8ec020a5f968 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Request method failure captured: Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 26 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtGiR2GnGZL2tVXQaDH9wLniEDPw0Ai8h9NYxw8G7Gm3wjOAOuIbgYW2q09ec4W30XzQ-MGNlxdOt0rsI5ftS_5hJq_IKkav0atcozn8W6M3BZxFN90Z7YLkkpMs9mAFYGfdXodSHscvepnLC2VstrpyXEToIuwzHhb34Uz7u9zS2aE Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ebdd7d5c2a9f4c7f9505c5e983469e59 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}] Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ebdd7d5c2a9f4c7f9505c5e983469e59 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsNegativeTestJSON-543161108-project Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 6eb8256cdb744f079cdfbcf7ef83e1d7 Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-543161108-project Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: {"pool": "non_exist_pool"} Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: exception: Floating IP pool not found. Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:40.491635 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:40.497444 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 18 16:17:40.497444 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.498457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a88efed5-43ac-4549-a629-8ec020a5f968 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Returning 404 to user: Floating IP pool not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:40.499508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a88efed5-43ac-4549-a629-8ec020a5f968 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.077588 Oct 18 16:17:40.500259 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2042/4067] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:17:40 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:17:40.508710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.515554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.530738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.531219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.531806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.533038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.541229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.543639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.580824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.590367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-301d5ab9-2bc7-46e3-a503-024376897d9a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.323349 Oct 18 16:17:40.591281 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2026/4068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:40.596828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:40.597745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.605244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.606247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.607107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.608047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.608730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.609506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.665390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 16:17:40.675062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.691726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.694200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.695884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-86276961-79aa-4919-bc86-a7edce5edef2 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.194480 Oct 18 16:17:40.697402 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2043/4069] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:40.707178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.716021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.724621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.725355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.725972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.726969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.727607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.728215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.761361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a30c6d43-82f7-47ff-9d8e-15e75754b698 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.168234 Oct 18 16:17:40.762445 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2027/4070] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:40 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:40.768676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Calling method '.version_select at 0x7f5fd18c3310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.788728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:40.863389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG neutronclient.v2_0.client [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2854a2f4-5523-4a98-9e5f-c54d3862de28 could not be found", "detail": ""}} {{(pid=120571) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 16:17:40.866819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] HTTP exception thrown: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Request method failure captured: Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-floating-ips/2854a2f4-5523-4a98-9e5f-c54d3862de28 HTTP/1.1 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtGiR2GnGZL2tVXQaDH9wLniEDPw0Ai8h9NYxw8G7Gm3wjOAOuIbgYW2q09ec4W30XzQ-MGNlxdOt0rsI5ftS_5hJq_IKkav0atcozn8W6M3BZxFN90Z7YLkkpMs9mAFYGfdXodSHscvepnLC2VstrpyXEToIuwzHhb34Uz7u9zS2aE Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: ebdd7d5c2a9f4c7f9505c5e983469e59 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ebdd7d5c2a9f4c7f9505c5e983469e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebdd7d5c2a9f4c7f9505c5e983469e59"}]}] Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: ebdd7d5c2a9f4c7f9505c5e983469e59 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-543161108 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsNegativeTestJSON-543161108-project Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6eb8256cdb744f079cdfbcf7ef83e1d7 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-543161108-project Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: exception: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2854a2f4-5523-4a98-9e5f-c54d3862de28'} Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2854a2f4-5523-4a98-9e5f-c54d3862de28 could not be found Oct 18 16:17:40.870207 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aac1d2f7-f457-4934-9da3-9883c58e894c'] Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28. Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28 Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28 Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] Returning 404 to user: Floating IP not found for ID 2854a2f4-5523-4a98-9e5f-c54d3862de28 {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-211c58f3-b89d-415a-a8dc-f0f3423182d3 tempest-FloatingIPsNegativeTestJSON-543161108 tempest-FloatingIPsNegativeTestJSON-543161108-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/2854a2f4-5523-4a98-9e5f-c54d3862de28" status: 404 len: 111 microversion: 2.1 time: 0.108364 Oct 18 16:17:40.875307 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2028/4071] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:17:40 2022] DELETE /compute/v2.1/os-floating-ips/2854a2f4-5523-4a98-9e5f-c54d3862de28 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:40.888778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.889643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.909027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.910886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.913298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.915043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.917481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.920024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.977139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73edcaae-c2a6-4676-b125-e123c0f729b6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 204 len: 0 microversion: 2.1 time: 0.272421 Oct 18 16:17:40.979483 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2044/4072] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:40 2022] DELETE /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:40.995690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.997867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:41.015854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.016650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.018622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.019566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.023613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.025411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.346022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:41.361364 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5392e8ab-0f6c-45e7-9b7f-b2037fab8b69 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1506 microversion: 2.1 time: 0.376175 Oct 18 16:17:41.362075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2045/4073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:41.376193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:41.389941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:41.397560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.398443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.399199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.407015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.408130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.408755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.624451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:41.639051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-626977e9-e6d4-43c8-9597-3c1f656c8b3c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1461 microversion: 2.1 time: 0.764695 Oct 18 16:17:41.647065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2029/4074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1461 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:41.661056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:41.662578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:41.665191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:41.680689 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b738e14-b035-49e7-a3e8-dd4049e3779e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.317106 Oct 18 16:17:41.682711 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2046/4075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:41 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:41.690839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.692300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.693035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.694679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.695044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:41.696532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.696796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:41.697542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.713853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.714352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.714788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.715516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.715974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.722579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.739380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:42.103623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:42.122070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-503f5897-1ce1-4043-95cb-88355ecd8c7d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.436599 Oct 18 16:17:42.137062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2047/4076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:41 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:42.140419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:42.141074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:42.178586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.179470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.180090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.185045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.187251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.190830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.326962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:42.339151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:42.357411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:42.362351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:42.374914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b8af742-4990-47d4-abe5-61466d41268b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.715157 Oct 18 16:17:42.378684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-630f1a18-a27b-4273-842d-2a64c9a56b3b tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.251401 Oct 18 16:17:42.393021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2030/4077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:41 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:42.393299 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2048/4078] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:42 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:42.402012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:42.402012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:42.422095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.423034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.423497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.424260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.424729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.425281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.677777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:42.681165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:42.707883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.708581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.711542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.712314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:42.712795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:42.713262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:42.812597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:43.253882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:43.309229 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d1fa75b-a09b-4ea4-8dad-3e97f12ce646 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1461 microversion: 2.1 time: 0.637044 Oct 18 16:17:43.314087 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2049/4079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:42 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1461 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:43.338413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:43.340808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:43.390335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:43.393672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:43.398089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:43.402297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:43.405101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:43.410027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:43.518104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:43.550449 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50e7fedc-5630-4df8-bd35-c0685baa6bb2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1506 microversion: 2.1 time: 1.161454 Oct 18 16:17:43.564069 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2031/4080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:42 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1506 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:43.567192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490d464-852e-471c-ba03-a3ebe3d19b37", "name": "network-vif-plugged", "status": "completed", "tag": "284e36b2-05c9-4468-9fae-9ce34d64e1f1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:43.602706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:43.606835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:43.610186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:43.673583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] Creating event network-vif-plugged:284e36b2-05c9-4468-9fae-9ce34d64e1f1 for instance d490d464-852e-471c-ba03-a3ebe3d19b37 on n-h1-858383-14 Oct 18 16:17:43.685910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b5f51180-b1a6-427c-8f17-57ea6486d3b1 req-8f155b3c-9204-4d4b-9d2c-dd3ac6f05760 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124059 Oct 18 16:17:43.688582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2032/4081] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:43.699646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:43.701886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:43.721259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:43.722738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:43.723436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:43.725072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:43.725748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:43.726363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:44.625990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:44.638954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77116e13-9c42-4093-92e0-f952c71a8549 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 1.322029 Oct 18 16:17:44.639576 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2050/4082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:43 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:44.655865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:44.656484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:44.699436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:44.702581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:44.707039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:44.707911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:44.708477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:44.708920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:45.654700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:45.666577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ea1d7e1-3cb6-422d-9add-b2cf9ccca87a tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 1.025725 Oct 18 16:17:45.689559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2051/4083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:44 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:45.702071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:45.710179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:45.721690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:45.729959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:45.730766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:45.734449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:45.735660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:45.736329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:45.972320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:45.983325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.009206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.013032 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18d14809-a1a5-48b1-bb66-232df071808e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.321618 Oct 18 16:17:46.017071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2052/4084] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:45 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:46.034994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:46.037430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:46.050732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.054174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.055563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.057954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.074648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.078797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.258231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.309689 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c64708aa-0ee0-4d58-87d8-ea3d0f46abb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 2.618649 Oct 18 16:17:46.310769 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2033/4085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:43 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:46.361862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:46.363112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:46.377940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.378890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.379639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.382005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.383231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.384781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.521825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.525610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.526429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.526998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid b261a7d9-572e-42c8-9249-cf712b2e72f7 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:46.610056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.628568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.631666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59dc27b0-fdc5-4ea7-b599-6269a915cc52 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 200 len: 1309 microversion: 2.1 time: 0.288047 Oct 18 16:17:46.633179 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2034/4086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:46 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:46.638276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-unplugged", "status": "completed", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:46.639503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-084e3b6f-c3a4-4a4c-9e18-a5b7ec21d2d9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.621269 Oct 18 16:17:46.640088 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2053/4087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:46 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:46.658475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.660312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:46.660940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:46.667246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.667246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.686950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.687440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.690318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.692399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.694265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Creating event network-vif-unplugged:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:17:46.695290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.696073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.712582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] Instance fbec4eba-b46d-4577-8783-23e0100e1f17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:17:46.744268 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1449dcac-2d48-46eb-97e3-5865b7b490b7 req-f7b54679-5f12-4043-a372-5a91cce5e7cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109271 Oct 18 16:17:46.747413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2035/4088] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:46.764712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261a7d9-572e-42c8-9249-cf712b2e72f7", "name": "network-vif-deleted", "tag": "b2dc2d2a-c15a-4887-b9f3-31e1defd588a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:46.795549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.799676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.800580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.833286 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] Creating event network-vif-deleted:b2dc2d2a-c15a-4887-b9f3-31e1defd588a for instance b261a7d9-572e-42c8-9249-cf712b2e72f7 on n-h1-858383-14 Oct 18 16:17:46.840228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-66793274-6396-413b-8dfc-de701266bde0 req-a406202a-36e3-4661-a90d-5f1be4a95fb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089352 Oct 18 16:17:46.842600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2036/4089] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:46.851029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:46.852301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:46.859997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.860882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.861874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.863785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.866526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.867206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.471091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.485389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11415827-3c5f-4f37-942a-34143186094a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.842912 Oct 18 16:17:47.486533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2054/4090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:46 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:47.498188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:47.503461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:47.517498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.521826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.522611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.523684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.531874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.532670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.575741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.589976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b4ec1fa3-7d36-41ec-bdfe-3d347d759fee tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.745787 Oct 18 16:17:47.591225 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2037/4091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:46 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:47.604223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:47.617888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:47.629536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.635232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.636289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.642041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.643557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.645585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.774068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.791845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.808432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.812171 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e81233d9-3de6-4a08-bcb7-41327969272c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.323797 Oct 18 16:17:47.813488 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2055/4092] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:47 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:47.842575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:47.847149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:47.876508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.882584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.883370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.884759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.890499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.892581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.946315 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 HTTP/1.1 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b261a7d9-572e-42c8-9249-cf712b2e72f7'} Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:47.956433 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:17:47.969372 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:47.971028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:47.973026 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5111fcb7-b2f1-47bb-847d-36acd48ecb6f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 404 len: 111 microversion: 2.1 time: 0.154428 Oct 18 16:17:47.975912 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2056/4093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:47 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:48.008057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:48.009624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:48.025391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.026615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.027643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:48.029313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.030394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.045256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:48.537803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:48.553169 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a6d741f-498e-4d2d-8480-3232b91c9003 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.560282 Oct 18 16:17:48.554584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2057/4094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:47 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:48.559532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c027ce4b-4a7f-4152-9b7a-e26cf8fe0412 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: .version_select at 0x7f5fd18950d0>, body: {"keypair": {"name": "tempest-key-824530442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzGIwn6OHtQswOpLg0P2i0PtvVqttgX1JU93A9s1bCjZ0bC+6XcEYWkUT8G2n6RQRomSefd00TX1EbkyusOG7sCY9K88gASJuC2/S1L57SD/kBackKvh3AVeLtke97yZg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:48.599086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c027ce4b-4a7f-4152-9b7a-e26cf8fe0412 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:48.605366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c027ce4b-4a7f-4152-9b7a-e26cf8fe0412 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:48.677993 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c027ce4b-4a7f-4152-9b7a-e26cf8fe0412 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.121347 Oct 18 16:17:48.687785 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2058/4095] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:17:48 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:48.693305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:48.694816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:48.730808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.739513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.740620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:48.742120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.742880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.743569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.100781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.112283 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67867d37-c230-40ae-b998-c2ba846040dd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 1.519068 Oct 18 16:17:49.112873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2038/4096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:47 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:49.133699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:49.144645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:49.160685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.163334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.164454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.165674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.167611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.169955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.172000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-906253b7-07f2-4523-a136-185853fd5628 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.491185 Oct 18 16:17:49.172665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.183046 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2059/4097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:48 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:49.207134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0ba4af4-89af-406d-b87a-81397491382e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '.version_select at 0x7f5fd6330e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:49.218699 n-d-858383-14 devstack@n-api.service[120570]: WARNING oslo_db.sqlalchemy.utils [None req-c0ba4af4-89af-406d-b87a-81397491382e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:17:49.232779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0ba4af4-89af-406d-b87a-81397491382e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.033114 Oct 18 16:17:49.234824 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2060/4098] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:17:49 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:49.241901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:49.301470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.308770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.309205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.348189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Creating event network-changed:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:17:49.362832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] Instance fbec4eba-b46d-4577-8783-23e0100e1f17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:17:49.415723 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-97bf39dd-f6ca-4b1d-b70f-850eed003110 req-a3eff2ae-f631-4348-8531-829642721507 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179394 Oct 18 16:17:49.421034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2061/4099] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:49.442050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:49.442851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:49.468265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.468777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.478760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.484373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.485122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.485914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.633728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.649936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.651658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.654599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a02621bc-9929-49b9-b8c4-a93c5ff3ef5a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.228213 Oct 18 16:17:49.657690 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2062/4100] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:49 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:49.673656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-675492285", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-key-824530442", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:49.704160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.726244 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f541cb27-e54e-49fc-b723-4e71d89c97ae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.596708 Oct 18 16:17:49.730381 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2039/4101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:49 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:49.749607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:49.757241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:49.783640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.787285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.789863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.792943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:49.796205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:49.802207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.810733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:17:50.255716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:50.268203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-097f6a39-d585-4a76-b4dd-be146e56fe82 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.536096 Oct 18 16:17:50.270461 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2040/4102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:50.299720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:50.300627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:50.315988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:50.317251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:50.320635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:50.322152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:50.323827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:50.324807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.139815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.157975 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e19b864-97f5-4932-9504-13d256a871cd tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.865847 Oct 18 16:17:51.160857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2041/4103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:50 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:51.182036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:51.193756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:51.212637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.213552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.214204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.215215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.217713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.218463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.555711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.570418 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b573693-8ab8-4fe0-9d32-ab23053afb32 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1468 microversion: 2.1 time: 0.405624 Oct 18 16:17:51.573420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2042/4104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:51 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:51.586758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:51.590203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:51.605369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.607280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.608228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.614985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.616414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.617582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.887673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.922536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.928969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.931761 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-82926fcb-7c69-439a-baaa-a9d998558b0e tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.357151 Oct 18 16:17:51.957595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2043/4105] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:51 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:51.985697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:51.986740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:52.013525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:17:52.014408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:17:52.014663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:17:52.015261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:17:52.016691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:17:52.019799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.021639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.022545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.024789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.027810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.028602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.057560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.076649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.080192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.082804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.093446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.094567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.243811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:52.288376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:52.380043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:17:52.384576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:17:52.566866 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6911588-e712-412e-b493-7c3b1690a9ca tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.907164 Oct 18 16:17:52.575441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2063/4106] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:17:52.622876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:52.623817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:52.682828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.698390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.702254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.707132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.707863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.708534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:53.712585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:53.745328 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35b367d0-89af-451d-bc8d-9ea57efdb28c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 1.781370 Oct 18 16:17:53.756201 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2044/4107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:51 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:53.821296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:53.828064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:53.861375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:53.862016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:53.862485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:53.869423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:53.871579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:53.890058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:54.057245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:54.079675 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e0a9bdac-08e9-4203-8a30-592f2084b267 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 1.490602 Oct 18 16:17:54.096303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2064/4108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:52 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:54.102634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b5a3f33-98f9-4559-af1b-3d2b9f497ba0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:54.103673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b5a3f33-98f9-4559-af1b-3d2b9f497ba0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:54.564599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b5a3f33-98f9-4559-af1b-3d2b9f497ba0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:54.575521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b5a3f33-98f9-4559-af1b-3d2b9f497ba0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1227 microversion: 2.1 time: 0.477635 Oct 18 16:17:54.576768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2065/4109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:54 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1227 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:54.582608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:54.583459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:54.593153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:54.594595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:54.595603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:54.597546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:54.598760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:54.599706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.133988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.168296 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ff32850-eab2-4b4d-8fe0-1b6c6fc59129 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1501 microversion: 2.1 time: 1.400287 Oct 18 16:17:55.169717 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2045/4110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:53 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1501 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:55.230322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:55.231571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:55.248867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.251161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.251826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.262702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.271824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.272775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.282964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.293600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-000b8d12-b705-481d-8046-b0cd0ae5f175 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1461 microversion: 2.1 time: 0.715167 Oct 18 16:17:55.305617 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2066/4111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:54 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1461 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:55.311799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:55.323777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:55.368080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.368733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.369207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.369968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.370410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.370835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.653429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.677690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.683774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.686398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d24cc3fd-bdf8-4996-bea4-43a2b21a054a tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.514045 Oct 18 16:17:55.702994 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2046/4112] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:55 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:55.722103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:55.722727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:55.759290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.762058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.763136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.782865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:55.783457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:55.788658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:55.960591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:55.984348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ece9e78-301b-4d2f-82bb-eff7cc0e9584 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.675912 Oct 18 16:17:56.003118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2067/4113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:55 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:56.022041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0976739-1600-423a-a1fc-66e948388ea1"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:56.044545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:56.061094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.061595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.062031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.062741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.063255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.063694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.127227 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Cannot 'attach_volume' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state rescued Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/os-volume_attachments HTTP/1.1 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 74 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: {"volumeAttachment": {"volumeId": "a0976739-1600-423a-a1fc-66e948388ea1"}} Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'attach_volume' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state rescued Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '6370e14d-fed1-42dc-af35-c4a2309ddfaf', 'body': {'volumeAttachment': {'volumeId': 'a0976739-1600-423a-a1fc-66e948388ea1'}}} Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 18 16:17:56.132448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state rescued Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state rescued Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:17:56.137126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 409 to user: Cannot 'attach_volume' instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf while it is in vm_state rescued {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:56.140530 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-022dad1f-b6b5-42ff-8bd6-18be0b869eca tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.122905 Oct 18 16:17:56.145762 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2068/4114] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:17:56 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/os-volume_attachments => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:17:56.156468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:56.158671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:56.183988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.185128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.185937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.187314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.188123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.188971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.408708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:56.433450 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f40afbd4-f128-4f0e-80f8-ac9dc0fe0627 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.719607 Oct 18 16:17:56.438486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2047/4115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:55 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:56.468604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:56.472220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:56.499016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.500340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.502279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.503891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.506156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.520357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.572577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:56.737282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:56.753812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b763ad2c-b0e4-4356-b9d0-3514694e819b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1287 microversion: 2.1 time: 0.312701 Oct 18 16:17:56.767702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2048/4116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:56 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1287 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:56.809357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:56.813647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:56.853798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.854570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.859686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.868277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.871840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.873964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.146562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53f207f4-2ff3-46be-a9e0-ce5089b9c53e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.360661 Oct 18 16:17:57.150676 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2049/4117] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:56 2022] POST /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:57.168167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:57.170175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:57.199328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.200237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.203438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.204521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.205300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.205983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.656896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1bf7ca8a-fe38-446e-9c37-80b3b45620cd tempest-MigrationsAdminTest-530628342 tempest-MigrationsAdminTest-530628342-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1614 microversion: 2.1 time: 1.509098 Oct 18 16:17:57.658092 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2069/4118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:56 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1614 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:57.669695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:57.695522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:57.744814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.747487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.766823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.769400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.781813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.782665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.902576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:57.938741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:57.956308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:57.964903 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8652c319-4ba3-4ea9-89e4-dbf24b5cc728 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.810381 Oct 18 16:17:57.980278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2050/4119] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:17:57 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:17:57.992290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:57.993203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:58.000594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.001345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.002551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.004162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.006813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.007487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.540905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:58.580601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-646a907c-2531-4a82-8df1-43efc5168a0a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1509 microversion: 2.1 time: 0.591358 Oct 18 16:17:58.581477 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2051/4120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:57 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:58.612118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-plugged", "status": "completed", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:58.664357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.667445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.670142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.717567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] Creating event network-vif-plugged:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:17:58.739672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4ae520e0-416a-4075-81a9-ba1664a3b4e5 req-e63e027d-4bfc-4bd4-b0f2-d2e91b3a3332 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153229 Oct 18 16:17:58.741760 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2052/4121] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:58.758297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:58.761268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:58.787647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.790541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.791326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.793464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.796283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.798407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.267454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:59.278593 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6c6b015-e4b5-46d7-9d43-d4bb50f5c572 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.533612 Oct 18 16:17:59.279745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2053/4122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:58 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:59.305034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:59.306892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:59.321920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.326637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.327357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.328275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.329183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.329772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.440941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:59.824626 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26e25cb4-054e-4a4d-b36d-358813ddee49 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 204 len: 0 microversion: 2.1 time: 0.540365 Oct 18 16:17:59.831899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2054/4123] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:59 2022] DELETE /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:59.850166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:59.851096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:59.869746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.870853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.872462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.874397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.875346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.878810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.984352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.011930 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf42e56e-9dbb-42b7-8057-c2b9840156d1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 2.350573 Oct 18 16:18:00.012548 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2070/4124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:57 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:00.037507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:00.038129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:00.058791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.066441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.072402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.074677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.076702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.077296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.093984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:00.441642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.462365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.467890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.476552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.477920 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-117fc4f0-8254-4af3-a5ed-5b86a28222dd tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.464243 Oct 18 16:18:00.493273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dca9b11a-9bdd-4a91-89e9-738277724461 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.658900 Oct 18 16:18:00.494270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2055/4125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:59 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:00.517703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:00.519998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:00.530635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2071/4126] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:18:00 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:18:00.539054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.547922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.548940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.550454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.553711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.554475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:00.555228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.569967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:00.582135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.582981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.584231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.585935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.588728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.589730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:01.686540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:01.713429 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f6d955e-47ff-45b9-a67b-a936a3da5500 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1509 microversion: 2.1 time: 1.215209 Oct 18 16:18:01.730575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2056/4127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:00 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1509 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:01.746055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:01.747397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:01.767259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:01.768085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:01.768713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:01.772036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:01.772741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:01.773386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.002983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:02.044258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83f3ed3f-3092-498e-be9f-8aa945deec96 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1467 microversion: 2.1 time: 1.511992 Oct 18 16:18:02.049806 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2072/4128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:00 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1467 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:02.055666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:02.083749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:02.138026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:02.141148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:02.144226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.149126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:02.152844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:02.165818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.167760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:02.591922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:02.601623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75b3ee50-6366-42b0-82c1-69a2c0e7730e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.869577 Oct 18 16:18:02.621332 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2057/4129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:01 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:02.621332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:02.621332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:02.633686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:02.640354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:02.641806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.646130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:02.647439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:02.648472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.911541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:02.933576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-465efba8-b687-41bc-9c67-68443c1d9139 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.877722 Oct 18 16:18:02.934464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2073/4130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:02 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:02.958735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:02.960383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:02.969034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:02.990300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:02.992549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:02.993938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.997647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.001712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.002313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.443620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:03.453857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:03.467495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:03.469133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4dc84af0-9f54-4a96-bd6d-bf9565860870 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1604 microversion: 2.42 time: 0.855161 Oct 18 16:18:03.485804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2058/4131] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:18:02 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1604 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:18:03.496302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:03.506305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:03.513508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.514343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.516022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.522039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.522761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.523384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:04.485808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:04.503596 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cacf0f7c-09a0-4085-b328-d204b12c0dcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 1.562739 Oct 18 16:18:04.505292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2074/4132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:02 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:04.552556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:04.563238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:04.598382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:04.611450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:04.613431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:04.619693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:04.629431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:04.632100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:04.632894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:04.940359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:04.982979 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ff242c8-d6ea-428f-8f86-4e320bec2e16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1425 microversion: 2.1 time: 0.463244 Oct 18 16:18:04.996116 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2075/4133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:04 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1425 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:05.018332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:05.022548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:05.060365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:05.064490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:05.073728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:05.079004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:05.080086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:05.087740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:05.402027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:05.420535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64ca7f3c-b19d-436c-80fa-ef629b0406e8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1509 microversion: 2.1 time: 1.933101 Oct 18 16:18:05.425570 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2059/4134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:03 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1509 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:05.457130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:05.459307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:05.487314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:05.524045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:05.524952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:05.557395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:05.558193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:05.558594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.085103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.112499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29ceb592-cfbc-462d-8de6-2cef96489fc8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.679748 Oct 18 16:18:06.117039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2060/4135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:05 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:06.122939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:06.142303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:06.167279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.168254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.169526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.172500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.173991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.175908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.220259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.245487 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08169a19-15a2-463c-b2d0-c82b437c0677 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 1.248041 Oct 18 16:18:06.248419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.249651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2076/4136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:04 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:06.250158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.250846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.251605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lazy-loading 'fault' on Instance uuid b7136c0d-2c35-48a2-ad3d-18218bf72d6f {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:06.265779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbec4eba-b46d-4577-8783-23e0100e1f17", "name": "network-vif-deleted", "tag": "3a19c299-11bf-491c-b5c8-6b521ea4442d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:06.304965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.305483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.311862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.339529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.349350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] Creating event network-vif-deleted:3a19c299-11bf-491c-b5c8-6b521ea4442d for instance fbec4eba-b46d-4577-8783-23e0100e1f17 on n-h1-858383-14 Oct 18 16:18:06.364784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ba000824-ea10-414a-b7d8-5cfad1655580 req-2fc24bb8-c5ec-49be-b3b5-626ede76d2a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111558 Oct 18 16:18:06.366376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2077/4137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:06.375504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.380705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16bd1444400e47de84f0c1c15cc42c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf1d849d91426d94f338ed22af5f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.386591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08083e6-250c-4223-9c1d-0be557870a7b", "tag": "1e92b862-f31b-4835-be2f-1c5e1f876681"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:06.387733 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9578db2-bd6b-4e9c-b4a4-81d359463c96 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 200 len: 1609 microversion: 2.42 time: 0.268533 Oct 18 16:18:06.388904 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2061/4138] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:18:06 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 1609 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:18:06.394079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:06.402071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:06.411362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.412341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.413037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.414234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.415018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.416407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.418057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.418609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.419112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.447155 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] Creating event network-changed:1e92b862-f31b-4835-be2f-1c5e1f876681 for instance c08083e6-250c-4223-9c1d-0be557870a7b on n-h1-858383-14 Oct 18 16:18:06.462555 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7cdbf080-7fcd-4c42-99ae-bbc89437e373 req-28a8cd59-84fe-4c4d-8c9a-73521262da5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091952 Oct 18 16:18:06.467086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2078/4139] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:06.475113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:06.481092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:06.494538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.496373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.498140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.505418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.506167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.507052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.606889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.607406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.608685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.609423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid fbec4eba-b46d-4577-8783-23e0100e1f17 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:06.691782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.710984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5404db8c-200d-44d6-8de3-072a4656c841 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 200 len: 1301 microversion: 2.1 time: 0.241291 Oct 18 16:18:06.712491 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2079/4140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:06 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 1301 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:06.717678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:06.727780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:06.757571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.761297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.761984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.765386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.772342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.777006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.821793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.826214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:06.839356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd737d0a-1384-42eb-b7f3-51f4c4984358 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.449018 Oct 18 16:18:06.839975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2062/4141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:06 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:07.159714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:07.161184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:07.193982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.194812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.195589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.211085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.214167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:07.220482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.221238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.225938 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3915848b-ba69-426d-92c1-d4fb98835503 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1515 microversion: 2.1 time: 0.512109 Oct 18 16:18:07.229561 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2080/4142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:06 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:07.280965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:07.281738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:07.295354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.301098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.305857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.307645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.325581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.329722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.759361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:07.779425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33a20c29-8454-4546-974e-a10b6ad1d743 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.498396 Oct 18 16:18:07.782217 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2081/4143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:07 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:07.803661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:07.810785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:07.842733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.844659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:07.849214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.851892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.854617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.859592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.872140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8de6ba8c-6b4f-4790-a6aa-9aeef808b764 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.717533 Oct 18 16:18:07.877786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.886191 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2063/4144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:07 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:07.900777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:07.901493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: fbec4eba-b46d-4577-8783-23e0100e1f17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:07.922167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.932359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.933025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.935277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.937794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.939461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.994413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] HTTP exception thrown: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. Oct 18 16:18:07.998577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] HTTP exception thrown: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Request method failure captured: Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 HTTP/1.1 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB0S7DMbfeWNajV27NO-dpWHO6zlDKgyOg-TaVB1oR-drLeXr8geCZeUup9WZrLfUuzOPnCU_utAJ8xnvcFkGTeQKmIqX9E-JjrC24OhuTb3WYeJW6mjIjO3mFSV7G6Ry31u6Px2lfx7XGaC6qh4mYqztOlrv4scYRSvjXlhxVzc2o Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9333cee966ee488888baa81cca159833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9333cee966ee488888baa81cca159833"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}] Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: edf8e722c29b4428a12703b05e0ebc2a Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'fbec4eba-b46d-4577-8783-23e0100e1f17'} Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:08.001249 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. Oct 18 16:18:08.006589 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.012086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Returning 404 to user: Instance fbec4eba-b46d-4577-8783-23e0100e1f17 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:08.016924 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62345297-a4a4-42d6-b1a6-3343b588916b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17" status: 404 len: 111 microversion: 2.1 time: 0.129185 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Request method failure captured: Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f HTTP/1.1 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs__cPuYcl1gwiRvHbs-CgoxMjYDc4bALrKDCf1z1cMeZEogG5MhXG9mwn5XJbinZzM6uoNSotxsX6V00xnaaATxjTb2H-I95Mw5T1wX5nx7M-Yv2s80wUPU8oPx57f4vBgDOVJ5ndywnmuGEFNL9PNekT7NdwQjdXLZP2ynipEowjo Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}] Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 16bd1444400e47de84f0c1c15cc42c66 Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b7136c0d-2c35-48a2-ad3d-18218bf72d6f'} Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.019345 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:08.028213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:08.029470 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2064/4145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:07 2022] GET /compute/v2.1/servers/fbec4eba-b46d-4577-8783-23e0100e1f17 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:08.029645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Returning 404 to user: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:08.029645 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4de4d080-7698-46a5-87f3-d198fc8bf71c tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 404 len: 111 microversion: 2.42 time: 0.239337 Oct 18 16:18:08.040593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.041778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2082/4146] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:18:07 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:08.042730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:08.061901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.062413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:08.064148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.068073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.068625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.071668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.075232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.078839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.086296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.086858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.087307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.088192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.089135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.089636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.197735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:08.391105 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4020e326-3bd2-40a7-ad7c-9f47cb13b785 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 204 len: 0 microversion: 2.1 time: 0.347234 Oct 18 16:18:08.396283 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2083/4147] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:08 2022] DELETE /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:08.402910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08b3225e-f5fd-46ae-9278-b1a660300e7d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '.version_select at 0x7f5fd19c03a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.439158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08b3225e-f5fd-46ae-9278-b1a660300e7d tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320027980" status: 204 len: 0 microversion: 2.42 time: 0.041285 Oct 18 16:18:08.449154 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2084/4148] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:18:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320027980 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:18:08.462777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.463592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:08.479061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.480137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.481067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.482597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.484517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.485450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.713188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:08.727644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f0c7f77-d627-498a-b03b-32c183d42475 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.701046 Oct 18 16:18:08.771502 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2065/4149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:08 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:08.806365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.807264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:08.833309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:08.842579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.845472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.846127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.850919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.851581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.852218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.277046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:09.287291 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-48488692-9c68-41bc-8651-239718cc443b tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1535 microversion: 2.1 time: 0.836790 Oct 18 16:18:09.291542 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2085/4150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:08 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1535 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:09.322900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:09.325177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:09.352384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.356729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.357293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.358415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.359000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.365627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.820790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:09.837701 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2392f8c5-29f6-4e18-a587-46e40d2ca535 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.526057 Oct 18 16:18:09.842801 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2086/4151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:09 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:09.859716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:09.865817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:09.880461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.884818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.885676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.886717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.887459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.889538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:10.384129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:10.406247 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2765b2f4-cc1f-455e-9794-385a18b187e2 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 1.604445 Oct 18 16:18:10.422078 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2066/4152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:08 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:10.438676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:10.448263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:10.468034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.468536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.468979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:10.469867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.470326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.470756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:10.789202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:10.808733 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3508c993-e9e0-4a44-a7f8-33d0a1ed36b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.961154 Oct 18 16:18:10.809904 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2087/4153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:09 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:10.865333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:10.866062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:10.888386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.888967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.892456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:10.900714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.901635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.902293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:11.195289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:11.213397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f60534d1-0f3b-4965-9d71-ba7744922e4c tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1535 microversion: 2.1 time: 0.789875 Oct 18 16:18:11.220935 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2067/4154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:10 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1535 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:11.446650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:11.449410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:11.462373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:11.464799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:11.466637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:11.468033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:11.475319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:11.477708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:11.992440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:12.004616 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b96714f-9a62-40ff-939e-1c6014686bb5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.566883 Oct 18 16:18:12.007787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2068/4155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:11 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:12.019069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ba07682-a481-4623-8c2a-996e4ce7755e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: .version_select at 0x7f5fd1359820>, body: {"keypair": {"name": "tempest-keypair-1725496763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJ8D0vz+aOlctFhxymNbB6dnDMOxhUtM91l+KYQWtzZ3plGYHLl5DaFvmZH5Oi5d+SllkjJV+y3SE47FD6YMTn1c3K8fuA/kdUihAOJng1kuYOxLc4qjzRdCjT2zGlcA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:12.061396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3ba07682-a481-4623-8c2a-996e4ce7755e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:12.075880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3ba07682-a481-4623-8c2a-996e4ce7755e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for user 1cc60ef5fff74c2eab3f81450c33a4e7 and project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:12.141797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ba07682-a481-4623-8c2a-996e4ce7755e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132453 Oct 18 16:18:12.145883 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2069/4156] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:18:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:12.163118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:12.168118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:12.196377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:12.197612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:12.199214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:12.200824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:12.205221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:12.210040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:12.949093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:12.979170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:12.993577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d653f046-d3af-41cd-a8b1-39dbf2c4d044 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 2.133247 Oct 18 16:18:13.000604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2088/4157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:10 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:13.033288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:13.033922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:13.052610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.054989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.055585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:13.056404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.057092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.057537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:13.399518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:13.420294 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e99723df-95a2-4644-8a7b-369398d9242a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 1.272833 Oct 18 16:18:13.421345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2070/4158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:12 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:13.442847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:13.446126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:13.472410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.472898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.476205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:13.479368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.480176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.482280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:14.274315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:14.289250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-511ecf4a-cae8-444e-a468-e21bf1820049 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1493 microversion: 2.1 time: 1.270382 Oct 18 16:18:14.299786 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2089/4159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:13 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1493 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:14.312699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:14.313719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:14.356751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:14.358734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:14.360970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:14.363191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:14.365100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:14.366266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:14.910863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:14.937063 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6404676-ebf6-4cdf-a673-592de9574be5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 1.513841 Oct 18 16:18:14.976865 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2071/4160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:13 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:15.006508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:15.027476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:15.053019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.054399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.058641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.074236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.075047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.078310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.276332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:15.295230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d8223c5-0a17-4035-8885-588039e18eb9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1504 microversion: 2.1 time: 0.991428 Oct 18 16:18:15.297050 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2090/4161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:14 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1504 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:15.308663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c9c64-5b75-45f4-97a7-a910b41032c9", "name": "network-vif-deleted", "tag": "679901bf-250c-42ed-9793-6749f15e9353"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:15.336058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.336538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.339806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.378862 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] Creating event network-vif-deleted:679901bf-250c-42ed-9793-6749f15e9353 for instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 on n-h2-858383-14 Oct 18 16:18:15.392684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-cbbd0f6e-6f86-4208-acf6-f514ad67db6c req-6b108b10-bcbc-43df-82b3-64add14b84a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094384 Oct 18 16:18:15.396346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2091/4162] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:15.422915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:15.426122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:15.443666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.444567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.445302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.446749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.447753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.448716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.524000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.524948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.526522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.527503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 6a5c9c64-5b75-45f4-97a7-a910b41032c9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:15.698921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:15.725129 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddacc7c4-94c7-478f-9058-3671a4101c16 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1369 microversion: 2.1 time: 0.323495 Oct 18 16:18:15.728746 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2092/4163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:15 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1369 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:15.983438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:15.984773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:15.997985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.998998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.001443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.003850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.005170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.006991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.337941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:16.352213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61d33a3c-167c-4eb8-a774-8067b81c07b2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 1.373878 Oct 18 16:18:16.356456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2072/4164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:14 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:16.384826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08083e6-250c-4223-9c1d-0be557870a7b", "name": "network-vif-plugged", "status": "completed", "tag": "1e92b862-f31b-4835-be2f-1c5e1f876681"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:16.424318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.426998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.428285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.472077 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] Creating event network-vif-plugged:1e92b862-f31b-4835-be2f-1c5e1f876681 for instance c08083e6-250c-4223-9c1d-0be557870a7b on n-h1-858383-14 Oct 18 16:18:16.486846 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2e265802-917d-4b47-ae97-b1d0e6bd9281 req-34b98e1d-76e9-482b-b176-cab0129a2523 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128898 Oct 18 16:18:16.487867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2073/4165] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:16.503690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:16.505443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:16.532587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.533115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.533567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.534280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.545913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.546661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.740310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:16.762872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-155bb087-e087-4618-9353-73bcad33171a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.784218 Oct 18 16:18:16.765209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2093/4166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:15 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:16.821957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:16.822817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:16.842728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.854006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.855233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.856335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.861344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.861849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.969317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:16.969817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:16.970250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:16.970706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 6a5c9c64-5b75-45f4-97a7-a910b41032c9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:17.087652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:17.097621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1371c809-a11e-4ccc-8b5a-03e44696ac76 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1504 microversion: 2.1 time: 0.607966 Oct 18 16:18:17.101744 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2074/4167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:16 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1504 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:17.136153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:17.146768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7242620-55e1-4f9e-90fa-3f90c16fbdb9 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1369 microversion: 2.1 time: 0.337755 Oct 18 16:18:17.148807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2094/4168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:16 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1369 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:17.401778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:17.403351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:17.413547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.414321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.415143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.417575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.418336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.419397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.803076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:17.804388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:17.814350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.814899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:17.815414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.816049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.817989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.818754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.819577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.835494 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea9be43c-7828-4598-8fc2-0e72400c6703 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.437857 Oct 18 16:18:17.837613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2075/4169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:17 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:18.138547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:18.139657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:18.157778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.166992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.167781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.168737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.169579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.172083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.288664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:18.302566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4bf46874-d797-4abc-97e2-f5a945969628 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.504858 Oct 18 16:18:18.303479 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2095/4170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:17 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:18.310096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:18.311046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:18.318846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.320182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.320874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.321924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.322611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.323259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.374381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.376129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.376939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.378159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 6a5c9c64-5b75-45f4-97a7-a910b41032c9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:18.480312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:18.494566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e616f744-2bc0-42c5-b940-6ecc60ee0920 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1369 microversion: 2.1 time: 0.189006 Oct 18 16:18:18.495180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2096/4171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:18 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:18.723531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490d464-852e-471c-ba03-a3ebe3d19b37", "name": "network-vif-unplugged", "status": "completed", "tag": "284e36b2-05c9-4468-9fae-9ce34d64e1f1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:18.786642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.786642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.786642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.804058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] Creating event network-vif-unplugged:284e36b2-05c9-4468-9fae-9ce34d64e1f1 for instance d490d464-852e-471c-ba03-a3ebe3d19b37 on n-h1-858383-14 Oct 18 16:18:18.812318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b8484606-6895-4825-af13-efa3d1dd5d6a req-53952f19-d4d7-4f4a-b21e-5396821d9d11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095437 Oct 18 16:18:18.814630 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2097/4172] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:18:18.862759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:18.863514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:18.879524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.880910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.883101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.884122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.884602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.888667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.976341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:18.997676 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37758fcf-2450-4e5a-9def-eb6e7570d555 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1504 microversion: 2.1 time: 0.875891 Oct 18 16:18:19.003739 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2076/4173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:18 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1504 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:19.236685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:19.270617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-000b2c83-30f8-436f-a3a3-0b16f6f28ee0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1327 microversion: 2.1 time: 0.412137 Oct 18 16:18:19.282410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2098/4174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:18 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:19.330842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:19.331504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:19.346278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.352872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.353887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.354945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.355622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.356291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.533310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:19.534067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:19.551060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.551661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.552655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.554036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.554747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.556296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.623303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.624475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.625183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.625883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 6a5c9c64-5b75-45f4-97a7-a910b41032c9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:19.678996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:19.690799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84b2a983-652e-459b-85f7-17835093eef8 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1369 microversion: 2.1 time: 0.162178 Oct 18 16:18:19.692787 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2099/4175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:19 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:20.037665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.039369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.056700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.059396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.060894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.062894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.070707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.072498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.177693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:20.191200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64c228e5-beaf-4dfe-8380-3a925158012b tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.865943 Oct 18 16:18:20.210362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2077/4176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:19 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:20.307397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.310726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.328138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.337997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.339633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.340496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.341411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.346480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.433147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:20.452503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-847d7d57-2905-4120-875e-d3b4eac38d27 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 200 len: 1507 microversion: 2.1 time: 0.420626 Oct 18 16:18:20.459101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2100/4177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:20.502859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.508920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.519539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.520377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.521242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.522515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.523351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.524796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.750543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:20.767092 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aed4513f-821f-4463-8541-a34678211611 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1508 microversion: 2.1 time: 0.471555 Oct 18 16:18:20.773296 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2078/4178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:20.774381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:20.783461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78af6dd8-b2b8-4f70-ba8c-04c0914ca468 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.291458 Oct 18 16:18:20.784577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2101/4179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:20.796408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.796951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.804744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.805358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.805890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.807150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.807733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.808227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.809805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.817570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.828541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.829625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.831392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.833579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.834382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.835131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.881733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.882707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.883556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.885438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 6a5c9c64-5b75-45f4-97a7-a910b41032c9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:20.893815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] HTTP exception thrown: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Request method failure captured: Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f HTTP/1.1 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTs__cPuYcl1gwiRvHbs-CgoxMjYDc4bALrKDCf1z1cMeZEogG5MhXG9mwn5XJbinZzM6uoNSotxsX6V00xnaaATxjTb2H-I95Mw5T1wX5nx7M-Yv2s80wUPU8oPx57f4vBgDOVJ5ndywnmuGEFNL9PNekT7NdwQjdXLZP2ynipEowjo Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}] Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 16bd1444400e47de84f0c1c15cc42c66 Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b7136c0d-2c35-48a2-ad3d-18218bf72d6f'} Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:20.897568 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:20.905054 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:20.911583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Returning 404 to user: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:20.911583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7099b651-3f05-4933-b28c-26b9357446de tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 404 len: 111 microversion: 2.42 time: 0.133956 Oct 18 16:18:20.915595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2079/4180] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:18:20 2022] DELETE /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:20.935461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.936516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.944964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.946532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.947079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.947900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.948605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.949425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.982454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:21.014445 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-136fc90c-1e2d-49c8-b79b-35b90b374a69 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 200 len: 1369 microversion: 2.1 time: 0.226201 Oct 18 16:18:21.017288 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2102/4181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:21.040233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:21.040898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:21.047765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.049991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.052476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.054127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.054814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.055931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.266858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:21.268424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f8c314a-50a1-47d4-877c-9775fafc191e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.249566 Oct 18 16:18:21.281857 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2103/4182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:21 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:21.301841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:21.302984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] [instance: b7136c0d-2c35-48a2-ad3d-18218bf72d6f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:21.309502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.310301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.311008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.311961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.312653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.313363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.330587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] HTTP exception thrown: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Request method failure captured: Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f HTTP/1.1 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs__cPuYcl1gwiRvHbs-CgoxMjYDc4bALrKDCf1z1cMeZEogG5MhXG9mwn5XJbinZzM6uoNSotxsX6V00xnaaATxjTb2H-I95Mw5T1wX5nx7M-Yv2s80wUPU8oPx57f4vBgDOVJ5ndywnmuGEFNL9PNekT7NdwQjdXLZP2ynipEowjo Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5daf1d849d91426d94f338ed22af5f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5daf1d849d91426d94f338ed22af5f9a"}]}] Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 5daf1d849d91426d94f338ed22af5f9a Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-812146263 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 16bd1444400e47de84f0c1c15cc42c66 Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TaggedBootDevicesTest_v242-812146263-project Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b7136c0d-2c35-48a2-ad3d-18218bf72d6f'} Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:21.332824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. Oct 18 16:18:21.337642 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:21.339841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] Returning 404 to user: Instance b7136c0d-2c35-48a2-ad3d-18218bf72d6f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:21.340809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17762161-b88c-4c2d-8e61-30819634e289 tempest-TaggedBootDevicesTest_v242-812146263 tempest-TaggedBootDevicesTest_v242-812146263-project] 10.222.0.78 "GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f" status: 404 len: 111 microversion: 2.42 time: 0.057661 Oct 18 16:18:21.341702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2104/4183] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:18:21 2022] GET /compute/v2.1/servers/b7136c0d-2c35-48a2-ad3d-18218bf72d6f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:21.365756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-760694407", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b15ddfd-50ce-4f21-a77f-c7e9e6ee19ae"}], "security_groups": [{"name": "tempest-securitygroup--758160129"}], "key_name": "tempest-keypair-1725496763", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:21.419779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:21.432514 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b3b3a2f-1a05-4c5e-9ee4-babfb177bb80 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1508 microversion: 2.1 time: 0.513387 Oct 18 16:18:21.433159 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2080/4184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:21.438214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:21.439178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:21.450133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.451173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.452372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.453422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.454095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.454740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.617678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] validate_networks() for [('8b15ddfd-50ce-4f21-a77f-c7e9e6ee19ae', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:18:21.780693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:21.805237 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-825e85b9-57c8-4dd1-8845-65632920d9ab tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.366812 Oct 18 16:18:21.821684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2081/4185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:21 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:21.827578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:21.828205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:21.842538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.843295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.844855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.846393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.847041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.847691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.878316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.099155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.122007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:22.134409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6af37bb4-e89a-4616-979f-35c698c01640 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.311489 Oct 18 16:18:22.137209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2082/4186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:21 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:22.156173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:22.157281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:22.165572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.166479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.166632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.167510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.168334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.168768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.243944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:22.370829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:22.371776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:22.372516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:22.373052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:22.373747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:22.386805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.387701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.388411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.389431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.390157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.390834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.416252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:22.425303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Getting quotas for user 1cc60ef5fff74c2eab3f81450c33a4e7 and project 9aec8b651e6d4b89bd98c593b6e932a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:22.445904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:22.460380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:22.461685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-faaff1b8-d8c2-4c78-a0de-bcfd7d072de8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 204 len: 0 microversion: 2.1 time: 0.317598 Oct 18 16:18:22.462959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2083/4187] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:22 2022] DELETE /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:22.473969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:22.474902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 6a5c9c64-5b75-45f4-97a7-a910b41032c9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:22.497386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.498216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.499272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.500224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.500869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.501510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.520807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] HTTP exception thrown: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Request method failure captured: Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 HTTP/1.1 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB0S7DMbfeWNajV27NO-dpWHO6zlDKgyOg-TaVB1oR-drLeXr8geCZeUup9WZrLfUuzOPnCU_utAJ8xnvcFkGTeQKmIqX9E-JjrC24OhuTb3WYeJW6mjIjO3mFSV7G6Ry31u6Px2lfx7XGaC6qh4mYqztOlrv4scYRSvjXlhxVzc2o Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9333cee966ee488888baa81cca159833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9333cee966ee488888baa81cca159833"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}] Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: edf8e722c29b4428a12703b05e0ebc2a Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6a5c9c64-5b75-45f4-97a7-a910b41032c9'} Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:22.522870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. Oct 18 16:18:22.528282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:22.530852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Returning 404 to user: Instance 6a5c9c64-5b75-45f4-97a7-a910b41032c9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:22.532461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27050ac0-2a88-4a10-bfdf-49be3ef02bd2 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9" status: 404 len: 111 microversion: 2.1 time: 0.067689 Oct 18 16:18:22.537700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2084/4188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:22 2022] GET /compute/v2.1/servers/6a5c9c64-5b75-45f4-97a7-a910b41032c9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:22.585250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2233ef53-5cdb-42fd-877f-e658998cf1e2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.232117 Oct 18 16:18:22.586012 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2105/4189] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:22.598291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:22.599046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:22.602292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.621775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.623021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.623021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.623538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.624006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.624440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.737546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.778973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-150648055", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "0400d885-7ea2-4fe9-aabb-5c42c7d66e6f"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:22.897353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] validate_networks() for [('0400d885-7ea2-4fe9-aabb-5c42c7d66e6f', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:18:22.975109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:22.987163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df966346-7a8a-46c6-b92b-94251ce84d39 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.397128 Oct 18 16:18:22.988135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2106/4190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:22 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:22.997423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:23.004374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:23.017597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:23.018259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:23.028649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:23.030294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:23.031082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:23.031840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:23.423453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:23.437206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b741baa3-a3a3-4b50-b762-2bf913abc97c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1514 microversion: 2.1 time: 0.445485 Oct 18 16:18:23.456120 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2107/4191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:22 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1514 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:23.471622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c962a6c-51e0-4839-8c6b-11b01a868f4e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '.version_select at 0x7f5fd184a5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:23.520294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c962a6c-51e0-4839-8c6b-11b01a868f4e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861424518" status: 202 len: 0 microversion: 2.1 time: 0.058748 Oct 18 16:18:23.524555 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2108/4192] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861424518 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:23.536714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-414f612a-ebea-4e8a-8bef-b5356928545f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:23.537765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-414f612a-ebea-4e8a-8bef-b5356928545f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:23.684313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-414f612a-ebea-4e8a-8bef-b5356928545f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:23.735373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-414f612a-ebea-4e8a-8bef-b5356928545f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1245 microversion: 2.1 time: 0.206992 Oct 18 16:18:23.741087 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2109/4193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:23 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1245 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:23.757317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:23.762301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:23.782658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:23.783475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:23.790004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:23.791093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:23.791909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:23.792690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.021926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:24.023116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:24.023763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:24.024423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:24.025027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:24.043049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.044367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.047056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.048035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.049558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.049960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:24.053191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.064486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57c2b0fc-6b98-4a3f-9339-41444dd2dccd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.315727 Oct 18 16:18:24.068418 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2110/4194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:23 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:24.080477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:24.105191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:24.119215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.132260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.133155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.139472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for user 7d7104a95b73405ab66140df742af14f and project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:24.181362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:24.186997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:24.325788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Going to try to stop instance {{(pid=120570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:18:24.352318 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4efac217-8941-4050-84e2-28ccac907218 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812268 Oct 18 16:18:24.355215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2085/4195] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:24.371295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0be09274-73df-4ccf-bb1b-30c63a46e86b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:24.375783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0be09274-73df-4ccf-bb1b-30c63a46e86b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:24.392392 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddcc25dd-0dc2-4f2f-bde2-c9d617268f5b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.321467 Oct 18 16:18:24.393055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2111/4196] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:24 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:24.405883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:24.406607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:24.424124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.425203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.425203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.428254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.428787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.431391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.689572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:24.706537 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c65a31ca-cc07-4b7c-9e08-45d90e4babf0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.306391 Oct 18 16:18:24.710238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2112/4197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:24 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:24.715900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:24.716829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:24.727867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.728629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.729284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.730300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.730935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.732039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.119462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0be09274-73df-4ccf-bb1b-30c63a46e86b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:25.128566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0be09274-73df-4ccf-bb1b-30c63a46e86b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1224 microversion: 2.1 time: 0.763601 Oct 18 16:18:25.133529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2086/4198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:24 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1224 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:25.146287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:25.147376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:25.150390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:25.167417 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-805223df-e07b-482d-8cff-c1a5915ead7c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1514 microversion: 2.1 time: 0.455747 Oct 18 16:18:25.170462 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2113/4199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:24 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:25.190247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.191048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.191823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.193024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.194327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.197352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:25.203708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.204408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:25.226429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.226937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.229594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.230444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.230926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.231369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.737891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:25.754767 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9bcc626-313d-4002-a7ce-90a7431b5ad1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.578621 Oct 18 16:18:25.758700 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2114/4200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:25 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:25.768236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:25.771785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:25.791574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.793480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.795303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.799143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.799874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.800563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.941900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:25.958852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9605c6f-307c-4b4a-aa54-18be7dbbd7cc tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1297 microversion: 2.1 time: 0.822853 Oct 18 16:18:25.962707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2087/4201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:25 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1297 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:26.157852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:26.190769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.192007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.192734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.233910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] Creating event network-vif-plugged:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:18:26.257710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7d85b3f6-8bdb-4148-9ea0-2550c22f2b36 req-bd3eb8f0-0f39-4403-bccf-4dc69b8e5081 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102814 Oct 18 16:18:26.259366 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2088/4202] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:18:26.269741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:26.270858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:26.275682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:26.281893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.283121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.283798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.285648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.287922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.289514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.294249 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2acfd40-a729-4d33-995f-8199aefe1877 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.534054 Oct 18 16:18:26.295206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2115/4203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:25 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:26.314009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:26.314807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:26.334984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.335497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.345441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.346315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.346807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.347251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.622207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:26.636535 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf46e8be-146b-4c15-8d9b-d52bee1b013a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1472 microversion: 2.1 time: 0.340019 Oct 18 16:18:26.646859 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2116/4204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:26 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:26.665239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08083e6-250c-4223-9c1d-0be557870a7b", "name": "network-vif-deleted", "tag": "1e92b862-f31b-4835-be2f-1c5e1f876681"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:26.703565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.724094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.725117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.747395 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] Creating event network-vif-deleted:1e92b862-f31b-4835-be2f-1c5e1f876681 for instance c08083e6-250c-4223-9c1d-0be557870a7b on n-h1-858383-14 Oct 18 16:18:26.764899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:26.775371 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f719bc9d-0259-4764-a7d2-44cfdf7cc893 req-d2cadd64-f70f-4810-b661-145ae1b44008 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117704 Oct 18 16:18:26.776872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2117/4205] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:26.782997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0cb9f28-88eb-47db-a797-8d27d0d41211 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1276 microversion: 2.1 time: 0.512581 Oct 18 16:18:26.787206 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2089/4206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:26 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1276 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:26.795916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:26.797743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:26.806758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.807614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.808284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.809378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.811427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.812446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.992487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:26.993451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:27.004726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.010057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.012345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.016775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.017622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.018372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.371142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:27.390292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:27.396773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f321fdfb-f839-4d92-92d5-8629e4d8bc7e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1303 microversion: 2.1 time: 0.409074 Oct 18 16:18:27.399517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14be1a8b-a23b-4aab-98cd-8b6525c7c736 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.618772 Oct 18 16:18:27.399973 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2118/4207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:26 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:27.409892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2090/4208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:26 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1303 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:27.413822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:27.414450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:27.435147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.436724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.439235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.445123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.446464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.447126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.549239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:27.550271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:27.558612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.559443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.560126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.561167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.562075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.562751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.610756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:27.769192 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45db1d98-6fcd-4d8a-b4cf-f3eab3c5fbe1 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 204 len: 0 microversion: 2.1 time: 0.226429 Oct 18 16:18:27.774202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2091/4209] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:27 2022] DELETE /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:27.782013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:27.784087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:27.791297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.792734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.793261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.794199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.794822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.795939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.802515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:27.851030 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd7b76be-97da-44b8-a6a1-4d390ad93f83 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.449517 Oct 18 16:18:27.861695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.861695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.861695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.861695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid c08083e6-250c-4223-9c1d-0be557870a7b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:27.878244 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2119/4210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:27 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:27.898003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:27.898918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:27.913824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.914372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.914818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:27.915545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:27.916359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:27.917191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.047070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:28.069541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5301f0b-d319-48f2-a99a-99367af2342a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 200 len: 1317 microversion: 2.1 time: 0.291449 Oct 18 16:18:28.070904 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2092/4211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:27 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:28.075954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:28.076775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:28.086033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.087057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.087894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.088818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.089883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.090508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.301842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:28.318393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1af11a51-2b3e-4623-a456-2e2adb5335ca tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1468 microversion: 2.1 time: 0.432526 Oct 18 16:18:28.319980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2120/4212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:27 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:28.429236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:28.433936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:28.458969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.459908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.460616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.461492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.463975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.464434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.610968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:28.619977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-258887a3-5b56-4fbe-9feb-9bc67b604e37 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.547788 Oct 18 16:18:28.621675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2093/4213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:28 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:28.632438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:28.638369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:28.656734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.664170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.665448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.666750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.667420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.668031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.146588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:29.165337 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ccfa623f-cb27-4a5c-9ec1-fee415e68a2a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.738676 Oct 18 16:18:29.171424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2121/4214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:28 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:29.185125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.201256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:29.240450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.240956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.241456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.242169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.242624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.243048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.262643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:29.278011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5eb3f0ec-8ab4-4241-b18e-691dda6b75cf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1519 microversion: 2.1 time: 0.652870 Oct 18 16:18:29.280485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2094/4215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:28 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:29.288953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.312550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:29.341929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.344413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.345118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.348960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.350088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.350913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.402142 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b HTTP/1.1 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c08083e6-250c-4223-9c1d-0be557870a7b'} Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:29.404758 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:18:29.410741 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:29.413350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:29.418659 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fd67d11-cace-4a4c-9c5b-7206af5ff93f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 404 len: 111 microversion: 2.1 time: 0.134286 Oct 18 16:18:29.420934 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2095/4216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:29 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:29.436742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.438895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:29.453809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:29.480365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.481116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.481857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.483682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.485044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.485713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.868941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:29.881405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d6f58a89-91d3-4461-8abf-0f9af357df64 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1468 microversion: 2.1 time: 0.459049 Oct 18 16:18:29.898426 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2096/4217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:29 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:29.904509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e652cc8b-1bd3-48aa-99ae-dff11a658810 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '.version_select at 0x7f5fd19d1c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.946997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e652cc8b-1bd3-48aa-99ae-dff11a658810 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-key-824530442" status: 202 len: 0 microversion: 2.1 time: 0.047067 Oct 18 16:18:29.948188 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2097/4218] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:18:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-824530442 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:29.971477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.973078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:29.985977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.986483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.986933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.991832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.992380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.992888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:30.423559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:30.438098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85d8d9f2-d1df-4c75-92f2-41a713469156 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 1.257426 Oct 18 16:18:30.438957 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2122/4219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:29 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:30.459256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1524977783", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:30.554093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:30.573122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:18:30.583260 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58dc76dc-ce12-4eac-9162-eeaad25b033d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.625664 Oct 18 16:18:30.589424 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2098/4220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:29 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:30.605011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:30.605757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:30.658117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:30.658750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:30.665551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:30.666975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:30.672611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:30.673479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.263254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:31.279872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9d78130-aa65-403e-8d18-7487cee780ae tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.684667 Oct 18 16:18:31.301654 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2099/4221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:30 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:31.314524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:31.315938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:31.329156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.330823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.331612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.334374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.335634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.336369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.350729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:31.647414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:31.648495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:31.649232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:31.649843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:31.650472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:31.671872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.672718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.673398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.674332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.674990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.675679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.712205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:31.715142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:31.731397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88c97a53-3ff4-4157-9145-160a3e57a859 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.438238 Oct 18 16:18:31.733060 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2100/4222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:31 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:31.736694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:31.742958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "708cd7ec-91bd-4329-8a41-74adca7d06b6", "tag": "20b1375d-c0d2-43ab-b441-6c324c4252f7"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:31.759881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.761258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.761990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.768191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:31.772065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:31.780727 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] Creating event network-changed:20b1375d-c0d2-43ab-b441-6c324c4252f7 for instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 on n-h1-858383-14 Oct 18 16:18:31.789567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-be9e63a7-90cf-4db7-aa57-b7beff3e50fe req-dbdd28f7-1021-4366-a9fc-198d0e601bd4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053123 Oct 18 16:18:31.791829 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2101/4223] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:31.800012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:31.801237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:31.809266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.810135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.812332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.813562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.814989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.815671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.869318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d31a0e38-d6a8-4b95-b3db-b070cb5dd8fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426789 Oct 18 16:18:31.877247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2123/4224] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:31.903350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:31.904182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:31.921038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.923904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.924666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.927739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.929939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.930671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.106146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:32.126397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-388bd353-4fe2-4bc9-870e-38e8b614dd1e tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1468 microversion: 2.1 time: 0.330337 Oct 18 16:18:32.128898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2102/4225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:31 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:32.147127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:32.148624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:32.172875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.175530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.176396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.177914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.181801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.182342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.442235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:32.451938 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-affd3f5f-0833-4949-8384-479f3f4b1c93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.570040 Oct 18 16:18:32.452520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2124/4226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:31 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:32.460807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:32.465250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:32.476196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:32.483356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.490055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.491402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.493387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.494080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.494761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.530799 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b08a8779-f66e-46fb-b357-1ef009ad8dbd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.400626 Oct 18 16:18:32.532412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:32.544175 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2103/4227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:32 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:32.564426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab10459a-9a61-403f-9ea5-ff2738011e26 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:32.564949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab10459a-9a61-403f-9ea5-ff2738011e26 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:32.726898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab10459a-9a61-403f-9ea5-ff2738011e26 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:32.734991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab10459a-9a61-403f-9ea5-ff2738011e26 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1209 microversion: 2.1 time: 0.188644 Oct 18 16:18:32.735588 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2104/4228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:32 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1209 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:32.766039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:32.766901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:32.781939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.782728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.783343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.786397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.787078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.787796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.993738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.009603 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d260dcba-c9a1-4cb8-b34a-f26bd98a3cc9 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.552819 Oct 18 16:18:33.010568 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2125/4229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:32 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.021518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef0c003-ec76-4121-932f-80dda207dc30", "name": "network-vif-deleted", "tag": "e5b40610-60ad-4f74-a608-60661790f1a6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:33.058723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.059617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.060209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.087571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] Creating event network-vif-deleted:e5b40610-60ad-4f74-a608-60661790f1a6 for instance eef0c003-ec76-4121-932f-80dda207dc30 on n-h1-858383-14 Oct 18 16:18:33.102017 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-358e7220-24f8-4cf2-a52b-2d49c8161251 req-4c7fccc1-244a-4d9a-a3a3-6542c08911ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083341 Oct 18 16:18:33.102017 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2126/4230] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:33.107503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.109871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.118811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.119307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.119753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.120513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.120974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.121717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.149984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.161308 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f9c24fd-5759-4e23-8fa7-397b0c5710e4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.397707 Oct 18 16:18:33.162116 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2105/4231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:32 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.167289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.167902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.174251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.174748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.175311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.176667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.177346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.177780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.262880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.275346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-813835e8-37a4-40cc-8272-9c572af1505d tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1426 microversion: 2.1 time: 0.111932 Oct 18 16:18:33.276082 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2106/4232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.403583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.422244 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e76047d2-5fb0-405b-b0db-ceb600ae06da tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.319494 Oct 18 16:18:33.424496 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2127/4233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.451525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd4b65ad-3376-4424-b137-f780f2c35f95 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:33.461482 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-bd4b65ad-3376-4424-b137-f780f2c35f95 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd4b65ad-3376-4424-b137-f780f2c35f95 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/2058cc76-7b8d-4626-a5b7-74b3a6f95ea4/action HTTP/1.1 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 15 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: {"os-stop": {}} Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2058cc76-7b8d-4626-a5b7-74b3a6f95ea4', 'body': {'os-stop': {}}} Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:33.468783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. Oct 18 16:18:33.476087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:33.479786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd4b65ad-3376-4424-b137-f780f2c35f95 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 2058cc76-7b8d-4626-a5b7-74b3a6f95ea4 has no mapping to a cell. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:33.481034 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd4b65ad-3376-4424-b137-f780f2c35f95 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/2058cc76-7b8d-4626-a5b7-74b3a6f95ea4/action" status: 404 len: 117 microversion: 2.1 time: 0.034513 Oct 18 16:18:33.481666 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2107/4234] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:33 2022] POST /compute/v2.1/servers/2058cc76-7b8d-4626-a5b7-74b3a6f95ea4/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:33.485039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.485482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.493428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.497609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.509556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.510039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.510243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.510476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.511246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.511533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.511694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.512336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.512499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.513275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.513825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.514329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.745207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.756466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b47ffecb-2c7d-4010-a9c5-5f8f3ca48fa1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.269407 Oct 18 16:18:33.778809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2108/4235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.787337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.794149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.794749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.801699 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-725d9883-f1ad-4689-88d5-90a8e6907b66 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.324890 Oct 18 16:18:33.802334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2128/4236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:33.802477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.802838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.803532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.804928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.805676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.806281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.819253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.819889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.831561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.832134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.837807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.838985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.839651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.840097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.942715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:33.959125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7bf2c29-93f4-43c0-8e9f-94b404e41dad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1213 microversion: 2.1 time: 0.151865 Oct 18 16:18:33.960578 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2129/4237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.966850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.968656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.979022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.979695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.980149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.980868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.981367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.982616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.082164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:34.097155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:34.103998 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-38f03bef-f1a9-436c-83f9-fe1f5ab365c2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.323756 Oct 18 16:18:34.120357 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2109/4238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:34.204840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:34.206894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:34.228743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.234588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.239856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.240980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.244384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.248505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.532290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:34.585843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2eda832c-efe7-4aaf-8722-e107645d0cc1 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.621633 Oct 18 16:18:34.588962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2130/4239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:34.603849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:34.604853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:34.612441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.613397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.614130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.615305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.616061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.617431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.658021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:34.677793 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35815a7e-b761-46bb-aa60-2a70d7d54270 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.494918 Oct 18 16:18:34.699367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2110/4240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:34 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:34.731080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.732376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.733705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.733923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:34.734890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid eef0c003-ec76-4121-932f-80dda207dc30 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:34.735468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 4e020d12-8210-41f7-8113-e6e4e2a0a1c0] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:34.753261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/4e020d12-8210-41f7-8113-e6e4e2a0a1c0/action HTTP/1.1 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 15 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: {"suspend": {}} Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4e020d12-8210-41f7-8113-e6e4e2a0a1c0', 'body': {'suspend': {}}} Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:34.764512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 4e020d12-8210-41f7-8113-e6e4e2a0a1c0 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:34.770229 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07d018e7-19e4-481b-9a1e-b03430d82b02 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/4e020d12-8210-41f7-8113-e6e4e2a0a1c0/action" status: 404 len: 111 microversion: 2.1 time: 0.062846 Oct 18 16:18:34.771808 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2111/4241] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:34 2022] POST /compute/v2.1/servers/4e020d12-8210-41f7-8113-e6e4e2a0a1c0/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:34.796577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:34.797769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:34.802317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:34.814705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15fe99fc-3126-446f-bc89-60c23e98ad43 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 200 len: 1303 microversion: 2.1 time: 0.222917 Oct 18 16:18:34.817365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2131/4242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:34 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:34.828935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.839749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.842073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.848807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.849719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.850445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.857867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:34.862049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:34.885747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.887522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.906349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.912463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:34.915603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:34.916073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.388056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:35.412263 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc95aa8d-8460-4bff-9713-2d8ff9bb1718 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.631445 Oct 18 16:18:35.413194 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2112/4243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:34 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:35.428072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:35.430043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:35.446212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.453491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.457045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.458593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.461271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.461916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.569901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:35.602074 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d429822-44a9-43c7-a372-4b22883a9f12 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.759168 Oct 18 16:18:35.605404 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2132/4244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:34 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:35.628114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:35.629464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:35.640744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.643574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.645296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.646783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.647875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.649747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.677074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:35.693188 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89288191-6c55-4a31-97ce-b667a846f89f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1261 microversion: 2.1 time: 0.278132 Oct 18 16:18:35.695195 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2113/4245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:35 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1261 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:35.702942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:35.717297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.718263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.720227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.741448 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] Creating event network-changed:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:18:35.748140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b837e608-6e70-4842-9db4-0cbfc825e9d6 req-b1a8f945-702d-46a2-a902-0a6bb555db94 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051431 Oct 18 16:18:35.752094 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2114/4246] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:35.771234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:35.774366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:35.792333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.792842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.793322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.796278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.798266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.798770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.948632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:35.963914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9fec067-d98b-40bb-a033-ddbfd9e0a421 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.345027 Oct 18 16:18:35.969042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2133/4247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:35 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.003991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.016338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.032065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.035948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.039464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.040484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.041294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.045187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.125263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.151624 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0527a6a-794c-409f-9fa7-9d04b573455c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.395406 Oct 18 16:18:36.165080 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2115/4248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:35 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.191581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.192598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: eef0c003-ec76-4121-932f-80dda207dc30] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.207930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.208499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.209220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.210062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.210523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.210958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.236525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] HTTP exception thrown: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Request method failure captured: Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 HTTP/1.1 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB0S7DMbfeWNajV27NO-dpWHO6zlDKgyOg-TaVB1oR-drLeXr8geCZeUup9WZrLfUuzOPnCU_utAJ8xnvcFkGTeQKmIqX9E-JjrC24OhuTb3WYeJW6mjIjO3mFSV7G6Ry31u6Px2lfx7XGaC6qh4mYqztOlrv4scYRSvjXlhxVzc2o Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9333cee966ee488888baa81cca159833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9333cee966ee488888baa81cca159833"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}] Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: edf8e722c29b4428a12703b05e0ebc2a Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'eef0c003-ec76-4121-932f-80dda207dc30'} Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:36.246175 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Returning 404 to user: Instance eef0c003-ec76-4121-932f-80dda207dc30 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13c23c84-bfe7-4a5b-b6cf-91ad294e3442 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30" status: 404 len: 111 microversion: 2.1 time: 0.088792 Oct 18 16:18:36.254946 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2116/4249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/eef0c003-ec76-4121-932f-80dda207dc30 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:36.268143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:36.268143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.278651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.279497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.280258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.281534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.282528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.283255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.362572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lazy-loading 'flavor' on Instance uuid aee72ab8-e58d-4dfe-905b-47a5e377f50b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:36.414811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.429998 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b7ebd30-84bf-4290-9273-f97e0b2a4b86 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.445267 Oct 18 16:18:36.433265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2134/4250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:35 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.441956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.442632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.450936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.451524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.452702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.453849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.454906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.455581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.490362 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d5f86e4-8028-4cc5-ab7a-dfd549d050af tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.227339 Oct 18 16:18:36.496104 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2117/4251] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:36 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:36.506744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.508557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.520515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:36.551863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.553276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.554255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.555729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.556748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.557737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.646520 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d681abbb-20df-4608-a422-17f274daa29a tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "DELETE /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 204 len: 0 microversion: 2.1 time: 0.211693 Oct 18 16:18:36.649764 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2135/4252] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:36 2022] DELETE /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:36.665862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.667173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.686436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.687033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.687656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.688477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.689041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.689645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.933787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.947821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f88e48ec-518c-4328-8a73-5700d404e525 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1514 microversion: 2.1 time: 0.448861 Oct 18 16:18:36.970070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2118/4253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.979482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.981301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.995077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.996205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.997473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.999245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.000254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.001247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.192260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:37.220502 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a07bc16b-8b72-40ba-9e64-f26528bc5e7e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1679 microversion: 2.1 time: 0.566935 Oct 18 16:18:37.233752 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2136/4254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1679 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:37.249453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:37.260498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:37.277858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.279571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.280146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.281370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.282677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.286090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.314053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:37.333740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba747e67-2a91-435c-bea0-aa10c8de9245 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1468 microversion: 2.1 time: 0.360885 Oct 18 16:18:37.350565 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2119/4255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:37.364959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:37.366388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:37.377865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.379059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.379728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.381106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.381995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.382782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.389999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:37.497788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:37.514687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ebbe9c2a-f7c8-489a-a34d-6eaa132eb210 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1267 microversion: 2.1 time: 0.276750 Oct 18 16:18:37.525037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2137/4256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:37 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:37.533248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:37.534567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:37.551165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.552207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.553062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.553972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.554625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.555067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.740890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:37.757659 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2254f067-f4ff-44ce-aa94-68528d128ece tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.404695 Oct 18 16:18:37.763352 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2120/4257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:37 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:37.778542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708cd7ec-91bd-4329-8a41-74adca7d06b6", "name": "network-vif-plugged", "status": "completed", "tag": "20b1375d-c0d2-43ab-b441-6c324c4252f7"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:37.794723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:37.795566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:37.796332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:37.812538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] Creating event network-vif-plugged:20b1375d-c0d2-43ab-b441-6c324c4252f7 for instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 on n-h1-858383-14 Oct 18 16:18:37.819981 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-11001250-6d48-473c-821c-3a04dae5fb35 req-0e5f5a14-45f5-4c0e-a600-d1f9f83ba863 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054406 Oct 18 16:18:37.821302 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2121/4258] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:37.991089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:37.993599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:38.026709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.027903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.029232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.032687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.033915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.036321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.422214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:38.442804 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed6abb66-c413-4e93-9019-8b7fcb89c54a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.919137 Oct 18 16:18:38.443403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2138/4259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:37 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:38.449642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:38.450542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:38.470543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.471377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.471986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.473596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.474267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.474880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.600769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:38.611714 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97a2e4f8-fb5f-4a3c-8d42-0a9c87dcf5ba tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1497 microversion: 2.1 time: 0.634483 Oct 18 16:18:38.622142 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2122/4260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:37 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1497 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:38.653213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:38.653853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:38.669117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.669855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.671010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.672132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.675858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.676876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.942651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:38.959785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a00d67b8-25c3-438b-ae74-7d535d35d8d6 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1468 microversion: 2.1 time: 0.335925 Oct 18 16:18:38.960394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2123/4261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:38 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:38.981915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:38.982805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:38.995934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.997254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.997695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.998657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.999291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.999894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.097918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:39.111244 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c0a327d-9e83-4661-af65-9d1b33c379bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1656 microversion: 2.1 time: 0.665318 Oct 18 16:18:39.131484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:39.133533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2139/4262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:38 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1656 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:39.146968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:39.157656 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d1f3efb-1abb-4d3f-a04b-c54f2cf26bc1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1267 microversion: 2.1 time: 0.181766 Oct 18 16:18:39.158956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:39.160396 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2124/4263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:38 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:39.186434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.186926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.187377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.188131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.188587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.189032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.192605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:39.193282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:39.213303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.213816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.214270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.215283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.215473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.215893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.279968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lazy-loading 'flavor' on Instance uuid aee72ab8-e58d-4dfe-905b-47a5e377f50b {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:39.288760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:39.313026 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'suspend' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state suspended Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 15 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: {"suspend": {}} Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'suspend' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state suspended Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'suspend': {}}} Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state suspended. Cannot suspend while the instance is in this state. Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 18 16:18:39.317085 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state suspended Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state suspended Oct 18 16:18:39.323188 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:39.327745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'suspend' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state suspended {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:39.328848 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3f24df4-92f5-4c55-8579-a592d34201e7 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 148 microversion: 2.1 time: 0.187952 Oct 18 16:18:39.332660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2140/4264] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:39 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 148 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:18:39.348711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:39.357133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.358519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.359515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.404782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Going to try to start instance {{(pid=120570) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:18:39.499248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-254482a1-d60e-4ddc-b2e2-f620a6fec782 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.162798 Oct 18 16:18:39.500343 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2141/4265] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:39 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:39.508724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:39.509852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:39.523845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.524902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.525668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.526690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.527564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.528766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.679125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7eda19cd-40f2-4ee8-8144-e4f8bb800ccf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 202 len: 0 microversion: 2.1 time: 0.174948 Oct 18 16:18:39.684735 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2142/4266] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:39 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:39.688073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:39.689086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:39.712207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:39.720303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.721216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.721663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.722956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.723411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.723986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.075670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.090883 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a6f786a-aebf-4813-b492-b3dc938e8bda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1324 microversion: 2.1 time: 0.919073 Oct 18 16:18:40.098688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2125/4267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:39 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1324 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:40.111074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:40.111695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:40.136980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.138536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.139219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.140827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.141781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.142853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.444819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.459499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e8b7790-7ab1-43a8-adf5-cd1b65388e3c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.359241 Oct 18 16:18:40.460730 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2126/4268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:40 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:40.467349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:40.468277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:40.489938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.491167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.492060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.494194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.495020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.495680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.529435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.540881 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd5bf268-c74f-4765-8bd6-5a359137d8f2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.859042 Oct 18 16:18:40.547782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2143/4269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:39 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:40.561571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:40.562698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:40.596154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.596693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.597205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.598296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.598810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.604241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.669101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.670117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.671868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.672547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lazy-loading 'fault' on Instance uuid 968fd83b-f594-44e0-a813-34f5a92b126c {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:40.845230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.854913 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13ba7cd2-9edd-4a36-82d0-dd60f910b354 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1503 microversion: 2.1 time: 0.392852 Oct 18 16:18:40.860149 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2127/4270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:40 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:40.892056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:40.896368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:40.898217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf8e722c29b4428a12703b05e0ebc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9333cee966ee488888baa81cca159833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.906974 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c990c72f-e2da-45d4-ac18-cfeed302a5fc tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 200 len: 1303 microversion: 2.1 time: 0.357864 Oct 18 16:18:40.907560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2144/4271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:40 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 1303 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:40.912029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968fd83b-f594-44e0-a813-34f5a92b126c", "name": "network-vif-deleted", "tag": "765b8e6d-a332-4721-88b6-0c81578d7a04"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:40.925786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.926336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.926783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.928528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.929255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.929872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.938317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.938792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.939216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.964965 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] Creating event network-vif-deleted:765b8e6d-a332-4721-88b6-0c81578d7a04 for instance 968fd83b-f594-44e0-a813-34f5a92b126c on n-h1-858383-14 Oct 18 16:18:40.978833 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2d51fa71-9d24-4138-a403-33d7eafbe2a4 req-0e0b7ac5-4e19-4fae-aba4-905e93622c1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070021 Oct 18 16:18:40.979457 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2145/4272] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:40.989416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "name": "network-vif-plugged", "status": "completed", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:41.017637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.018161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.018593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.047282 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] Creating event network-vif-plugged:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:18:41.053829 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d869fa03-3db8-4639-823a-992d8d316add req-88708e59-6cea-4d7c-8f39-bc53eb186f1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073051 Oct 18 16:18:41.054715 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2146/4273] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:41.142172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:41.143258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:41.153498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:41.161885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.162431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.165701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.167325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9923510d-0e39-4bc9-8163-bd33e9b15e94 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.293628 Oct 18 16:18:41.169106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2128/4274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:40 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:41.169616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.171391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.177556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.485438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:41.487182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:41.506622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.507740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.509872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.511300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.512149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.513154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.684857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:41.762683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=14 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:41.792522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:41.803222 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d614907-cd1b-463c-bc51-cafbd8b628fe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.666108 Oct 18 16:18:41.804387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2147/4275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:41 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:41.809456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:41.810301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:41.827881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.830246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.831092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.835484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.837461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.839488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.382069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:42.399633 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed4a4197-03b8-4179-9101-281c0f8b6c31 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.918686 Oct 18 16:18:42.401182 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2129/4276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:41 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:42.413414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:42.419666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:42.422414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:42.428671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a11aed03-e273-4924-9b88-0bc26625f3a6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1370 microversion: 2.1 time: 0.622644 Oct 18 16:18:42.435754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.436526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.437179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.438080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.438706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.439303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.453104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2148/4277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:41 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1370 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:42.462322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:42.463442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:42.475090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.475948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.476635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.477597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.478220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.478868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.734756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:42.830868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:42.846866 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64af655f-97ca-4110-8b14-040194b628ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.443544 Oct 18 16:18:42.848250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2130/4278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:42 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:42.854509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:42.855258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] [instance: 968fd83b-f594-44e0-a813-34f5a92b126c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:42.862066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.862998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.863953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.864925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.865636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.866490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.887753 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] HTTP exception thrown: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Request method failure captured: Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c HTTP/1.1 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtB0S7DMbfeWNajV27NO-dpWHO6zlDKgyOg-TaVB1oR-drLeXr8geCZeUup9WZrLfUuzOPnCU_utAJ8xnvcFkGTeQKmIqX9E-JjrC24OhuTb3WYeJW6mjIjO3mFSV7G6Ry31u6Px2lfx7XGaC6qh4mYqztOlrv4scYRSvjXlhxVzc2o Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9333cee966ee488888baa81cca159833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9333cee966ee488888baa81cca159833"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9333cee966ee488888baa81cca159833"}]}] Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9333cee966ee488888baa81cca159833 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MigrationsAdminTest-1040654924 Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: edf8e722c29b4428a12703b05e0ebc2a Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MigrationsAdminTest-1040654924-project Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '968fd83b-f594-44e0-a813-34f5a92b126c'} Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:42.890417 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] Returning 404 to user: Instance 968fd83b-f594-44e0-a813-34f5a92b126c could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fe60220-af1b-41b3-b40a-52bf7bdaa369 tempest-MigrationsAdminTest-1040654924 tempest-MigrationsAdminTest-1040654924-project] 10.222.0.78 "GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c" status: 404 len: 111 microversion: 2.1 time: 0.042798 Oct 18 16:18:42.899189 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2131/4279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:42 2022] GET /compute/v2.1/servers/968fd83b-f594-44e0-a813-34f5a92b126c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:42.903032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:42.903032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:42.909420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.910132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.910357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.911068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.911545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.911945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.080697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:43.095349 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-359d0958-87fd-4811-a7fc-2b1d862e4f6e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1503 microversion: 2.1 time: 0.638798 Oct 18 16:18:43.096202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2149/4280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:42 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:43.104942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78d0656-6904-4b88-961b-51ba1ffdd9da", "tag": "b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:43.126542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.126971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.127404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.167704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] Creating event network-changed:b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b for instance e78d0656-6904-4b88-961b-51ba1ffdd9da on n-h1-858383-14 Oct 18 16:18:43.173647 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-36eb1ac4-814a-474f-842b-7b2b85709063 req-5c6196dc-7fc6-4266-8928-8dfaa4e94eb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074357 Oct 18 16:18:43.174492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2150/4281] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:43.180752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81a46eeb-c88a-4c24-865d-0d9c5a756690 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1877800017", "metadata": {"": ""}}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81a46eeb-c88a-4c24-865d-0d9c5a756690 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action HTTP/1.1 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 107 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1877800017", "metadata": {"": ""}}} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1877800017', 'metadata': {'': ''}}}} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'': ''} Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:43.196856 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81a46eeb-c88a-4c24-865d-0d9c5a756690 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81a46eeb-c88a-4c24-865d-0d9c5a756690 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action" status: 400 len: 170 microversion: 2.1 time: 0.022300 Oct 18 16:18:43.204506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2151/4282] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 18 16:18:43 2022] POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:43.215857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:43.220308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:43.240908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.240908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.241498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.242109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.242649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.242982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.415520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:43.426268 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b909bf19-b765-4ac1-8d35-b839b388b054 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.528070 Oct 18 16:18:43.427308 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2132/4283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:42 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:43.448368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:43.449490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:43.458709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.459465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.460088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.460967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.461620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.462225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.817077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:43.851243 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ffb7305-21e4-42f1-804a-c38f1c077f25 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1665 microversion: 2.1 time: 0.406879 Oct 18 16:18:43.851864 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2133/4284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:43 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1665 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:43.883335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:43.886406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:43.904214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.905046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.910949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.910949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.910949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.912272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.913508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:43.930406 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-760369e1-14c7-4226-a0d2-80b532607b77 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.724972 Oct 18 16:18:43.931182 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2152/4285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:43 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:43.956098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:43.957819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:43.966569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.967523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.968146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.970447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.972206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.973078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.233977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:44.255586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:44.256362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83cb4ff4-5755-4ade-8433-a1b74b1d4bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.304707 Oct 18 16:18:44.265441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58f669d0-11fc-4fd9-9570-023c4bb47cc4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1562 microversion: 2.1 time: 0.412436 Oct 18 16:18:44.274415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2134/4287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:43 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1562 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:44.274705 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2153/4287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:43 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:44.306117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:44.311346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:44.313456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65e66d7e-9c40-480a-8f06-304ddd631417 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1984035921", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:44.333173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65e66d7e-9c40-480a-8f06-304ddd631417 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action HTTP/1.1 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 619 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1984035921", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1984035921', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:18:44.333465 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 16:18:44.337679 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.344602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65e66d7e-9c40-480a-8f06-304ddd631417 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:44.344809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.344809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.346851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.346851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.346851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.355392 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65e66d7e-9c40-480a-8f06-304ddd631417 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action" status: 400 len: 938 microversion: 2.1 time: 0.056706 Oct 18 16:18:44.362513 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2135/4288] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 18 16:18:44 2022] POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action => generated 938 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:44.385667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:44.387664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:44.407556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.409704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.411349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.412698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.418870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.420806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.623235 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a650e2f-477c-42ec-8afb-1ad5e6ddb4d7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256115 Oct 18 16:18:44.624675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2136/4289] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:18:44 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:44.642689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:44.644710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:44.656052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.663826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.664668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.674261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.674945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.675758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.727595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:44.735876 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60b21cd6-b49e-4b55-bca0-1286995d561f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1503 microversion: 2.1 time: 0.455235 Oct 18 16:18:44.736454 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2154/4290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:44 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:44.744456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:44.745097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:44.763140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.764213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.767776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.768631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.769896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.772162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.143138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:45.154198 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23d4fc77-91c1-4cd7-9fde-9bfb633533a4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.527204 Oct 18 16:18:45.155419 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2137/4291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:44 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:45.162220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:45.163208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:45.170039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.171662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.172317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.173395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.178969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.179675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.200086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:45.213500 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64a21e9d-9fa7-46d1-bf24-cd5742876d6c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.472664 Oct 18 16:18:45.214098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2155/4292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:44 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:45.225734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:45.226343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:45.245715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.257011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.257805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.258744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.259366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.259978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.558424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:45.574435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e70d9bcc-1106-436c-8572-672a8931f971 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.417619 Oct 18 16:18:45.579001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2138/4293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:45 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:45.613304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:45.614306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:45.622274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.622838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.623340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.624381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.625077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.625721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.669625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:45.842883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:45.873615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33689143-ad4f-4456-81f5-eec92e81a5c1 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.648566 Oct 18 16:18:45.875068 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2156/4294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:45 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:45.903859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:45.912438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:45.964545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.973312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.974201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:45.977876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:45.978637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:45.981746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.307018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:46.321583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a699ab13-bdfd-4031-b8eb-e359afcb9da1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.713236 Oct 18 16:18:46.326628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2139/4295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:45 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:46.332151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-718341c3-c2e4-4507-9177-deea750ca559 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-718341c3-c2e4-4507-9177-deea750ca559 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action HTTP/1.1 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 285 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.347203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:18:46.351343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:46.355193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-718341c3-c2e4-4507-9177-deea750ca559 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:46.358511 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-718341c3-c2e4-4507-9177-deea750ca559 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action" status: 400 len: 619 microversion: 2.1 time: 0.030510 Oct 18 16:18:46.363161 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2140/4296] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 18 16:18:46 2022] POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:18:46.381866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:46.382825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:46.399416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.400447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.400617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.402144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.408687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.409123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.709785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:46.710707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:46.722769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4d8b701-e787-41a1-b064-d94dcf4bf628 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.357213 Oct 18 16:18:46.732176 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2141/4297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:46 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:46.734099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66e6cb9d-a5ca-4091-8f2b-53a0e163853f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.854393 Oct 18 16:18:46.736937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2157/4298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:45 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:46.741030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:46.741632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:46.752225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:46.761848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.762779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.766722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.768158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.770011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.770941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:46.771936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.807421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.809806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.812633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.817150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:46.818078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:46.820959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:46.869314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:47.127303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:47.145514 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d7eaec1c-79ae-43b2-a122-b0ea63ae2c61 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.411043 Oct 18 16:18:47.146648 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2142/4299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:46 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:47.158216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:47.159034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:47.173273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:47.178697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:47.179393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:47.180613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:47.181360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:47.181993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:47.514777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:47.531414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-998def3a-2d69-472a-bb6b-73bf3c60a517 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.378199 Oct 18 16:18:47.532630 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2143/4300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:47 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:47.541131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:47.542583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:47.558649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:47.560241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:47.560887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:47.562325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:47.562945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:47.563370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:47.915941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:47.930745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-688cf899-58d0-4faa-922b-c01273fa955c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 1.188548 Oct 18 16:18:47.931716 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2158/4301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:46 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:47.946258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:47.947108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 5f65025d-14b9-40bf-bdd1-3541ada7d807] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:47.966028 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/5f65025d-14b9-40bf-bdd1-3541ada7d807/action HTTP/1.1 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 15 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: {"unpause": {}} Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5f65025d-14b9-40bf-bdd1-3541ada7d807', 'body': {'unpause': {}}} Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:47.968017 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 5f65025d-14b9-40bf-bdd1-3541ada7d807 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13e9a3b2-6c48-4501-9a64-783ca33bdb78 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/5f65025d-14b9-40bf-bdd1-3541ada7d807/action" status: 404 len: 111 microversion: 2.1 time: 0.036604 Oct 18 16:18:47.974959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2159/4302] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:47 2022] POST /compute/v2.1/servers/5f65025d-14b9-40bf-bdd1-3541ada7d807/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:47.983967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:47.984755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:48.004243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.004862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.005450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.006086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.006544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.006973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.175827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:48.192226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0183f5f3-2773-477b-ac99-81584aca5ed6 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.656473 Oct 18 16:18:48.209455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2144/4303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:47 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:48.231297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:48.231944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:48.247156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.247637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.248078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.248796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.249275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.249708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.624391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:48.640339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:48.658846 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e159dd75-2004-4cdd-8279-3351eca064b3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.682951 Oct 18 16:18:48.660286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2160/4304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:47 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:48.662303 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51bb7289-1d4b-4a71-b9ae-72fb343dd8a7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.447562 Oct 18 16:18:48.664375 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2145/4305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:48 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:48.680690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:48.683446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:48.687331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:48.688925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:48.695880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.697343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.698173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.698644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:48.699246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.700051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.701111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.721147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.723130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.727461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:48.728726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:48.729472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:48.730183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.099910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:49.117339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f91e993e-16f5-49bf-926a-d79c648cc793 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.455648 Oct 18 16:18:49.120680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2161/4306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:48 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:49.130367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:49.145789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:49.158868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.159421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.159858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.160722 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dab48c7-709a-4504-9e1d-90e8525f3def tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.491954 Oct 18 16:18:49.162673 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2146/4307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:48 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:49.184276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1409082509"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:49.192125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:49.209094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] Creating event network-changed:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:18:49.211087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.213041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.216383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.219488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b1bca407-3272-49c1-8c11-aeaa2ec361a5 req-7cc455a6-d6f9-46b1-98c7-6b8b11db57cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097262 Oct 18 16:18:49.221581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.223366 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2162/4308] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:49.225199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.226669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.610861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-901371403", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:49.812214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:18:49.826300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dff2b644-76dd-42c3-9f93-06b9cc0b3e41 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action" status: 202 len: 0 microversion: 2.1 time: 0.662061 Oct 18 16:18:49.827578 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2147/4309] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:49 2022] POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:18:49.835966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:49.838728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:49.852810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.853758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.868377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.871418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.872904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.873815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:50.708340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:50.734564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa189197-abd0-49bb-9760-954b6e11dcc5 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.904993 Oct 18 16:18:50.735591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2148/4310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:49 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:50.767457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:50.769106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:50.777479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:50.778389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:50.779094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:50.780152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:50.780857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:50.781653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:50.828617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'flavor' on Instance uuid bf4345bc-4647-4ee4-95a1-716a7c6c4a96 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:18:50.988941 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b955cb12-2888-405a-b209-00455041ac1d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.233317 Oct 18 16:18:50.990504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2149/4311] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:50 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:51.006751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:51.011094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.034783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.035447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.036181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.036933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.037413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.038445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.121268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:51.122100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:51.122255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:51.122596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:51.124231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:51.149913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.152223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.153362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.154604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.156887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.157911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.194118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Getting quotas for project 6cc9b0ddd863459ca89e442b6362dff6. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:51.207237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Getting quotas for user d7875829b50540cb950fd805d969baa2 and project 6cc9b0ddd863459ca89e442b6362dff6. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:51.227865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:51.230970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:51.311952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a04d528-338f-48de-af00-17d905204018 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.083992 Oct 18 16:18:51.313204 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2163/4312] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:51.333306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1909557863"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:51.337594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.349623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.350708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.351558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.353148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.353799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.354445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.433176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Cannot 'createImage' instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 while it is in task_state image_snapshot Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action HTTP/1.1 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 85 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1909557863"}} Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'createImage' instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 while it is in task_state image_snapshot Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1909557863'}}} Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:18:51.435150 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 while it is in task_state image_snapshot Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 while it is in task_state image_snapshot Oct 18 16:18:51.440578 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.442985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 409 to user: Cannot 'createImage' instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 while it is in task_state image_snapshot {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:51.444324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e9fb2ed-dd37-47fc-a45d-97c123ef32d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action" status: 409 len: 159 microversion: 2.1 time: 0.128717 Oct 18 16:18:51.445238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2164/4313] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:51 2022] POST /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6/action => generated 159 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:18:51.457517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78d0656-6904-4b88-961b-51ba1ffdd9da", "name": "network-vif-plugged", "status": "completed", "tag": "b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:51.498286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.504254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.507380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.545460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] Creating event network-vif-plugged:b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b for instance e78d0656-6904-4b88-961b-51ba1ffdd9da on n-h1-858383-14 Oct 18 16:18:51.556751 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-27b3cafd-f0ac-4038-894d-576617b2ffd9 req-e56fe4cf-7b54-4419-825b-38c74dd66326 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110034 Oct 18 16:18:51.557587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2165/4314] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:51.576114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:51.576752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.595779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:51.601423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.602038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.602572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.603581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.604189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.604850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.609647 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d78da0e-ab77-4724-8cee-56c2625e5b0b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.612514 Oct 18 16:18:51.632774 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2150/4315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:50 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:51.644636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:51.645380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.657691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.658198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.658643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.659395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.659864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.660299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.697777 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'unpause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 15 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: {"unpause": {}} Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'unpause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'unpause': {}}} Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state active. Cannot unpause while the instance is in this state. Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:51.703762 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'unpause' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:51.717774 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-35119068-ed1b-4df5-9248-046fac9ecf29 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 145 microversion: 2.1 time: 0.153795 Oct 18 16:18:51.719762 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2166/4316] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:51 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 145 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:18:51.738187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-712a3a62-321f-40a3-bbdd-fb723ef5902c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:51.742741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-712a3a62-321f-40a3-bbdd-fb723ef5902c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.876950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-712a3a62-321f-40a3-bbdd-fb723ef5902c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:51.890405 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-712a3a62-321f-40a3-bbdd-fb723ef5902c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1221 microversion: 2.1 time: 0.164445 Oct 18 16:18:51.892928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2167/4317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:51 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:51.899538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fabba72e-d7e6-42f5-aa27-a9b38ea0b87f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd645e670>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.148765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:52.160958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e528c7ed-38e5-4114-ad94-748f98c485c1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1677 microversion: 2.1 time: 0.527725 Oct 18 16:18:52.161657 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2151/4318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:51 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1677 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:52.174133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.177297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:52.193733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.194233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.194672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.195380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.195834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.196265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.291636 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fabba72e-d7e6-42f5-aa27-a9b38ea0b87f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/images/7f18c4b6-67b8-42d9-b6c3-8b41b0a09064" status: 204 len: 0 microversion: 2.1 time: 0.397352 Oct 18 16:18:52.292394 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2168/4319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:51 2022] DELETE /compute/v2.1/images/7f18c4b6-67b8-42d9-b6c3-8b41b0a09064 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:52.304254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.305609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:52.317344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.318144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.318877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.319794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.320456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.321099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.520850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:52.531128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f7c5631-06dc-4941-b093-dd2a5213182d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1540 microversion: 2.1 time: 0.232467 Oct 18 16:18:52.531819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2169/4320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:52 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:52.636015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:52.659393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.661200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:52.687051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0af64f81-8a13-49ce-b3d3-ea40efd9b62a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.501630 Oct 18 16:18:52.688220 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2152/4321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:52 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:52.697142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.698309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.700259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.703733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.704519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.707237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.740437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.741520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:52.764131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.771275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.772169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.773128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.774575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.775155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.005613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:53.015269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30949c46-5b4f-4556-88a9-cffb2fa46d6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1309 microversion: 2.1 time: 0.373997 Oct 18 16:18:53.016555 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2170/4322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:52 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:53.033244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:53.034047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.042602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.043100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.043678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.045407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.046299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.046750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.158675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:53.169794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:53.180686 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba88d5de-f201-4b3e-b872-a1b06efbf3fb tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.449526 Oct 18 16:18:53.181803 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2153/4323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:52 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:53.191637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e8b098cd-2b3e-40fa-a55e-d9bec898e363 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1217 microversion: 2.1 time: 0.171549 Oct 18 16:18:53.194559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2171/4324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:53 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:53.222235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:53.222611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:53.223242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.223459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: cbb72d14-de06-49e6-8e75-94dcbc35c171] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.233761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/cbb72d14-de06-49e6-8e75-94dcbc35c171/action HTTP/1.1 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 18 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: {"unshelve": null} Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'cbb72d14-de06-49e6-8e75-94dcbc35c171', 'body': {'unshelve': None}} Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:53.238812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. Oct 18 16:18:53.248880 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.255642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance cbb72d14-de06-49e6-8e75-94dcbc35c171 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:53.255642 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12ffa46d-f9ee-4caf-ae04-f224aac4ca5f tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/cbb72d14-de06-49e6-8e75-94dcbc35c171/action" status: 404 len: 111 microversion: 2.1 time: 0.041611 Oct 18 16:18:53.256570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2172/4325] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:53 2022] POST /compute/v2.1/servers/cbb72d14-de06-49e6-8e75-94dcbc35c171/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:53.273296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:53.275464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.278540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:53.291424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.292749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.294659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.296221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.297133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.297928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.561235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:53.573185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df532a83-754f-41fa-8850-35d9a7a4b371 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.309844 Oct 18 16:18:53.573828 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2173/4326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:53 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:53.581008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:53.582183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.590745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.591584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.592595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.594045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.597769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.598733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.052905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:54.095788 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b047dbf7-6b6e-423b-83a0-eba523675709 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1540 microversion: 2.1 time: 0.517517 Oct 18 16:18:54.101181 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2174/4327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:53 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1540 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:54.115047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:54.115999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:54.138176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.139243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.140261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.142856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.144356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.145403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.187675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:54.213143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94142415-ecb9-48fd-ab69-478058dc7ea7 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1660 microversion: 2.1 time: 1.002445 Oct 18 16:18:54.228691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2154/4328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:53 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1660 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:54.245150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:54.245784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:54.269739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.272422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.273183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.274167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.274871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.275610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.883146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:54.920621 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1fd334ba-609b-4b49-a780-a6aa864fa9dc tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.816828 Oct 18 16:18:54.942597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2175/4329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:54 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:54.958720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:54.964743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:54.966639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:54.976559 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f873ecb-2e20-4670-843c-605325e0bfcb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1490 microversion: 2.1 time: 0.744592 Oct 18 16:18:54.982138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.983002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.983610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:54.984757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:54.985406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:54.986340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.008377 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2155/4330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:54 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1490 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:55.023229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:55.024159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:55.051796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.072819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.073772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.083280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.084571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.085582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.276426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:55.307448 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea415d2f-188f-48fe-8914-06d950300039 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1273 microversion: 2.1 time: 0.361467 Oct 18 16:18:55.317583 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2176/4331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:54 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1273 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:55.333969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:55.335359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:55.358572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.359682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.360899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.363317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.367027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.371132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.399509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1e72663-604e-46e5-a508-3955169927bb tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action" status: 202 len: 0 microversion: 2.1 time: 0.367557 Oct 18 16:18:55.400683 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2156/4332] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:55 2022] POST /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:18:55.437457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:55.444034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:55.480253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.481081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.481786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.482931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.504910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.506244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.547190 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Cannot 'unshelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action HTTP/1.1 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 18 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: {"unshelve": null} Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'unshelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'unshelve': None}} Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b in vm_state active. Cannot unshelve while the instance is in this state. Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:18:55.557858 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 409 to user: Cannot 'unshelve' instance aee72ab8-e58d-4dfe-905b-47a5e377f50b while it is in vm_state active {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:55.564943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f9e5bd6-6b1c-45ce-9b01-869efc76e0a6 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action" status: 409 len: 146 microversion: 2.1 time: 0.240929 Oct 18 16:18:55.571832 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2177/4333] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:55 2022] POST /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b/action => generated 146 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:18:55.592401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1524977783", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:55.765128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:18:56.313439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:56.323933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50a22fa0-4a35-45ac-be07-0900b8ab3103 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1540 microversion: 2.1 time: 0.919471 Oct 18 16:18:56.328729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2157/4334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:55 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1540 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:56.340583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:56.341678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:56.361795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.363192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.363806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:56.364530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.365023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.365455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:56.932068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:56.933179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:56.934635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:56.941317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:56.944843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:56.968734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.969301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.969742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:56.973343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.973877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.974315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.032787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:57.048879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:57.078502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:57.081569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:57.150056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e027729-b14f-4650-b6a0-a601efac3f3b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576646 Oct 18 16:18:57.150989 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2178/4335] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:57.156431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:57.157327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:57.167390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:57.169968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.170515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.171065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.171787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.172250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.172678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.231807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:57.253071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df6f5b76-74b8-46a0-8aba-7b70d6e46893 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1666 microversion: 2.1 time: 0.922881 Oct 18 16:18:57.254663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2158/4336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:56 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1666 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:57.261938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708cd7ec-91bd-4329-8a41-74adca7d06b6", "name": "network-vif-plugged", "status": "completed", "tag": "20b1375d-c0d2-43ab-b441-6c324c4252f7"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:57.271747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.272232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.272692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.302554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] Creating event network-vif-plugged:20b1375d-c0d2-43ab-b441-6c324c4252f7 for instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 on n-h1-858383-14 Oct 18 16:18:57.328139 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f2590d7e-af6d-4857-b3bb-eb7e41bcef43 req-06e9a72b-e98b-479a-940b-baff7c34f046 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070601 Oct 18 16:18:57.333592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2159/4337] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:57.346366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:57.348152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:57.379675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.381198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.382455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.384362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.385678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.386805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.564691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:57.578735 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ed5ab68-1614-4e39-bc63-ec3cfcd00c35 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1279 microversion: 2.1 time: 0.242845 Oct 18 16:18:57.586346 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2160/4338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:57 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:57.604083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9d4ca2e-cc88-48a6-b1e6-10c394062a8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:57.604863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9d4ca2e-cc88-48a6-b1e6-10c394062a8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:57.757024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9d4ca2e-cc88-48a6-b1e6-10c394062a8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:57.764620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9d4ca2e-cc88-48a6-b1e6-10c394062a8a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1209 microversion: 2.1 time: 0.176420 Oct 18 16:18:57.767547 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2161/4339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:57 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:57.775784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:57.792890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:57.839863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.840776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.841500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:57.842550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:57.843281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:57.843971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.076984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:58.089354 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a302c7db-fa14-4264-90fb-fb4367dbcd9a tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.936901 Oct 18 16:18:58.107907 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2179/4340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:57 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:58.127437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.129227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.145312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.146296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.146815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.147570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.148042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.148479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.249331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:58.268883 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8755c400-b012-4157-ba29-b6d24ab99630 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1522 microversion: 2.1 time: 0.497663 Oct 18 16:18:58.281836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2162/4341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:57 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:58.304776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.306134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.336452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.337516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.338241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.339313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.339909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.345731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.044869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:59.064623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd59edfc-e984-4ee0-af84-ad9ad1df7d58 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1666 microversion: 2.1 time: 0.770156 Oct 18 16:18:59.068689 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2163/4342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:58 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1666 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:59.086583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:59.092246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:59.116365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.116920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.117397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.118531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.119122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.155589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.233464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:59.358166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:59.413760 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d60700f-7614-4067-a14f-310ede1df529 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 1.278885 Oct 18 16:18:59.415342 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2180/4343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:58 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:59.433757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68ad2c73-9cc7-4135-8b4e-a38002cc6a94 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 204 len: 0 microversion: 2.1 time: 0.362322 Oct 18 16:18:59.434377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:59.441205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:59.442195 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2164/4344] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:59 2022] DELETE /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:59.457062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:59.458227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:59.465329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.466115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.466743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.467660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.468285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.468875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.472684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.473545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.474068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.475959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.475959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.475959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.611747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:59.626568 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67b5580b-18c8-4cb0-93e2-9edfe0995b0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1261 microversion: 2.1 time: 0.175057 Oct 18 16:18:59.631527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2165/4345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:59 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:59.645446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1948561910_updated"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:59.650681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 1301bf4b-7edc-4132-b882-91e1685fac67] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:59.662393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/servers/1301bf4b-7edc-4132-b882-91e1685fac67 HTTP/1.1 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 81 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1948561910_updated"}} Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '1301bf4b-7edc-4132-b882-91e1685fac67', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1948561910_updated'}}} Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 16:18:59.664572 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:18:59.675910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 1301bf4b-7edc-4132-b882-91e1685fac67 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:59.684527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f603190-a0b0-4413-a300-e37e6a7bb640 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "PUT /compute/v2.1/servers/1301bf4b-7edc-4132-b882-91e1685fac67" status: 404 len: 111 microversion: 2.1 time: 0.042735 Oct 18 16:18:59.684527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2166/4346] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:18:59 2022] PUT /compute/v2.1/servers/1301bf4b-7edc-4132-b882-91e1685fac67 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:59.692277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:59.692472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:59.705783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.705783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.706749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.707074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:59.707894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:59.708588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:59.964769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:59.988258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe92275d-e749-43f5-8eda-bf7ff164074f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.571146 Oct 18 16:18:59.988877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2181/4347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:59 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:59.999573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:00.000203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:00.017752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.021806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.022133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.023112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.024632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.025309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.030563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:00.180449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:00.223738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9672af2a-9ab8-447a-8176-4368e74c4d8b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1528 microversion: 2.1 time: 0.535980 Oct 18 16:19:00.239973 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2167/4348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:59 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1528 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:00.286166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:00.287304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:00.317407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.318498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.319271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.323173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.327651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.328564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.523179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:00.548286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd3ecab8-b76d-43d4-bf72-b08b61745ecf tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.558175 Oct 18 16:19:00.565872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2182/4349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:59 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:00.591971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:00.593248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:00.608886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.610789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.611867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.614873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.616055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.617158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.892602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:00.911961 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b3fad57-c34d-45e7-b137-1c238979feb1 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 0.666351 Oct 18 16:19:00.913485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2168/4350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:00 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:00.922097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:00.923688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:00.955209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.957257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.960276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:00.964127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:00.964768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:00.965333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.150838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:01.174008 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dfa49195-fad1-421b-bc3d-f679724696c6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1261 microversion: 2.1 time: 0.257941 Oct 18 16:19:01.177548 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2169/4351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:00 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:01.187161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:01.188752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:01.215947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:01.227041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.228225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.229520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.231529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e4fd274-007e-45f0-b5ba-9817be117195 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.648712 Oct 18 16:19:01.233469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.241980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.243550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.246274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2183/4352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:00 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:01.266332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:01.267019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:01.284402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.284975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.288732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.289955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.291872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.294010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.799336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:01.826258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ac7e7a8-8ddf-40f0-aa5a-9d460ab88386 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.576833 Oct 18 16:19:01.828551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2184/4353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:01 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:01.835715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:01.836917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:01.848505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.850260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.851251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:01.852689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:01.853512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:01.854549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.358172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:02.417109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:02.424304 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b65d7136-8ce9-4afa-af5f-51f6bb07fc11 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1669 microversion: 2.1 time: 1.244670 Oct 18 16:19:02.426087 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2170/4354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:01 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1669 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:02.445717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5961cb69-f8cc-4243-b5ff-e2d1faa6ec8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5961cb69-f8cc-4243-b5ff-e2d1faa6ec8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b HTTP/1.1 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 280 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.486336 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:02.498848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5961cb69-f8cc-4243-b5ff-e2d1faa6ec8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:02.509851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5961cb69-f8cc-4243-b5ff-e2d1faa6ec8d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 400 len: 619 microversion: 2.1 time: 0.071290 Oct 18 16:19:02.511088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2171/4355] 10.222.0.78 () {60 vars in 1257 bytes} [Tue Oct 18 16:19:02 2022] PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 619 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:19:02.519879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade2af31-8f90-4dcb-b31e-681ae5ed2b4b", "tag": "768dddf8-7654-4892-b62d-ace098a840da"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:02.544854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.545663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.546359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.564097 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] Creating event network-changed:768dddf8-7654-4892-b62d-ace098a840da for instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b on n-h1-858383-14 Oct 18 16:19:02.570988 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6f4266c1-7772-498d-a94a-27157b2a84d4 req-59c975b9-feeb-4e0e-ad0c-c5bb2675d88e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Oct 18 16:19:02.571842 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2172/4356] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:02.578143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708cd7ec-91bd-4329-8a41-74adca7d06b6", "name": "network-vif-unplugged", "status": "completed", "tag": "20b1375d-c0d2-43ab-b441-6c324c4252f7"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:02.590983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.591991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.592788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.612596 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] Creating event network-vif-unplugged:20b1375d-c0d2-43ab-b441-6c324c4252f7 for instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 on n-h1-858383-14 Oct 18 16:19:02.620121 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0d6b266c-d93a-45ed-9b3b-35a2316a1c4a req-35722cac-f88a-4041-aeab-80dde8b1c580 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046484 Oct 18 16:19:02.621815 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2173/4357] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:02.631421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:02.633128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:02.657421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.663538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.666087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:02.667467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.669747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.671192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.673188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.677074 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-402c7412-6d09-4b74-bbf6-970e7d3d608e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1528 microversion: 2.1 time: 0.846214 Oct 18 16:19:02.698137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2185/4358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:01 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1528 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:02.711499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:02.712887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:02.731367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.733045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.736859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.738689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:02.739432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:02.740060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:02.847517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:02.865250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Working on deleting snapshot 0957f4a7-2fd7-476f-8a1c-a8f3e58614cd from shelved instance... Oct 18 16:19:03.064609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:03.084798 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4136351f-e10b-4677-b67f-f68c21c9d668 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1267 microversion: 2.1 time: 0.459820 Oct 18 16:19:03.086712 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2174/4359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:02 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1267 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:03.092106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:03.092898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:03.102245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:03.103506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:03.104174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:03.105109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:03.106368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:03.107523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:03.751053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:03.770905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4aed9d1-061c-4971-b577-f34e60be45e8 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.682891 Oct 18 16:19:03.785410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2175/4360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:03 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:03.798102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:03.798730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:03.813729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:03.814237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:03.814687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:03.816379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:03.816847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:03.817325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:04.210620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Doing local delete in cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120570) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 16:19:04.211359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:04.212235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:04.212752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:04.213393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 16:19:04.218484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] deallocate_for_instance() {{(pid=120570) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 16:19:04.566396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:04.577045 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc5e3c64-5864-4cef-a28c-76be47aba672 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.790307 Oct 18 16:19:04.577990 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2176/4361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:03 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:04.586406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:04.587591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:04.616373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:04.616912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:04.617368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:04.618092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:04.623107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:04.623645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:04.773051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:04.782626 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-009f95ff-e1d0-49b7-821e-bbd8e3a955c3 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 200 len: 1486 microversion: 2.1 time: 0.203273 Oct 18 16:19:04.787174 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2177/4362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:04 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:04.801869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:04.803129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:04.819674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:04.820301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:04.823944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:04.826212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:04.826709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:04.829562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.172186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:05.187152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b9a1087-948f-4e7b-8619-7a8a57601763 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.391953 Oct 18 16:19:05.188705 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2178/4363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:04 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:05.195270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:05.196252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:05.204916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.206947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.207581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.209655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.210797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.211428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.348750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Updating instance_info_cache with network_info: [] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:19:05.710995 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dec03feb-c5df-4148-9223-2c154e32ed93 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 204 len: 0 microversion: 2.1 time: 3.011305 Oct 18 16:19:05.714074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2186/4364] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:02 2022] DELETE /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 0 bytes in 3015 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:05.723719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:05.730958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708cd7ec-91bd-4329-8a41-74adca7d06b6", "name": "network-vif-deleted", "tag": "20b1375d-c0d2-43ab-b441-6c324c4252f7"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:05.736826 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bc94bc0-0b41-465b-9c85-40413d45781e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.546300 Oct 18 16:19:05.741310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2179/4365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:05 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:05.755058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-571ecfdc-3f5f-496b-880a-05bcb51a9565 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-571ecfdc-3f5f-496b-880a-05bcb51a9565 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b HTTP/1.1 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 24 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": ""}} Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b', 'body': {'server': {'name': ''}}} Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi '' Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:19:05.760438 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 16:19:05.766883 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.773320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-571ecfdc-3f5f-496b-880a-05bcb51a9565 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:05.773320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-571ecfdc-3f5f-496b-880a-05bcb51a9565 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 400 len: 108 microversion: 2.1 time: 0.028404 Oct 18 16:19:05.773320 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2180/4366] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:19:05 2022] PUT /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:19:05.777041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.777608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.777940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.779230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490d464-852e-471c-ba03-a3ebe3d19b37", "name": "network-vif-deleted", "tag": "284e36b2-05c9-4468-9fae-9ce34d64e1f1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:05.794381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.795578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.796888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.806630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] Creating event network-vif-deleted:20b1375d-c0d2-43ab-b441-6c324c4252f7 for instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 on n-h1-858383-14 Oct 18 16:19:05.812431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-22819331-ef41-4306-be66-0721458de519 req-b08420c2-8724-4074-b346-d1307363df93 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095102 Oct 18 16:19:05.813961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_external_events [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] Unable to find a host for instance d490d464-852e-471c-ba03-a3ebe3d19b37. Dropping event network-vif-deleted {{(pid=120571) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 16:19:05.816166 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ee1697f3-8367-4c5a-9d3b-fef96dd1ea28 req-9cfab3df-d85b-44b6-8fbe-4086e803b845 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.042212 Oct 18 16:19:05.818003 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2181/4367] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 16:19:05.818428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2187/4368] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:05.825647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:05.826921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:05.835191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.840343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:05.840343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: d490d464-852e-471c-ba03-a3ebe3d19b37] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:05.843621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.844377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.845845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.847780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.848328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.848767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.849177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.849710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.850111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.850243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.851071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.871428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 HTTP/1.1 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'd490d464-852e-471c-ba03-a3ebe3d19b37'} Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:05.873483 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:05.883639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 404 to user: Instance d490d464-852e-471c-ba03-a3ebe3d19b37 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:05.888038 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7805e27-91dc-4b1c-9e12-e60eeccb53c4 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37" status: 404 len: 111 microversion: 2.1 time: 0.064739 Oct 18 16:19:05.888038 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2188/4369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:05 2022] GET /compute/v2.1/servers/d490d464-852e-471c-ba03-a3ebe3d19b37 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:05.892960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:05.895232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:05.903724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.904759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.905495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:05.906552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:05.907421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:05.908078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.304757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:06.315103 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82dc8d4a-14e1-4dd2-9316-652b1e51b36e tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1506 microversion: 2.1 time: 0.427072 Oct 18 16:19:06.322150 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2189/4370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:05 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:06.327393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:06.331012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:06.345307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.348391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.349071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.349893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.351407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.352190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.384873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:06.394769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b4c73ae-ce05-48ce-b271-52cac9050a12 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.575060 Oct 18 16:19:06.405557 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:19:06.406135 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2182/4371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:05 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 HTTP/1.1 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6'} Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:06.418132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c88e79e4-8f19-46be-8e58-57fbab7b9950 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 404 len: 111 microversion: 2.1 time: 0.091991 Oct 18 16:19:06.423770 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2190/4372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:06 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:06.434587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:06.435658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:06.436858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-425195fb-1110-4de1-82b6-cf8769a98010 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'create', calling method: .version_select at 0x7f5fd31e3c10>, body: {"keypair": {"name": "tempest-keypair-876902989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAw6MFpqtClpyV2EeyS9+C13j2ZhAUZ+Kj+jsMG/hOLMOTiHeOOD7WdiwEaqOxUkHizevyUqr1MY3INKh33KckQpebZ3hr7Y8rFNad9Vqd4OSBS6Hqjw96/IOx1tbJoEeg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:06.447047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.447047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.447047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.447047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.447771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.448630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.469028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-425195fb-1110-4de1-82b6-cf8769a98010 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for project f4faf70c703a4417bd7131aef1d7475d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:06.500351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-425195fb-1110-4de1-82b6-cf8769a98010 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for user 7d7104a95b73405ab66140df742af14f and project f4faf70c703a4417bd7131aef1d7475d. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:06.545853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:06.574174 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-425195fb-1110-4de1-82b6-cf8769a98010 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134057 Oct 18 16:19:06.578636 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2183/4373] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:06.770656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:06.771387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:06.786130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.788921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.789832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:06.790764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:06.798238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:06.802568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:07.023607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:07.073390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=14 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:07.078852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6b7f153-0159-4ab0-9219-b0d9ec9f38ec tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 204 len: 0 microversion: 2.1 time: 0.660590 Oct 18 16:19:07.080173 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2191/4374] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:06 2022] DELETE /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:07.099009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:07.100648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:07.117379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:07.118502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:07.119443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:07.120597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:07.121660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:07.122401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:07.370544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:07.386891 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a956356-d564-48b9-b2fd-941fd0f6bb95 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.620728 Oct 18 16:19:07.388078 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2184/4375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:06 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:07.436741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:07.437644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:07.459283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:07.460425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:07.461966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:07.468433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:07.469200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:07.469925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:07.474837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:07.490309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:07.505450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17b511cb-74d7-46f9-a48b-1f8a4075935d tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1465 microversion: 2.1 time: 0.416374 Oct 18 16:19:07.533562 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2192/4376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:07 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1465 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:08.175234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:08.206964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-525c597f-b9b2-4ad7-be5d-b8d2e58a9318 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.770905 Oct 18 16:19:08.233437 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2185/4377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:07 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:08.420791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:08.421740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:08.435020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:08.440586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:08.445775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:08.447109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:08.448530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:08.449247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:08.562567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:08.563645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:08.607144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:08.608114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:08.608842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:08.610359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:08.611138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:08.619952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:08.911617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:08.942012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-42d83cac-6fe8-471d-83c6-e406fb75810e tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1465 microversion: 2.1 time: 0.388099 Oct 18 16:19:08.942212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:08.956309 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2186/4378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:08 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1465 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:08.970109 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-075b3dd9-0159-4374-91d4-f622d4ebcd45 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.542996 Oct 18 16:19:08.977043 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2193/4379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:08 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:09.253749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:09.255519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:09.267273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:09.271213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:09.273487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:09.274545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:09.277521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:09.278614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:09.421089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad854ec-0843-42aa-b4bb-abbc17d19f8a", "tag": "049393f4-4b9d-4c3f-b27f-3e409dd45408"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:09.477816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:09.479058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:09.479379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:09.540598 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] Creating event network-changed:049393f4-4b9d-4c3f-b27f-3e409dd45408 for instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a on n-h1-858383-14 Oct 18 16:19:09.555991 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f634c5e0-f267-490d-8bba-d6d0463ac933 req-79df0242-10d3-44f0-bf99-b45113e79fd0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141746 Oct 18 16:19:09.557070 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2194/4380] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:19:09.977512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:09.985635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:10.009523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:10.020536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:10.027443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:10.033372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:10.035999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:10.038447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:10.969919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:11.018640 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-209208e7-bf8e-48b2-ab33-2132604ec3ab tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 1.769180 Oct 18 16:19:11.019559 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2187/4381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:09 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:11.047517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:11.052763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:11.087987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:11.089749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:11.092192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:11.096894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:11.098506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:11.102173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:11.316478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:11.364607 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7271c9c1-97dd-4ef0-9089-9a6263651fe2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1465 microversion: 2.1 time: 1.389866 Oct 18 16:19:11.373884 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2195/4382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:09 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1465 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:11.410593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade2af31-8f90-4dcb-b31e-681ae5ed2b4b", "name": "network-vif-plugged", "status": "completed", "tag": "768dddf8-7654-4892-b62d-ace098a840da"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:11.525549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:11.529297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:11.531840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:11.563155 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] Creating event network-vif-plugged:768dddf8-7654-4892-b62d-ace098a840da for instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b on n-h1-858383-14 Oct 18 16:19:11.573904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-71e5d857-b275-411a-aec2-f73810e7be84 req-b60aa780-3058-4fda-bb26-bd7d3b3e5fea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196108 Oct 18 16:19:11.575764 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2196/4383] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:11.972791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582ea8a4-b73e-4cb6-9b90-5b3f0664455d", "name": "network-vif-deleted", "tag": "b28093cd-c4b6-4f34-a453-53c464e57ab5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:12.016244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.023230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.024985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.079490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] Creating event network-vif-deleted:b28093cd-c4b6-4f34-a453-53c464e57ab5 for instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d on n-h1-858383-14 Oct 18 16:19:12.096494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8092d637-7952-40fb-b1e7-0ee996ee6ce9 req-dfef47f7-d69c-4819-8b73-b698a91593b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133723 Oct 18 16:19:12.098184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2197/4384] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:12.103931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:12.122234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:12.139455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.140142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.140679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.141677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.142271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.142800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.782630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:12.798686 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9559167-8b34-425f-9669-adb6736da4fa tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.699046 Oct 18 16:19:12.800385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2198/4385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:12 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:12.817737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:12.825600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:12.838111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.840486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.848015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.849239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.850961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.862018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.964278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:12.964875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:12.965484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:12.966227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'fault' on Instance uuid 582ea8a4-b73e-4cb6-9b90-5b3f0664455d {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:13.062605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:13.072535 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a87a2df6-6871-47aa-8053-a81d9f0ab3b2 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 200 len: 1305 microversion: 2.1 time: 0.265696 Oct 18 16:19:13.082527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2199/4386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:12 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:13.674921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:13.691820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-668bd9a4-f390-4606-bb52-50208d4b434d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 2.669032 Oct 18 16:19:13.695063 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2188/4387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:11 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:13.836569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:13.837918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:13.856709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:13.859901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:13.864185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:13.868499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:13.869953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:13.871617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:13.924806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1405549453", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:13.944698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:14.088383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] validate_networks() for [('0400d885-7ea2-4fe9-aabb-5c42c7d66e6f', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:19:14.622112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:14.635294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a432765d-5871-4fd0-a9c1-815c860f0202 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.801672 Oct 18 16:19:14.636373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2200/4388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:13 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:14.661416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:14.671626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 582ea8a4-b73e-4cb6-9b90-5b3f0664455d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:14.699888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.702924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.705165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:14.711019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.712181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.716881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:14.749536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d HTTP/1.1 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '582ea8a4-b73e-4cb6-9b90-5b3f0664455d'} Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:14.755571 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. Oct 18 16:19:14.761670 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:14.764882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 404 to user: Instance 582ea8a4-b73e-4cb6-9b90-5b3f0664455d could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:14.769344 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-41625b2f-8f61-437e-b817-f9a497c29540 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d" status: 404 len: 111 microversion: 2.1 time: 0.114769 Oct 18 16:19:14.770230 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2201/4389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:14 2022] GET /compute/v2.1/servers/582ea8a4-b73e-4cb6-9b90-5b3f0664455d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:14.795393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:14.797771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:14.816646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.819310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.820087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:14.821148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.823680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.833104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:14.949492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:14.950117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:14.950748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:14.951557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:14.951988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:14.973772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.974681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.975327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:14.977892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:14.978615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:14.980322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.001379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:15.011048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for user 7d7104a95b73405ab66140df742af14f and project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:15.029496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:15.032337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:15.169757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3240571c-8b63-4e6b-aae8-ce4b57f636b0 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.252010 Oct 18 16:19:15.170779 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2189/4390] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:19:15.178521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:15.179791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:15.190602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.191431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.192261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.193747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.194406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.195002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.279150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:15.448326 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b4cd8f10-6649-48da-befc-2a8c06d5be4b tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 204 len: 0 microversion: 2.1 time: 0.272611 Oct 18 16:19:15.448971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2190/4391] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:15 2022] DELETE /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:15.468034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f933abf-9fc1-4efb-b0e4-2a663444afa2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:15.468556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f933abf-9fc1-4efb-b0e4-2a663444afa2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:15.548333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:15.570066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-360f5b85-0043-43fb-a85b-eeac31d929b9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.786638 Oct 18 16:19:15.577049 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2202/4392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:14 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:15.587185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:15.590672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:15.606128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f933abf-9fc1-4efb-b0e4-2a663444afa2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:15.618528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f933abf-9fc1-4efb-b0e4-2a663444afa2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1225 microversion: 2.1 time: 0.163320 Oct 18 16:19:15.619508 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2191/4393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:15 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1225 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:15.638392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.645375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.648508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.652742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.655883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.657477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.666488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:15.668885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:15.681356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.682768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.683512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.685148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.686024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.689174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.745103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.978097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:15.995694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bf6cae8-bfea-484c-b142-470ff729636e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.334962 Oct 18 16:19:16.009023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2192/4394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:15 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:16.136545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:16.158100 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8d52b29-0bdc-4058-a8c3-38967912db50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1508 microversion: 2.1 time: 0.583443 Oct 18 16:19:16.165948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2203/4395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:15 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:16.599839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:16.600474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:16.616681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:16.617523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:16.618160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:16.620784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:16.622046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:16.623913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:16.660135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:16.661456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:16.684736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:16.688458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:16.692693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:16.695654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:16.696382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:16.697051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.085803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:17.103930 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e499221-0492-4288-b3b3-459ebeb675dd tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1277 microversion: 2.1 time: 0.449285 Oct 18 16:19:17.128948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2204/4396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:16 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1277 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:17.153960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.155962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:17.180321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.181544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.182418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.184647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.186272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.190732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.391200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:17.430487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afe49a13-b8d3-40b8-94c2-a0bfa325acbc tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.836257 Oct 18 16:19:17.432237 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2193/4397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:16 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:17.448875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.451303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:17.465768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.471642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.475295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.476716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.479129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.479844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.550758 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 HTTP/1.1 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7fc12c05-0954-4f24-bdb6-701a67b55471'} Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:17.553952 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:17.559575 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aadecb22-2afc-4c75-8061-8a7761fbacc0 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 404 len: 111 microversion: 2.1 time: 0.124306 Oct 18 16:19:17.563240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2194/4398] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:17 2022] DELETE /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:17.580401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.584879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:17.621403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.621920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.627489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.628484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.629097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.632041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.694962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:17.704200 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-252c371f-8dc8-4965-985c-571f282d2466 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1321 microversion: 2.1 time: 0.573609 Oct 18 16:19:17.704805 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2205/4399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:17 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:17.751523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69351565-cf4d-4d96-8624-0d8d46c953af", "name": "network-vif-deleted", "tag": "7ce66c86-c944-42a5-a343-9dab7f31f106"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:17.782894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.783326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.784919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.811150 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] Creating event network-vif-deleted:7ce66c86-c944-42a5-a343-9dab7f31f106 for instance 69351565-cf4d-4d96-8624-0d8d46c953af on n-h2-858383-14 Oct 18 16:19:17.821393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ba517a27-86fa-4993-83c7-65ddfcd62d92 req-2340aa57-87aa-4a99-80e1-0dafe18168a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080643 Oct 18 16:19:17.822008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2206/4400] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:17.838311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.841521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: 7fc12c05-0954-4f24-bdb6-701a67b55471] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:17.875060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.876137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.877757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.880221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.891902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.893816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.961789 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 HTTP/1.1 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '7fc12c05-0954-4f24-bdb6-701a67b55471'} Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:17.968820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. Oct 18 16:19:17.975275 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:17.979478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance 7fc12c05-0954-4f24-bdb6-701a67b55471 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:17.979478 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30720b55-256f-41e7-93fa-bc91a74fa78d tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471" status: 404 len: 111 microversion: 2.1 time: 0.150502 Oct 18 16:19:17.981434 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2207/4401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:17 2022] GET /compute/v2.1/servers/7fc12c05-0954-4f24-bdb6-701a67b55471 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:17.995529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.997334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:18.007179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.008387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.009295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.010471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.011366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.012148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.115067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:18.282584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25e99c8c-1ecf-4d01-9905-a342862175b4 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 204 len: 0 microversion: 2.1 time: 0.297579 Oct 18 16:19:18.283198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2208/4402] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:17 2022] DELETE /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:18.301732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:18.304953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:18.318648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.319172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.319611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.324076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.324593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.325169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.326140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:18.341943 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-113fc8d7-3843-4bb8-aa00-bb326e2a461f tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1300 microversion: 2.1 time: 0.777466 Oct 18 16:19:18.342553 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2195/4403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:17 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1300 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:18.378814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:18.379482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:18.386099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.386918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.387550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.388531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.389284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.394278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.651249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:18.677895 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1de0f7d5-26f2-44a6-91ae-88d4f751d656 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1283 microversion: 2.1 time: 0.383773 Oct 18 16:19:18.678574 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2209/4404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:18 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1283 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:18.700474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:18.702534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:18.717975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.719799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.720681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.724745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.725920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.729527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.116179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:19.121594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:19.130364 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11d89461-4ee4-4925-af59-e1fd3c7b064c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.450466 Oct 18 16:19:19.130971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2210/4405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:18 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:19.158434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:19.159929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:19.171544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2e53f0f-8037-49cd-85d7-5803ea9a8b14 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.812154 Oct 18 16:19:19.173367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2196/4406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:18 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:19.178230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.181985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.182698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.183609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.185600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.186386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.212444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:19.384388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:19.389688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:19.420197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.426988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.428550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.430529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.432008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.436126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.523300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.523809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.524459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.525194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'fault' on Instance uuid 69351565-cf4d-4d96-8624-0d8d46c953af {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:19.676304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:19.685762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:19.717622 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c884780b-fe7c-4cfc-97eb-997746fd530a tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1470 microversion: 2.1 time: 0.560066 Oct 18 16:19:19.718764 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2211/4407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:19 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1470 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:19.728456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:19.743926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:19.760439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.764754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.765664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.767504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.768740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.771696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.781044 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1d7127e-99c2-4fff-b14f-14350388cdae tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 200 len: 1305 microversion: 2.1 time: 0.395249 Oct 18 16:19:19.796599 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2197/4408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:19 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 1305 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:19.981984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:20.019799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff4f6921-4770-49e7-be9a-13e9b66289e9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1283 microversion: 2.1 time: 0.293099 Oct 18 16:19:20.021034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2212/4409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:19 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:20.160437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:20.169997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:20.208462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.209521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.210434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:20.211860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.212785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.218852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:20.385431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:20.386044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] [instance: aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:20.397167 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] HTTP exception thrown: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Request method failure captured: Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff/action HTTP/1.1 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 15 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHoF__rOglYZAGn4m9my_QSun2QllbM66G1VM-SB6UFl5Zm5SIvA-phJ-ujd2aTJK1Q1tyge-ENtuosRJSd9hVR9X-XdZQgvNNFsUr_GqcxT7LR92wru1__3fFELUlKxQZTWWH20WXoDdmomvxg9QTXwaR54T_C9t7sM2prKHaa6vg Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}] Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9895b06667a7463297c8151854551ca1 Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: {"migrate": {}} Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff', 'body': {'migrate': {}}} Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:20.399500 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. Oct 18 16:19:20.405669 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:20.407086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Returning 404 to user: Instance aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:20.408261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97cf4e8b-9152-41cf-b1d4-2bfbf2ae70b5 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff/action" status: 404 len: 111 microversion: 2.1 time: 0.615168 Oct 18 16:19:20.415784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2198/4410] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:19 2022] POST /compute/v2.1/servers/aedaf9d5-7e4c-40bb-bc8d-f427dcfd58ff/action => generated 111 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:20.421579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:20.432477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:20.463444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.463967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.464631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:20.465774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.466812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.468005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.000871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:21.010556 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4893e47-fa0b-4cdb-9d33-06eb1576befd tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1512 microversion: 2.1 time: 0.593213 Oct 18 16:19:21.025767 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2199/4411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:20 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1512 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:21.045996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-449720539", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:21.126785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] validate_networks() for None {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:19:21.379001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:21.399963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9141d37-7693-4490-a4c5-3a1966af64e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 1.247445 Oct 18 16:19:21.412736 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2213/4412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:20 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:21.419715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:21.420712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 69351565-cf4d-4d96-8624-0d8d46c953af] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:21.434109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.434988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.435670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.436622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.437349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.443120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.466499 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af HTTP/1.1 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '69351565-cf4d-4d96-8624-0d8d46c953af'} Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:21.468543 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. Oct 18 16:19:21.474633 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:21.479783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 404 to user: Instance 69351565-cf4d-4d96-8624-0d8d46c953af could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:21.481642 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47eca5a5-5454-4d6b-962e-5bd5ca7acb43 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af" status: 404 len: 111 microversion: 2.1 time: 0.067372 Oct 18 16:19:21.487600 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2214/4413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:21 2022] GET /compute/v2.1/servers/69351565-cf4d-4d96-8624-0d8d46c953af => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:21.513176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:21.514467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:21.515245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:21.515418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:21.516313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:21.516935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:21.519198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:21.537307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.537927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.538194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.538615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.539599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.540245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.541252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.546847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.548390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.551349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.552727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.553396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.587977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Getting quotas for project 6cc9b0ddd863459ca89e442b6362dff6. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:21.597994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Getting quotas for user d7875829b50540cb950fd805d969baa2 and project 6cc9b0ddd863459ca89e442b6362dff6. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:21.622536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:21.626159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:21.721200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c4f8051-fd20-4d7a-9208-fa5a48a440b0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693432 Oct 18 16:19:21.723001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2200/4414] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:19:21.840188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1768601807", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "814c787d-9383-44e8-82a3-f6205ed1ea85"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:21.932678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] validate_networks() for [('814c787d-9383-44e8-82a3-f6205ed1ea85', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:19:22.069434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:22.083193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdc7dcfe-ff60-4ad5-b549-92c3b058b93c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.593296 Oct 18 16:19:22.084144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2215/4415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:21 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:22.105371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:22.106063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:22.126714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.127767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.128213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:22.128919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.129418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.129849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:22.209809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:22.392705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:22.413004 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-510c7bc8-3290-4660-990f-8989c932bcc9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 204 len: 0 microversion: 2.1 time: 0.325728 Oct 18 16:19:22.416843 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2216/4416] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:22 2022] DELETE /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:22.433456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99e02f76-0928-46b3-b476-7bfbe196721c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:22.435982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99e02f76-0928-46b3-b476-7bfbe196721c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:22.699213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99e02f76-0928-46b3-b476-7bfbe196721c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:22.712132 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99e02f76-0928-46b3-b476-7bfbe196721c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1221 microversion: 2.1 time: 0.291409 Oct 18 16:19:22.713595 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2217/4417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:22 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1221 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:22.731010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad854ec-0843-42aa-b4bb-abbc17d19f8a", "name": "network-vif-plugged", "status": "completed", "tag": "049393f4-4b9d-4c3f-b27f-3e409dd45408"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:22.771188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.772548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.774690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:22.811584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] Creating event network-vif-plugged:049393f4-4b9d-4c3f-b27f-3e409dd45408 for instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a on n-h1-858383-14 Oct 18 16:19:22.863151 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-79fc7e7f-2cf3-4aac-86d0-5719243dbb37 req-46881e30-f980-4390-b0a4-2ed399426044 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144322 Oct 18 16:19:22.865335 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2218/4418] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:22.881909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:22.884483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:22.922824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.925548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.927538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:22.957522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.960302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.963471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.356471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:23.365024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:23.367808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:23.371457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:23.385288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:23.422498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=21 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:23.431002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.431546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.432199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.433374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.434139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.434713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.501644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Getting quotas for project eee97a09ef2f48b694ad82e7f5a93d5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:23.509030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466ba2f759a34d11b6dd8887bb49554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f13c8b99d641b0b30333ec27f72b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:23.526835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Getting quotas for user 4b9a32a405e24a27bc8088db06d9d6fe and project eee97a09ef2f48b694ad82e7f5a93d5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:23.529210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fa965c3-767d-4ae6-8ee4-2224eb465b6c tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 200 len: 1302 microversion: 2.1 time: 0.661060 Oct 18 16:19:23.532254 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2219/4419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:22 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 1302 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:23.561379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:23.563559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:23.569213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:23.572195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:23.585461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.586883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.588714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.592714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.603638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.603638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.724157 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99f99ecd-5a71-4249-af31-1fde2a7124b9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999639 Oct 18 16:19:23.724832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2201/4420] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:19:23.744831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:23.746228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:23.758553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.759063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.759574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.760370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:23.760957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:23.761557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.145460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.160325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c5fcb872-9960-4bd5-a496-99a446484822 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1309 microversion: 2.1 time: 0.421736 Oct 18 16:19:24.166232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.173512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2202/4421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:23 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.182297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee72ab8-e58d-4dfe-905b-47a5e377f50b", "name": "network-vif-deleted", "tag": "e2b373d7-4cf4-46cd-8677-a6327409e7f2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:24.186835 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6dcc0ee-903a-4350-ac78-12cb4f210bd8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1494 microversion: 2.1 time: 0.645635 Oct 18 16:19:24.194030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.194841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.195977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.218174 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2220/4422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:23 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1494 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.237525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] Creating event network-vif-deleted:e2b373d7-4cf4-46cd-8677-a6327409e7f2 for instance aee72ab8-e58d-4dfe-905b-47a5e377f50b on n-h2-858383-14 Oct 18 16:19:24.245250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:24.246425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:24.256606 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a6d6622a-0241-41f7-a7be-77161c431ceb req-798fd128-32f8-4cf7-871f-f953bf9d458b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080979 Oct 18 16:19:24.265457 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2203/4423] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:24.276489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.280346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a039a66-64ca-4148-9fc8-fb7f58d16c25 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:24.281820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.282473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.283420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.284141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.285557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.290458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a039a66-64ca-4148-9fc8-fb7f58d16c25 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:24.512769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a039a66-64ca-4148-9fc8-fb7f58d16c25 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.527155 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a039a66-64ca-4148-9fc8-fb7f58d16c25 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1217 microversion: 2.1 time: 0.256253 Oct 18 16:19:24.527755 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2204/4424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:24 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.541361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:24.541361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:24.565222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.565534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.565973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.566887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.567499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.568090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.678513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.686891 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab119b62-9a00-47f5-b3c4-20dbab9c5929 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1273 microversion: 2.1 time: 0.158011 Oct 18 16:19:24.688298 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2205/4425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:24 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.695145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:24.696641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] [instance: aee72ab8-e58d-4dfe-905b-47a5e377f50b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:24.717258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.718048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.718710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.719599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.720254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.721388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.736963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.762114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c7d32df-28c1-4177-a88f-a70b5b2ac66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.541773 Oct 18 16:19:24.766103 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2221/4426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:24 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.769797 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] HTTP exception thrown: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Request method failure captured: Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b HTTP/1.1 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtDxbmOol-mvQmWrn-FUvWfjI3FUcffQ8hBrFKs-gR9JU0dUZZuygCsTsMkkUnOEMCIrsIy9Fyi7KLtqucWHsBx5I-UnC-_wR-FDuOJHaT7_N5FFBfyUvG7rmH_P5PHo0B-KPJ8oJZaL0NHPKqhIJLY8vJoDrA7IhC63nFMP2cgR0Dc Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09f13c8b99d641b0b30333ec27f72b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09f13c8b99d641b0b30333ec27f72b9a"}]}] Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 09f13c8b99d641b0b30333ec27f72b9a Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-350725051 Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 466ba2f759a34d11b6dd8887bb49554d Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-350725051-project Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'aee72ab8-e58d-4dfe-905b-47a5e377f50b'} Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:24.773562 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. Oct 18 16:19:24.783123 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:24.785677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] Returning 404 to user: Instance aee72ab8-e58d-4dfe-905b-47a5e377f50b could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:24.787778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-994af198-50cd-473c-9d2c-ec4e6c08ef83 tempest-ServersNegativeTestJSON-350725051 tempest-ServersNegativeTestJSON-350725051-project] 10.222.0.78 "GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b" status: 404 len: 111 microversion: 2.1 time: 0.097726 Oct 18 16:19:24.788735 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2206/4427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:24 2022] GET /compute/v2.1/servers/aee72ab8-e58d-4dfe-905b-47a5e377f50b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:25.191854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.193346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.224144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.224605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.225271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.225890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.228640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.229759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.231212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.233594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.238399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.238995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.239447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.240191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.240650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.242464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.561514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:25.571585 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0831f9e-e0b6-4cf4-a8e7-99a837c0f9f8 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1452 microversion: 2.1 time: 0.353290 Oct 18 16:19:25.572185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2207/4428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1452 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:25.597480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.598355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.605100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.606045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.606643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.607561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.608011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.608541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.707462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:25.729235 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-135da8ed-2c2e-4c9b-a517-11f2d15318c5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1491 microversion: 2.1 time: 0.532649 Oct 18 16:19:25.730207 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2222/4429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1491 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:25.755429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:25.758205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.759376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.766074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.766787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.767167 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9293f773-2971-4471-8d03-5d6e67fb8ff0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1269 microversion: 2.1 time: 0.180779 Oct 18 16:19:25.768258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.768737 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2208/4430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:25.769423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.770115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.770703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.777443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.778067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.801578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.804309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.804917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.809365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.809903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.810353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.008468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.023619 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5572b6a-bd81-45ce-891e-fcf729481ae0 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1279 microversion: 2.1 time: 0.275737 Oct 18 16:19:26.030333 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2223/4431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1279 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:26.039158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.040814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.047989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.048486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.049604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.050813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.051289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.051722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.332059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.352310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.357205 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e7db13e-1728-4d5e-b8bc-7263ded2eda1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1490 microversion: 2.1 time: 0.586358 Oct 18 16:19:26.358554 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2209/4432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1490 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:26.369354 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc782241-374b-45f0-91c3-bd5ee3c2c42e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.329591 Oct 18 16:19:26.381421 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2224/4433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:26 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:26.388112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9748d0f-cf1e-4ee9-b60f-9acef10c41bf", "tag": "b63ec723-c48b-44ac-bd8d-026d0dcd7b4c"}, {"server_uuid": "25218f60-c04c-4c77-8eda-e8c2d4c5a116", "name": "network-vif-deleted", "tag": "3a59b973-8e30-4ced-8cca-ac5297de0016"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:26.403733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.404883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.419166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.419996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.420757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.434342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.435202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.435968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.437233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.438046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.438799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.474532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Creating event network-changed:b63ec723-c48b-44ac-bd8d-026d0dcd7b4c for instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf on n-h2-858383-14 Oct 18 16:19:26.475436 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] Creating event network-vif-deleted:3a59b973-8e30-4ced-8cca-ac5297de0016 for instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 on n-h2-858383-14 Oct 18 16:19:26.508316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4ef07a37-828e-4161-9c06-02e5c6cf36bb req-e2155785-b26d-4049-bea1-0c68c0f0fd7c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.133212 Oct 18 16:19:26.516961 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2210/4434] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:26.603145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.606000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.617292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.619564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.620480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.623257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.624964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.625613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.683805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:26.688820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.691461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.691973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.692800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'fault' on Instance uuid 25218f60-c04c-4c77-8eda-e8c2d4c5a116 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:26.784271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.785203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.809509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-481e6e24-c013-41fa-862a-3f6b974c92ea tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1305 microversion: 2.1 time: 0.214607 Oct 18 16:19:26.810112 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2211/4435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:26 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1305 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:26.813010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56caac51-d2c5-4d8b-95e4-674249d15cb1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1491 microversion: 2.1 time: 0.416234 Oct 18 16:19:26.814087 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2225/4436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:26 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1491 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:26.820491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.821153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.829318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.830093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.830876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.832054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.832527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.833162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.884930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.886070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.894626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.895396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.896077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.897130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.897829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.898483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.946916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:27.059466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:27.085169 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a61a37cb-f748-4b7a-be8d-f99e33393f27 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1277 microversion: 2.1 time: 0.268384 Oct 18 16:19:27.096171 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2212/4437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:26 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:27.104744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:27.105783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:27.117827 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21e7d1ba-6cd9-4477-a7f7-6c06f491718f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 204 len: 0 microversion: 2.1 time: 0.236785 Oct 18 16:19:27.118781 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2226/4438] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:26 2022] DELETE /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:19:27.132113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:27.133958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.136780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.137767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.140080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.140653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.141246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:27.142158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.181591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.183588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.185884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.189842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.191858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.197345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.225600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:27.322828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:27.340039 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-814b033b-9958-4c05-845a-aca728796f6e tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1279 microversion: 2.1 time: 0.251364 Oct 18 16:19:27.341440 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2213/4439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:27 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:27.387027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:27.387539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:27.395934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.396899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.397551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.398432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.399127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.399723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.431646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:27.479472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:27.489637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f04c0fe3-c7f1-46b2-a777-286a82136f6e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1497 microversion: 2.1 time: 0.365079 Oct 18 16:19:27.490991 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2227/4440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:27 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1497 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:27.885035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:27.886100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:27.909390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.910533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.914824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.917889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.918733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.919509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.950554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:28.030512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-967c8213-b2e6-47ce-887b-44c9357be871 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.601190 Oct 18 16:19:28.030512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2214/4441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:27 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:28.043854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.044345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.044779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.045259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'fault' on Instance uuid 25218f60-c04c-4c77-8eda-e8c2d4c5a116 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:28.111107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:28.112657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:28.123164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.123802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.124395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.125314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.125910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.126851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.172334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:28.193340 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d2e3826-37fb-4fa6-9f27-da64e29bfe8c tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 200 len: 1305 microversion: 2.1 time: 0.316366 Oct 18 16:19:28.199116 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2228/4442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:27 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 1305 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:28.268706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:28.278865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66a07c03-b617-4ed3-9455-4992ce25065a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1277 microversion: 2.1 time: 0.171909 Oct 18 16:19:28.294592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2215/4443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:28 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:28.366335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:28.366954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:28.386961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.387460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.387932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.388675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.389168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.389595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.532446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:28.537566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:28.548644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.555673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.556572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.557909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.558897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.559899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.041984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:29.060114 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15586ba5-ce15-4238-8498-ade042c2a4c6 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.697567 Oct 18 16:19:29.060738 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2229/4444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:28 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:29.066428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.067396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.086020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.087693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.088357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.089159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.095795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.096760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.523837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:29.532648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7950518a-723b-48d8-bc48-c7f355caa1cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.470807 Oct 18 16:19:29.540200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2230/4445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:29 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:29.553644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.556743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: 25218f60-c04c-4c77-8eda-e8c2d4c5a116] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.584808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.585639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.586474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.588227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.590291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.590989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.609794 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 HTTP/1.1 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '25218f60-c04c-4c77-8eda-e8c2d4c5a116'} Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:29.614161 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:29.619468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 404 to user: Instance 25218f60-c04c-4c77-8eda-e8c2d4c5a116 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:29.620636 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30f50081-e6ea-4da5-81ff-1d887a116049 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116" status: 404 len: 111 microversion: 2.1 time: 0.077684 Oct 18 16:19:29.624411 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2231/4446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:29 2022] GET /compute/v2.1/servers/25218f60-c04c-4c77-8eda-e8c2d4c5a116 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:29.626537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.627568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.634507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.635289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.635713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.636535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.637269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.637912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.739840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:29.751842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e166c0c9-869a-4052-9c67-98cb64758f6b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1497 microversion: 2.1 time: 1.227256 Oct 18 16:19:29.753066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2216/4447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:28 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1497 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:29.759128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.759646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.772279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.774066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.774683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.776133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.776731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.777410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.821369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:29.934411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2dd6c00c-47dc-4755-aa37-f0a45b7fb566 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 204 len: 0 microversion: 2.1 time: 0.174490 Oct 18 16:19:29.935993 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2217/4448] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:29 2022] DELETE /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:29.950933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.952104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.962360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.963660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.964400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.967791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.968575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.969486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.098642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:30.108807 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5b67225-558d-4dc4-83a3-6536f2c90a91 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1275 microversion: 2.1 time: 0.485974 Oct 18 16:19:30.110178 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2232/4449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:29 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:30.115464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:30.117426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:30.124398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.125204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.125871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.127302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.128286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.128914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.462070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:30.480669 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-377288fd-f2f5-4735-8c4d-4a90673ea308 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.367450 Oct 18 16:19:30.482020 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2233/4450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:30 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:30.571778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:30.574322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:30.582100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.582894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.583485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.584509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.586707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.587211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.679692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:30.690850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a238377-3e68-4a0e-b036-b0a590415d50 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1675 microversion: 2.1 time: 0.747092 Oct 18 16:19:30.692107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2218/4451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:29 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1675 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:30.790140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:30.790913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:30.797227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.797715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.798145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.798938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:30.799620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:30.800191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.019188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:31.034731 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-342c7717-ee65-404e-99f2-7793c12b7710 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.473156 Oct 18 16:19:31.042324 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2234/4452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:30 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:31.135777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:31.155647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:31.158753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:31.172737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.174025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.174618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.175314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb811ed0-deb2-45ac-9784-27518fc4ab68 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 200 len: 1497 microversion: 2.1 time: 0.387533 Oct 18 16:19:31.175679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.176458 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2219/4453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:30 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 1497 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:31.176735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.177641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.323404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad854ec-0843-42aa-b4bb-abbc17d19f8a", "name": "network-vif-deleted", "tag": "049393f4-4b9d-4c3f-b27f-3e409dd45408"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:31.344366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.356468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.357349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.390775 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] Creating event network-vif-deleted:049393f4-4b9d-4c3f-b27f-3e409dd45408 for instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a on n-h1-858383-14 Oct 18 16:19:31.396904 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6a3d366d-dabc-4ee5-b889-bca611383673 req-e2dd58d8-dfc1-4059-9610-135f311950cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078182 Oct 18 16:19:31.398090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2220/4454] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:31.513845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:31.515480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:31.544050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.548342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.552475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.554303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.555535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.557090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.049318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:32.061457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c65be13a-60fe-40c4-a143-cd00fd2169c0 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.913196 Oct 18 16:19:32.068538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:32.080846 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2235/4455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:31 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:32.090147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:32.091628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:32.092857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3391bf59-60a4-4e46-9ba1-ae6ad35285ef tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.583275 Oct 18 16:19:32.097101 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2221/4456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:31 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:32.107314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.108491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.109209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:32.110335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.110777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:32.111661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.112329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.112962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.127839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.128873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.129549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.130460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.131043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.131565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.631611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:32.650531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f3854125-7ebd-4bd5-9936-e76d714ab639 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.551249 Oct 18 16:19:32.651883 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2222/4457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:32 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:32.679999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:32.683081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:32.701849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.703751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.705679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.708608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.710620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:32.712912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.714827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.762084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a HTTP/1.1 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '8ad854ec-0843-42aa-b4bb-abbc17d19f8a'} Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:32.766740 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:19:32.774488 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:32.779377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:32.782369 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-adf949d9-e065-4cbe-b7e9-dd6f16ead1aa tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 404 len: 111 microversion: 2.1 time: 0.125841 Oct 18 16:19:32.793696 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2223/4458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:32 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:32.800821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:32.802677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:32.811743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.813097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.813847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.815571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.816062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.816470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.851080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:32.941208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:32.965541 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-426f91ea-3120-4f2d-a632-25d4979582c0 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1675 microversion: 2.1 time: 0.882679 Oct 18 16:19:32.966072 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2236/4459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:32 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1675 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:33.081397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0824703a-9143-4cf2-a544-6099b665bb78 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 204 len: 0 microversion: 2.1 time: 0.283440 Oct 18 16:19:33.087876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.088059 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2224/4460] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:32 2022] DELETE /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:33.088706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:33.099118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.099783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.100669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.101162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.101409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:33.101891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.102359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.106135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.116136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.117344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.122590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.123928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.124769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.125637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.465774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:33.547999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:33.562469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:33.566724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2a0ac4a-cd1c-4e23-81da-672e5abcf5c8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1496 microversion: 2.1 time: 0.475841 Oct 18 16:19:33.584321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2225/4461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1496 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:33.584321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.584889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:33.596593 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f59fd7f1-903c-4466-a64d-bec7428d443e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.512522 Oct 18 16:19:33.610783 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2237/4462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:33.619976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb1c2db-3df4-4c98-9d08-47525fb44cc5", "tag": "c421a463-a781-4b78-8286-cc3565f82fc8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:33.633583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.634427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.635095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.652858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.656447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.657169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.659984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.660955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.661618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.665081 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] Creating event network-changed:c421a463-a781-4b78-8286-cc3565f82fc8 for instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 on n-h1-858383-14 Oct 18 16:19:33.675236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a0949c40-2490-4730-86a4-bf604f833c94 req-64771365-57ee-450f-b636-c3f5846b8266 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059245 Oct 18 16:19:33.682316 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2238/4463] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:33.701638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.709277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:33.728470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.729793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.730455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.731383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.731928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.732437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.970879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:33.980576 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3637ca6c-6cb5-4f96-8dd4-658234110c72 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.409055 Oct 18 16:19:33.981635 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2226/4464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:33.997253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.998472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:34.006728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.007212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.007657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.008402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.008860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.009324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.119659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:34.135601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-959ef8c0-c850-41ad-85bc-5ec097cd2e24 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1608 microversion: 2.1 time: 0.147516 Oct 18 16:19:34.137306 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2227/4465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1608 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:34.276132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:34.316866 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f861ae41-9df4-4be9-9d67-1855c623945d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.627879 Oct 18 16:19:34.339219 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2239/4466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:34.517973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9748d0f-cf1e-4ee9-b60f-9acef10c41bf", "name": "network-vif-plugged", "status": "completed", "tag": "b63ec723-c48b-44ac-bd8d-026d0dcd7b4c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:34.530759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=7 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:34.555777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.556658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.557436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.594527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] Creating event network-vif-plugged:b63ec723-c48b-44ac-bd8d-026d0dcd7b4c for instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf on n-h2-858383-14 Oct 18 16:19:34.601085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:34.601659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:34.618584 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-95805df5-7c7e-4219-8a03-e4548e601fbd req-b5c3957a-0c15-406b-af2e-0f09fd70679f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095361 Oct 18 16:19:34.620168 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2228/4467] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:34.627515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.648079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:34.653216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:34.659112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.659718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.665906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.667042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.667512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.704381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.706577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.707510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.710636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.715162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.719147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.185123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:35.199630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d169998-f479-4155-9b37-89b44b3b04f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1496 microversion: 2.1 time: 0.602796 Oct 18 16:19:35.200831 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2240/4468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:34 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1496 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:35.209382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54cf92-f013-4cd5-bca6-4cfb3cd42359", "tag": "507ce10f-0cde-4998-b42d-9820ce343af8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:35.229188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.230341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.231029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.251722 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] Creating event network-changed:507ce10f-0cde-4998-b42d-9820ce343af8 for instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 on n-h2-858383-14 Oct 18 16:19:35.262644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-48ad6c21-3cde-4c17-9273-80add287c15b req-392711ce-9434-4370-bdf4-a0293dccb148 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058931 Oct 18 16:19:35.263184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2241/4469] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:35.271692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:35.272683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:35.280115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.280814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.281166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.282010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.282533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.283766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.728608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:35.741743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:35.759814 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7112b55-dff2-4376-9bdb-318741a94a1d tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 1.133569 Oct 18 16:19:35.761574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2229/4470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:34 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:35.770316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:35.771590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:35.803318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.804558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.805560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.807108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.809377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.810563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.922994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.924176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.925826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.927088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lazy-loading 'fault' on Instance uuid bf4345bc-4647-4ee4-95a1-716a7c6c4a96 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:36.003483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:36.016442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f5e119f-1f60-4ca1-8a9d-052284f5b473 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.751188 Oct 18 16:19:36.017630 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2242/4471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:35 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:36.031559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:36.033387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:36.045636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.047319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.050483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.052752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.055491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfadddfac24b69b7ae873925514f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1607209530428891cc7f9b2406e42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:36.056097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.057415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.064698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-514b6a9c-0359-4976-873d-0e935a765bd9 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 200 len: 1328 microversion: 2.1 time: 0.300636 Oct 18 16:19:36.068152 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2230/4472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:35 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 1328 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:36.086422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4345bc-4647-4ee4-95a1-716a7c6c4a96", "name": "network-vif-deleted", "tag": "04c8ba7f-826f-4705-88e4-7fd8cc78b4bb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:36.118287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.119314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.120338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.150953 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] Creating event network-vif-deleted:04c8ba7f-826f-4705-88e4-7fd8cc78b4bb for instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 on n-h2-858383-14 Oct 18 16:19:36.161512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-256bcb4f-431f-4522-8008-1e28376e0762 req-aa5e1b5a-23d2-4285-bba2-f1b21241e7bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086919 Oct 18 16:19:36.162093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2231/4473] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:36.240814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:36.249691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:36.262676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.262901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.263492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.264645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.265233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.265769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.379495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:36.396393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fe4186b-8046-441d-8ddf-ece39c1d46f8 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1325 microversion: 2.1 time: 0.373722 Oct 18 16:19:36.401924 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2243/4474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:36 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:36.735186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:36.750227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63e5e383-8e77-4752-b020-f7c0ca1f62e2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1496 microversion: 2.1 time: 0.517428 Oct 18 16:19:36.752037 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2232/4475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:36 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1496 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:36.790806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:36.791437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:36.805200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.805681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.806123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:36.806845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:36.807305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:36.807730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.052864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.053694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.061828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.062419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.062929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.063728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.065411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.066030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.317132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:37.328518 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28b7efac-ed16-48fa-ad3f-5fad8fe9cfbb tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.541250 Oct 18 16:19:37.330496 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2244/4476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:36 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:37.340690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.345765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] [instance: bf4345bc-4647-4ee4-95a1-716a7c6c4a96] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.363010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.363518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.363992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.364776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.366497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.366497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.389629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] HTTP exception thrown: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Request method failure captured: Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 HTTP/1.1 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTs8vHB_VzFk5pRDdKNp4ny0mZWMA94ONspfZiNOT4686pi8__BRvQWo5pB6FS2V9nYwPi7cryeInLu30Ye6jJOemmeho6Ck0R9p23X_bcp5G4FTMe4lxiqy8gtP1BuVf3bq8sRibdMj2Bubsj3WvTnZG3Ebmo1o_UChSQ8hQDs0WJqU Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e1607209530428891cc7f9b2406e42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e1607209530428891cc7f9b2406e42c"}]}] Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6e1607209530428891cc7f9b2406e42c Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074036991 Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f3bfadddfac24b69b7ae873925514f1a Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1074036991-project Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'bf4345bc-4647-4ee4-95a1-716a7c6c4a96'} Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:37.392509 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Returning 404 to user: Instance bf4345bc-4647-4ee4-95a1-716a7c6c4a96 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:37.395946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d27f6c0-ebf3-43ba-953e-5bd5033dc052 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96" status: 404 len: 111 microversion: 2.1 time: 0.062508 Oct 18 16:19:37.401304 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2245/4477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/bf4345bc-4647-4ee4-95a1-716a7c6c4a96 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:37.410026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-697bc213-5614-44f9-96a3-c8c2c0163f88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] Calling method '.version_select at 0x7f5fd1834940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.455578 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-697bc213-5614-44f9-96a3-c8c2c0163f88 tempest-ServerActionsTestJSON-1074036991 tempest-ServerActionsTestJSON-1074036991-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545137024" status: 202 len: 0 microversion: 2.1 time: 0.051819 Oct 18 16:19:37.456663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2246/4478] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545137024 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:19:37.471834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.473210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.490490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.491309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.492037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.492810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.493487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.498445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.510737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:37.707188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:37.740039 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b23ff957-7e0c-46bc-a44a-28505d5438f1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.691619 Oct 18 16:19:37.754155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:37.756530 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2233/4479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:37.766255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b5a2bc9-89c3-46de-9fb3-2013b1703a8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1523 microversion: 2.1 time: 0.307953 Oct 18 16:19:37.781615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.783934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.784080 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2247/4480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:37.803274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.805322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.805825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.806601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.813362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.813362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.817886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.818974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.845095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.845840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.846391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.847158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.847813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.848407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.214029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:38.226597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8000183b-633c-453d-bd6d-2e8b6a6af7cf tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1523 microversion: 2.1 time: 0.418762 Oct 18 16:19:38.227812 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2248/4481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:38.252716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1285396346"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:38.257054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:38.265923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:38.267142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:38.268476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.269702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:38.270340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:38.271182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.546979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:38.567100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd9e1fad-d679-4285-a89e-b0ce8f0253e4 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1496 microversion: 2.1 time: 0.788688 Oct 18 16:19:38.569078 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2234/4482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1496 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:38.581820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:38.587693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:38.634091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:38.639674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:38.649144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.652855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:38.654339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:38.655268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.754461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdb3021b-ffec-4a93-b175-329a62092203 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf/action" status: 202 len: 0 microversion: 2.1 time: 0.507407 Oct 18 16:19:38.755914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2249/4483] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:38 2022] POST /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:19:38.777407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5bed68bf-ef71-46e8-9d21-f4c883557dfe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd1826dc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:39.007107 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5bed68bf-ef71-46e8-9d21-f4c883557dfe tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa" status: 204 len: 0 microversion: 2.1 time: 0.243322 Oct 18 16:19:39.008484 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2250/4484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:38 2022] DELETE /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:39.027955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:39.029533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:39.043688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.044271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.045237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.046651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.047634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.048715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.248065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:39.271203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d10e5170-0fef-4727-882d-bc42ff5f9b2f tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.693573 Oct 18 16:19:39.276454 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2235/4485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:38 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:39.295555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1203eb1a-79e2-4cca-a19a-7392cacceeda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd15c0a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:39.330493 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1203eb1a-79e2-4cca-a19a-7392cacceeda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Image not found. Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1203eb1a-79e2-4cca-a19a-7392cacceeda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa HTTP/1.1 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0c71fdfc-6a07-41b2-9b77-fb9f08322eaa'} Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c71fdfc-6a07-41b2-9b77-fb9f08322eaa Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 16:19:39.336462 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c71fdfc-6a07-41b2-9b77-fb9f08322eaa could not be found. Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:19:39.339846 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:39.345498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1203eb1a-79e2-4cca-a19a-7392cacceeda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:39.351229 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1203eb1a-79e2-4cca-a19a-7392cacceeda tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa" status: 404 len: 62 microversion: 2.1 time: 0.070630 Oct 18 16:19:39.354242 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2236/4486] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:39 2022] GET /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:19:39.363585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78d0656-6904-4b88-961b-51ba1ffdd9da", "name": "network-vif-deleted", "tag": "b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:39.403326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.410142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.411346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.461437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] Creating event network-vif-deleted:b1a5420f-d8f8-47c7-a98e-8fb1c16cc31b for instance e78d0656-6904-4b88-961b-51ba1ffdd9da on n-h1-858383-14 Oct 18 16:19:39.472436 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5fa3e6d1-db37-4b58-b2ad-20579846b023 req-672b0974-c74a-4645-8eb2-108b19815601 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113668 Oct 18 16:19:39.473713 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2237/4487] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:39.481092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:39.482632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:39.498570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.499674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.502508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.507738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.508862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.509803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.699661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:39.736806 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f64cf402-4725-4db2-a54d-b2f2dea9ba43 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.722043 Oct 18 16:19:39.738102 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2251/4488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:39 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:39.747272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:39.754074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:39.778690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.780838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.782115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.784331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.788096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.791060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.937673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:39.938551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:39.939779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:39.947086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid e78d0656-6904-4b88-961b-51ba1ffdd9da {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:39.997514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:40.035854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d964ddd-706c-42d9-9352-3036d106f8ff tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1543 microversion: 2.1 time: 0.560320 Oct 18 16:19:40.038033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2238/4489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:39 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1543 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:40.096002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb1c2db-3df4-4c98-9d08-47525fb44cc5", "name": "network-vif-plugged", "status": "completed", "tag": "c421a463-a781-4b78-8286-cc3565f82fc8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:40.124905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:40.125857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:40.127457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:40.157472 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] Creating event network-vif-plugged:c421a463-a781-4b78-8286-cc3565f82fc8 for instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 on n-h1-858383-14 Oct 18 16:19:40.168616 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f9664cf0-e1c3-4ef4-9fd3-73116b916730 req-f129d5fc-63d2-4af8-a891-84000a58d953 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078210 Oct 18 16:19:40.170352 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2239/4490] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:19:40.189130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:40.209745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-607317dc-3566-436b-8b38-e028b9d83ae1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 200 len: 1299 microversion: 2.1 time: 0.469685 Oct 18 16:19:40.232774 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2252/4491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:39 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 1299 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:40.331671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:40.334440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:40.356308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:40.357100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:40.357744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:40.359188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:40.360099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:40.360735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:40.660399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:40.676447 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2168aab-0e04-4cd1-89e0-66039e34a7e6 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.363119 Oct 18 16:19:40.678241 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2240/4492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:40 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:40.813372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:40.822742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:40.842239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:40.846658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:40.849302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:40.850303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:40.852172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:40.853138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.087744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:41.089555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:41.103450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.105364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.106981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.108761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.110444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.112012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.432656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:41.444091 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6f85b64-776f-46b5-8b7d-10a63fcbefc4 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1321 microversion: 2.1 time: 0.664207 Oct 18 16:19:41.461176 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2253/4493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:40 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:41.467222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:41.468316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:41.476287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.477147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.477769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.478732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.479397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.480028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.500493 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da HTTP/1.1 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e78d0656-6904-4b88-961b-51ba1ffdd9da'} Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:41.504293 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:19:41.508023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:41.511841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:41.514246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18c002ef-1a56-4ad3-ab8d-15fc9631b342 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 404 len: 111 microversion: 2.1 time: 0.051135 Oct 18 16:19:41.515646 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2254/4494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:41 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:41.529676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:41.562851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b87317e-0997-4285-8e59-86868707747b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1535 microversion: 2.1 time: 0.483061 Oct 18 16:19:41.564890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2241/4495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:41 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1535 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:41.717706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:41.718770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:41.728924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.729958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.730565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.737133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:41.737911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:41.738575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:41.760725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-120056433", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:41.893373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:19:42.224104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:42.267718 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12ea2bc9-62a6-4781-8d4d-b776d360f6a9 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.557270 Oct 18 16:19:42.292547 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2255/4496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:41 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:42.484283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:42.489252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:42.530648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:42.536255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:42.538935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:42.543765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:42.545464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:42.546746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:42.756927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:42.757689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:42.757829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:42.758254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:42.758666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:42.779252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:42.781789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:42.789620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:42.791168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:42.791986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:42.792721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:42.835488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:42.846818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:42.874012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:42.879032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:42.989513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aaf48b1c-f42a-4c53-a2e2-7dcfa13d068c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237180 Oct 18 16:19:42.991003 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2242/4497] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:19:42.999342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:43.000687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:43.010780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.011725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.012437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.013865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.014971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.016042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.173896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:43.192601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ae23c59-28f1-4e47-962a-fb79ab7084ce tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1470 microversion: 2.1 time: 0.721268 Oct 18 16:19:43.194719 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2256/4498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:42 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1470 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:43.205138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e4d1bc57-d09b-4626-b7f3-986006f590d5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:43.205970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e4d1bc57-d09b-4626-b7f3-986006f590d5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:43.412076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:43.437702 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-91f855eb-8125-4afd-8f38-06c02e218221 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1541 microversion: 2.1 time: 0.444830 Oct 18 16:19:43.438318 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2243/4499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:42 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1541 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:43.461862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:43.462727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:43.477918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.481399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.482742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.487066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.492717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.494567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.634565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lazy-loading 'flavor' on Instance uuid cdb1c2db-3df4-4c98-9d08-47525fb44cc5 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:43.837431 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef13a4de-9e17-4067-a303-ef3716c5a175 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5/action" status: 202 len: 0 microversion: 2.1 time: 0.383205 Oct 18 16:19:43.840258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2244/4500] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:43 2022] POST /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:19:43.862943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:43.867488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:43.889027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.890769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.892321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.894867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:43.897084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:43.899538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:43.923656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e4d1bc57-d09b-4626-b7f3-986006f590d5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:43.950636 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e4d1bc57-d09b-4626-b7f3-986006f590d5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1208 microversion: 2.1 time: 0.750091 Oct 18 16:19:43.965282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2257/4501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:43 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1208 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:43.980043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:43.983091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:44.008190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:44.014560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:44.016624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:44.024356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:44.025401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:44.025906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:44.026358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:44.206152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:44.215724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-feeb79e1-8e65-49a3-9e01-dd5b7bdc16ea tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.373317 Oct 18 16:19:44.216562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2245/4502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:43 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:44.473779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:44.474971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:44.484083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:44.485085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:44.486260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:44.487890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:44.488679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:44.490141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:44.853031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:44.877373 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a724395f-b930-4902-9a36-dc2c90d2d8ba tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1541 microversion: 2.1 time: 0.406519 Oct 18 16:19:44.878488 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2246/4503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:44 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1541 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:44.982182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-270236c7-7a7c-4a30-8043-7ee16ed58b71 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1631 microversion: 2.1 time: 1.022696 Oct 18 16:19:44.983146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2258/4504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:43 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1631 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:45.017801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:45.023596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:45.051312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.055316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.056389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.059127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.061261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.062792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.220436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:45.228316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a42a48da-4817-42af-9719-9e790c6f63e0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1260 microversion: 2.1 time: 0.237227 Oct 18 16:19:45.228832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2247/4505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:44 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:45.259309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:45.259939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:45.268074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.269159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.269929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.271049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.271882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.272719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.526117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b54cf92-f013-4cd5-bca6-4cfb3cd42359", "name": "network-vif-plugged", "status": "completed", "tag": "507ce10f-0cde-4998-b42d-9820ce343af8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:45.537720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:45.561751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.562496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.563076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.581345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:45.584180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] Creating event network-vif-plugged:507ce10f-0cde-4998-b42d-9820ce343af8 for instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 on n-h2-858383-14 Oct 18 16:19:45.591419 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-043ac662-39a1-48f8-a48b-1d9cf957372b req-e2db4de8-9800-468d-adcd-184905be2a39 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069376 Oct 18 16:19:45.592573 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2248/4506] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:19:45.904501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:45.905602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:45.926746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:45.946274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-789a7241-8b37-4a6b-a592-a2d31443a658 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.691018 Oct 18 16:19:45.951113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.951828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.952293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:45.953665 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2259/4507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:45 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:45.965351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:45.966347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:45.968049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.028494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:46.029750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:46.062444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.063128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.064234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.065124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.065681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.066381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.495458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e29c293-cedf-496b-8fdb-58d0b08b92ee tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1614 microversion: 2.1 time: 0.472806 Oct 18 16:19:46.496545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2260/4508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:46 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1614 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:46.501973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:46.509727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:46.519086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.523493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.529576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.531025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.531952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.532750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.642445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:46.654514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad00b55d-e715-4e75-8bf1-cea4fbacef6d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1266 microversion: 2.1 time: 0.156643 Oct 18 16:19:46.655225 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2261/4509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:46 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:46.667491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:46.668193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:46.685427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.686022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.686538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.687319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:46.687853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:46.688354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:46.889842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] HTTP exception thrown: Cannot 'migrate' instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 while it is in vm_state suspended Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Request method failure captured: Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5/action HTTP/1.1 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 15 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHoF__rOglYZAGn4m9my_QSun2QllbM66G1VM-SB6UFl5Zm5SIvA-phJ-ujd2aTJK1Q1tyge-ENtuosRJSd9hVR9X-XdZQgvNNFsUr_GqcxT7LR92wru1__3fFELUlKxQZTWWH20WXoDdmomvxg9QTXwaR54T_C9t7sM2prKHaa6vg Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}] Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9895b06667a7463297c8151854551ca1 Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: {"migrate": {}} Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'migrate' instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 while it is in vm_state suspended Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'cdb1c2db-3df4-4c98-9d08-47525fb44cc5', 'body': {'migrate': {}}} Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 in vm_state suspended. Cannot resize while the instance is in this state. Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:19:46.891502 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 while it is in vm_state suspended Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 while it is in vm_state suspended Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Returning 409 to user: Cannot 'migrate' instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 while it is in vm_state suspended {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f21a4fd9-d989-4a53-bdca-ebe26b1d62e2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5/action" status: 409 len: 148 microversion: 2.1 time: 0.236424 Oct 18 16:19:46.895655 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2262/4510] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:46 2022] POST /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5/action => generated 148 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:19:46.905016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc27012e-2f36-4c73-8aff-4d1bfb424c3c tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc27012e-2f36-4c73-8aff-4d1bfb424c3c tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Request method failure captured: Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action HTTP/1.1 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 39 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHoF__rOglYZAGn4m9my_QSun2QllbM66G1VM-SB6UFl5Zm5SIvA-phJ-ujd2aTJK1Q1tyge-ENtuosRJSd9hVR9X-XdZQgvNNFsUr_GqcxT7LR92wru1__3fFELUlKxQZTWWH20WXoDdmomvxg9QTXwaR54T_C9t7sM2prKHaa6vg Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}] Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9895b06667a7463297c8151854551ca1 Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: {"os-resetState": {"state": "invalid"}} Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ade2af31-8f90-4dcb-b31e-681ae5ed2b4b', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:19:46.909758 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc27012e-2f36-4c73-8aff-4d1bfb424c3c tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:46.913631 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc27012e-2f36-4c73-8aff-4d1bfb424c3c tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action" status: 400 len: 144 microversion: 2.1 time: 0.010022 Oct 18 16:19:46.918632 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2263/4511] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:46 2022] POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:19:46.961554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8065b1a5-e791-4dca-b968-e1061c4a8ae2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8065b1a5-e791-4dca-b968-e1061c4a8ae2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Request method failure captured: Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action HTTP/1.1 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 31 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHoF__rOglYZAGn4m9my_QSun2QllbM66G1VM-SB6UFl5Zm5SIvA-phJ-ujd2aTJK1Q1tyge-ENtuosRJSd9hVR9X-XdZQgvNNFsUr_GqcxT7LR92wru1__3fFELUlKxQZTWWH20WXoDdmomvxg9QTXwaR54T_C9t7sM2prKHaa6vg Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}] Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9895b06667a7463297c8151854551ca1 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: {"os-resetState": {"state": 1}} Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ade2af31-8f90-4dcb-b31e-681ae5ed2b4b', 'body': {'os-resetState': {'state': 1}}} Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 1 Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 16:19:46.969174 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 16:19:46.973522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:46.975966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8065b1a5-e791-4dca-b968-e1061c4a8ae2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:46.977467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8065b1a5-e791-4dca-b968-e1061c4a8ae2 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action" status: 400 len: 120 microversion: 2.1 time: 0.055563 Oct 18 16:19:46.978774 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2264/4512] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:19:46 2022] POST /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b/action => generated 120 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:19:46.989260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:46.990201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:47.000300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.001509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.002192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.003281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.004094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.004686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.056699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:47.073774 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4aef346b-6ae4-4460-aa09-49eb0f55d0c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1541 microversion: 2.1 time: 1.176813 Oct 18 16:19:47.074374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2249/4513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:45 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1541 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:47.094879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:47.097325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Failed to fetch instance by id 999 {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:19:47.097838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Request method failure captured: Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 37 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHoF__rOglYZAGn4m9my_QSun2QllbM66G1VM-SB6UFl5Zm5SIvA-phJ-ujd2aTJK1Q1tyge-ENtuosRJSd9hVR9X-XdZQgvNNFsUr_GqcxT7LR92wru1__3fFELUlKxQZTWWH20WXoDdmomvxg9QTXwaR54T_C9t7sM2prKHaa6vg Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1265442a420448dca3dd8bb3ebd30b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1265442a420448dca3dd8bb3ebd30b33"}]}] Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1265442a420448dca3dd8bb3ebd30b33 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1852163587 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9895b06667a7463297c8151854551ca1 Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1852163587-project-admin Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: {"os-resetState": {"state": "error"}} Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 999 could not be found. Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:47.110931 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:47.114950 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:47.114950 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 16:19:47.114950 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:47.116165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:47.117246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8caee15d-df94-47c1-9656-20b3e980fd72 tempest-ServersAdminNegativeTestJSON-1852163587 tempest-ServersAdminNegativeTestJSON-1852163587-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027174 Oct 18 16:19:47.118005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2250/4514] 10.222.0.78 () {60 vars in 1179 bytes} [Tue Oct 18 16:19:47 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:19:47.127664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:47.128393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:47.145286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.147503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.148229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.150776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.151537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.152249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.257937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:47.443323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:47.474187 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-729d3e69-1e3c-40c9-a822-c38ceb836fc2 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1317 microversion: 2.1 time: 0.488990 Oct 18 16:19:47.475674 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2265/4515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:46 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:47.484394 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83df8e40-5514-490b-b316-a41db5d7b280 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 204 len: 0 microversion: 2.1 time: 0.361089 Oct 18 16:19:47.486246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2251/4516] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:47 2022] DELETE /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:19:47.504859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:47.505709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:47.522012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.524472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.527297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.529217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.531753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.535366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.642554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9748d0f-cf1e-4ee9-b60f-9acef10c41bf", "name": "network-vif-plugged", "status": "completed", "tag": "b63ec723-c48b-44ac-bd8d-026d0dcd7b4c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:47.677377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.678837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.681752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.757100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] Creating event network-vif-plugged:b63ec723-c48b-44ac-bd8d-026d0dcd7b4c for instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf on n-h2-858383-14 Oct 18 16:19:47.769875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f91ceccf-ee7a-4944-95f7-34a5531bd60a req-416fc885-f0c5-4f95-8c94-ef68a5cb65dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141932 Oct 18 16:19:47.771734 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2252/4517] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:19:47.798447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:47.802263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:47.820151 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7fd0681-3b8e-4c5d-9d36-2726ce0e6d2b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1467 microversion: 2.1 time: 0.326327 Oct 18 16:19:47.837152 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2266/4518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:47 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1467 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:47.837648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:47.865621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.867140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.868312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:47.874223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:47.876797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:47.883087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.080520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:48.099997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24843243-47d0-4ccf-bb10-abe81aa40eb7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1266 microversion: 2.1 time: 0.326480 Oct 18 16:19:48.100849 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2253/4519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:47 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:48.139977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:48.140837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:48.163491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.167292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.168050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.169708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.170869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.172513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.179419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:48.504567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:48.505227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:48.512015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.512412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.512844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.513581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.514010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.514431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.562493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:48.574339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af1721e8-b969-471a-8134-5da5f3e350f9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1541 microversion: 2.1 time: 0.475876 Oct 18 16:19:48.574984 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2267/4520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:48 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1541 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:48.858849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:48.858849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:48.871981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.872477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.872912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:48.873650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:48.874107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:48.874531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.148933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:49.166951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7cccbb39-15e6-4149-a55c-7c1640ba6d60 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1506 microversion: 2.1 time: 0.666866 Oct 18 16:19:49.176784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2254/4521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:48 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:49.189217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:49.193119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:49.246422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.251476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.252140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.253104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.258222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.269319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.593592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:49.612976 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5c29a50-73a2-4a46-8479-3aa3f7994614 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1467 microversion: 2.1 time: 0.758816 Oct 18 16:19:49.613698 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2268/4522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:48 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1467 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:49.634063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:49.634667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:49.646449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.647756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.648702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.652472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.653241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.653924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.694996 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96791d11-6013-46f2-a355-4ace2390884b tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips" status: 200 len: 109 microversion: 2.1 time: 0.080230 Oct 18 16:19:49.696297 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2269/4523] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:19:49 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips => generated 109 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:49.703458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:49.704623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:49.717865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.718906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.720378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:49.723197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:49.724185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:49.725260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.058258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:50.075175 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d30aca0d-079d-4d58-a3cc-08891959bcad tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1523 microversion: 2.1 time: 0.377100 Oct 18 16:19:50.093393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2270/4524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:49 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:50.100224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:50.107672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:50.119985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.120881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.121723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.123024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.131059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.131762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.211018 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4771e383-1495-4d9a-82b7-3bb29b10071a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips" status: 200 len: 109 microversion: 2.1 time: 0.115674 Oct 18 16:19:50.224222 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2271/4525] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:19:50 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips => generated 109 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:50.235007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:50.236592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:50.247929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.249171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.250228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.252557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.254103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.255280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.307805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:50.531050 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d1a85ab-e7ec-47ec-80e3-6ea8759e972d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 204 len: 0 microversion: 2.1 time: 0.296751 Oct 18 16:19:50.534387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2272/4526] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:50 2022] DELETE /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:50.556267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:50.560683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:50.587542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.588367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.589118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.605637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.606571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.607292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.710450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e3567c6-80db-464b-b325-12b327d0ad8c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips/tempest-ServerAddressesTestJSON-705021824-network" status: 200 len: 94 microversion: 2.1 time: 0.173741 Oct 18 16:19:50.721640 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2273/4527] 10.222.0.78 () {58 vars in 1398 bytes} [Tue Oct 18 16:19:50 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359/ips/tempest-ServerAddressesTestJSON-705021824-network => generated 94 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:19:50.731442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:50.732822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:50.747767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.748468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.749404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.750526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.752620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.753306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.861925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:50.874407 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69bdf4ca-4134-4c18-96fa-27ae1ee2327f tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 1.696023 Oct 18 16:19:50.893470 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2255/4528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:49 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:50.904875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:50.905709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:50.917635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.918324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.918918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:50.919803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:50.920411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:50.921027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.268783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:51.284021 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc5bc2c3-f7c2-447f-9456-9b9bceb2a58f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1529 microversion: 2.1 time: 0.560083 Oct 18 16:19:51.284868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2274/4529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:50 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1529 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:51.289991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:51.290750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:51.299919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.300810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.301475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.302414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.304170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.305317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.342765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:51.496977 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcc4c9e6-2e49-4597-b15a-e4979d1fab61 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 204 len: 0 microversion: 2.1 time: 0.208730 Oct 18 16:19:51.497994 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2275/4530] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:51 2022] DELETE /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:51.527342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:51.533556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:51.567770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.569758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.573802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.575711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.577973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.580140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.882783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:51.895613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd25d974-2643-4a61-9158-54af13a72015 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1467 microversion: 2.1 time: 1.000729 Oct 18 16:19:51.896443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2256/4531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:50 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1467 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:51.910235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:51.911662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:51.957479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.957982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.958429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:51.959305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:51.960109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:51.969536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:52.031501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:52.045755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ccde785c-de75-4f65-b429-44aaa71e5f8e tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1512 microversion: 2.1 time: 0.540439 Oct 18 16:19:52.046507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2276/4532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:51 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:52.055378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb1c2db-3df4-4c98-9d08-47525fb44cc5", "name": "network-vif-unplugged", "status": "completed", "tag": "c421a463-a781-4b78-8286-cc3565f82fc8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:52.078576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:52.080113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:52.080725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:52.100718 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] Creating event network-vif-unplugged:c421a463-a781-4b78-8286-cc3565f82fc8 for instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 on n-h1-858383-14 Oct 18 16:19:52.109060 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a653cdfc-2b3f-4450-abdc-1fc0fcd96dc7 req-175cca4e-5b6b-49d2-9902-5368f1596ac4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060806 Oct 18 16:19:52.112065 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2277/4533] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:52.337313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:52.338641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:52.352166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:52.354421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:52.355309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:52.356339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:52.357107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:52.357791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:52.627001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:52.645496 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df8d2a28-5d39-4ee2-b5e7-069e4fe2f716 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.747698 Oct 18 16:19:52.646033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2257/4534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:51 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:52.755308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:52.765338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eff46212-ef2b-4fc5-8d5f-4ad7814365f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1529 microversion: 2.1 time: 0.442589 Oct 18 16:19:52.766293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2278/4535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:52 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1529 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:52.927945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:52.929667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:52.954601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:52.955321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:52.957185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:52.958453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:52.958849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:52.959726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:52.960186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:52.960613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.079210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:53.082629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:53.138916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:53.139732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:53.140445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.141792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:53.142544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:53.143190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.367980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:53.399630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbcfa84e-7f84-4c4b-b09c-063a01eb7319 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1425 microversion: 2.1 time: 0.475351 Oct 18 16:19:53.402259 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2258/4536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:52 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1425 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:53.439227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb1c2db-3df4-4c98-9d08-47525fb44cc5", "name": "network-vif-deleted", "tag": "c421a463-a781-4b78-8286-cc3565f82fc8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:53.466455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:53.469137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:53.471292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.493861 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] Creating event network-vif-deleted:c421a463-a781-4b78-8286-cc3565f82fc8 for instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 on n-h1-858383-14 Oct 18 16:19:53.500364 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c990cac2-7c18-4ab6-be58-a6b59e2369ef req-d94a19c9-8fa8-45d5-8a18-3592959536f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067730 Oct 18 16:19:53.505932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2259/4537] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:53.695829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:53.696832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:53.715603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:53.716364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:53.716947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.718775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:53.720225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:53.722591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:53.937809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:54.538585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:54.556777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b62f96b4-e24c-439c-a65b-f46cf8e23108 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.865633 Oct 18 16:19:54.557853 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2260/4538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:53 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:54.582732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:54.583727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:54.608689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:54.615331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:54.616146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:54.617193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:54.620634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:54.621400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:54.743898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:54.810713 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78682180-c3cd-4e8a-9bd9-32ddbae3fc74 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1512 microversion: 2.1 time: 1.738241 Oct 18 16:19:54.812719 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2279/4539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:53 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1512 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:54.868156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:54.870004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:54.884653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:54.885896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:54.887013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:54.889248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:54.890658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:54.891800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:54.973728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:54.974605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:54.975311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:54.988501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lazy-loading 'fault' on Instance uuid cdb1c2db-3df4-4c98-9d08-47525fb44cc5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:55.134057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:55.154253 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-86163323-6ab6-4c68-bd0f-e4da317124ca tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 200 len: 1311 microversion: 2.1 time: 0.314885 Oct 18 16:19:55.174984 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2280/4540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:54 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:55.180442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9748d0f-cf1e-4ee9-b60f-9acef10c41bf", "name": "network-vif-unplugged", "status": "completed", "tag": "b63ec723-c48b-44ac-bd8d-026d0dcd7b4c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:55.197029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:55.197762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:55.198353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:55.220765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] Creating event network-vif-unplugged:b63ec723-c48b-44ac-bd8d-026d0dcd7b4c for instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf on n-h2-858383-14 Oct 18 16:19:55.230836 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2b55c1c6-f81e-445e-95ca-568e6e0ac103 req-cc75eca9-de47-4d6a-bebb-adac5c518dac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053615 Oct 18 16:19:55.232069 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2281/4541] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:55.480819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-168847968", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:55.586204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:55.587861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:55.589062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:55.590073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:55.591078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:55.608716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:55.610727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:55.611604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:55.613093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:55.614154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:55.615083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:55.639220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Getting quotas for project 0d9f40afe6f84b4cacbaad47846895ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:55.648426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Getting quotas for user 3821d9ad75e04711bdf8a93567115d92 and project 0d9f40afe6f84b4cacbaad47846895ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:55.666456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:55.671021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:55.779362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5f1e143-7f3f-4fda-be7e-153d17d85093 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.544490 Oct 18 16:19:55.807507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2282/4542] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:19:55.828987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:55.831824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:55.854171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:55.859115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:55.859115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:55.859115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:55.859115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:55.861055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:55.870989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:56.441781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:56.450948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:56.467129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-caca109d-c1b0-4518-9368-eecaeea5424d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1529 microversion: 2.1 time: 1.907457 Oct 18 16:19:56.474627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7075f2c2-f228-4676-9aad-029e4a928a56 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.663275 Oct 18 16:19:56.475688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2261/4543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:54 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1529 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:56.489586 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2283/4544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:55 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:56.496714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ea8baf-ba46-4642-9633-b93882bac746", "tag": "19db8aaa-4f7e-4905-8a04-8ef09561db28"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:56.504233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:56.510916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:56.518582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:56.519323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:56.519914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:56.540630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] Creating event network-changed:19db8aaa-4f7e-4905-8a04-8ef09561db28 for instance 35ea8baf-ba46-4642-9633-b93882bac746 on n-h1-858383-14 Oct 18 16:19:56.549496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1a9d8ed2-eac8-45cc-932f-19c6f60f3826 req-ce88a2a4-8c55-41f7-82d7-f335be64e898 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057819 Oct 18 16:19:56.551974 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2284/4545] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:56.562286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:56.563798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:56.577947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:56.578974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:56.579626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:56.580593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:56.582276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:56.583179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:56.843618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:56.885337 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-709964bd-53e3-4715-9982-ec3fdd14346c tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1470 microversion: 2.1 time: 0.329864 Oct 18 16:19:56.886426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2285/4546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:56 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:56.903379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:56.905344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: cdb1c2db-3df4-4c98-9d08-47525fb44cc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:56.946995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:56.954355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:56.955164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:56.956467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:56.957354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:56.958388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:56.992878 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] HTTP exception thrown: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Request method failure captured: Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 HTTP/1.1 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHnGX-RTuGMORQBREmqYjdydji63apEo9JGzLUn32kX7EvktxsxlD_bfvLi7Pr5Ks1JibxMI1RXGP50HHL8mCObwRwNwUqPcqGt8KuXQH4DgO3n-22d2qhEY26JJdSILMG31a1M_DB254OLvk8oe35OYSjOTJdAAltHlVUgv9rXFlg Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6cc9b0ddd863459ca89e442b6362dff6 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cc9b0ddd863459ca89e442b6362dff6"}]}] Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6cc9b0ddd863459ca89e442b6362dff6 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-946001437-project Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d7875829b50540cb950fd805d969baa2 Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-946001437-project Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'cdb1c2db-3df4-4c98-9d08-47525fb44cc5'} Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:56.996655 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:57.015001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Returning 404 to user: Instance cdb1c2db-3df4-4c98-9d08-47525fb44cc5 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:57.019212 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91e40cf9-ddb7-4cde-9b7d-cfe13bbbd94f tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5" status: 404 len: 111 microversion: 2.1 time: 0.127534 Oct 18 16:19:57.027616 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2286/4547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:56 2022] GET /compute/v2.1/servers/cdb1c2db-3df4-4c98-9d08-47525fb44cc5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:57.036719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9748d0f-cf1e-4ee9-b60f-9acef10c41bf", "name": "network-vif-deleted", "tag": "b63ec723-c48b-44ac-bd8d-026d0dcd7b4c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:57.056534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.057751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.058754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.085685 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] Creating event network-vif-deleted:b63ec723-c48b-44ac-bd8d-026d0dcd7b4c for instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf on n-h2-858383-14 Oct 18 16:19:57.106524 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1dda5893-b18b-4f2e-8cb5-42c84e34db32 req-e708d77a-9587-41bf-ba26-0397bf37895b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070889 Oct 18 16:19:57.108422 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2287/4548] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:57.132886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:57.137063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:57.157676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.159116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.161883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.164444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.168535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.168810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.184345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:57.210760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:57.220386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:57.222191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb3dee33-fa03-40a2-b754-b8ea07a77055 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1280 microversion: 2.47 time: 0.744504 Oct 18 16:19:57.238441 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2262/4549] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:19:56 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1280 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:19:57.269296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:19:57.505392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:57.506142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:57.521805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.522313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.522771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.527447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.528002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.529861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.548699 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4efd505-d466-4fbf-a78b-ebe82e50d0d1 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 204 len: 0 microversion: 2.1 time: 0.432878 Oct 18 16:19:57.549318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2288/4550] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:19:57 2022] DELETE /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:19:57.572552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:57.575359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:57.594463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.595306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.597403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.598601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.600445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.601612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.679293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.679973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.680813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.681750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lazy-loading 'fault' on Instance uuid a9748d0f-cf1e-4ee9-b60f-9acef10c41bf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:57.859385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:57.897675 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22dedac8-09cb-4191-acac-e5fb47758a59 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 200 len: 1315 microversion: 2.1 time: 0.339832 Oct 18 16:19:57.899089 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2289/4551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:57 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:57.906379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:57.907285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:57.919319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.920588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.921268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:57.922314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:57.923117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:57.923737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.002217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.017350 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0e339d8-9877-4452-9cc0-65f9f80cf421 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.515567 Oct 18 16:19:58.026753 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2263/4552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:57 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:58.039461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:58.040009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:58.057549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.058709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.059351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.069270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.070140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.070891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.128149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.129202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.129387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.130054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lazy-loading 'fault' on Instance uuid 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:19:58.252589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b9a32a405e24a27bc8088db06d9d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.265609 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0afb651e-e28f-41e6-aa0c-77eb294c8587 tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 200 len: 1307 microversion: 2.1 time: 0.236803 Oct 18 16:19:58.266866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2264/4553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:58 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:58.277041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:58.280485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:58.296443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.297258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.298628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.299489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.300127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.300496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.359434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.369831 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a0e7e6c-ff81-4882-a9aa-6e228773711c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1476 microversion: 2.1 time: 0.468799 Oct 18 16:19:58.370842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2290/4554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:57 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:58.482305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.497310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.499163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:58.500359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e8d9f82-93c9-4685-a700-23f16134f8f2 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1332 microversion: 2.47 time: 0.232041 Oct 18 16:19:58.502122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2265/4555] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:19:58 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:19:58.679949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b54cf92-f013-4cd5-bca6-4cfb3cd42359", "name": "network-vif-deleted", "tag": "507ce10f-0cde-4998-b42d-9820ce343af8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:58.716543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.718059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.719208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.751692 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] Creating event network-vif-deleted:507ce10f-0cde-4998-b42d-9820ce343af8 for instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 on n-h2-858383-14 Oct 18 16:19:58.770323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7d554a39-bc94-4122-924d-08d6e2615be9 req-8c959395-94ce-4835-89d4-0855a586d0f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098416 Oct 18 16:19:58.774840 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2291/4556] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:19:58.925174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:58.925801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:58.934371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.935561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.936618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.938428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:58.939179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:58.939810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:58.963318 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf HTTP/1.1 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a9748d0f-cf1e-4ee9-b60f-9acef10c41bf'} Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:58.966193 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:19:58.970131 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:19:58.973579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:58.974945 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0ffbc68-6353-4a7c-8715-2d01cf0c65eb tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 404 len: 111 microversion: 2.1 time: 0.055358 Oct 18 16:19:58.976516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2266/4557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:58 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:19:59.048404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:59.049926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:59.053818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:59.058077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.058985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.059667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.060597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.061249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.061853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.169473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1806475777", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:59.272107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] validate_networks() for [('0400d885-7ea2-4fe9-aabb-5c42c7d66e6f', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:19:59.418322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:59.427728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63091fea-33b3-4aa6-8ed4-06fca28812cd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.389007 Oct 18 16:19:59.445051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2292/4558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:59 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:59.445357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:59.449164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] [instance: 9b54cf92-f013-4cd5-bca6-4cfb3cd42359] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:59.459247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.459962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.463728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.464615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.465291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.465876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.488286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] HTTP exception thrown: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Request method failure captured: Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 HTTP/1.1 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtIJ372kKpYUMINnpMtd9t8Y4pGr5CLFyw3sIb5Ya-O3mma7OtRB3sfMjRFo4qIAos9SYgIo00C2_9CvOfJiEhqLyVCO_VwCPGquqhRBmk5kBEQPLT1vfS-hxjwYonYI_ZchqgyaQvHIe9-fy98FeJogxAFgkk_nwoZFNG8r_CNQtG4 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: eee97a09ef2f48b694ad82e7f5a93d5a Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerAddressesTestJSON-1683140672 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eee97a09ef2f48b694ad82e7f5a93d5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eee97a09ef2f48b694ad82e7f5a93d5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eee97a09ef2f48b694ad82e7f5a93d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eee97a09ef2f48b694ad82e7f5a93d5a"}]}] Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerAddressesTestJSON-1683140672 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: eee97a09ef2f48b694ad82e7f5a93d5a Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1683140672 Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerAddressesTestJSON-1683140672-project Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4b9a32a405e24a27bc8088db06d9d6fe Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerAddressesTestJSON-1683140672-project Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9b54cf92-f013-4cd5-bca6-4cfb3cd42359'} Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:19:59.490047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] Returning 404 to user: Instance 9b54cf92-f013-4cd5-bca6-4cfb3cd42359 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b438e3d-a7b5-43cd-9cfd-e901f30e294a tempest-ServerAddressesTestJSON-1683140672 tempest-ServerAddressesTestJSON-1683140672-project] 10.222.0.78 "GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359" status: 404 len: 111 microversion: 2.1 time: 0.058117 Oct 18 16:19:59.493436 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2293/4559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:59 2022] GET /compute/v2.1/servers/9b54cf92-f013-4cd5-bca6-4cfb3cd42359 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:59.497492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:59.498205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:59.512221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.512728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.513216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.513953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:59.514452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:59.514889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:59.962627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:59.973794 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ef4b1247-66fa-48a8-8dc3-c9dc307228b7 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1476 microversion: 2.1 time: 0.480102 Oct 18 16:19:59.990354 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2294/4560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:59 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:00.000486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:00.002465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:00.009654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.010576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.011269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.012583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.013253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.013850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.157561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:00.158217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:00.159175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:00.160050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:00.160961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:00.186519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.189901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.191235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.192230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.192861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.193724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.219879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:00.226386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Getting quotas for user 7d7104a95b73405ab66140df742af14f and project f4faf70c703a4417bd7131aef1d7475d. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:00.232184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:00.248055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:00.249868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:00.251867 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-372e013f-049b-4136-ae0b-0fe9ac886979 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1340 microversion: 2.47 time: 0.260352 Oct 18 16:20:00.264582 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2295/4561] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:19:59 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1340 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:00.287633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:00.293698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:00.364774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-121e6ba1-51bd-4f6c-93d9-cd75bf30e746 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: .version_select at 0x7f5fd1857430>, body: {"keypair": {"name": "tempest-keypair-2087589318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCmew+bSQVz/tGQCSgtrPmVspgqwwRR7rKybxXhTKrHDRhHbWFslb+b+7Il7ueSH56WLulXiHtpECBtLq9LNU0+5oPeVCts4uFC2qEcbZi8hN0b5z8mqX5zYMpb/iSJeA=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:00.387686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-121e6ba1-51bd-4f6c-93d9-cd75bf30e746 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:00.395749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-121e6ba1-51bd-4f6c-93d9-cd75bf30e746 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for user 9d2663d26c42412c8acb3ded09320213 and project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:00.445246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-121e6ba1-51bd-4f6c-93d9-cd75bf30e746 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.179062 Oct 18 16:20:00.456909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2296/4562] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:20:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:20:00.467373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:00.471889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:00.487347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.489424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.489989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.490989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:00.491243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:00.491697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:00.526143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03311e1b-1e39-4ff5-b80f-818a093114d4 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.361985 Oct 18 16:20:00.537272 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2267/4563] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:20:00.545124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca05a830-33e6-4da6-b15a-43139ca23b44 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:00.552132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ca05a830-33e6-4da6-b15a-43139ca23b44 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:00.706730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca05a830-33e6-4da6-b15a-43139ca23b44 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:00.738851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca05a830-33e6-4da6-b15a-43139ca23b44 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1225 microversion: 2.1 time: 0.196813 Oct 18 16:20:00.740495 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2268/4564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:00 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:00.909475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:00.919845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0aedce7a-aff6-46b1-838a-096847e98a8d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.460848 Oct 18 16:20:00.922816 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2297/4565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:00 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:01.009767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:01.010646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:01.024217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.026419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.027478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.028599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.031706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.033568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.085558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:01.291904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:01.292619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:01.314741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.315569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.316210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.317443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.317978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.318621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.479191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:01.512278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:01.513403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:01.518831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:01.525953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56c5697f-d404-467e-953e-611aadd10098 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1340 microversion: 2.47 time: 0.235264 Oct 18 16:20:01.528581 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2298/4566] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:01 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1340 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:01.551953 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e238610-ff03-42f7-a245-5b0fbf0c838b tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1476 microversion: 2.1 time: 0.550873 Oct 18 16:20:01.552586 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2269/4567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:00 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:01.770154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:01.770882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:01.785378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.789282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.791446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.794098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.796539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.799129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.963035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:01.966559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:01.981700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.984552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.986135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:01.987843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:01.988914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:01.989934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:02.126768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:02.140957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26880d02-5f6f-403f-85bd-5c8079f92e9d tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1221 microversion: 2.1 time: 0.376033 Oct 18 16:20:02.158531 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2299/4568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:01 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:02.561592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:02.562463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:02.576047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:02.576555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:02.577030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:02.583065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:02.583595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:02.584054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.052532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:03.080749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:03.085379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:03.096676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66e47c25-0f06-4265-b1f9-3136127a4dfb tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1338 microversion: 2.47 time: 0.541540 Oct 18 16:20:03.105980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2300/4569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:02 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1338 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:03.119615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:03.133672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:03.144242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:03.150588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:03.151098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:03.151536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.156352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:03.156912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:03.159460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.198746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff82c3ab-b6ed-41a2-b7b9-4e343807dc2d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 1.241702 Oct 18 16:20:03.206070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2270/4570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:01 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:03.243244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade2af31-8f90-4dcb-b31e-681ae5ed2b4b", "name": "network-vif-unplugged", "status": "completed", "tag": "768dddf8-7654-4892-b62d-ace098a840da"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:03.266914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:03.273246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:03.277802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.323328 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] Creating event network-vif-unplugged:768dddf8-7654-4892-b62d-ace098a840da for instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b on n-h1-858383-14 Oct 18 16:20:03.343060 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-911eada1-b542-4a5b-aa9e-4e2329834e59 req-d9e2b220-38b1-499c-928b-7c6ba5330234 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128534 Oct 18 16:20:03.344010 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2271/4571] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:03.353499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:03.354978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:03.371205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:03.377760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:03.378675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.387430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:03.388369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:03.389465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:03.624259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:03.653556 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-116ed670-5e5f-4198-8064-eeeea6015236 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1283 microversion: 2.1 time: 0.307566 Oct 18 16:20:03.654515 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2272/4572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:03 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1283 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:04.139280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:04.140328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:04.156556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.161319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.162593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.163805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.167916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.170029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.211695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.227048 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15d17351-179c-44ec-bfb6-45a26065ee1c tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1476 microversion: 2.1 time: 1.118189 Oct 18 16:20:04.228132 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2301/4573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:03 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1476 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:04.256823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:04.261216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:04.287040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.289148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.290160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.292447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.295434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.296224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.306693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:04.492013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.506526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.511311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.517285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c974a2a6-8c07-4902-8ef4-16c9f2aaf986 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1338 microversion: 2.47 time: 0.391061 Oct 18 16:20:04.528289 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2273/4574] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:04 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1338 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:04.544305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade2af31-8f90-4dcb-b31e-681ae5ed2b4b", "name": "network-vif-deleted", "tag": "768dddf8-7654-4892-b62d-ace098a840da"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:04.571627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.586893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.587900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.631303 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] Creating event network-vif-deleted:768dddf8-7654-4892-b62d-ace098a840da for instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b on n-h1-858383-14 Oct 18 16:20:04.640961 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-68da097a-4b5b-44a7-a78d-bab95efcad9f req-fa50c585-99b1-4213-b1d5-d505b52ad4b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100197 Oct 18 16:20:04.652935 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2274/4575] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:20:04.698458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:04.699744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:04.714653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.715647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.716757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.717777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.718433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.720100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.846273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.863726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6670311a-67ee-4549-9d26-e0ec6cf51f04 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 0.632699 Oct 18 16:20:04.864390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2302/4576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:04 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:04.882509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb18bf31-45b9-4ba2-b83d-aafe23246949"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:04.888552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:04.906794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.908126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.908746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.909709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:04.913901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:04.914580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:04.920596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:04.955090 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c2c5b54-8c2b-4137-be4f-dfe915ffab8a tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1283 microversion: 2.1 time: 0.261801 Oct 18 16:20:04.960758 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2275/4577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:04 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1283 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:05.275471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:05.276174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:05.325348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.327358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.328114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.332235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.333543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.336063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.434066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.434930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.435730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.436754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lazy-loading 'fault' on Instance uuid ade2af31-8f90-4dcb-b31e-681ae5ed2b4b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:05.542494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e648121-3d10-4b75-9c5e-4c676bdc393e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676758 Oct 18 16:20:05.546086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2303/4578] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:20:04 2022] POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:05.564812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:05.565677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7875829b50540cb950fd805d969baa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc9b0ddd863459ca89e442b6362dff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:05.566224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:05.604609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.605724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.606612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.610856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.613325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-949799fe-c220-4fb3-8527-83ab059f29d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 200 len: 1311 microversion: 2.1 time: 0.343673 Oct 18 16:20:05.614390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.616399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.619977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2276/4579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:05 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 1311 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:05.632984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:05.898347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:05.901769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:05.958713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.959736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.964315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:05.969022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:05.975733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:05.979654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:06.343772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:06.409340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:06.432871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:06.438960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8cb811c-d064-4cdf-8ee9-6058c1cad464 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1338 microversion: 2.47 time: 0.878667 Oct 18 16:20:06.440567 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2304/4580] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:05 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1338 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:06.450006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:06.451539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:06.463814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:06.464593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:06.465348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:06.466433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:06.467068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:06.467707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.171707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:07.193734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25fbbb82-03ac-412c-8df6-e0256cfcf17c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 0.747736 Oct 18 16:20:07.196917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2305/4581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:06 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:07.201804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ea8baf-ba46-4642-9633-b93882bac746", "name": "network-vif-plugged", "status": "completed", "tag": "19db8aaa-4f7e-4905-8a04-8ef09561db28"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:07.236800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.237513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.237968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.267255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] Creating event network-vif-plugged:19db8aaa-4f7e-4905-8a04-8ef09561db28 for instance 35ea8baf-ba46-4642-9633-b93882bac746 on n-h1-858383-14 Oct 18 16:20:07.275129 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e0cfb692-c539-4443-b295-0c401f4645bb req-3167f7a9-d098-49b6-abfa-57dca290804d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076627 Oct 18 16:20:07.276503 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2306/4582] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:07.290576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:07.291563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] [instance: ade2af31-8f90-4dcb-b31e-681ae5ed2b4b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:07.308840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.314858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.315655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.316692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.317598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.320128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.354223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] HTTP exception thrown: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Request method failure captured: Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b HTTP/1.1 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHnGX-RTuGMORQBREmqYjdydji63apEo9JGzLUn32kX7EvktxsxlD_bfvLi7Pr5Ks1JibxMI1RXGP50HHL8mCObwRwNwUqPcqGt8KuXQH4DgO3n-22d2qhEY26JJdSILMG31a1M_DB254OLvk8oe35OYSjOTJdAAltHlVUgv9rXFlg Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 6cc9b0ddd863459ca89e442b6362dff6 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cc9b0ddd863459ca89e442b6362dff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cc9b0ddd863459ca89e442b6362dff6"}]}] Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 6cc9b0ddd863459ca89e442b6362dff6 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-946001437 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-946001437-project Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d7875829b50540cb950fd805d969baa2 Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-946001437-project Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ade2af31-8f90-4dcb-b31e-681ae5ed2b4b'} Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:07.356169 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:07.363396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] Returning 404 to user: Instance ade2af31-8f90-4dcb-b31e-681ae5ed2b4b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:07.367276 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c1f9f39-1705-4891-baac-e58617eb79d3 tempest-ServersAdminNegativeTestJSON-946001437 tempest-ServersAdminNegativeTestJSON-946001437-project] 10.222.0.78 "GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b" status: 404 len: 111 microversion: 2.1 time: 0.082650 Oct 18 16:20:07.367276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2307/4583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:07 2022] GET /compute/v2.1/servers/ade2af31-8f90-4dcb-b31e-681ae5ed2b4b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:07.398207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:07.410191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77967651-c3b5-4eb5-844e-3554a3f791b7 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 1.523860 Oct 18 16:20:07.426465 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2277/4584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:05 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:07.474348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:07.475773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:07.487763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.488700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.489636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.491020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.492019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.493049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.644148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:07.653118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:07.654607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:07.655892 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3093eff-3f6c-4f37-ab59-a3ed61bd6e8d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1359 microversion: 2.47 time: 0.187816 Oct 18 16:20:07.656465 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2308/4585] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:07 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:07.699445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1233796777"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:07.702979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:07.719582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.720103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.720546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:07.721320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:07.725760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:07.728271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.236575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:08.238526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9be0582-5117-477f-9c92-924ac949ecda tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "POST /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9/action" status: 202 len: 52 microversion: 2.47 time: 0.541760 Oct 18 16:20:08.240482 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2278/4586] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:20:07 2022] POST /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9/action => generated 52 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:20:08.248816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:08.260321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:08.261697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:08.272958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.274296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.275477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.275917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.276867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.277658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.278692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.280154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.280318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.283545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.285240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.285741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.342094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:20:08.524546 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f8b5931-9f36-4faf-8719-8e77ac211425 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 204 len: 0 microversion: 2.47 time: 0.271173 Oct 18 16:20:08.535019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2279/4587] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:20:08 2022] DELETE /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:20:08.550937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:08.552305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:08.569094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.569993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.570928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:08.572482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:08.573383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:08.574231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:09.354823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:09.379434 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c21b7306-6dae-4618-bda8-c604064560c6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 1.151852 Oct 18 16:20:09.381694 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2309/4588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:08 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:09.389750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b280fc09-8c06-400d-a5be-e7b356062599", "tag": "fd1b932a-da3f-4285-9ce6-f6f8260490e6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:09.414951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:09.416555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:09.417495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:09.440168 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] Creating event network-changed:fd1b932a-da3f-4285-9ce6-f6f8260490e6 for instance b280fc09-8c06-400d-a5be-e7b356062599 on n-h2-858383-14 Oct 18 16:20:09.471786 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-42fdd8e8-5fac-4297-9808-4701e98f8a9e req-a45751e9-6645-4504-88e3-d2a103a2e70e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074152 Oct 18 16:20:09.474771 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2310/4589] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:09.489719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:09.491524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:09.556720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:09.562530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:09.566990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:09.572132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:09.573389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:09.574560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:09.664408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:09.673764 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36ac4553-e568-43af-a371-4705d7c3a823 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1308 microversion: 2.1 time: 1.136488 Oct 18 16:20:09.687888 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2280/4590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:08 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1308 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:09.790205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1060061113", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38e8d636-af89-408a-8b6a-f4d4507bc5f5"}], "security_groups": [{"name": "tempest-securitygroup--1812152658"}], "key_name": "tempest-keypair-2087589318", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:09.806026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:09.843717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:09.857254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:09.864338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c2feb39-7826-4c14-8409-ae45dbf761df tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1365 microversion: 2.47 time: 0.387847 Oct 18 16:20:09.876118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2311/4591] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:09 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:10.204293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:10.392663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] validate_networks() for [('38e8d636-af89-408a-8b6a-f4d4507bc5f5', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:20:10.421323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:10.426018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:10.448221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:10.462090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:10.466959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:10.469846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:10.471932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:10.472436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:10.472892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:10.735043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:10.894813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:11.156975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.178538 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5d2a503-4042-4452-b6e3-bd17785550c7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 0.764244 Oct 18 16:20:11.179300 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2312/4592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:10 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:11.192754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:11.194078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:11.202637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.203425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.204090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.205026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.205886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.206515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.266232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:11.266935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:11.267548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:11.268164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:11.268791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:11.285784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.288709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.289358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.290291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.292689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.293324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.343604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:11.352666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for user 9d2663d26c42412c8acb3ded09320213 and project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:11.368470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:11.371340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:11.447401 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b7b9659-d4bd-44c7-93a2-cf48879300fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.662297 Oct 18 16:20:11.451932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2281/4593] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:20:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:20:11.478415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:11.480713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:11.512208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.521783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.522751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.524148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.524629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.527049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.682878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.699695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.704909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.709648 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7fc86d2-752b-4bc8-b40b-107322d8ce2c tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1365 microversion: 2.47 time: 0.256425 Oct 18 16:20:11.710430 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2282/4594] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:11 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:11.722474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:11.723106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:11.870780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.883964 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1270ee45-7d9c-4b97-b18b-b3096f1c09f0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1490 microversion: 2.1 time: 0.703514 Oct 18 16:20:11.886465 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2313/4595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:11 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1490 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:11.916333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:11.931546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:11.933242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.944888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.953196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:11.955820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d33c8a84-265b-444f-8988-2c0eb2560640 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1282 microversion: 2.20 time: 0.243802 Oct 18 16:20:11.956065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2283/4596] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:11 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:11.970150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:12.203097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:12.204549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:12.215192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:12.231575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:12.232298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:12.241307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:12.242379 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd989b97-6bf6-450b-b914-4888a91b188d tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "PUT /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1085 microversion: 2.1 time: 0.331067 Oct 18 16:20:12.247951 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2314/4597] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:20:11 2022] PUT /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1085 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:12.256347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:12.259720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:12.287098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:12.288186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:12.316684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:12.317773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:12.323351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:12.324980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:12.326030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:12.327580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.258785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.291825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1027929d-bd35-466f-9492-da39cd5c6120 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 1.092257 Oct 18 16:20:13.313854 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2284/4598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:12 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:13.325641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:13.327991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:13.341263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.341762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.342205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.343018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.343483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.343965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.382159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:13.412004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.412516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.412960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.413453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lazy-loading 'fault' on Instance uuid 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:13.475088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.491746 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4cf6435-7055-4e28-9861-e3b2a6123640 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1511 microversion: 2.1 time: 1.215562 Oct 18 16:20:13.493908 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2315/4599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:12 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1511 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:13.528905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:13.529569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:13.549476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.550004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.550513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.551864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.554398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.556289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.579848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.597799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.599498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3821d9ad75e04711bdf8a93567115d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9f40afe6f84b4cacbaad47846895ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.600738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eba3718e-925d-470f-8698-705244be1b2d tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 200 len: 1370 microversion: 2.47 time: 0.283442 Oct 18 16:20:13.609398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2285/4600] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:13 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:13.656064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:13.656793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:13.679175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.679823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.680273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.681021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:13.681489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:13.681911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:13.923290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.937698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.946549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:13.961184 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a64973a-5bf0-43b2-8940-9f767cdc12c2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1278 microversion: 2.20 time: 0.443099 Oct 18 16:20:13.962010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2316/4601] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:13 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1278 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:14.338765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:14.338765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:14.352596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:14.353196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.353196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.353602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.362542 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-255dd499-b1ed-40f9-91d4-cdaa63f517d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1511 microversion: 2.1 time: 0.728155 Oct 18 16:20:14.363619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2286/4602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:13 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:14.385796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.386426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.386883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.390252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:14.391073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:14.405629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.406289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.407382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.408215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.408829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.409426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.471739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:20:14.665268 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3763238-2772-407e-9b91-1ebadbdc30ef tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 204 len: 0 microversion: 2.1 time: 0.278872 Oct 18 16:20:14.667004 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2287/4603] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:20:14 2022] DELETE /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:20:14.684632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:14.688668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] [instance: 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:14.701758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.702769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.703794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.705610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.706839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.709600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.747532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] HTTP exception thrown: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Request method failure captured: Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 HTTP/1.1 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIqGZcv-QVoh_jS214Q1jg5T6mp4jLTeM1elG4kSXIEikmrWTI7G5bRT8-mZNCuyz_phhokaWy9pSSwpBCBN39iijdqUt8k4EC9CfJDiQDVbFdb9rQB7_-ay9AIViUDuygBlXJjBJPQcKKVaapQviCvFiLWcZ5cba4-tI8qDsClcSw Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 0d9f40afe6f84b4cacbaad47846895ca Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersAaction247Test-1684116596 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d9f40afe6f84b4cacbaad47846895ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d9f40afe6f84b4cacbaad47846895ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d9f40afe6f84b4cacbaad47846895ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d9f40afe6f84b4cacbaad47846895ca"}]}] Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersAaction247Test-1684116596 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 0d9f40afe6f84b4cacbaad47846895ca Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersAaction247Test-1684116596 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersAaction247Test-1684116596-project Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3821d9ad75e04711bdf8a93567115d92 Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersAaction247Test-1684116596-project Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '84299fd2-2dc9-498d-b1af-88ecd0cb5ed9'} Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:14.749138 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] Returning 404 to user: Instance 84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a05dea5-dff2-40c7-9ea0-2818dbe1a8d7 tempest-ServersAaction247Test-1684116596 tempest-ServersAaction247Test-1684116596-project] 10.222.0.78 "GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9" status: 404 len: 111 microversion: 2.47 time: 0.082398 Oct 18 16:20:14.752983 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2288/4604] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:14 2022] GET /compute/v2.1/servers/84299fd2-2dc9-498d-b1af-88ecd0cb5ed9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:20:14.757714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:14.758957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:14.769944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.770448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.770883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:14.771585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:14.772073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:14.773758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:15.334722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:15.351938 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c930358d-25dc-4ac7-8545-8d4accbffc14 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 1.018653 Oct 18 16:20:15.355308 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2317/4605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:14 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:15.383261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:15.384813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:15.406659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:15.410011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:15.411982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:15.417233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:15.418839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:15.419538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:15.459354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:15.470320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a8852bce-458a-44fc-8680-7fdead34a4d9 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1517 microversion: 2.1 time: 0.716077 Oct 18 16:20:15.470949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2289/4606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:14 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1517 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:15.685370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:15.702572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:15.722162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:15.728920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:15.733479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-429a896a-7a6c-414f-b27f-08cb6e3097da tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1340 microversion: 2.20 time: 0.375716 Oct 18 16:20:15.734427 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2318/4607] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:15 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1340 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:16.386583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:16.387779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:16.455507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:16.464129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:16.465656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:16.467663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:16.468597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:16.470185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:16.507679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:16.512813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:16.550464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:16.551557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:16.552679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:16.554845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:16.557552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:16.558272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:17.117627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:17.137880 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-173194c2-b8a4-449d-a568-0ec7e903432c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 0.757884 Oct 18 16:20:17.142211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2290/4608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:16 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:17.160933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:17.167242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:17.168653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:17.189363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:17.190630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:17.194921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:17.195467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b3673ba-7bd5-42d3-894a-a1c1af5ce787 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1517 microversion: 2.1 time: 0.688099 Oct 18 16:20:17.196203 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2319/4609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:16 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1517 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:17.198878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:17.200060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:17.202473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:17.930603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:17.950396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:17.960885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:17.962144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-869c1f26-1d1b-4074-b22a-5a4e86646fb5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.816719 Oct 18 16:20:17.977064 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2291/4610] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:17 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:18.024780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b280fc09-8c06-400d-a5be-e7b356062599", "name": "network-vif-plugged", "status": "completed", "tag": "fd1b932a-da3f-4285-9ce6-f6f8260490e6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:18.075232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.077544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.078569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.113422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] Creating event network-vif-plugged:fd1b932a-da3f-4285-9ce6-f6f8260490e6 for instance b280fc09-8c06-400d-a5be-e7b356062599 on n-h2-858383-14 Oct 18 16:20:18.127319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8ac4b821-67fc-4fd1-ac63-17256caea146 req-aae1542f-cdab-4d6d-8216-760cb03f0b94 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108719 Oct 18 16:20:18.128630 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2292/4611] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:20:18.180418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:18.181219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:18.221746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.222455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.223119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.229933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.230597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.237437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.523531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-946137309", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:18.690201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:18.691351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:18.692067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:18.692502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:18.693730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:18.708970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.710309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.711154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.712240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.713126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.714685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.752897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Getting quotas for project 2137dcdad6004d0c8038949a765d259e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:18.761453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Getting quotas for user 61cf7ea9fbe3487294ed6d52cfa2fec0 and project 2137dcdad6004d0c8038949a765d259e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:18.783412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:18.791231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:18.820468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:18.833950 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e27a5d7-8a5f-4f1b-b22f-ecd43472851c tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 0.671828 Oct 18 16:20:18.836592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2293/4612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:18 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:18.850471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:18.851536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:18.868745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.869670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.870337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.871154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.873476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.874663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.919974 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6fc5083-3765-4153-9a69-9d1174c3c84b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.158614 Oct 18 16:20:18.920642 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2320/4613] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:20:18.934582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.936839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.937268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.938239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid 35ea8baf-ba46-4642-9633-b93882bac746 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:18.947527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ea8baf-ba46-4642-9633-b93882bac746", "name": "network-vif-deleted", "tag": "19db8aaa-4f7e-4905-8a04-8ef09561db28"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:18.966592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:18.967089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:18.967533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:18.987986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:18.994749 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] Creating event network-vif-deleted:19db8aaa-4f7e-4905-8a04-8ef09561db28 for instance 35ea8baf-ba46-4642-9633-b93882bac746 on n-h1-858383-14 Oct 18 16:20:18.999298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5d7c032-e2be-4af6-b7a6-e57705e6a901 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 200 len: 1319 microversion: 2.1 time: 0.160033 Oct 18 16:20:19.000633 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2294/4614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:18 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:19.005793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:19.006622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:19.032580 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-360c6be6-5f1e-4665-99bb-8f86e0cc06f8 req-1cc5a9b2-ee82-421f-bc67-7a14671b466e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101542 Oct 18 16:20:19.033699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2321/4615] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:19.044567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:19.048632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:19.074211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:19.078436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:19.080869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:19.082140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:19.083353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:19.083996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:19.131937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.148689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.150199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.158444 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3f009f1-842d-4084-abcf-810a38bc63b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1452 microversion: 2.91 time: 0.156469 Oct 18 16:20:19.159029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2295/4616] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:19 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:19.607259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.640595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.643297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:19.655466 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac545c7a-d2b8-4649-9229-9ef272ccfdc1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.605552 Oct 18 16:20:19.659037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2322/4617] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:19 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:19.687092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:19.719286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:19.720631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:19.723843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:19.748734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] Creating event network-changed:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:20:19.767570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e0237e73-c4cf-4912-9a9b-e53c50e22b77 req-099edef4-4089-4135-8542-db754d1bc1f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084893 Oct 18 16:20:19.775635 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2296/4618] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:19.867507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:19.868364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:19.897494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:19.898296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:19.899412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:19.900360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:19.903689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:19.904717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.036494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:20.038595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:20.052780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.053308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.053762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.057200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.057750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.058186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.092550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 HTTP/1.1 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '35ea8baf-ba46-4642-9633-b93882bac746'} Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:20.095364 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:20:20.099482 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:20.111940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:20.115242 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16857ef5-3b1f-41c1-be80-ef0cfa3435fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 404 len: 111 microversion: 2.1 time: 0.084292 Oct 18 16:20:20.125183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2297/4619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:20 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:20.195067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:20.196713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:20.229819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.230524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.233548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.237325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.237996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.238625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.348763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:20.358246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f594ae2d-7768-49fa-91b3-a8601113a66b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1325 microversion: 2.1 time: 0.499535 Oct 18 16:20:20.364835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2323/4620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:19 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:20.468043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:20.483256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:20.486304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:20.500193 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-22001ad7-6244-428d-a85a-d3094f50ecb9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1448 microversion: 2.91 time: 0.313435 Oct 18 16:20:20.507611 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2298/4621] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:20 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1448 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:20.592325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1613103512", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "c7a4d515-2302-48b3-95b4-50d00fe00dd7"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:20.688671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:20.690035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:20.694257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] validate_networks() for [('c7a4d515-2302-48b3-95b4-50d00fe00dd7', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:20:20.701169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.701782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.704781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:20.705813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:20.707866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:20.708373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.316479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:21.433215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:21.453971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:21.458392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:21.460076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a6f8a81-18c5-4392-8859-be3d87ab1cb2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.775411 Oct 18 16:20:21.461420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2299/4622] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:20 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:21.482446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:21.483567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:21.508824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.509948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.510572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.512087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.512788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.513416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.630314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:21.632057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:21.633203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:21.634273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:21.634904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:21.657500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.658829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.660152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.664346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.668439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.669271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.725814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:21.746969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Getting quotas for user 70ac3d341e8444fda9964798e94f0d16 and project 95df9210b0dd484abf991849367a2c16. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:21.775919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:21.778319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:21.791272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:21.841821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10bc6508-0759-4e9d-aaa1-b5107f614e5e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258989 Oct 18 16:20:21.843209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:21.849571 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2324/4623] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:20:21.855794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:21.856595 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bec852cc-b3e5-4c0f-813e-c482c2859df9 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1523 microversion: 2.1 time: 0.393772 Oct 18 16:20:21.856951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:21.857224 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2300/4624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:21 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:21.865809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.866631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.867361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.868304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:21.869043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:21.883613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:21.885272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f12aa65-d67d-44da-855e-b57559feb4b0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:21.885964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f12aa65-d67d-44da-855e-b57559feb4b0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:22.148817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f12aa65-d67d-44da-855e-b57559feb4b0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.167524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f12aa65-d67d-44da-855e-b57559feb4b0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1209 microversion: 2.1 time: 0.309179 Oct 18 16:20:22.183773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2301/4625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:21 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1209 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:22.194495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:22.194495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:22.214116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.215492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.215492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.216395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.216395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.216606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.266845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:20:22.377399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:22.396906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.420147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.424956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.442474 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9b429f5-c28b-409f-a902-e48dfaa395f6 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 204 len: 0 microversion: 2.1 time: 0.256377 Oct 18 16:20:22.448436 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2302/4626] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:20:22 2022] DELETE /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:22.449648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b0c94d09-e195-4116-8dd5-523090e25d73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1510 microversion: 2.91 time: 0.598331 Oct 18 16:20:22.451098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2325/4627] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:21 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:22.486751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:22.487680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:22.499466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:22.511095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.514654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:22.514849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.515602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.516520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.517375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.517955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.534436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.540673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.542658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.544481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:22.546465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:22.548758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:22.949974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.965142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.972181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:22.975301 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29083321-b331-434a-ba66-1751ca21d917 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.482472 Oct 18 16:20:22.976650 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2326/4628] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:22 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:23.021534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:23.034114 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cba3eaa7-8379-4410-9291-514c503b0cc2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1529 microversion: 2.1 time: 0.583938 Oct 18 16:20:23.039463 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2303/4629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:22 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1529 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:23.194585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:23.195283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:23.207297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:23.207698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:23.208139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:23.208855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:23.213150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:23.213633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:23.372653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:23.390103 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-873961c2-8fab-4450-a615-4051ced7d1b5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1213 microversion: 2.1 time: 0.201987 Oct 18 16:20:23.393357 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2327/4630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:23 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:23.485905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:23.486780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:23.494667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:23.495937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:23.496540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:23.497439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:23.498040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:23.498616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:23.638065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:23.690328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:23.693170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:23.706722 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00a6d0ad-2781-49d3-8389-49bf7aa124ae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1510 microversion: 2.91 time: 0.224967 Oct 18 16:20:23.713286 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2304/4631] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:23 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:24.025307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:24.026093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:24.034233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.035018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.035812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.036696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.037329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.037938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.075480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:24.076107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:24.093057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.093595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.094620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.095347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.095801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.096413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.477539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.489724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-024796b1-ad01-4399-8612-1c5ac8dd364b tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1529 microversion: 2.1 time: 0.418109 Oct 18 16:20:24.492133 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2305/4632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:24 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1529 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:24.497184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:24.498078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:24.505423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.506232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.515973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.517051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.518365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.519055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.519932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.543274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.544722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.569092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-829bd45d-1549-44b8-a915-f6488ecb06b0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.563058 Oct 18 16:20:24.575856 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2328/4633] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:24 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:24.698536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.711920 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae1817b4-eaf6-4b73-9f1d-20cd990f3fad tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1261 microversion: 2.1 time: 0.215181 Oct 18 16:20:24.728291 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2306/4634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:24 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:24.738257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:24.738890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:24.758604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.761930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.763953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.766726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:24.767335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:24.769590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:24.905413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.920232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.923742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:24.931860 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b19ee02-d03f-4053-b0f2-d875e3707725 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1510 microversion: 2.91 time: 0.198316 Oct 18 16:20:24.933162 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2329/4635] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:24 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:25.521298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:25.521967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:25.552166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:25.552664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:25.559536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:25.560560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:25.566239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:25.567578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:25.595603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:25.596803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:25.614845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:25.615339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:25.615770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:25.624499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:25.630926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:25.631484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.217694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:26.228842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:26.230242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:26.232410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:26.235791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87552d47-0bfb-4927-976e-869ec83c29f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.646014 Oct 18 16:20:26.237056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2330/4636] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:25 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:26.242946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:26.246158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:26.252725 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e019e5ef-1c84-497a-b546-9ab17808c88e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1529 microversion: 2.1 time: 0.739202 Oct 18 16:20:26.253575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2307/4637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:25 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1529 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:26.254712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.255387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.255976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.256839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.257475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.258052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.273279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:26.273900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:26.287600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'flavor' on Instance uuid c7b81207-45cd-44fb-abb4-b7faeb7002ad {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:26.290881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.291419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.291869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.292598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.293190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.293791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.466246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:26.476062 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b250888-5586-419e-b649-a2e01b2b2e28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1267 microversion: 2.1 time: 0.206527 Oct 18 16:20:26.480783 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2308/4638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:26 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:26.496276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:26.496276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:26.510453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.511893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.512540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.514313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.518155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.520452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.563643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ced6431c-8202-43f8-9755-c676e41e90c0 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/action" status: 200 len: 32 microversion: 2.1 time: 0.323843 Oct 18 16:20:26.568062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2331/4639] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:20:26 2022] POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:20:26.584785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:26.586807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:26.603124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.607874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.612939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:26.614216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:26.617638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:26.618423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:27.456600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:27.467428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a216424f-e25f-4285-877c-ec83b9d4e57e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.894208 Oct 18 16:20:27.481020 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2332/4640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:26 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:27.491095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:27.493888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:27.498208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:27.506545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:27.506545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:27.506545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:27.506545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:27.506897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:27.507195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:27.512820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:27.514367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:27.528696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:27.530392 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2cf02e5-f992-4bb5-8fd2-01358eca9b53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1531 microversion: 2.91 time: 1.047894 Oct 18 16:20:27.532004 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2309/4641] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:26 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1531 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:27.551584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:27.552578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:27.566899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:27.567680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:27.568944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:27.570024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:27.570760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:27.572739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.211769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:28.226523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:28.235697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:28.248833 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de77f67a-bb14-4284-8f60-7f88688abdef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.763713 Oct 18 16:20:28.249619 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2333/4642] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:27 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:28.272215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:28.272835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:28.289870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.293060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.293711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.297827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.298527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.298807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7104a95b73405ab66140df742af14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4faf70c703a4417bd7131aef1d7475d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:28.302947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.307745 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbab3020-ec65-4335-8426-a2188a0a1f6f tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 200 len: 1529 microversion: 2.1 time: 0.774484 Oct 18 16:20:28.318093 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2310/4643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:27 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 1529 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:28.541146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:28.561526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70cfa558-f6c6-4bee-b82a-175bc29cd480 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1267 microversion: 2.1 time: 0.302357 Oct 18 16:20:28.574403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2334/4644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:28 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:28.590032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:28.610317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:28.631483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.632975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.634754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.636905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.639878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.640973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.701786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:28.820403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:28.821133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:28.830066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.830857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.831515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:28.832450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:28.833347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:28.833989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:29.036768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lazy-loading 'services' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:29.091499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-642cbbe9-49eb-4717-8085-9ce9794a6a47 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1938 microversion: 2.91 time: 0.770647 Oct 18 16:20:29.098005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2311/4645] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:28 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1938 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:29.112974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b280fc09-8c06-400d-a5be-e7b356062599", "name": "network-vif-deleted", "tag": "fd1b932a-da3f-4285-9ce6-f6f8260490e6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:29.169924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:29.170723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:29.172217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:29.231736 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] Creating event network-vif-deleted:fd1b932a-da3f-4285-9ce6-f6f8260490e6 for instance b280fc09-8c06-400d-a5be-e7b356062599 on n-h2-858383-14 Oct 18 16:20:29.242179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5d8e2b9b-1ebe-4cba-a2f0-81497f3ab86b req-00f6aac6-069a-470c-8e90-9edf9c9a2a04 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141069 Oct 18 16:20:29.243134 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2312/4646] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:29.249139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:29.250079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:29.265298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:29.265851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:29.266369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:29.267150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:29.267617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:29.268277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:29.441260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lazy-loading 'services' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:29.527555 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4dcef20-37f6-4bfb-ba3a-e4430d4b3731 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1938 microversion: 2.91 time: 0.280653 Oct 18 16:20:29.528758 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2313/4647] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:29 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1938 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:29.538805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:29.541726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:29.561961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:29.563113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:29.563964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:29.566596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:29.568115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:29.569985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.152135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:30.170528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1faf8b0d-453d-4cd6-8d98-680df8c8625b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 1.590714 Oct 18 16:20:30.173757 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2335/4648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:28 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:30.185007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.191676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: b280fc09-8c06-400d-a5be-e7b356062599] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.207067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.207576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.208026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.208750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.209234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.209865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.238879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 HTTP/1.1 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b280fc09-8c06-400d-a5be-e7b356062599'} Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.241876 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. Oct 18 16:20:30.246119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.248737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance b280fc09-8c06-400d-a5be-e7b356062599 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:30.250651 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be207f2e-5ac5-47c4-a136-52adf5944504 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599" status: 404 len: 111 microversion: 2.1 time: 0.075136 Oct 18 16:20:30.255520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2336/4649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:30 2022] GET /compute/v2.1/servers/b280fc09-8c06-400d-a5be-e7b356062599 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:30.261383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:30.262500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.268714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.269461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.270119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.271025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.271671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.272261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.277117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:30.279843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:30.281989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-782ebb73-ae52-44ce-b470-e9fd17bfb74b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.751537 Oct 18 16:20:30.288393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2314/4650] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:29 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:30.301410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.305915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.320106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4bf811ae-ab77-425a-bbb5-f79b228cd41d tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.062530 Oct 18 16:20:30.325698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.330397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.330656 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2337/4651] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 18 16:20:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:20:30.332385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.336010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.338046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.340706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.342589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2b6df0-ed72-44c5-b870-df2ae89e85f2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd6499d30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.386285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-dc2b6df0-ed72-44c5-b870-df2ae89e85f2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Image not found. Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2b6df0-ed72-44c5-b870-df2ae89e85f2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa HTTP/1.1 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: exception: Image not found. Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '0c71fdfc-6a07-41b2-9b77-fb9f08322eaa'} Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c71fdfc-6a07-41b2-9b77-fb9f08322eaa to delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c71fdfc-6a07-41b2-9b77-fb9f08322eaa could not be found. Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.388259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:20:30.393099 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.396266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2b6df0-ed72-44c5-b870-df2ae89e85f2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Image not found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:30.397327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc2b6df0-ed72-44c5-b870-df2ae89e85f2 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa" status: 404 len: 62 microversion: 2.1 time: 0.064299 Oct 18 16:20:30.398086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2338/4652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:30 2022] DELETE /compute/v2.1/images/0c71fdfc-6a07-41b2-9b77-fb9f08322eaa => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:20:30.406667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:30.410211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.436815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.437687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.438294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.439169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.439780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.440379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.496801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lazy-loading 'flavor' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:20:30.693691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:30.706254 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f6d932c-67eb-4c36-af63-d8172bbb115a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.416419 Oct 18 16:20:30.707431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2315/4653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:30 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:30.714443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.716908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.724622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.725454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.726110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.727018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.727684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.728318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.754020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf HTTP/1.1 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a9748d0f-cf1e-4ee9-b60f-9acef10c41bf'} Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:30.758332 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:30.762583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5a935cd-3c15-4193-94ef-1de44ac15783 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 404 len: 111 microversion: 2.1 time: 0.053871 Oct 18 16:20:30.771322 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2316/4654] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:20:30 2022] DELETE /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:30.780375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.788197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: a9748d0f-cf1e-4ee9-b60f-9acef10c41bf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.796970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.801392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.801881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.802622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.803092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.803521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.825894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3fae8c67-b3d1-433b-80e4-d0b54397e961 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action" status: 202 len: 0 microversion: 2.91 time: 0.426110 Oct 18 16:20:30.826700 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2339/4655] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:20:30 2022] POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:30.838706 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.838916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.839760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf HTTP/1.1 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a9748d0f-cf1e-4ee9-b60f-9acef10c41bf'} Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.840430 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance a9748d0f-cf1e-4ee9-b60f-9acef10c41bf could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-936d0785-b5c2-48b1-938f-531849390811 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf" status: 404 len: 111 microversion: 2.1 time: 0.069679 Oct 18 16:20:30.844006 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2317/4656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:30 2022] GET /compute/v2.1/servers/a9748d0f-cf1e-4ee9-b60f-9acef10c41bf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:30.855206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6cb71e3-f022-497b-beac-06a297655bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd167f5e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:30.859101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.860408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.862696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.864323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:30.870031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:30.870786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:30.884112 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6cb71e3-f022-497b-beac-06a297655bb7 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876902989" status: 202 len: 0 microversion: 2.1 time: 0.033118 Oct 18 16:20:30.888935 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2318/4657] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:20:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876902989 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:31.118288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:31.137255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:31.145204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:31.152536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c950585-52aa-4ca3-90b2-adbc10ea173f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.320441 Oct 18 16:20:31.158269 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2340/4658] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:30 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:31.199013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:31.199643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:31.213271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.216917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.217601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.219104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.219729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.220840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.294909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889", "tag": "37f28306-ed5e-4083-a6f6-0f27ccd62159"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:31.324773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.326756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.327427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.346549 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] Creating event network-changed:37f28306-ed5e-4083-a6f6-0f27ccd62159 for instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 on n-h1-858383-14 Oct 18 16:20:31.363732 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0379f038-a1e6-4f42-b18a-20913fcaa9a0 req-e788b980-ae72-4315-b315-e8f22f8e9bbf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073577 Oct 18 16:20:31.366001 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2341/4659] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:31.380897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:31.381974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:31.400307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.401160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.403270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.407396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.408212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.408856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.601696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:31.622141 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2674948a-6217-4e68-a34c-6ea3b77baab4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.427296 Oct 18 16:20:31.627048 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2319/4660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:31 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:31.735557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:31.735931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:31.748730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.749294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.750459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.751332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:31.755935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:31.757696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:31.759667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:32.007553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.019719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3993e8a-afa9-4ef6-be6d-fb1dceb3f20e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.289910 Oct 18 16:20:32.020738 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2320/4661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:31 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:32.168155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "name": "network-vif-plugged", "status": "completed", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:32.178829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:32.181773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:32.182246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:32.182861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:32.197692 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] Creating event network-vif-plugged:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:20:32.204895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-efa0a21c-de49-4318-9e2a-a8a549f9dd0d req-12adee29-3fb6-496f-9b8a-c906681d4f84 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047322 Oct 18 16:20:32.206591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2321/4662] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:20:32.213432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:32.214472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:32.224491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:32.226171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:32.226807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:32.227774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:32.228381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:32.228957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:32.271266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:32.337376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.350522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.354332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.356062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.365193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.367077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.367498 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6663ef6a-949d-48e1-8252-0e121d92ac31 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.159503 Oct 18 16:20:32.368287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2322/4663] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:32 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:32.368880 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8603634a-34b6-42dd-9ddf-b02dbf469a03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.998074 Oct 18 16:20:32.370365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2342/4664] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:31 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:32.651106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:32.652270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:32.661548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:32.662043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:32.662658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:32.663367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:32.663823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:32.664255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:32.867236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:32.877493 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-823a504d-160b-489a-b0cd-5a2f72486892 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.230576 Oct 18 16:20:32.878487 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2323/4665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:32 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:33.048379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.049654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:33.059222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.059728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.060169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.061167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.061634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.062602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.112631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7472ba9b-a0d7-4241-9fa7-b0a56089fc09 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '.version_select at 0x7f5fd158d1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.159544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7472ba9b-a0d7-4241-9fa7-b0a56089fc09 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Image not found. Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7472ba9b-a0d7-4241-9fa7-b0a56089fc09 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/images/7f18c4b6-67b8-42d9-b6c3-8b41b0a09064 HTTP/1.1 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: exception: Image not found. Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7f18c4b6-67b8-42d9-b6c3-8b41b0a09064'} Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f18c4b6-67b8-42d9-b6c3-8b41b0a09064 to delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f18c4b6-67b8-42d9-b6c3-8b41b0a09064 could not be found. Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.162441 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7472ba9b-a0d7-4241-9fa7-b0a56089fc09 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Image not found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7472ba9b-a0d7-4241-9fa7-b0a56089fc09 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/images/7f18c4b6-67b8-42d9-b6c3-8b41b0a09064" status: 404 len: 62 microversion: 2.1 time: 0.058270 Oct 18 16:20:33.167116 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2324/4666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:33 2022] DELETE /compute/v2.1/images/7f18c4b6-67b8-42d9-b6c3-8b41b0a09064 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:20:33.181073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.193683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:33.215296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.215860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.216320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.217084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.217544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.222991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.248958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 HTTP/1.1 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6'} Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:33.252051 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.256270 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.258777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:33.259860 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b22341bf-fe92-4245-95d3-483531bee58e tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "DELETE /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 404 len: 111 microversion: 2.1 time: 0.082696 Oct 18 16:20:33.263990 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2325/4667] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:20:33 2022] DELETE /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:33.271760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.272566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] [instance: 708cd7ec-91bd-4329-8a41-74adca7d06b6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:33.280412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.281224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.283371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.284467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.286520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.287209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.309570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] HTTP exception thrown: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Request method failure captured: Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 HTTP/1.1 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtHN7pG713YvLZVXKxdJY4TH-BQE_dUbtFawRSltSeNd448jP0KNCyeIRm3tbV0SqqchbJFSKxhihrCAeTJmVBAFd1IoyzHrxbpRygA0AX8GKI_OmsBkSV9gCbe-Lut4uRO5-IAT-32ujJYkPX-ZXeJh-lG_6hX2zKOiCHSuDQ7iK4k Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4faf70c703a4417bd7131aef1d7475d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4faf70c703a4417bd7131aef1d7475d"}]}] Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4faf70c703a4417bd7131aef1d7475d Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-971741411 Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 7d7104a95b73405ab66140df742af14f Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-971741411-project Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '708cd7ec-91bd-4329-8a41-74adca7d06b6'} Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.312603 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. Oct 18 16:20:33.316839 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:20:33.324854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] Returning 404 to user: Instance 708cd7ec-91bd-4329-8a41-74adca7d06b6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:33.326033 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ff792b8-9cb8-4ad3-bc02-4b81fd48e408 tempest-ImagesOneServerNegativeTestJSON-971741411 tempest-ImagesOneServerNegativeTestJSON-971741411-project] 10.222.0.78 "GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6" status: 404 len: 111 microversion: 2.1 time: 0.060712 Oct 18 16:20:33.326763 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2326/4668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:33 2022] GET /compute/v2.1/servers/708cd7ec-91bd-4329-8a41-74adca7d06b6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:33.473917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:33.490497 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c7c0c6a-2b55-4bd3-b9a6-dbf8bc65a7f8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.450336 Oct 18 16:20:33.491121 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2343/4669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:33 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:33.521192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.521847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:33.550389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.551068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.551524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.552197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.554808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.558851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.597977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: .version_select at 0x7f5fd11d4430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1984427990", "policies": ["affinity"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:33.637408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:33.648443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:33.776862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:33.788685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:33.888930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1badd41f-c6f3-4689-9b5f-c23dc61e65b7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.556278 Oct 18 16:20:33.908840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2327/4670] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:20:33 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:33.916233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:33.918079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:33.930808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.933380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.934385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:33.935374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:33.936210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:33.937555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:34.239742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.262978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.273983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.275631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.278218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.279780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.287226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c6c243e-9fdf-42db-98c8-431c2f477d4f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1408 microversion: 2.20 time: 0.782856 Oct 18 16:20:34.290208 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1d6374e-7a19-4f34-b6f0-c12d08917ca8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.379663 Oct 18 16:20:34.301022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2344/4671] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:33 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1408 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:34.307095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: .version_select at 0x7f5fd64fe280>, body: {"server_group": {"name": "tempest-server-group-404665143", "policies": ["affinity"]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:34.313779 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2328/4672] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:33 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:34.341229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:34.341853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:34.359245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:34.359992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:34.360551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:34.361281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:34.361737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:34.362163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:34.384504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:34.396423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:34.513766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:34.533709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:34.564790 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d202e83-92be-44c6-8176-0b3ffdf1d07c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.265863 Oct 18 16:20:34.571100 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2345/4673] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:20:34 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:34.582741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:34.589891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:34.601933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:34.603683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:34.604171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:34.606608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:34.607748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:34.611224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:34.785783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.794476 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f7929c06-6c4f-45f5-a10c-375253a8514c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.479497 Oct 18 16:20:34.805745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2329/4674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:34 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:34.828784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: .version_select at 0x7f5fd2475790>, body: {"server_group": {"name": "tempest-server-group-404665143", "policies": ["affinity"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:34.869375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:34.875923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:34.918307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:34.933861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cffbb4e6-2d62-4de6-931e-100e800ea621 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.361327 Oct 18 16:20:34.934871 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2346/4675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:34 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:34.974015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:34.987041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:35.011727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:35.013604 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd430bc2-49b0-46af-891f-b704ed25ba95 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.206679 Oct 18 16:20:35.014347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2330/4676] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:20:34 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:35.027284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f4746bf-7b30-4638-9d05-d4117c4ff8a0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.094936 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f4746bf-7b30-4638-9d05-d4117c4ff8a0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/0971d319-c189-4965-a21f-aa4f6d11dbde" status: 204 len: 0 microversion: 2.1 time: 0.070461 Oct 18 16:20:35.100175 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2347/4677] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:20:35 2022] DELETE /compute/v2.1/os-server-groups/0971d319-c189-4965-a21f-aa4f6d11dbde => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:35.116619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ca0cc43-be70-4ff8-977f-05c462e11cf8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.146694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1d824f3-4b5c-4cde-896e-d757f31f8929 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: .version_select at 0x7f5fd20cf310>, body: {"keypair": {"name": "tempest-keypair-21573099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL++Z26MINYwSLd9ivAwYwfQp6cTctCoQGpGcPkg9gM7hj/q8UDZ4wqoRb6nz6Rpe84XlIRPX7KDRpbQS22io3tmFn3TBqMcaIfWsSIbcg39uN2YZWDSQhdSgdrg1Of+9Q=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:35.164230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ca0cc43-be70-4ff8-977f-05c462e11cf8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.062745 Oct 18 16:20:35.165722 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2348/4678] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:20:35 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:35.240749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c1d824f3-4b5c-4cde-896e-d757f31f8929 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:35.261199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a78e78f-9205-40a6-a048-6473d1419369 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.262205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-c1d824f3-4b5c-4cde-896e-d757f31f8929 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:35.295066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a78e78f-9205-40a6-a048-6473d1419369 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/752f130f-7095-4b43-8f26-2405ac2fc0bb" status: 204 len: 0 microversion: 2.1 time: 0.037971 Oct 18 16:20:35.299236 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2349/4679] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:20:35 2022] DELETE /compute/v2.1/os-server-groups/752f130f-7095-4b43-8f26-2405ac2fc0bb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:20:35.309845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd3b2fe6-517f-42c6-8f1e-7c3214163820 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.318671 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1d824f3-4b5c-4cde-896e-d757f31f8929 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.246227 Oct 18 16:20:35.320228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2331/4680] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:35.344670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.345839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:35.348377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd3b2fe6-517f-42c6-8f1e-7c3214163820 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040015 Oct 18 16:20:35.350355 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2350/4681] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:20:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:35.356414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.357548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:35.369585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.370279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.370477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.371835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:35.371976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.372512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:35.372635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.373057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.373558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.374113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.375200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:35.376039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:35.568025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:35.588267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:35.589920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:35.592839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:35.606724 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2781bbf7-7318-4ae6-9170-331092ea3274 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.254459 Oct 18 16:20:35.613069 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2351/4682] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:35 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:35.613435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: .version_select at 0x7f5fd649ef70>, body: {"server_group": {"name": "tempest-server-group-312470516", "policies": ["affinity"]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:35.661614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:35.675441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:35.787793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:35.813851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:35.876177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f50b47c3-526f-4279-bc03-db98aa9e42a7 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.265816 Oct 18 16:20:35.878149 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2352/4683] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:20:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:35.890472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:35.891087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:35.910006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.910588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.911026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:35.911736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:35.912190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:35.912616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:36.340388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:36.355116 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8e04b3c-e0a9-4f60-a0a1-eb6fd9957c08 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.475088 Oct 18 16:20:36.360421 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2353/4684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:35 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:36.367919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06dce7d1-4b4d-4b7d-a462-29cae41f38e6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:36.428804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:36.446653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:36.454823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:36.460673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bd63a7b-25cc-40c3-9659-de3c39106e2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1600 microversion: 2.20 time: 1.121329 Oct 18 16:20:36.461442 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2332/4685] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:35 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1600 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:36.465103 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06dce7d1-4b4d-4b7d-a462-29cae41f38e6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/b2f84c45-fcf3-40a7-810c-da19eba36827" status: 204 len: 0 microversion: 2.1 time: 0.103224 Oct 18 16:20:36.465694 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2354/4686] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:20:36 2022] DELETE /compute/v2.1/os-server-groups/b2f84c45-fcf3-40a7-810c-da19eba36827 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:36.472776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:36.478476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:36.478608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a128cc8a-3b93-4ef9-a0b4-6faa17e10aeb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:36.491875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:36.494007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:36.494622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:36.498793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:36.499516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:36.500182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:36.535961 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a128cc8a-3b93-4ef9-a0b4-6faa17e10aeb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.064717 Oct 18 16:20:36.537521 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2355/4687] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:20:36 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:36.544178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:36.545862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:36.556483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:36.557551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:36.558255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:36.560840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:36.561631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:36.562569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:36.923318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:36.955084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-18a14e31-abc6-41fa-a2f9-5f394bc1a8a8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.486852 Oct 18 16:20:36.969619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2333/4688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:36 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:36.978437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: .version_select at 0x7f5fd1133ee0>, body: {"server_group": {"name": "tempest-server-group-499380357", "policies": ["anti-affinity"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:37.010104 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c17dd5a-71a6-4aab-8642-a6782f049c03 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.470601 Oct 18 16:20:37.013337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:37.020266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2356/4689] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:20:36 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-interface => generated 285 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:20:37.025283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:37.025909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:37.028402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:37.043815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:37.044317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:37.044763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:37.045495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:37.047939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:37.051060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:37.114787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:37.121856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_groups'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:37.151217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a324d77-777d-488f-8d25-0e266a75e2d0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.191202 Oct 18 16:20:37.152235 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2334/4690] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:20:36 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:37.163926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28d78442-25f5-4ad8-9575-c0f305eaf440 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:37.188959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:37.206626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:37.211862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:37.229636 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e215654-7dff-4bf0-b008-2a6653b6d4c9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.206731 Oct 18 16:20:37.247090 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2357/4691] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:37 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:37.268488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28d78442-25f5-4ad8-9575-c0f305eaf440 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/d0019438-5c30-4459-9dd2-2e5d828ab3e6" status: 204 len: 0 microversion: 2.1 time: 0.108602 Oct 18 16:20:37.272981 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2335/4692] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:20:37 2022] DELETE /compute/v2.1/os-server-groups/d0019438-5c30-4459-9dd2-2e5d828ab3e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:37.277916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d32bf3f-894b-4613-8a76-e275541e5a2b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:37.290434 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d32bf3f-894b-4613-8a76-e275541e5a2b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016310 Oct 18 16:20:37.291590 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2358/4693] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:20:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:37.387296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:37.388848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:37.399496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:37.400732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:37.401365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:37.402321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:37.404052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:37.404704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:37.445670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-422402525", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "3482a710-3943-47ab-8f1e-1abcf14232c5"}]}, "os:scheduler_hints": {"group": "ac8be54f-4a19-43e8-b4da-3a07ffea250b"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:37.521570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] validate_networks() for [('3482a710-3943-47ab-8f1e-1abcf14232c5', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:20:38.311425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:38.330856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21af3253-769f-465b-ab97-fc2454465b92 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.948955 Oct 18 16:20:38.331887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2336/4694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:37 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:38.344660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:38.345582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:38.367646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.368142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.368581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:38.369329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.369780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.370206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:38.616328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:38.616833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:38.617291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:38.617744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:38.618393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:38.659824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.660745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.661363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:38.663621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.665797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.666480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:38.727475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:38.735431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:38.767463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:38.771480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:38.845898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:38.857163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:38.885441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:38.901246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e05e0deb-bbbc-40b8-90be-d538582ad2a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.565383 Oct 18 16:20:38.901869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2337/4695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:38 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:38.916128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:38.924119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:38.924294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Getting quotas for user f24f528b90ed4813a69cd8e5bdda5d36 and project fd1f47477049427ab12ec7adb829c5f5. Resources: {'server_group_members'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:38.925177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:38.932093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.932867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.934556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:38.935726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:38.938222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:38.947777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:39.011250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe1eacc8-3586-465b-ac2d-1e1d4f8c1423 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.570239 Oct 18 16:20:39.012146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2359/4696] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:20:39.052332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036186979", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4fdb82c-83da-439d-8df3-8e5dbfce3308"}], "security_groups": [{"name": "tempest-securitygroup--1925981616"}], "key_name": "tempest-keypair-21573099", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:39.112584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:39.126210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:39.127671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:39.146245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-556c36c5-6bf9-4632-a11b-95a41789f650 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.231693 Oct 18 16:20:39.146846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2338/4697] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:38 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:39.159172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-194ce065-6319-4e68-9a8c-3ae40ca636eb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:39.162039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-194ce065-6319-4e68-9a8c-3ae40ca636eb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:39.352930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-194ce065-6319-4e68-9a8c-3ae40ca636eb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:39.367679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-194ce065-6319-4e68-9a8c-3ae40ca636eb tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1212 microversion: 2.1 time: 0.213921 Oct 18 16:20:39.371233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2339/4698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:39 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1212 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:39.384740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:39.385623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:39.405164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:39.407304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:39.408250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:39.415619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:39.416724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:39.418562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:39.517832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] validate_networks() for [('a4fdb82c-83da-439d-8df3-8e5dbfce3308', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:20:40.051299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:40.068419 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a2c45cf-1d0e-4ec6-86fa-297c5530ca56 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.695881 Oct 18 16:20:40.071333 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2340/4699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:39 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:40.087123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:40.089439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:40.112369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.115464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.117970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.120783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.122638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.123731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.463069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:40.478106 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff4be7c7-dc6e-460a-9ea5-8082d5fc6572 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.404576 Oct 18 16:20:40.478720 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2341/4700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:40 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:40.509737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:40.510351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:40.531922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.532661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.533308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.534226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.536361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.537292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.687202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:40.701564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:40.706978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:40.721863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b421259-6dbd-4be9-a6ca-fb79b413a5a8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.224893 Oct 18 16:20:40.723303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2342/4701] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:40 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:40.736658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889", "name": "network-vif-plugged", "status": "completed", "tag": "37f28306-ed5e-4083-a6f6-0f27ccd62159"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:40.775711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.775711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.778607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.797731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] Creating event network-vif-plugged:37f28306-ed5e-4083-a6f6-0f27ccd62159 for instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 on n-h1-858383-14 Oct 18 16:20:40.805437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-57653520-eca0-40d8-81dd-16f2eb2f528f req-783e2e01-fbca-4c2e-b8de-f98c8b001fb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078028 Oct 18 16:20:40.807214 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2343/4702] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:40.814927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:40.815770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:40.832233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.832840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.833610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:40.835277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:40.835997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:40.836940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.016437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:41.027691 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a50d8508-d65f-4d88-9d1c-9335c000eb5c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1264 microversion: 2.1 time: 0.218816 Oct 18 16:20:41.028339 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2344/4703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:40 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:41.049829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:41.072894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:41.073411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:41.073841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.122437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] Creating event network-changed:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:20:41.136128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-14de274b-a501-446f-8706-fe4a7b7150a0 req-84e3e2da-a6c6-4c7e-897d-812361fb8300 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101215 Oct 18 16:20:41.138993 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2345/4704] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:41.154919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:41.156631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:41.165401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:41.165936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:41.166385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.169479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:41.169966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:41.170406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.174260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:20:41.175441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:20:41.176593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:20:41.177336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:20:41.177994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:20:41.190003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:41.191355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:41.192201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.193265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:41.194004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:41.194655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:41.261648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:41.269511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:41.285386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:41.334746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:20:41.341424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:20:41.435352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a472d48f-cee5-431c-9d8c-e662905e1d04 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.422309 Oct 18 16:20:41.440888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2360/4705] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:20:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:20:41.453415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9f5eca8-8933-47ff-9112-783e0f21cdc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:41.454188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b9f5eca8-8933-47ff-9112-783e0f21cdc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:41.986697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:41.996285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88bdc87d-f592-454e-aa8a-3d4ef991d96e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.855982 Oct 18 16:20:41.999406 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2346/4706] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:41 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:42.010176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:42.011068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:42.018272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.019141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.019833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.020812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.021526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.022184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.146711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9f5eca8-8933-47ff-9112-783e0f21cdc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.162186 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b9f5eca8-8933-47ff-9112-783e0f21cdc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1240 microversion: 2.1 time: 0.713352 Oct 18 16:20:42.163918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2361/4707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:41 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1240 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:42.200987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:42.207160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:42.248107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.251290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.251787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.256626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.260721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.261690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.332530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.343808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c65e0c5-a21a-4581-927a-88081e916bb3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.340272 Oct 18 16:20:42.346267 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2347/4708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:41 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:42.351207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:42.357216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:42.376591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.377509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.377954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.378949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:42.379420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:42.379855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:42.510014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.513941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:42.525857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a12628c3-da09-48b6-b00a-940171c5caf3 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1270 microversion: 2.1 time: 0.178215 Oct 18 16:20:42.526680 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2348/4709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:42 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:42.547020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.572887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.575418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:42.589652 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15e31bbf-3f23-4b2b-8aad-cad85389c168 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.407889 Oct 18 16:20:42.601844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2362/4710] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:42 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:43.034686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:43.035756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:43.054470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.056280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.058505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.059632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.062374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.063457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.190189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:43.191739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:43.205205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.205831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.206610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.207588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.208979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.209883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.336397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:43.349603 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ad03a36-b4cd-4149-b08c-450bf405f2ec tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1292 microversion: 2.1 time: 0.166096 Oct 18 16:20:43.350210 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2363/4711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:43 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1292 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:43.377423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:43.378059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:43.392813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.393848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.394609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.395513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.396124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.396703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.422554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:43.433124 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e6c1c8c-1067-4fc9-88e4-a9231b99980c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.410163 Oct 18 16:20:43.433718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2349/4712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:43 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:43.560577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:43.561394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:43.573827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.575707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.576380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:43.577377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:43.578054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:43.578785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.141014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.159047 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-582bfba1-5f91-4ef7-8177-e4d24a5c2882 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.601286 Oct 18 16:20:44.177892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2350/4713] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:43 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:44.198498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:44.201962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:44.215336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.215826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.216263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.216966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.217516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.218043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.350304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.354081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:44.398696 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d80c7520-e1ca-41ec-a6bd-0e65c237d1ce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1491 microversion: 2.1 time: 1.022955 Oct 18 16:20:44.403082 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2364/4714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:43 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1491 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:44.414939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:44.415575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:44.439788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.440960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.441796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.442847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.443626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.444377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.610114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.623352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb3506a1-6312-4882-987a-1b17b4638994 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1298 microversion: 2.1 time: 0.216975 Oct 18 16:20:44.629697 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2365/4715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:44 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1298 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:44.634790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1155573833"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:44.641393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:44.659435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.665954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.666584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.677944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.678533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.679056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.786342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.797115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.801960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:44.809181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1fe6b11f-f6d1-442b-bea8-70350bd93470 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.624264 Oct 18 16:20:44.811601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2351/4716] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:44 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:44.818994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:44.820311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:44.829688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.830543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.831206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.832261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.833246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.835194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.843352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-281c2544-52ab-4365-8ea9-11ff2a1dba13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "PUT /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1076 microversion: 2.1 time: 0.212255 Oct 18 16:20:44.844359 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2366/4717] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:20:44 2022] PUT /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1076 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:44.868091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:44.870071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:44.889268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.892547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.893249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:44.897385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:44.898498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:44.899113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.123170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:45.138351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d49bb2fe-adfd-4bde-8b7d-e4ef5e5f4d40 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.323516 Oct 18 16:20:45.140908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2352/4718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:44 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:45.192284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:45.194357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:45.206921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.207708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.208805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.209714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.210346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.210947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.269987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:45.283069 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f828ced1-3964-4528-803d-d8b0535dd186 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1502 microversion: 2.1 time: 0.419969 Oct 18 16:20:45.284276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2367/4719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:44 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1502 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:45.308782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:45.309777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:45.319881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.320740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.321400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.322713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.323592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.324383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.583907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:45.596704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a7e9ba2-3c5c-4e4a-955f-c1b007ee2b76 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.412638 Oct 18 16:20:45.597738 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2353/4720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:45 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:45.659049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:45.659677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:45.669851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.681104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.681867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.686026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.686933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.687648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.907811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:45.918271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90e8efc8-4442-43ba-b0c4-80eea43b01fb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1502 microversion: 2.1 time: 0.614292 Oct 18 16:20:45.933555 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2368/4721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:45 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1502 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:45.942452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:45.943345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:45.951650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.953160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.953975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:45.955597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:45.956244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:45.956861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.067175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.080175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.082089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.088529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-174bdbc4-3a7d-4efd-9321-fc13380a61d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.153557 Oct 18 16:20:46.089468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2369/4722] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:45 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:46.097770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:46.106041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.106816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.107481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.133901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Going to try to stop instance {{(pid=120570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:20:46.141909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.150652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5370bd95-277b-4b8a-a9f1-2865d6a5f886 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.496970 Oct 18 16:20:46.151846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2354/4723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:45 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:46.164175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:46.165178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:46.171938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:46.174452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.175302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.175822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.176608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.177343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.178004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.202857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1bb551cd-de67-4a21-9920-cec3e84bf392 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "POST /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889/action" status: 202 len: 0 microversion: 2.1 time: 0.111360 Oct 18 16:20:46.204186 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2370/4724] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:20:46 2022] POST /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:46.228852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:46.229599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:46.238333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.241766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.241766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.241766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.241766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.241766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.482908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.499573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7dbb3b22-a4df-4a66-ab9a-9ee4ea9e3970 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1733 microversion: 2.1 time: 0.339724 Oct 18 16:20:46.501335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2355/4725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:46 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1733 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:46.520477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6594fcb-246f-48d9-9870-05d49189e002", "tag": "cb1d804a-9eff-476b-9be5-75a1dd0c8dde"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:46.531126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.531839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.532539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.546711 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] Creating event network-changed:cb1d804a-9eff-476b-9be5-75a1dd0c8dde for instance a6594fcb-246f-48d9-9870-05d49189e002 on n-h2-858383-14 Oct 18 16:20:46.552608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-91c40d57-1681-434b-9129-32e5a4c5ac18 req-75e0f6ea-6b05-483d-adf5-e4bd67400739 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049888 Oct 18 16:20:46.553508 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2356/4726] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:46.624693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:46.625801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:46.634758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.635505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.636146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.637046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:46.637805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:46.638406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:46.790911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:46.814377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-221c611b-0425-43bc-8c19-2cffc95371f6 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.588408 Oct 18 16:20:46.831690 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2371/4727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:46 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:47.121259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:47.121966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:47.134493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.134996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.135434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.136311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.136774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.138415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.272623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.286190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.288337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.294912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94e99467-af07-43ed-8706-f22aa6bf2f78 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.180882 Oct 18 16:20:47.314114 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2372/4728] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:47 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:47.321608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:47.326657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:47.339234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.341781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.342290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.342801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.344014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.344198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.345380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.348285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-268aabad-4312-4416-a216-72e88eead3c1 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.728458 Oct 18 16:20:47.348880 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2357/4729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:46 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:47.525639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:47.526415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:47.537269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.537677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.539640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.540375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.540834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.541284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.673752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.693479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7383cf2d-8680-4f11-996e-fe8a65c70fbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.379470 Oct 18 16:20:47.694064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2373/4730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:47 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:47.706843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a91d7db-776b-4e39-8ce9-ab78b91a89bd", "tag": "bd19bdb7-4041-42fb-907b-550c06966f0e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:47.736712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.740515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.745108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.767755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] Creating event network-changed:bd19bdb7-4041-42fb-907b-550c06966f0e for instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd on n-h1-858383-14 Oct 18 16:20:47.776058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-79e466f2-e19b-48d6-a2a0-f290975a4ce5 req-761b75ee-e494-43c7-a0f9-ba4d97f94bad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073040 Oct 18 16:20:47.777733 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2374/4731] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:47.830979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:47.839460 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56db75f5-4dc4-4f3b-8fd1-cbfd30c3e229 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1713 microversion: 2.1 time: 0.319270 Oct 18 16:20:47.854022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2358/4732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:47 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1713 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:47.871438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:47.872947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:47.879998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.880640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.881243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:47.882102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:47.882687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:47.883252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.024243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfb97290-7136-4b0e-9af0-4596fb0c81a2 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd64b85e0>, body: {"keypair": {"name": "tempest-keypair-200207228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQcBaK3u9Y2pEHQsGC4SB7RoknflVUVu/h+L7sltYJ/AMuuI3p+Fe3YaCNoj0zQh87Vjk/zSKdZ64rmxrpYgAYD2ijbIKUbBVvOt9AZfeUyd0OdGUMARHUt4ieZyOOpcA=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.041699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cfb97290-7136-4b0e-9af0-4596fb0c81a2 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.047427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cfb97290-7136-4b0e-9af0-4596fb0c81a2 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:48.075901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfb97290-7136-4b0e-9af0-4596fb0c81a2 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240095 Oct 18 16:20:48.076846 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2375/4733] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:20:48.084314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.085250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.091580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.092608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.093915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.094373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.095281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.095752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.096186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.101981 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe9782de-32fc-48c8-8caa-c1e97e988f19 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.246552 Oct 18 16:20:48.118043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2359/4734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:47 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:48.125709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5f724e3-b033-41f3-9ddc-142818a58bc1 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd182a4c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.135449 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5f724e3-b033-41f3-9ddc-142818a58bc1 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-200207228" status: 200 len: 497 microversion: 2.1 time: 0.016008 Oct 18 16:20:48.142951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2360/4735] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:20:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-200207228 => generated 497 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:48.149013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6eb6ba9b-d0b9-4841-81d2-1480f061de8b tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd1133a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.172165 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6eb6ba9b-d0b9-4841-81d2-1480f061de8b tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200207228" status: 202 len: 0 microversion: 2.1 time: 0.027845 Oct 18 16:20:48.177819 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2361/4736] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200207228 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:48.189909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a678246-94dd-462a-9d17-6bff6137222c tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd1139f70>, body: {"keypair": {"name": "tempest-keypair-233247081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwVI5rxCC3P+oM4NHthZ8mv3vEJcQMTJsbq65xkDvv7cORZhsjWW5NX5GaEzkX/83+aDAxeeGKEQt0louBeY1sHU51WvghZyS9i0FSlSC9KWORX97kkFE9mIKevXwiJoQ=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.207919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a678246-94dd-462a-9d17-6bff6137222c tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.212727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Cannot 'detach_volume' instance c7b81207-45cd-44fb-abb4-b7faeb7002ad while it is in vm_state rescued Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments/cb18bf31-45b9-4ba2-b83d-aafe23246949 HTTP/1.1 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'detach_volume' instance c7b81207-45cd-44fb-abb4-b7faeb7002ad while it is in vm_state rescued Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': 'c7b81207-45cd-44fb-abb4-b7faeb7002ad', 'id': 'cb18bf31-45b9-4ba2-b83d-aafe23246949'} Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c7b81207-45cd-44fb-abb4-b7faeb7002ad while it is in vm_state rescued Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:48.215023 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c7b81207-45cd-44fb-abb4-b7faeb7002ad while it is in vm_state rescued Oct 18 16:20:48.218879 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:20:48.219714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8a678246-94dd-462a-9d17-6bff6137222c tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:48.222525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 409 to user: Cannot 'detach_volume' instance c7b81207-45cd-44fb-abb4-b7faeb7002ad while it is in vm_state rescued {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:20:48.223468 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e2aa0b9-b9c2-4057-b9a7-692448a57cd2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments/cb18bf31-45b9-4ba2-b83d-aafe23246949" status: 409 len: 152 microversion: 2.1 time: 0.144482 Oct 18 16:20:48.224045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2376/4737] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:20:48 2022] DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments/cb18bf31-45b9-4ba2-b83d-aafe23246949 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:20:48.238607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.239814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.247408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.248116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.248796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.250446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.251332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.252025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.257668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a678246-94dd-462a-9d17-6bff6137222c tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074914 Oct 18 16:20:48.260543 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2362/4738] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:48.271622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d259dc8-75bb-4103-929d-15fb303c9b41 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd10ec0d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.310812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d259dc8-75bb-4103-929d-15fb303c9b41 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233247081" status: 202 len: 0 microversion: 2.1 time: 0.045436 Oct 18 16:20:48.314288 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2363/4739] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233247081 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:20:48.328614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.329702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.337161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.338140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.338995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.339941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.340626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.341487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.347438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddd514ed-3244-4c9e-9cf1-7f95dee865f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/action" status: 202 len: 0 microversion: 2.1 time: 0.114003 Oct 18 16:20:48.353145 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2377/4740] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:48.360049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9e79847-241c-48da-be4b-11caebf7daea tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd18261f0>, body: {"keypair": {"name": "tempest-keypair-67403208", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.376011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e9e79847-241c-48da-be4b-11caebf7daea tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.386063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e9e79847-241c-48da-be4b-11caebf7daea tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:48.420174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9e79847-241c-48da-be4b-11caebf7daea tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.065201 Oct 18 16:20:48.420960 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2378/4741] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:48.430727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.431826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.440618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.442272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.442867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.443771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.445439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.445906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.449946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.458927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.460629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.468543 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d442152-3b22-4510-b2b9-66ee294b6bc4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.147127 Oct 18 16:20:48.470502 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2364/4742] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:48 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:48.479348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.480985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.511227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.512497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.513534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.515444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.516629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.517629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.685436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.696045 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20490751-89e0-41e4-ba1a-e6276e1f10b1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1721 microversion: 2.1 time: 0.273736 Oct 18 16:20:48.709660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2379/4743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:48 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:48.715532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20d8ec15-9f06-4727-b735-89978082bbc6 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd6384c10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.740177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20d8ec15-9f06-4727-b735-89978082bbc6 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67403208" status: 202 len: 0 microversion: 2.1 time: 0.029295 Oct 18 16:20:48.741490 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2380/4744] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67403208 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:48.746210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:48.746885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:48.754288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.754761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.755201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.756091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:48.756808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:48.757332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:48.759167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.770007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63f94de1-8690-4418-a3be-0ee5d5abc22e tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.295005 Oct 18 16:20:48.770007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2365/4745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:48 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:48.790159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-711a7477-0264-429c-b6ba-00377f903ecf tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd149a700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1951925061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArly9lKTDlZAw5rGfaDCzcZc+32JOWBX0vS3XAD3VBsN1Adt26P1d+ZyZ+SCVFE4powx7ACxlohjZTO0MQ7BNanYwPv2hr2hsP9UlZymAKOYwzs/wGLP4miWvG0OjsW/Q=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.812769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-711a7477-0264-429c-b6ba-00377f903ecf tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.818260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-711a7477-0264-429c-b6ba-00377f903ecf tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:48.849730 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-711a7477-0264-429c-b6ba-00377f903ecf tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063627 Oct 18 16:20:48.854864 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2366/4746] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:48.870661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80b460e7-ae82-4bcc-b7eb-75f1a2f14f52 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd1139d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1372181103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwN/IIBpPOq63RlBqlKyLaSAJuOWfFx9RbjE/hBMCG4iLxhpGw1/GY8lPNj/CZCjJ6tg8FljX69MQLkzULvOeD142umQ9DdisIJUZH33KC/WV1tctrXU2Gz/wznVie1ug=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.894536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-80b460e7-ae82-4bcc-b7eb-75f1a2f14f52 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.901662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-80b460e7-ae82-4bcc-b7eb-75f1a2f14f52 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:48.938854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80b460e7-ae82-4bcc-b7eb-75f1a2f14f52 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.074541 Oct 18 16:20:48.939460 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2367/4747] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:48.952678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:48.956705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9899007-8b68-4658-9ccd-02f0b084b53a tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Action: 'create', calling method: .version_select at 0x7f5fd1133ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-378738013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH/1ehl8fjLH7/KRYwo0+TxdXk22Q4fkNglc36w1o6zlIKLRwd8G7WFexbbt16CUfsFWFgYeqehqbOvTDJcAYdSivFhLQzyIp7fHd21wWA5URIM4+NSYmB7ft3L3TQIEw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:48.960730 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0bf68e86-5d44-4bcd-b183-577c18c4520d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.218218 Oct 18 16:20:48.961524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2381/4748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:48 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:48.975136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e9899007-8b68-4658-9ccd-02f0b084b53a tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:20:48.981681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e9899007-8b68-4658-9ccd-02f0b084b53a tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Getting quotas for user c41c3cfa66994ed2bf5e027e11a203f1 and project 1527ac1dc1c546d1ae7875738a9adc25. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:20:49.006685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9899007-8b68-4658-9ccd-02f0b084b53a tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058255 Oct 18 16:20:49.007301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2368/4749] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:20:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:49.017860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61f16439-35da-4569-8de3-d87203492e17 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd6499f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.021951 n-d-858383-14 devstack@n-api.service[120570]: WARNING oslo_db.sqlalchemy.utils [None req-61f16439-35da-4569-8de3-d87203492e17 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:20:49.027482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61f16439-35da-4569-8de3-d87203492e17 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.013700 Oct 18 16:20:49.028034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2382/4750] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:20:49 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:49.039563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-955914c4-c794-4bda-8640-d38b3b66c075 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd20cf310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.061548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-955914c4-c794-4bda-8640-d38b3b66c075 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-378738013" status: 202 len: 0 microversion: 2.1 time: 0.025793 Oct 18 16:20:49.062124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2369/4751] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-378738013 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:49.071379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d63e9023-0259-4f2a-a340-2e15fb259d48 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd64080d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.093766 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d63e9023-0259-4f2a-a340-2e15fb259d48 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1372181103" status: 202 len: 0 microversion: 2.1 time: 0.026035 Oct 18 16:20:49.094367 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2383/4752] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1372181103 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:49.102792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be78a401-3556-4a83-8b18-0bee20dda058 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] Calling method '.version_select at 0x7f5fd10ed310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.125583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be78a401-3556-4a83-8b18-0bee20dda058 tempest-KeyPairsV2TestJSON-939784082 tempest-KeyPairsV2TestJSON-939784082-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1951925061" status: 202 len: 0 microversion: 2.1 time: 0.026329 Oct 18 16:20:49.126326 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2370/4753] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1951925061 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:20:49.133968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.134663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:49.142392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.143000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.143524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.144306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.144847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.145381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.166793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:49.297448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:49.309601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2581b556-46a1-4a19-a463-2479f8d087db tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.184414 Oct 18 16:20:49.310184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2384/4754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:49 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:49.528392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.529254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:49.535481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.536022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.536640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.537378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.538010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.538608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.610770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:49.619667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:49.621169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:49.627245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98016cf9-94ae-496b-8fe0-83c1800ae81c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.103276 Oct 18 16:20:49.647822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2371/4755] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:49 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:49.728182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.728962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:49.737258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.737923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.738377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.739238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.739703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.740130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.792931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:49.793616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:49.801475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.801663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.802095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:49.802887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:49.804203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:49.804314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.087546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.096978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b21cbe18-88dc-4aec-ba24-6fe268220bff tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1721 microversion: 2.1 time: 0.373046 Oct 18 16:20:50.100260 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2385/4756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:49 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:50.117413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:50.118439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:50.128266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.130836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.131307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.132040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.132508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.132939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.149986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.161155 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed941fe1-47c6-4331-abb8-a155a65873f8 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.371936 Oct 18 16:20:50.165942 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2372/4757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:49 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:50.335968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:50.336588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:50.349537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.353341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.353796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.354536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.354993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.355407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.624683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.642001 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1e4aa2e0-e53e-4d46-903c-c2c6b2e17a36 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.310002 Oct 18 16:20:50.644301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2373/4758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:50 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:50.667516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:50.668845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:50.680124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.687224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.689153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.693513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a7c7560-f6c2-4ec9-b90a-557f1033f364 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.587830 Oct 18 16:20:50.705495 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2386/4759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:50 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:50.708569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.709842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:50.710328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:50.713227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:50.810311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.846020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.848370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:50.856321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-325be095-2732-42c6-a21a-2c209a1cf50d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.192983 Oct 18 16:20:50.857431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2374/4760] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:50 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:51.128938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:51.129591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:51.141733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.147142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.153723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.154842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.155635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.156174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.189405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:51.192966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:51.215455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.216315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.227573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:51.231925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.232870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.233537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.234228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.241088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:51.367552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:51.378335 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96991c3b-759f-4dab-b2a8-de71d0758560 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1721 microversion: 2.1 time: 0.256029 Oct 18 16:20:51.378920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2387/4761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:51 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:51.535293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:51.590537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df8456a2-c4c1-4883-978c-b9800159c2c0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.403038 Oct 18 16:20:51.591878 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2375/4762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:51 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:51.674839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:51.674839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:51.689590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.690824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.691471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.692498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.693729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.694318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.720546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:51.721248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:51.732327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.734570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.738222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.741819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.743520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.744030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.955168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:51.960053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:51.964490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78b8bf43-9a92-4f7d-b920-7c0127747334 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.250506 Oct 18 16:20:51.966470 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2376/4763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:51 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:51.972791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:51.973566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:51.983171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.984406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.985278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:51.985868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d43d9a95-9878-4fb8-a3ba-89f1de8e8490 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.318909 Oct 18 16:20:51.986685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:51.987516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2388/4764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:51 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:51.987627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:51.988578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.146633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:52.157264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:52.159306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:52.162725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:52.166135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec56820c-eba5-4788-b1f0-f59e6bad0036 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.198497 Oct 18 16:20:52.182969 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2377/4765] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:51 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:52.404659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:52.405726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:52.414216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6594fcb-246f-48d9-9870-05d49189e002", "name": "network-vif-plugged", "status": "completed", "tag": "cb1d804a-9eff-476b-9be5-75a1dd0c8dde"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:52.416064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:52.416818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:52.417496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.418411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:52.419068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:52.419701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.431806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:52.432290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:52.432752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.468050 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] Creating event network-vif-plugged:cb1d804a-9eff-476b-9be5-75a1dd0c8dde for instance a6594fcb-246f-48d9-9870-05d49189e002 on n-h2-858383-14 Oct 18 16:20:52.482494 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d21990ae-d699-458f-88c0-0b60d664edd7 req-e92e2288-eb7d-4d1e-a3a4-f24406afe5ca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072188 Oct 18 16:20:52.484211 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2378/4766] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:52.619623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:52.621330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:52.633214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:52.633709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:52.634150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.634919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:52.635370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:52.636082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:52.784075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:52.808319 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a52d72b-8ef7-4dec-a6d6-cc5615085c88 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1721 microversion: 2.1 time: 0.409176 Oct 18 16:20:52.829434 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2389/4767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:52 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1721 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:52.884155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:52.894766 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52047fc6-c3bc-49c0-9827-d81999e2d402 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.281792 Oct 18 16:20:52.895845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2379/4768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:52 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:52.993301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:52.994074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:52.997261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:53.012112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.012633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.013400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.016104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:53.016775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:53.021801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.022644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.024865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.034752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.035368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.035812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.036527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.036982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.037474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.206726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:53.218369 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3a37f7a8-378c-452a-bfe2-ed5b6d3159a5 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.206567 Oct 18 16:20:53.219396 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2380/4769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:53 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:53.251286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:53.252205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:53.273700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.275806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.276330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.278789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.282056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.282799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.355400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:53.373429 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff79f332-eab2-4c0b-9071-22a109723a48 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.384596 Oct 18 16:20:53.377608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2390/4770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:52 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:53.412411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:53.426541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:53.432802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:53.445636 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-743e2996-ba87-4fa6-94c8-3520e4d37148 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.225077 Oct 18 16:20:53.446956 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2381/4771] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:53 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:53.836775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:53.838081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:53.849031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.852227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.852900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.857058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.857858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.859730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.926254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:53.927670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:53.964825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.969026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.971857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:53.974159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:53.980490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:53.981305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.300937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.322002 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6b856d3-aa7a-44f3-a33a-6e14e587e983 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1721 microversion: 2.1 time: 0.482797 Oct 18 16:20:54.322449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.322994 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2391/4772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:53 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:54.328703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:54.329088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:54.345187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d3f9686-b84e-495e-9f4a-bf319368be3c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1312 microversion: 2.1 time: 0.430535 Oct 18 16:20:54.347748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.348982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.349609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.353095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.355837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.356427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.357626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2382/4773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:53 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:54.402781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:54.403664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:54.416388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.417214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.417854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.424310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.425216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.425735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.728556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.738729 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-44847883-7dc9-4e9b-b8d5-97e955c25f0a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.339772 Oct 18 16:20:54.741060 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2383/4774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:54 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:54.756611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:54.757349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.761439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:54.771456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.776494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a229792-39ab-4c73-9504-80a71c46403a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.452447 Oct 18 16:20:54.777117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2392/4775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:54 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:54.778609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.780898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.784443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.785620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.786172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.791035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a91d7db-776b-4e39-8ce9-ab78b91a89bd", "name": "network-vif-plugged", "status": "completed", "tag": "bd19bdb7-4041-42fb-907b-550c06966f0e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:20:54.817570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:54.818778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:54.821597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:54.855472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] Creating event network-vif-plugged:bd19bdb7-4041-42fb-907b-550c06966f0e for instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd on n-h1-858383-14 Oct 18 16:20:54.867325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f55c02bb-c2ae-4d47-ad62-9df4ba481cb1 req-9232528b-2f47-4812-8b61-20e6afadb427 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084882 Oct 18 16:20:54.868460 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2393/4776] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:54.948954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.961678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.970962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:54.979918 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0fd7241e-764f-4628-9f37-03953791108d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.239255 Oct 18 16:20:54.983703 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2384/4777] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:54 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:55.363787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:55.367423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:55.371662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:55.372332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:55.379772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.380263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.380701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.383513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.384005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.387723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.393697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.394672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.395299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.397439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.402025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.403282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.649369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:55.661118 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01f96887-e43a-4377-aab2-51823739f6c6 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1497 microversion: 2.1 time: 0.292317 Oct 18 16:20:55.662323 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2385/4778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:55 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1497 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:55.689909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:55.718159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_groups [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Querying cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) for 1 instances {{(pid=120571) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 16:20:55.718899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.719383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.719822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.760911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-464b06ff-4e1c-4fc6-83a3-10bd1e1077f0 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b" status: 200 len: 222 microversion: 2.1 time: 0.076319 Oct 18 16:20:55.777397 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2386/4779] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:20:55 2022] GET /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b => generated 222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:55.782555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:55.783177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:55.800055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.800551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.801017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:55.801767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:55.802228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:55.802661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.057269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.068428 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-36e722db-808e-4e5b-8538-3b8557f5e915 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1366 microversion: 2.1 time: 0.289805 Oct 18 16:20:56.069217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2387/4780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:55 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:56.091939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:56.093306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:56.103580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.104469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.105182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.107615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.108549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.109268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.189638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:20:56.231519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.250095 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c01c32a-2f10-442e-a391-cff792fd21b9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1727 microversion: 2.1 time: 0.901114 Oct 18 16:20:56.250733 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2394/4781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:55 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1727 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:56.281666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:56.283993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:56.305449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.306304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.306946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.307867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.308526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.309285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.411927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a1e34c8-7089-489b-8812-e71f557b5d52 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 204 len: 0 microversion: 2.1 time: 0.326926 Oct 18 16:20:56.415805 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2388/4782] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:20:56 2022] DELETE /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:20:56.442773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:56.443802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:56.452832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.453696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.454608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.455598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.465680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.466496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.611316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.632570 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4caed53-959a-4574-b154-3f4c92be303c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.377303 Oct 18 16:20:56.633504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2395/4783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:56 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:56.638871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:56.639813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:56.650879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.657390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.658307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.658977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.661999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.664533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.665420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.666160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.668296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:56.683139 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-005b926e-ae4d-4355-942c-73c7edd3a35a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.265761 Oct 18 16:20:56.685866 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2389/4784] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:56 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:56.696226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:56.696860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:56.735813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.736325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.736775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:56.737539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:56.737986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:56.738416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.018660 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-823a9ff9-baba-4401-9036-567e5f17b34b tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.383623 Oct 18 16:20:57.019311 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2396/4785] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:20:56 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-interface => generated 284 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:57.096843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:57.097760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:57.138840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.149300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.149943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.150744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.151588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.152034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.366924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:57.383549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28cbb099-fc3c-4f02-9bb4-7b9e0aa35c9a tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1503 microversion: 2.1 time: 0.695739 Oct 18 16:20:57.384178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:57.384691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2390/4786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:56 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:57.410093 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-45ef8e22-13fc-4984-9727-1edbea11943f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1557 microversion: 2.1 time: 0.304989 Oct 18 16:20:57.411477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2397/4787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:57 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1557 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:20:57.444934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:57.447774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:57.466438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.467390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.468818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.470603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.471517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.472162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.479995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:57.661786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:57.662602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:57.672809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.685726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.687311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.688233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.688884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.689498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.699638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c898f75-726d-44f9-afbc-746f733ec05d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261559 Oct 18 16:20:57.700600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2391/4788] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:20:57 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-interface => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:20:57.746669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:57.760518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:57.786455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.786951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.787389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:57.804715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:57.807218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:57.807736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:58.060395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:58.100509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:58.111039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:58.127467 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d19b06a8-582e-4888-a370-42b79a9e6948 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.392577 Oct 18 16:20:58.145058 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2392/4789] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:57 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:20:58.236626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:58.245029 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdb63988-86d4-4bf8-a160-6b14e0086adf tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.587065 Oct 18 16:20:58.250279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2398/4790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:57 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:20:58.409828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:58.410682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:58.423803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:58.424384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:58.424926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:58.439899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:58.440387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:58.440828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:58.990875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=46 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:59.177118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:59.178375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:59.180663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=46 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:59.197350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:59.198161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:59.198803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:59.203960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:59.204679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:59.205356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:59.517305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:59.527878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:59.535089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:59.577485 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14d6df80-4ee0-4597-822d-abb718fd7a5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.403433 Oct 18 16:20:59.580920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2399/4791] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:20:59 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:20:59.606120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:20:59.612176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:20:59.641593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:59.646316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:59.647032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:59.648008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:20:59.648693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:20:59.652302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:20:59.856526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:20:59.870079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eccc8aac-ce88-4ea9-a174-f846abac2258 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1503 microversion: 2.1 time: 1.466166 Oct 18 16:20:59.877493 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2393/4792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:58 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1503 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:00.230416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:00.251177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b59d521b-2d6a-4df3-a151-6f2a37d98469 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.667689 Oct 18 16:21:00.252281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2400/4793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:20:59 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:00.616489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:00.617876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:00.629120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:00.634258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:00.636522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:00.638200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:00.639480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:00.641125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:00.835089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:00.854499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:00.856288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:00.862564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9edd4c18-82d7-4c1e-b707-84da842f868e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.250973 Oct 18 16:21:00.869394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2394/4794] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:00 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:00.895672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:00.896902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:00.907899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:00.908765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:00.912537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:00.913898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:00.914287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a91d7db-776b-4e39-8ce9-ab78b91a89bd", "tag": "bd19bdb7-4041-42fb-907b-550c06966f0e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:00.914904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:00.915721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:00.945254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:00.945735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:00.948885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:00.979602 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] Creating event network-changed:bd19bdb7-4041-42fb-907b-550c06966f0e for instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd on n-h1-858383-14 Oct 18 16:21:00.994734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-46d01901-8c22-45fc-86b0-6243542c2225 req-e0b3bcb4-f347-4892-8e9c-82efb4323167 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134490 Oct 18 16:21:00.999162 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2401/4795] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:01.287917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:01.288628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:01.298270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:01.299043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:01.300396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:01.301462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:01.302169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:01.302788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:01.726860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:01.731931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:01.752650 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3ddb4db-5a87-4585-a5ca-b657e9f5ee39 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.474659 Oct 18 16:21:01.761262 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2402/4796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:01 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:01.841151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:01.867081 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cddf378e-c5b2-4375-a1fd-e4cf184e411c tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1503 microversion: 2.1 time: 0.975635 Oct 18 16:21:01.885178 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2395/4797] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:00 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1503 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:01.927918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:01.928554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:01.962233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:01.962739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:01.963184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:01.963896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:01.964359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:01.964793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:02.338452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:02.364975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:02.366784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:02.391532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7343836-2483-41ee-8dd9-47787f2fc406 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.467378 Oct 18 16:21:02.409033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2403/4798] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:01 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:02.499232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6594fcb-246f-48d9-9870-05d49189e002", "name": "network-vif-deleted", "tag": "cb1d804a-9eff-476b-9be5-75a1dd0c8dde"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:02.548037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:02.549999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:02.550723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:02.583396 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] Creating event network-vif-deleted:cb1d804a-9eff-476b-9be5-75a1dd0c8dde for instance a6594fcb-246f-48d9-9870-05d49189e002 on n-h2-858383-14 Oct 18 16:21:02.608679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-25d86c04-e806-4c52-9b41-1fdfa54f159e req-00e60935-fc59-4db6-b3d2-d8e4b359d37f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119715 Oct 18 16:21:02.613249 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2396/4799] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:02.799177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:02.812706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:02.836811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:02.838999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:02.840318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:02.845556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:02.847888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:02.848661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:02.897765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:02.898480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:02.920821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:02.934141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:02.934905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:02.956310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:02.958863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:02.959421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:03.042551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:03.045120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:03.045729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:03.046293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lazy-loading 'fault' on Instance uuid a6594fcb-246f-48d9-9870-05d49189e002 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:03.302148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:03.325914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cbf0a905-6c8b-47e7-bacb-c9abcc7e49a2 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.538607 Oct 18 16:21:03.328073 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2404/4800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:02 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:03.425322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:03.426860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:03.435440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:03.453184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:03.453988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:03.454930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:03.455754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:03.456383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:03.515351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24f528b90ed4813a69cd8e5bdda5d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1f47477049427ab12ec7adb829c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:03.531919 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41f474ae-cd0d-499c-9682-ef515d2c88bf tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 200 len: 1302 microversion: 2.1 time: 0.641319 Oct 18 16:21:03.533258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2397/4801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:02 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 1302 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:03.640698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:03.652948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:03.657325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:03.677544 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f4c9778-e1ed-4d6b-b602-b23785afc3f4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.255780 Oct 18 16:21:03.679453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2405/4802] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:03 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:04.353664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:04.355557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:04.366109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.367014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.367699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.368621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.369311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.370017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.566537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:04.567152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:04.587691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.589376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.592792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.593914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.595227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.595873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.635548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 HTTP/1.1 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a6594fcb-246f-48d9-9870-05d49189e002'} Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:04.641103 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:04.644979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:04.645551 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b298229b-23ce-42b6-8d0c-3904a8382d71 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 404 len: 111 microversion: 2.1 time: 0.084916 Oct 18 16:21:04.645684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2406/4803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:04 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:04.667269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:04.713322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.server_groups [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Querying cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) for 1 instances {{(pid=120570) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 16:21:04.714231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.715338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.715789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.749365 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fea3992a-4f66-4839-9fca-5105032c2532 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.085685 Oct 18 16:21:04.750398 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2407/4804] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:21:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:21:04.762996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:04.763452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:04.763641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:04.782936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.783245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ef133e3-458c-4d9a-b383-f513669632df tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.433366 Oct 18 16:21:04.783441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.783890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.787150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.790491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.791235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.810547 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2398/4805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:04 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:04.831597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}, {"name": "network-changed", "server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:04.859173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:04.875104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:04.875914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:04.911740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Creating event network-changed:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:21:04.912854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] Creating event network-changed:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:21:04.921565 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ed199574-15cc-45c5-8581-7fd18a44fd32 req-cea90b37-5a84-48b5-9ea5-3338a30de137 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107526 Oct 18 16:21:04.923171 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2399/4806] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:04.982147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.023501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_groups [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Querying cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) for 1 instances {{(pid=120571) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 16:21:05.024645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.025374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.025976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.045871 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eceb3f9d-22c6-47b9-a54d-a955f2189e13 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b" status: 200 len: 184 microversion: 2.1 time: 0.119340 Oct 18 16:21:05.063773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2400/4807] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:21:04 2022] GET /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b => generated 184 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:05.069534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.070402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:05.083798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.084761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.085387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.086261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.087888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.088502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.140364 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 HTTP/1.1 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a6594fcb-246f-48d9-9870-05d49189e002'} Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:05.146947 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.152554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.155861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.157068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58233ab5-76ed-49d9-b3e9-3d79de59ede2 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 404 len: 111 microversion: 2.1 time: 0.091824 Oct 18 16:21:05.161538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2401/4808] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.182147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.183067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] [instance: a6594fcb-246f-48d9-9870-05d49189e002] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:05.196300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.197191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.198006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.201397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.202231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.205313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.242024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 HTTP/1.1 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a6594fcb-246f-48d9-9870-05d49189e002'} Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.243580 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance a6594fcb-246f-48d9-9870-05d49189e002 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.247779 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37f231e9-ec77-46aa-a98e-425fcbb2db43 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002" status: 404 len: 111 microversion: 2.1 time: 0.082265 Oct 18 16:21:05.258366 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2402/4809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:05 2022] GET /compute/v2.1/servers/a6594fcb-246f-48d9-9870-05d49189e002 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.265359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d277e3e2-4e34-4077-98cf-a0e57aa0c665 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.274531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d277e3e2-4e34-4077-98cf-a0e57aa0c665 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d277e3e2-4e34-4077-98cf-a0e57aa0c665 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-server-groups/d0019438-5c30-4459-9dd2-2e5d828ab3e6 HTTP/1.1 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'd0019438-5c30-4459-9dd2-2e5d828ab3e6'} Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.276799 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d277e3e2-4e34-4077-98cf-a0e57aa0c665 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance group d0019438-5c30-4459-9dd2-2e5d828ab3e6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.281551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d277e3e2-4e34-4077-98cf-a0e57aa0c665 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/d0019438-5c30-4459-9dd2-2e5d828ab3e6" status: 404 len: 117 microversion: 2.1 time: 0.018528 Oct 18 16:21:05.283080 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2403/4810] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/d0019438-5c30-4459-9dd2-2e5d828ab3e6 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.295129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1088aab-dc21-4be8-8dc9-0d746aa3d94d tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.316520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f1088aab-dc21-4be8-8dc9-0d746aa3d94d tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1088aab-dc21-4be8-8dc9-0d746aa3d94d tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-server-groups/b2f84c45-fcf3-40a7-810c-da19eba36827 HTTP/1.1 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b2f84c45-fcf3-40a7-810c-da19eba36827'} Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.318178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1088aab-dc21-4be8-8dc9-0d746aa3d94d tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance group b2f84c45-fcf3-40a7-810c-da19eba36827 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.322407 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1088aab-dc21-4be8-8dc9-0d746aa3d94d tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/b2f84c45-fcf3-40a7-810c-da19eba36827" status: 404 len: 117 microversion: 2.1 time: 0.035530 Oct 18 16:21:05.325406 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2404/4811] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/b2f84c45-fcf3-40a7-810c-da19eba36827 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.333171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1541b10f-c968-4c59-b13d-9099d6cd8b6b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.341655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1541b10f-c968-4c59-b13d-9099d6cd8b6b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1541b10f-c968-4c59-b13d-9099d6cd8b6b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-server-groups/752f130f-7095-4b43-8f26-2405ac2fc0bb HTTP/1.1 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '752f130f-7095-4b43-8f26-2405ac2fc0bb'} Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.344033 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1541b10f-c968-4c59-b13d-9099d6cd8b6b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance group 752f130f-7095-4b43-8f26-2405ac2fc0bb could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.348132 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1541b10f-c968-4c59-b13d-9099d6cd8b6b tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/752f130f-7095-4b43-8f26-2405ac2fc0bb" status: 404 len: 117 microversion: 2.1 time: 0.019056 Oct 18 16:21:05.349739 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2405/4812] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/752f130f-7095-4b43-8f26-2405ac2fc0bb => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.358548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66a844f0-b701-4be2-adab-0354fa5a1b05 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.395731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-66a844f0-b701-4be2-adab-0354fa5a1b05 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] HTTP exception thrown: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66a844f0-b701-4be2-adab-0354fa5a1b05 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Request method failure captured: Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-server-groups/0971d319-c189-4965-a21f-aa4f6d11dbde HTTP/1.1 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJRQ9NI6TxwvvNN5le6tEMc19M5xTb3OpL3392wTwNcm1Djr_0hHAgBbNppyMzwTCm6soSWpHdWF7JOVZEESiASYdofbUT8mmoPCsEZiSqMx-hSO1Uyq6Up9-hKKA1rheKLwENp3Oe0m3x7Bu9gFPZOGytB4c__zleslmL67dAVh_g Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd1f47477049427ab12ec7adb829c5f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd1f47477049427ab12ec7adb829c5f5"}]}] Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: fd1f47477049427ab12ec7adb829c5f5 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerGroupTestJSON-774750397 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f24f528b90ed4813a69cd8e5bdda5d36 Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerGroupTestJSON-774750397-project Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0971d319-c189-4965-a21f-aa4f6d11dbde'} Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.397714 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. Oct 18 16:21:05.401919 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:05.411126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66a844f0-b701-4be2-adab-0354fa5a1b05 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Returning 404 to user: Instance group 0971d319-c189-4965-a21f-aa4f6d11dbde could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:05.412141 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66a844f0-b701-4be2-adab-0354fa5a1b05 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/0971d319-c189-4965-a21f-aa4f6d11dbde" status: 404 len: 117 microversion: 2.1 time: 0.061393 Oct 18 16:21:05.415657 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2406/4813] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/0971d319-c189-4965-a21f-aa4f6d11dbde => generated 117 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:05.423646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa2630f6-b2c6-44e8-9e3d-5d4c4f05b510 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.472791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:05.486643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:05.488557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:05.505546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8aaeb089-0b20-45a7-80b9-9a926001142c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.753324 Oct 18 16:21:05.506715 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2408/4814] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:04 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:05.515414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa2630f6-b2c6-44e8-9e3d-5d4c4f05b510 tempest-ServerGroupTestJSON-774750397 tempest-ServerGroupTestJSON-774750397-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b" status: 204 len: 0 microversion: 2.1 time: 0.092930 Oct 18 16:21:05.516049 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2407/4815] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/ac8be54f-4a19-43e8-b4da-3a07ffea250b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:21:05.809839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:05.810736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:05.828738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.835488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.836132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:05.837108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:05.840064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:05.840742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:06.046897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1552677286", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:06.179500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:21:06.505409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:06.524631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f5b1fbd-be0b-4632-8723-b5e9295a90a3 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.715744 Oct 18 16:21:06.527089 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2408/4816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:05 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:06.549887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:06.550788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:06.565562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:06.569810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:06.571212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:06.573712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:06.577745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:06.578483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:06.786982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:06.803583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:06.824517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:06.849858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8bcc0ee1-96c9-405c-8aa8-a4649fd3d91a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.307302 Oct 18 16:21:06.854807 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2409/4817] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:06 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:07.559138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:07.560289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:07.581791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:07.582354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:07.582672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:07.583363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:07.585569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:07.587662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:07.856497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:21:07.859116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:21:07.863573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:21:07.866541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:21:07.872962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:21:07.930797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:07.932453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:07.941054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:07.943281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:07.956433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:07.956900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:07.990430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:07.997065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:21:08.003692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:21:08.034673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:21:08.037296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:21:08.067745 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cb43cab-d00b-4586-8744-f8cf7af2af3e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.511229 Oct 18 16:21:08.070668 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2410/4818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:07 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:08.105811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:08.108729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:08.136482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4e1f4472-0261-4441-97b0-5c028c95486b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.628390 Oct 18 16:21:08.145512 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2409/4819] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:21:08.152595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eda76cfd-dd00-4355-9e4c-adf9c8999da9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:08.153625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eda76cfd-dd00-4355-9e4c-adf9c8999da9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:08.163454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:08.176380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:08.178198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:08.180975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:08.188061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:08.191978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:08.329575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eda76cfd-dd00-4355-9e4c-adf9c8999da9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:08.339928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eda76cfd-dd00-4355-9e4c-adf9c8999da9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1215 microversion: 2.1 time: 0.192862 Oct 18 16:21:08.340522 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2410/4820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:08 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:08.409160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:08.425684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:08.427115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:08.433504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:08.437850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95332618-2fef-4e96-ace3-68d6532484d0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.362022 Oct 18 16:21:08.438958 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2411/4821] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:08 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:09.094480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:09.096003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:09.121429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.121893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.122343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.123080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.124125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.124862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.365678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:09.366981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:09.393028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.393781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.394395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.395785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.397094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.397725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.559241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:09.574129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:09.574831 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-983b0742-98d3-4087-8299-ec1543180f4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1219 microversion: 2.1 time: 0.213583 Oct 18 16:21:09.578959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2412/4822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:09 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:09.593146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:09.593773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:09.604663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.622948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.626905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.629159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c4e613c-e699-40e2-a0a7-f5efb0273381 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.533828 Oct 18 16:21:09.631780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:09.632492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:09.633358 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2411/4823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:09 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:09.634635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:09.938450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:09.977187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:09.995619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:10.027389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8d73d55-de1e-4888-b056-71d7bfce2127 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.447109 Oct 18 16:21:10.030409 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2413/4824] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:09 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:10.641788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:10.645934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:10.673033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:10.687401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:10.729309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:10.736347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:10.743831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:10.745272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:10.746130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:10.760828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:10.768479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:10.769504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:10.778022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:10.779759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:10.791583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:10.797630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:11.188036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:11.256122 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a2a67d4-ec82-4d7a-bd5d-1393ecc6db88 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1267 microversion: 2.1 time: 0.644637 Oct 18 16:21:11.273051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2412/4825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:10 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1267 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:11.290074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:11.290869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:11.318360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:11.329537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:11.330079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:11.334509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:11.335026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:11.335483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:11.478649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:11.500648 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02cd2317-72e6-47f2-b575-5f7a07b64f93 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1512 microversion: 2.1 time: 0.836191 Oct 18 16:21:11.502809 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2414/4826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:10 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1512 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:11.564251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:11.587624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:11.589673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:11.599202 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac7c1790-6cf3-4fa4-bf1d-2e3ce2105c4a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.336467 Oct 18 16:21:11.600791 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2413/4827] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:11 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:12.292627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:12.294552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:12.317418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.319046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.324099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.328932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.330260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.336322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.516537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:12.529916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:12.531298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:12.541659 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a3ae955-9711-4393-9a3b-e070f47db153 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1273 microversion: 2.1 time: 0.255838 Oct 18 16:21:12.542260 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2415/4828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:12 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:12.550594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.553261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.554131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.571331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.572754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.574968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.633390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:12.634509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:12.649028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.649526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.649944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.650638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:12.651086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:12.651507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:12.667213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:12.980817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:13.004390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:13.008163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:13.026195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-601ad22a-ed65-4391-b004-90c97fa90119 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.400343 Oct 18 16:21:13.031036 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2416/4829] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:12 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:13.575113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:13.577088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:13.668926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:13.670768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:13.671606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:13.675407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:13.676546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:13.677374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:13.730589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:13.772143 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5380e118-8b1d-452d-8b41-e73dd4a07d22 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1489 microversion: 2.1 time: 1.242817 Oct 18 16:21:13.776141 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2414/4830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:12 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1489 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:13.799715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-673466789"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:13.802822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:13.811293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:13.812150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:13.812753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:13.813685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:13.814309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:13.814961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.018745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fd09abd-b430-43c5-9bd1-218563aa8060 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "PUT /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1061 microversion: 2.1 time: 0.225724 Oct 18 16:21:14.019387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2415/4831] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:21:13 2022] PUT /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1061 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:14.046084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:14.051319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:14.075225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.075742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.076320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.077227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.078077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.078743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.459635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:14.472806 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-424442c9-a2cf-4316-a0df-44c7ffdc79fd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1488 microversion: 2.1 time: 0.435111 Oct 18 16:21:14.473467 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2416/4832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:14 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1488 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:14.488671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:14.489726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:14.495701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:14.507561 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5364f87a-f486-434f-8667-64fa5d57eb36 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.940276 Oct 18 16:21:14.511466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2417/4833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:13 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:14.521161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:14.523042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.523622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.526213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.527372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.529794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:14.537370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.538131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.571570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.587982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.594678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.596168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:14.611881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:14.612817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:14.789264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:14.835073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:14.844776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:14.875080 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-784f6190-1318-4b26-916b-f1279b9aa60a tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.396053 Oct 18 16:21:14.877318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2417/4834] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:14 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:15.432648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:15.457198 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6cf3697-5442-4f7f-b985-2e2e6797cf0a tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1488 microversion: 2.1 time: 0.943863 Oct 18 16:21:15.465330 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2418/4835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:14 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1488 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:15.511789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:15.512051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:15.533967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.534680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.535139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:15.539532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.540180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.540942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:15.561670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:15.562445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:15.591730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.594277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.597407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:15.598540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.600089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.600735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:15.642320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:21:15.876318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e523cba7-1e4c-4609-829e-912f300cb65b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 204 len: 0 microversion: 2.1 time: 0.373662 Oct 18 16:21:15.884934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2418/4836] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:15 2022] DELETE /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:21:15.901273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:15.902633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:15.926650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.927430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.928071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:15.949358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:15.949862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:15.950312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:16.204869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:16.219742 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c5afbeb5-0562-46f2-8e71-21c091638e41 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.671582 Oct 18 16:21:16.233118 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2419/4837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:15 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:16.234126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:16.242574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:16.260156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:16.260668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:16.261380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:16.265188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:16.267611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:16.268433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:16.412811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:16.433157 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0878f814-3947-47ba-9e44-d5db397d5701 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1494 microversion: 2.1 time: 0.533206 Oct 18 16:21:16.439579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2419/4838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:15 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1494 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:16.491073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:16.512676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:16.519287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:16.538177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0cc29849-49a4-4fb2-b83a-c1568a070ce3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.313932 Oct 18 16:21:16.544419 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2420/4839] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:16 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:17.249321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:17.250878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:17.260190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea3329b-fe6a-4b0b-99b7-4073003b0ffd", "tag": "a4ce25e8-7629-41e4-886d-7580d97396bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:17.276551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.277169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.277523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.278252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.278713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.284589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.285839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.286557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.286744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.314180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:17.341378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] Creating event network-changed:a4ce25e8-7629-41e4-886d-7580d97396bc for instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd on n-h1-858383-14 Oct 18 16:21:17.354424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5fff38c3-e7ee-4f3b-a673-5c5cc5fcc844 req-32d774d1-537b-4681-8ee5-b5859188c189 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776361 Oct 18 16:21:17.356137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2420/4840] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:17.472255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:17.473074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:17.493529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.495195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.496908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.498061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.500305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.502232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.746941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:17.783104 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d515c56e-0aae-43c3-9c5b-0f30e1acadce tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1494 microversion: 2.1 time: 0.317951 Oct 18 16:21:17.785507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2421/4841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:17 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1494 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:17.902652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:17.909544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:17.981823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:17.984632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:17.990306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.990306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:17.990890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:17.997615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:17.998692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:18.002977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:18.224834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:18.239080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:18.240865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:18.258194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-417fe51b-40b0-442a-999e-2be8f1939528 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.469158 Oct 18 16:21:18.261307 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2422/4842] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:17 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:18.271934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:18.283840 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ae05576-f29f-49e5-bf26-225d8ec8ca4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 1.040056 Oct 18 16:21:18.290378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2421/4843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:17 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:18.822742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:18.825730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:18.849311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:18.865403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:18.866408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:18.868517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:18.870597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:18.872231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:18.876127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:19.305425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:19.306442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:19.310385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:19.319513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-358a5358-f9fb-48ee-a4c9-b7c93dbca649 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1494 microversion: 2.1 time: 0.504874 Oct 18 16:21:19.333615 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2423/4844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:18 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1494 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:19.335839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:19.336719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:19.337445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:19.338656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:19.339299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:19.339744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:19.340067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:19.340626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:19.352086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:19.352737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:19.353554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:19.354680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:19.355478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:19.356233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:19.664866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:19.710899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:19.714658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:19.736963 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95508ff7-314c-4211-b46c-28fea1fb1aab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.441516 Oct 18 16:21:19.750629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2422/4845] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:19 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:20.205485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:20.236897 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4532455-d08e-4120-93b1-27fba4009180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.900951 Oct 18 16:21:20.240436 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2424/4846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:19 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:20.364248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:20.365254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:20.388137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:20.389224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:20.389672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:20.390523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:20.391181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:20.391644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:20.401563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889", "name": "network-vif-deleted", "tag": "37f28306-ed5e-4083-a6f6-0f27ccd62159"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:20.441239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:20.444302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:20.447769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:20.525374 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] Creating event network-vif-deleted:37f28306-ed5e-4083-a6f6-0f27ccd62159 for instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 on n-h1-858383-14 Oct 18 16:21:20.540750 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2aa6bb50-964b-44ed-ae53-a9ba62a62e15 req-40349765-82e9-4451-9f45-1cdde510783c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142993 Oct 18 16:21:20.543779 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2425/4847] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:20.637069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:20.656335 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dff89831-e185-49bf-a798-d44768d00c28 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1452 microversion: 2.1 time: 0.297797 Oct 18 16:21:20.657578 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2423/4848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:20 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1452 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:20.802118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:20.803539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:20.813727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:20.814925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:20.815765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:20.816924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:20.817879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:20.818623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:20.964794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:20.982969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:20.986579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:20.997368 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b210de76-266a-4ef4-a67e-dd8e4dd40109 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.200045 Oct 18 16:21:20.999314 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2426/4849] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:20 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:21.265568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:21.266916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:21.276371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:21.277240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:21.278757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:21.280518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:21.281239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:21.282304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:21.557149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:21.571838 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e72a3c8-07f5-4e35-8d07-5de8173262af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.310883 Oct 18 16:21:21.573621 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2424/4850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:21 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:21.686555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:21.688557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:21.706220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:21.707077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:21.708189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:21.712644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:21.713592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:21.714661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:21.816807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:21.818326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:21.819370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:21.820108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:21.919427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:21.934563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d0b7740-1999-4a92-b946-9e78eb6f16ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.256750 Oct 18 16:21:21.936826 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2427/4851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:21 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:22.047180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:22.047837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:22.055413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:22.055942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:22.056384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:22.057134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:22.057592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:22.058031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:22.256174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:22.289249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:22.292740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:22.305098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ae230e3-e4c9-492a-8d3d-445d7a9d6113 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.262744 Oct 18 16:21:22.307082 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2425/4852] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:22 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:22.608343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:22.608849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:22.628038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:22.629085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:22.637456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:22.640966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:22.642515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:22.644054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:22.968922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:22.971626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:23.002370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:23.003041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:23.003719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:23.006029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:23.006883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:23.007859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:23.086372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:23.087616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:23.088642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:23.089900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lazy-loading 'fault' on Instance uuid ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:23.165870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:23.188033 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29d1c19d-9e02-47df-b930-669b7aaecf94 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.576413 Oct 18 16:21:23.191897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2428/4853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:22 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:23.219490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:23.232201 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-986b3a0a-0844-485d-98f0-3ab9808554f1 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 200 len: 1309 microversion: 2.1 time: 0.275162 Oct 18 16:21:23.251007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2426/4854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:22 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:23.354014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:23.354721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:23.363498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:23.364109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:23.364754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:23.365774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:23.366287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:23.366731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:23.456325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:23.466105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:23.468088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:23.474504 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1836148f-7079-4258-abe8-5b63f2bd8f39 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.125819 Oct 18 16:21:23.475347 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2429/4855] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:23 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:24.222122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.225737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.238497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.239507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.241085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.242084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.242993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.243875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.273894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.275874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.286418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.287255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.288043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.289483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.290585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.291386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.325037 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 HTTP/1.1 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889'} Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.332346 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.336436 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.338019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:24.338918 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78146452-51e6-4fa8-a3e9-d09046db3c61 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 404 len: 111 microversion: 2.1 time: 0.083076 Oct 18 16:21:24.342233 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2430/4856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:24 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:21:24.363033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.363541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.378455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.379248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.380556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.384363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.385080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.385682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.415763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 HTTP/1.1 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889'} Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:24.426151 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-559f3aeb-d770-4406-bd6b-2f9c01753750 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 404 len: 111 microversion: 2.1 time: 0.069171 Oct 18 16:21:24.443414 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2431/4857] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:24 2022] DELETE /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:24.446022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.446883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.465799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.468948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.470238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.473873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.475164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.476275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.527345 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 HTTP/1.1 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889'} Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.532253 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. Oct 18 16:21:24.544092 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.549970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:24.552955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0483bd9a-4495-4f70-88ad-2b20cf706dc0 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889" status: 404 len: 111 microversion: 2.1 time: 0.117595 Oct 18 16:21:24.555034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2432/4858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:24 2022] GET /compute/v2.1/servers/ce2d7d0b-a469-4d1d-bb7d-6b343e9cd889 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:24.575689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.578841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.590494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.591106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.591650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.593156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.593696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.594202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.707827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:24.717835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:24.719292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:24.736519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-257d8301-8965-4eb0-913c-2bea7ff8512c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1535 microversion: 2.91 time: 0.178261 Oct 18 16:21:24.743656 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2433/4859] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:24 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1535 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:24.759821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.760667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.773640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.775068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.776132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.777665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.778729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.780698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.815716 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 HTTP/1.1 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '35ea8baf-ba46-4642-9633-b93882bac746'} Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:24.819771 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.828331 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.833708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:24.833708 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12398544-da5c-4065-9ac5-a4eb82b8c19b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 404 len: 111 microversion: 2.1 time: 0.085521 Oct 18 16:21:24.835282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2434/4860] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:24 2022] DELETE /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:24.851390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.852845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 35ea8baf-ba46-4642-9633-b93882bac746] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.872011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.874009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.875243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.876957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.878040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.879028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.915310 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 HTTP/1.1 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '35ea8baf-ba46-4642-9633-b93882bac746'} Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:24.918692 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. Oct 18 16:21:24.927381 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:24.930495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 35ea8baf-ba46-4642-9633-b93882bac746 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:24.932379 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b74b7898-5bf4-4191-aa29-a098fdbe4345 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746" status: 404 len: 111 microversion: 2.1 time: 0.091073 Oct 18 16:21:24.934020 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2435/4861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:24 2022] GET /compute/v2.1/servers/35ea8baf-ba46-4642-9633-b93882bac746 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:21:24.956410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:24.956956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:24.972525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.973863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.975064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:24.976503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:24.977495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:24.978931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.016929 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a HTTP/1.1 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '8ad854ec-0843-42aa-b4bb-abbc17d19f8a'} Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.021216 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.027902 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.033228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.035124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26a3c7fd-2e35-4971-b2f7-f6d285bc914b tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 404 len: 111 microversion: 2.1 time: 0.088047 Oct 18 16:21:25.037545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2436/4862] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:24 2022] DELETE /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.048375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.049561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: 8ad854ec-0843-42aa-b4bb-abbc17d19f8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.059065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.059569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.060117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.062382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.063020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.063472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.094481 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a HTTP/1.1 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '8ad854ec-0843-42aa-b4bb-abbc17d19f8a'} Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.097214 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. Oct 18 16:21:25.101599 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.104284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance 8ad854ec-0843-42aa-b4bb-abbc17d19f8a could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.105564 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aea82703-7a0a-47b0-b7f1-b1dd3f48d35c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a" status: 404 len: 111 microversion: 2.1 time: 0.062273 Oct 18 16:21:25.107420 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2437/4863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/8ad854ec-0843-42aa-b4bb-abbc17d19f8a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.118716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.119420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.127032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.127832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.128278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.129055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.129614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.130057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.151428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da HTTP/1.1 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e78d0656-6904-4b88-961b-51ba1ffdd9da'} Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.155224 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.163759 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.169587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.169587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66e67669-0b95-42d5-a3e2-050c8f108576 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 404 len: 111 microversion: 2.1 time: 0.052496 Oct 18 16:21:25.169587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2438/4864] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:25 2022] DELETE /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.181255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.182742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: e78d0656-6904-4b88-961b-51ba1ffdd9da] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.190666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:25.193994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.195546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.196415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.197904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.198920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.199881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.202071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56ba1a43-9127-44a2-a82d-9ab8bc776af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.987808 Oct 18 16:21:25.203066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2427/4865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:24 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:25.220413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da HTTP/1.1 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e78d0656-6904-4b88-961b-51ba1ffdd9da'} Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.223731 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. Oct 18 16:21:25.231450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.235819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance e78d0656-6904-4b88-961b-51ba1ffdd9da could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.241405 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-549be097-3d99-4312-ba60-9c07e3974e43 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da" status: 404 len: 111 microversion: 2.1 time: 0.062994 Oct 18 16:21:25.243949 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2439/4866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/e78d0656-6904-4b88-961b-51ba1ffdd9da => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:21:25.267933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.268881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.282836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.284937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.286950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.288235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.288798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.289333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.310140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b HTTP/1.1 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c08083e6-250c-4223-9c1d-0be557870a7b'} Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.315986 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9e2b51a-9c38-41d8-b2bc-140ba235b410 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 404 len: 111 microversion: 2.1 time: 0.069334 Oct 18 16:21:25.324456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2428/4867] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:25 2022] DELETE /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.337385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.339058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: c08083e6-250c-4223-9c1d-0be557870a7b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.351237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.352477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.354061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.355853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.362642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.363533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.389209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b HTTP/1.1 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c08083e6-250c-4223-9c1d-0be557870a7b'} Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.391934 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance c08083e6-250c-4223-9c1d-0be557870a7b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55cb90c0-0ab6-494e-b56c-cc3df6045515 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b" status: 404 len: 111 microversion: 2.1 time: 0.067350 Oct 18 16:21:25.397475 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2440/4868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/c08083e6-250c-4223-9c1d-0be557870a7b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.407517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.408180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.416010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.416679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.417934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.418937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.419773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.420098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.442074 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 HTTP/1.1 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b261a7d9-572e-42c8-9249-cf712b2e72f7'} Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.444071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9aaa149-042e-461a-b27a-5359155fa4ed tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 404 len: 111 microversion: 2.1 time: 0.043940 Oct 18 16:21:25.447677 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2429/4869] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:25 2022] DELETE /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.455775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.456948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: b261a7d9-572e-42c8-9249-cf712b2e72f7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.464169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.464433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.464878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.465791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.466514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.468272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.486769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 HTTP/1.1 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b261a7d9-572e-42c8-9249-cf712b2e72f7'} Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.488637 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. Oct 18 16:21:25.492252 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.494465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance b261a7d9-572e-42c8-9249-cf712b2e72f7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.495753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-943e8a3c-ba01-4cb6-9343-870afe377a13 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7" status: 404 len: 111 microversion: 2.1 time: 0.045054 Oct 18 16:21:25.496868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2441/4870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/b261a7d9-572e-42c8-9249-cf712b2e72f7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.509283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.509283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.515293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 HTTP/1.1 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a6a9f20b-6933-46db-b6e8-e801b2194102'} Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.518041 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f54a426-d736-4d00-8c64-8cba719c383e tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102" status: 404 len: 111 microversion: 2.1 time: 0.018327 Oct 18 16:21:25.522812 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2430/4871] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:25 2022] DELETE /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.529111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.530348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: a6a9f20b-6933-46db-b6e8-e801b2194102] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.537423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 HTTP/1.1 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a6a9f20b-6933-46db-b6e8-e801b2194102'} Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:25.539030 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance a6a9f20b-6933-46db-b6e8-e801b2194102 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d7929ce-e021-42cc-b56b-eceba91e66cb tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102" status: 404 len: 111 microversion: 2.1 time: 0.015532 Oct 18 16:21:25.543259 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2442/4872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/a6a9f20b-6933-46db-b6e8-e801b2194102 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:25.554517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.555036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.564009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.564889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.565955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.567238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.567841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.568468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.601873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:21:25.746387 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a71ce10d-155b-424e-8355-49dec78bc21c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 204 len: 0 microversion: 2.1 time: 0.197962 Oct 18 16:21:25.754174 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2431/4873] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:25 2022] DELETE /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:21:25.758423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.759053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.769719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:25.770516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:25.772299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.772804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.778499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.778936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.779406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.780122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.780249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.780786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.781114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:25.781249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.782371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:25.783066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:25.884094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:25.896884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:25.898903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:25.907084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a77e578-7016-45cf-ad86-f16316406b62 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1535 microversion: 2.91 time: 0.144553 Oct 18 16:21:25.908508 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2432/4874] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1535 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:26.211899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:26.226360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1510eba1-e105-42fe-b346-6e642af77cdd tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1479 microversion: 2.1 time: 0.471882 Oct 18 16:21:26.229346 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2443/4875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:25 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1479 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:26.248315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:26.249198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:26.256198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:26.257088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:26.257743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:26.258665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:26.259327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:26.259966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:26.287799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:26.439356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:26.448111 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fcd6b9bb-77fb-4e1e-b1ee-20939cf34090 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.205544 Oct 18 16:21:26.448965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2433/4876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:26 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:26.635905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea3329b-fe6a-4b0b-99b7-4073003b0ffd", "name": "network-vif-plugged", "status": "completed", "tag": "a4ce25e8-7629-41e4-886d-7580d97396bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:26.656187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:26.656682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:26.657153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:26.691830 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] Creating event network-vif-plugged:a4ce25e8-7629-41e4-886d-7580d97396bc for instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd on n-h1-858383-14 Oct 18 16:21:26.707221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1fe991e0-469e-4ea7-a081-f02c231a6161 req-a01fb019-af35-4cba-a2b2-6b8ddc902757 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074883 Oct 18 16:21:26.708066 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2444/4877] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:26.938768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:26.939771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:26.958809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:26.959699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:26.960388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:26.961412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:26.962092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:26.962735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.087327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.105365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.107381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.113711 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a0c55cbc-3530-4bca-8b92-251ef7e602df tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1538 microversion: 2.91 time: 0.180954 Oct 18 16:21:27.123178 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2434/4878] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:26 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1538 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:27.143764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:27.146463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:27.156933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.157762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.158450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.159398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.160064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.160880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.230391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-14". {{(pid=120570) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 16:21:27.259668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:27.260442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:27.302753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.303430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.304053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.309456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.313060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.314597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.393230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:27.468900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9200559-3683-485c-beda-603c849e7c21 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action" status: 202 len: 0 microversion: 2.91 time: 0.326490 Oct 18 16:21:27.473940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2445/4879] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:21:27 2022] POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:21:27.479790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:27.480611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:27.489500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.490478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.490938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.491829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.492325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.496442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.728126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.738461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50547d9d-927f-4089-bfea-46070737cc1c tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1479 microversion: 2.1 time: 0.482502 Oct 18 16:21:27.753029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2435/4880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:27 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1479 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:27.753029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:27.753029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:27.766791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.769407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.770251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.771475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:27.772360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:27.774718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:27.890224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.903821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.906058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:27.914319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f757be6e-57dc-4c63-8899-ecab80e002fa tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1546 microversion: 2.91 time: 0.173616 Oct 18 16:21:27.914921 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2436/4881] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:27 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:28.278581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:28.300613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f83bef95-a6ed-44d5-9db6-2dba8546edd7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1315 microversion: 2.1 time: 0.816294 Oct 18 16:21:28.304067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2446/4882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:27 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:28.768554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:28.769536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:28.784190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:28.784727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:28.785540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:28.789577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:28.790142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:28.790783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:28.952068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:28.955207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:28.973882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:28.974498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:28.975037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:28.976238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:28.976938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:28.981280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:29.165283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:29.181313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:29.196423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:29.211709 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af46d6df-b52a-4cc7-82fb-be0131f0bfb2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1486 microversion: 2.91 time: 0.269476 Oct 18 16:21:29.213501 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2447/4883] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:28 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:29.338419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:29.339220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:29.351284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:29.354872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:29.355536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:29.358706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:29.359428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:29.360346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:29.674936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ac3d341e8444fda9964798e94f0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95df9210b0dd484abf991849367a2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:29.698815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50df6d9c-3145-4e0c-909c-b18546eb4ed8 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 200 len: 1479 microversion: 2.1 time: 0.934262 Oct 18 16:21:29.700810 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2437/4884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:28 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 1479 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:29.985736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:30.015391 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72bf284c-bb3a-4d4b-b621-6ef1dbb82e99 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1502 microversion: 2.1 time: 0.682958 Oct 18 16:21:30.016412 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2448/4885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:29 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1502 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:30.054981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:30.055498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:30.070979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.071479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.071920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.081851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.082381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.082912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.119370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0e6a7f-e88b-41e8-a473-c02a113946a2", "name": "network-vif-deleted", "tag": "45e269eb-28a2-4c34-9421-64ec536a58d0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:30.156454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.157042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:21:30.157327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.157713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.192700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] Creating event network-vif-deleted:45e269eb-28a2-4c34-9421-64ec536a58d0 for instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 on n-h2-858383-14 Oct 18 16:21:30.215698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8bbcb8b6-07e0-4c53-ac93-50f984ca413d req-d0e414be-2bf3-48e6-98f4-9617b2187fb8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.512763 Oct 18 16:21:30.216849 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2438/4886] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:30.259291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:30.260135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:30.270452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.270974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.271360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.272145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.272606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.279286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.346783 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0825e8f0-57f5-4908-8cd7-fbe88e1f649e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 204 len: 0 microversion: 2.1 time: 0.301620 Oct 18 16:21:30.361733 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2449/4887] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:30 2022] DELETE /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:21:30.373157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:30.384226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:30.401790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.402295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.402741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.405288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.405925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.406512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.440564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:30.451797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:30.457059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:30.462814 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.219971 Oct 18 16:21:30.477373 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2439/4888] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:30 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:30.478931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:30.490245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17fb220a-0661-4c14-a7ac-06f0386db64f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005694 Oct 18 16:21:30.491790 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2440/4889] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 18 16:21:30 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 16:21:30.728838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:30.729592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] [instance: ee0e6a7f-e88b-41e8-a473-c02a113946a2] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:30.738274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.739015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.740733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.742628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:30.743515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:30.744784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:30.775872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:30.790002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] HTTP exception thrown: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Request method failure captured: Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 HTTP/1.1 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFlTOwyKuCsBidGYOZRFsg_-pM_H0jqTpG91kP_p6nOIdh3b9nwJZtNX3pMXv0jo8aIF7rgp-3VDOK-62HfwTWm8az06hNJu8mRd31dw3Ixi03-rixjWcMJ0igr7pR6LvhQyvCR7PmZFYQr3o1dw6WBbBYcS0KmPa5jO7o0ft0mkcE Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95df9210b0dd484abf991849367a2c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95df9210b0dd484abf991849367a2c16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95df9210b0dd484abf991849367a2c16"}]}] Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestJSON-1120621745 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95df9210b0dd484abf991849367a2c16 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestJSON-1120621745 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 70ac3d341e8444fda9964798e94f0d16 Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestJSON-1120621745-project Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'ee0e6a7f-e88b-41e8-a473-c02a113946a2'} Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:30.792140 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. Oct 18 16:21:30.796868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:30.798865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] Returning 404 to user: Instance ee0e6a7f-e88b-41e8-a473-c02a113946a2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:30.799908 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34887f0e-b025-47de-a2a6-6e85642f6417 tempest-ServersTestJSON-1120621745 tempest-ServersTestJSON-1120621745-project] 10.222.0.78 "GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2" status: 404 len: 111 microversion: 2.1 time: 0.075317 Oct 18 16:21:30.800653 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2441/4890] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:30 2022] GET /compute/v2.1/servers/ee0e6a7f-e88b-41e8-a473-c02a113946a2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:21:30.802747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0771fa40-dea9-46ef-b55e-ef8bd23ad192 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1508 microversion: 2.1 time: 0.435806 Oct 18 16:21:30.808676 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2450/4891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:30 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:31.499317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:31.500040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:31.509534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:31.510036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:31.510491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:31.511212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:31.530427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:31.531163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:31.711496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:31.727197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:31.730573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:31.744987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47ef3642-065f-4325-968a-76db7dec4652 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.250718 Oct 18 16:21:31.745872 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2442/4892] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:31 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:31.829852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:31.831134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:31.847851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:31.849148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:31.850109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:31.851451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:31.853466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:31.859745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:32.363465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:32.410173 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-681e2d77-6ed2-4dcf-b48d-243559eb8d2e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1508 microversion: 2.1 time: 0.581590 Oct 18 16:21:32.412536 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2451/4893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:31 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:32.800969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:32.804736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:32.833829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:32.846170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:32.847310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:32.849066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:32.850107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:32.850856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:33.158290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:33.173434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:33.178282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:33.199192 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f198e5e-0892-43dc-afd9-d78c9fffba53 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.408267 Oct 18 16:21:33.213535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2443/4894] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:32 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:33.451394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:33.453896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:33.495109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:33.501459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:33.502482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:33.503599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:33.504435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:33.505465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.236567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:34.237222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:34.257623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.262970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.284842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.285664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.286149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.292673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.540349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:34.557992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:34.565725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:34.598334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1c81546-27db-4894-8b8e-b0d10d408c3e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.366456 Oct 18 16:21:34.618709 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2444/4895] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:34 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:34.656694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea3329b-fe6a-4b0b-99b7-4073003b0ffd", "name": "network-vif-deleted", "tag": "a4ce25e8-7629-41e4-886d-7580d97396bc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:34.685914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.686876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.687795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.708449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:34.741525 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6090843b-4270-41c6-b86c-6984704e2b08 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1508 microversion: 2.1 time: 1.297633 Oct 18 16:21:34.755064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2452/4896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:33 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1508 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:34.762507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] Creating event network-vif-deleted:a4ce25e8-7629-41e4-886d-7580d97396bc for instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd on n-h1-858383-14 Oct 18 16:21:34.779563 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f99edb60-5774-4558-95c4-3f6e18a5de10 req-f4eadc68-a8b5-42d0-8305-ae7416020bd6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130272 Oct 18 16:21:34.781823 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2445/4897] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:21:35.645693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:35.646427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:35.667181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.669888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.670740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:35.674628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.683311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.707174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:35.778065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:35.779743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:35.799799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:35.803281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.808794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.810477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:35.815216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.817402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.819830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:36.055144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:36.058049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:36.059626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:36.063005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lazy-loading 'fault' on Instance uuid cea3329b-fe6a-4b0b-99b7-4073003b0ffd {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:36.189967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:36.207149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:36.217784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:36.257949 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b7ce356-b682-4e4f-b4c7-1289b4fe6c6e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.617337 Oct 18 16:21:36.272090 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2453/4898] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:35 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:36.402760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:36.414776 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98d84f68-74e5-4e5c-aedc-ab2b27e6c66e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 200 len: 1305 microversion: 2.1 time: 0.642463 Oct 18 16:21:36.418657 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2446/4899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:35 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 1305 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:37.324545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:37.325703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:37.349115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.355759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.364048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.367600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.368257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.368839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.450770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:37.452765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:37.470258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.471942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.472402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.491534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.492413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.492877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.657601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:37.677499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:37.682835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:37.709514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c90a138-8aa0-4b37-a790-c5479e718208 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.389520 Oct 18 16:21:37.710827 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2454/4900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:37 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:38.241456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd HTTP/1.1 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'cea3329b-fe6a-4b0b-99b7-4073003b0ffd'} Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:38.243576 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:21:38.248171 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:21:38.250541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:38.251686 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd35c525-1218-42e5-9021-20fe0b3f8219 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 404 len: 111 microversion: 2.1 time: 0.805613 Oct 18 16:21:38.252458 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2447/4901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:37 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 111 bytes in 807 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:21:38.750839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:38.752839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:38.789858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2009613797", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:38.793235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:38.794146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:38.799796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:38.800579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:38.817671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:38.818553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:39.028958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:21:39.178351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:39.189065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:39.220331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:39.237463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-270fe362-3dc1-4e18-b059-bcd12b9d9fd2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.494702 Oct 18 16:21:39.264913 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2455/4902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:38 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:40.297689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:40.299079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:40.313153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.313934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.314550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.318219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.319066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.319715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.598523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:40.620781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:40.630964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:40.646694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-80ba6461-d23a-4242-b5b1-6cf3a13c0ee7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.353735 Oct 18 16:21:40.652230 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2456/4903] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:40 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:40.699261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:21:40.701712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:21:40.702830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:21:40.703649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:21:40.704604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:21:40.732392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.733410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.734137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.738996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.739900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.740614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.799592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:21:40.810047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:21:40.839791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:21:40.848856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:21:40.974339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1eb9d319-c060-46b6-886e-525c1bec5c00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.194241 Oct 18 16:21:40.977910 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2448/4904] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:21:40.990464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e74a0f83-d5c3-4143-8556-e02dea45ce67 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:40.991247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e74a0f83-d5c3-4143-8556-e02dea45ce67 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:41.007663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:41.237138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e74a0f83-d5c3-4143-8556-e02dea45ce67 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:41.246962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e74a0f83-d5c3-4143-8556-e02dea45ce67 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1215 microversion: 2.1 time: 0.262945 Oct 18 16:21:41.250373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2457/4905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:40 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:41.683346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:41.687407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:41.734693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:41.737741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:41.740091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:41.746054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:41.746558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:41.747031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.094190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:42.116550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:42.125080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:42.153989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39e47f4c-0a1d-4b37-ac26-2fd3df53f288 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.476353 Oct 18 16:21:42.161673 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2449/4906] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:41 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:42.286210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-565cc8fa-cd28-4411-a75f-277a97c1830b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:42.286858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-565cc8fa-cd28-4411-a75f-277a97c1830b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:42.345313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:42.346117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:42.360418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.362733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.370007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.370619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.371151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.371354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.441264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e306211d-65df-49d7-9177-c76fb1eec561 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/ips" status: 200 len: 151 microversion: 2.20 time: 0.100778 Oct 18 16:21:42.449984 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2450/4907] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Oct 18 16:21:42 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:21:42.535376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-565cc8fa-cd28-4411-a75f-277a97c1830b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:42.565646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-565cc8fa-cd28-4411-a75f-277a97c1830b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1215 microversion: 2.1 time: 0.283108 Oct 18 16:21:42.580828 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2458/4908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:42 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:43.221083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:43.222384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:43.240140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:43.241831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:43.243558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:43.246560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:43.251707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:43.252654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:43.598388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:43.599091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:43.633920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:43.636071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:43.638823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:43.639785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:43.641440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:43.643136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:43.882387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:43.891352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ccd8b60f-5a19-419c-8c69-c2620dacf810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1267 microversion: 2.1 time: 0.298545 Oct 18 16:21:43.893667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2459/4909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:43 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:44.559268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:44.584130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:44.587503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:44.604854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc4ea85b-b88c-4a97-85f3-a9086cf98447 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 1.388188 Oct 18 16:21:44.625958 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2451/4910] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:43 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:44.925461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:44.927832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:44.966340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:44.966948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:44.967555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:44.978177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:44.978684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:44.979139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:45.643556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:45.647283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:45.688631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:45.694724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:45.695403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:45.699909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:45.702255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:45.715383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:45.942126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:45.960528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68a6c825-864b-479a-9ccc-bb15b6f467ff tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1273 microversion: 2.1 time: 1.042246 Oct 18 16:21:45.961604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2460/4911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:44 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1273 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:46.132356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:46.146373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:46.147838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:46.164383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c0f095c4-ce06-4c7f-b0ce-2f0812feecc8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.528039 Oct 18 16:21:46.169997 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2452/4912] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:45 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:46.992517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:46.994339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:47.009985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.011009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.014317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.015564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.028078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.029902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.207387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:47.208180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:47.224621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.230813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.239785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.241426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.242261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.242872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.510094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:47.532541 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b13f05a-e51b-452b-a8dc-44f3c90f8cc2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.543326 Oct 18 16:21:47.533903 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2461/4913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:46 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:47.553592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:47.559000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:47.575131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:47.615214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:47.617085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:47.618878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.623349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.624510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.626810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.627315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.633256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.640492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a8f1272-cee3-4ee4-adef-2db324725044 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.437777 Oct 18 16:21:47.653212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2453/4914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:47 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:47.689535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:47.694574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lazy-loading 'flavor' on Instance uuid e268bc7b-0f4b-4eba-b006-0eb28c380aea {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:47.798443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:47.799325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:47.830177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.831552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.832315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.833626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:47.836635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:47.837473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:47.846047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:48.013473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'services' on Instance uuid c7b81207-45cd-44fb-abb4-b7faeb7002ad {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:48.196872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f36c8df-2d54-4b2d-a899-18e700234d48 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/action" status: 202 len: 0 microversion: 2.20 time: 0.661458 Oct 18 16:21:48.199489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2462/4915] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:21:47 2022] POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:21:48.222520 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69cf051d-aed2-4224-b803-d7a50650aad9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments/cb18bf31-45b9-4ba2-b83d-aafe23246949" status: 202 len: 0 microversion: 2.1 time: 0.428897 Oct 18 16:21:48.223365 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2454/4916] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:21:47 2022] DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments/cb18bf31-45b9-4ba2-b83d-aafe23246949 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:21:48.225476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:48.226738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:48.236974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:48.241597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:48.251724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.252731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.253436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.254509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.256020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.256650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.257970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.258772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.259337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.260190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.260773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.273825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.348414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29654feb-82b5-4fb3-8280-dab3e5c5cc4f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117563 Oct 18 16:21:48.349949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2455/4917] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:48 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:48.557435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:48.558852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:48.579160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.579910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.580741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.581614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.586986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.587755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.778407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:48.803412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:48.805368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:48.806777 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-760b002c-093b-45fe-8f9e-809fc2a74909 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.593493 Oct 18 16:21:48.807533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2463/4918] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:48 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:48.820713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:48.821585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:48.832750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.834754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.835678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.844415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.845362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.846550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.103806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:49.129214 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-760dcd92-45d7-445f-9356-6ed0669745dd tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.577085 Oct 18 16:21:49.145625 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2456/4919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:48 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:49.295321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:49.314213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:49.316670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:49.330463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c2e19ea-15b2-4b21-9b4e-a7d560cdf01b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.521764 Oct 18 16:21:49.331160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2464/4920] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:48 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:49.367368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:49.369913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:49.381029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.382327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.382953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.384053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.384924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.385834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.444368 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00e6f5c0-6feb-4def-ad63-a6b8b797339a tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080964 Oct 18 16:21:49.445052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2457/4921] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:49 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:49.707232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f", "tag": "d1ba357e-6506-4541-9eaf-eb87da2535bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:49.735937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.740542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.741256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.776263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] Creating event network-changed:d1ba357e-6506-4541-9eaf-eb87da2535bc for instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f on n-h1-858383-14 Oct 18 16:21:49.793779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a89bafa6-e61a-4e27-8274-2d8dcd1956c8 req-49c7e665-f3fa-4ca5-bd26-161fb2d13215 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087414 Oct 18 16:21:49.795676 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2465/4922] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:49.835901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:49.836684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:49.851966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.852923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.853801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.857857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.859199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.859840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.159315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:50.160070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:50.179836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.180396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.181265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.182239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.182944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.183565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.443280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.468608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.470110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.472127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1a9104b-2096-4c6b-94a6-4b5235809235 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.641458 Oct 18 16:21:50.489105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2458/4923] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:49 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:50.503178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:50.504112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:50.525464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.526256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.526934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.527694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.528895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.529512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.594995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.612344 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33211e77-155e-4aa6-90b2-d60edf39f2af tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.459304 Oct 18 16:21:50.625056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2466/4924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:50 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:50.625056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:50.635687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:50.652508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.653860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.656863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.657772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.662102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.662844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.728496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d2e366f-045a-4864-89b4-ba4cd07e8407 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112721 Oct 18 16:21:50.729912 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2467/4925] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:50 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:50.773780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:50.787447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.804612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.806781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.828020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:50.829877 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbf9202a-b157-4dc8-853c-05fb1550227d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.350149 Oct 18 16:21:50.830822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2459/4926] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:50 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:51.513066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:51.513794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:51.540012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.542712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.545147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.549223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.554902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.556206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.642157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:51.642799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:51.652943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.655040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.655539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.656868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.658542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.659037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.920180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:51.938377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:51.939955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:51.941233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8ac69ed3-c469-49b2-8e99-57c26b994362 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.433132 Oct 18 16:21:51.945340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2468/4927] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:51 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:51.960880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:51.966514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:51.977450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.980095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.980734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.982997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.983659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.987239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:52.036030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:52.038380 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83cf1d80-7b1b-44dd-956f-250bf243ed96 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088655 Oct 18 16:21:52.039243 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2469/4928] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:51 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:52.044153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:52.045021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:52.049307 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e18a4458-acb1-411a-8757-f7aed26ed3a0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.407204 Oct 18 16:21:52.049992 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2460/4929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:51 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:52.063764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:52.064093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:52.064543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:52.071882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:52.072461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:52.085518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:52.247773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:52.257875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:52.259666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:52.267253 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5106b893-eb0a-4940-916e-f9f39a586512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.226522 Oct 18 16:21:52.282398 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2470/4930] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:52 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:52.979877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:52.982113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:53.010249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.013686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.014286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.015150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.019806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.020393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.051720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:53.055253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:53.057980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:53.074286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.076590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.080673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.083979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.086793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.087455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.146699 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d83dd385-c165-4099-9933-f9a886884eba tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098894 Oct 18 16:21:53.153584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2471/4931] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:53 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:53.158627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:53.159470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:53.165916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.166626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.167223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.168188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.168872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.171673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.438448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.454075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.455674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.456909 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c30248fa-ba52-41ec-83dc-4420c45bcbf7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 1.485283 Oct 18 16:21:54.457500 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2461/4932] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:52 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:54.473868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:54.474812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:54.490261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:54.491084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:54.491775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.492959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:54.493641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:54.494836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.507681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.542338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34636e61-43bd-438a-9631-0928b6638016 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 1.386999 Oct 18 16:21:54.544735 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2472/4933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:53 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:54.556570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:54.563460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:54.596904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:54.598278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:54.601145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.603396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:54.605580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:54.607314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.760193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.761483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09fdaf2e-1fe9-4b4c-9294-00a85c329ced tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214441 Oct 18 16:21:54.773512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.776290 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2473/4934] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:54 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:54.778317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.789089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e51dc539-7b66-4bb3-9da4-06a2d46d2627 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.324301 Oct 18 16:21:54.789560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2462/4935] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:54 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:55.373729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42a795b7-919e-4124-8bbd-500033532d43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: .version_select at 0x7f5fd1fb4940>, body: {"keypair": {"name": "tempest-keypair-1675343564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTJaIq1qzTO0WohmHnswgJBJOsa6cstDPUt/Ct7cSHJaAHJ1vJZxz95euJKGPrMa1YE2L7Ml2DF+N5zX8EiMOpt3baEmedqtJd+sR+IqJRoN+komPXF2YnnF6NgUSqM+Q=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:55.455892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-42a795b7-919e-4124-8bbd-500033532d43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:21:55.478435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-42a795b7-919e-4124-8bbd-500033532d43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for user 08b0514cd6004596969d5d5caf689179 and project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:21:55.526277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:55.527038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:55.542161 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42a795b7-919e-4124-8bbd-500033532d43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.439151 Oct 18 16:21:55.551916 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2474/4936] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:21:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:55.554263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.557311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.558080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:55.559398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.560201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.560865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:55.577961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:55.578851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:55.601311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.603521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.608018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:55.609227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.610246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.610960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.098487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.108717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4514ac3f-3bfd-4c01-9c2a-90bb83b1a11a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.540952 Oct 18 16:21:56.136034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2475/4937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:55 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:56.188833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:56.191618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:56.201127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.202072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.203015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.204477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.205654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.206967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.316872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f393882-b9fa-4916-a746-b2afd1aaeb04 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175295 Oct 18 16:21:56.318383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2476/4938] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:56 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:56.325627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:56.327092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:56.358663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.359448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.360310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.361353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.362549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.363202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.433400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.453158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.464271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.466902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b792e785-1f58-4c14-8b91-2c2975fa4572 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.958847 Oct 18 16:21:56.485857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2463/4939] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:55 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:56.569957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.602480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.614949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.655567 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0371e8b9-c74f-4c47-8d1a-50fa9e064ec5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.334124 Oct 18 16:21:56.658934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2477/4940] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:56 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:57.134950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:57.135877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:57.154893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.156568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.157513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.160158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.160788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.165705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.330779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:57.333937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:57.359076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.359680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.360504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.361436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.362656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.363444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.404893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:57.408647 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4fa07f6-7c89-4ba9-9e01-c372cbc0be0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081824 Oct 18 16:21:57.413633 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2478/4941] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:57 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:57.505463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:57.506490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:57.524372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.525508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.526197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.528561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.533469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.536289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.819737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:57.845785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06f97b77-3f43-4d6d-8907-bc48668fdc4a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.713689 Oct 18 16:21:57.848886 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2464/4942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:57 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:57.864706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:57.866239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:57.884122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.887105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.889501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.890509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.891239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.891939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.980682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.000843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.015595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.021265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de090670-e649-42cc-b540-9f299ba7785b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.528101 Oct 18 16:21:58.022373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2479/4943] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:57 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:21:58.087329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.100833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.106484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.122125 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddc10849-eea7-42bf-abb0-21d9042fab05 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1531 microversion: 2.91 time: 0.271427 Oct 18 16:21:58.125468 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2465/4944] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:57 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1531 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:58.156897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:58.165956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:58.173791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.174666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.175374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.176283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.176966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.178330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.296930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lazy-loading 'services' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:58.328414 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a43ec734-16c2-4ece-be28-fc057dd24dc0 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1938 microversion: 2.91 time: 0.175876 Oct 18 16:21:58.335610 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2480/4945] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:58 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1938 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:58.374290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:58.375621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:58.386695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.388580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.389233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.390114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.390723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.391384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.422104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:58.424975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:58.453841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.454792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.455418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.456409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.460569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.461928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.485798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lazy-loading 'flavor' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:21:58.568864 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c57b0523-6ed2-4b6f-98cb-2fadfdf0267c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151712 Oct 18 16:21:58.579325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2481/4946] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:58 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:58.875295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:58.877423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:58.888823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.891086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.894707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.896036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.905896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.907131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.092946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01117a1f-dd7a-4f67-91d0-5546cf41acec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action" status: 202 len: 0 microversion: 2.91 time: 0.725898 Oct 18 16:21:59.094953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2466/4947] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:21:58 2022] POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:21:59.101912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:59.103571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:59.113237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.114394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.115065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.116010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.116747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.117383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.412117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.422751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.442069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.444929 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9df34a6-fdb5-42d1-ad4e-adef758620d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.569651 Oct 18 16:21:59.446811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.450989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a839577-fd7a-4616-91a9-850c0a9d2b1b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.352470 Oct 18 16:21:59.464163 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2482/4948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:58 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:59.468949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2467/4949] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:59 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:59.491224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:59.492740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:59.520309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.521635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.521635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.522018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.522663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.523424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.585717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:59.588913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:59.614236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.617517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.617992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.618742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.621447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.622763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.629377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:59.685658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2de98896-70d4-478e-a64c-4e70a04f519c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103691 Oct 18 16:21:59.692656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.698641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2468/4950] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:21:59 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:21:59.713705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.730694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:59.751913 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13871d5c-a525-4651-8bc1-19605b816707 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.285789 Oct 18 16:21:59.755587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2483/4951] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:21:59 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:21:59.901031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-795786102", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1e93acb-d640-4312-86d3-85e2d5485813"}], "security_groups": [{"name": "tempest-securitygroup--516757081"}], "key_name": "tempest-keypair-1675343564", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:00.093736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] validate_networks() for [('b1e93acb-d640-4312-86d3-85e2d5485813', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:22:00.490986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:00.493766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:00.516681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.530159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.531300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.532780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.534246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.535267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.811959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:22:00.812491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:22:00.812851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:22:00.813288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:22:00.813819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:22:00.828950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.829487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.829926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.841927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.846010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.846010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.886178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:22:00.894484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:00.906027 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b45738c-117d-4948-8146-730c94b6d65f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.427329 Oct 18 16:22:00.917300 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2484/4952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:00 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:00.917528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for user 08b0514cd6004596969d5d5caf689179 and project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:22:00.917651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:00.917651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:00.927568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.945189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:22:00.947998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.948694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.949867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.950850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.951468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.951591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:22:01.070271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e87dc29-9de1-4c73-824e-d72fe2c99a98 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.179999 Oct 18 16:22:01.072041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2469/4953] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:21:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:22:01.081179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:01.087983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.102173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.102681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.103182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.103963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.105583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.108716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.159593 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e1f60b6-71ec-4eea-b7d5-e06fbdbe58a1 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086319 Oct 18 16:22:01.160265 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2470/4954] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:22:01 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:22:01.168726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:01.169169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.176782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.176976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.177419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.178120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.178771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.179663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.302280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.316947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.318775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.340128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e10d20a-720f-4d21-9b93-62dd24088ecb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.176813 Oct 18 16:22:01.342321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2471/4955] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:01 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:01.348631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ce6a7a9-cf73-46fb-8502-a100515b9f54 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:01.350873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ce6a7a9-cf73-46fb-8502-a100515b9f54 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.366564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:01.407096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.421286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.423129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.426305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c874568b-5a5f-4db4-93fb-503a388ed957 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1745 microversion: 2.20 time: 0.518018 Oct 18 16:22:01.429669 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2485/4956] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:00 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1745 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:01.443417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:01.452176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.470340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9ce6a7a9-cf73-46fb-8502-a100515b9f54 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:01.477595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.478231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.478754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.479559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.480107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.481399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.484589 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ce6a7a9-cf73-46fb-8502-a100515b9f54 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1237 microversion: 2.1 time: 0.141318 Oct 18 16:22:01.488318 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2472/4957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:01 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:01.582505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Cannot 'reboot' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action HTTP/1.1 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 28 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: {"reboot": {"type": "HARD"}} Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: exception: Cannot 'reboot' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '2a032d9f-0294-4fc2-9c24-be424e104d0c', 'body': {'reboot': {'type': 'HARD'}}} Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:22:01.584245 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.589936 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.593541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 409 to user: Cannot 'reboot' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:01.594646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ada4b5b-14e8-4154-9564-ed515c240bef tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action" status: 409 len: 145 microversion: 2.1 time: 0.162686 Oct 18 16:22:01.595248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2486/4958] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:22:01 2022] POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action => generated 145 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:22:01.606438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:01.609597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.625737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.626392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.627413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.630166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.631519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.632534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.671936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Cannot 'rebuild' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action HTTP/1.1 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 65 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: exception: Cannot 'rebuild' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2a032d9f-0294-4fc2-9c24-be424e104d0c', 'body': {'rebuild': {'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce'}}} Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:01.675313 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued Oct 18 16:22:01.678968 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:01.681588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 409 to user: Cannot 'rebuild' instance 2a032d9f-0294-4fc2-9c24-be424e104d0c while it is in vm_state rescued {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:01.683946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e8b5863-d52f-4b14-a16a-cbef9c16ff6e tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action" status: 409 len: 146 microversion: 2.1 time: 0.081114 Oct 18 16:22:01.685368 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2473/4959] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:22:01 2022] POST /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c/action => generated 146 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:22:01.696224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:01.696707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.712876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.715890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.716564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.717437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.719400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.721448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.807557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:22:01.932759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:01.933614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:01.949720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.950387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.951106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.952034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.954580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.956279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.025904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51d25733-a922-4b3c-ba57-1c68164ba000 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 204 len: 0 microversion: 2.1 time: 0.334296 Oct 18 16:22:02.026874 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2487/4960] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:01 2022] DELETE /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:02.036220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:02.037287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:02.047506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.048346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.049027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.074840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.078650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.082147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.283392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.295020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-367fa943-51f4-4c8f-890b-0a568ce5d6e6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.366860 Oct 18 16:22:02.295994 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2474/4961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:01 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:02.380765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.394424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:02.401193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:02.417600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38e97a1c-116c-4467-87de-6151f31747f8 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1687 microversion: 2.1 time: 0.384913 Oct 18 16:22:02.423597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2488/4962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:02 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1687 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:02.425155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.425892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.426495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.427559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.428261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.428851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.459521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:02.460601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:02.473252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.473752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.483796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.486119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.493217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.494500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.614829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.639030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.641092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.655383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66d6744c-4985-4e35-a419-ba2d1014b4c6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.279175 Oct 18 16:22:02.657380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2475/4963] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:02 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:02.665165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:02.670215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:02.691650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.692363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.692935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.693834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:02.694447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:02.694979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:02.838365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.860822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.868581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:02.871821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a7d2c73f-2070-4344-852b-f8efb83e94f8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1745 microversion: 2.20 time: 0.415061 Oct 18 16:22:02.872778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2489/4964] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:02 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1745 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:03.276284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.291426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b49cba7b-cae8-452f-af16-3ab1304ece64 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1241 microversion: 2.1 time: 0.632688 Oct 18 16:22:03.299697 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2476/4965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:02 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1241 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:03.323733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:03.325035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:03.335947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.342187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.342187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.342187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.342563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.343064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.460389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:03.479414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:03.499776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.500706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.501405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.502389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.503924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.504611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.585845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.597469 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72343615-aa27-41c6-8e86-ed80da14b0c9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.278348 Oct 18 16:22:03.598069 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2490/4966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:03 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:03.689995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:03.693465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:03.701639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.702606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.703270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.704224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.704886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.705907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.783038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.797234 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2b4bef3-7407-4962-8418-13dd96d2759f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1687 microversion: 2.1 time: 0.352763 Oct 18 16:22:03.798021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2477/4967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:03 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1687 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:03.804805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.816811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.818475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:03.821827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:03.831858 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-288715ea-98fc-4283-b6de-d9304c78287d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.145622 Oct 18 16:22:03.835381 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2491/4968] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:03 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:03.901453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:03.902004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:03.916192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.916609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.917087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:03.923375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:03.923880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:03.924720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.212797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:04.232644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:04.234462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:04.235968 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bfa13b1c-958f-47b3-ba5f-7bc2198837b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1745 microversion: 2.20 time: 0.338921 Oct 18 16:22:04.236552 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2478/4969] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:03 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1745 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:04.323458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:04.324835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:04.332379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.333018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.333563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.334367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.335052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.335678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.461689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:04.476684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6dd2e94-547a-43c2-a731-09ccf1e1982b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1241 microversion: 2.1 time: 0.156287 Oct 18 16:22:04.477566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2492/4970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:04 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:04.627301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:04.628510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:04.649736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.650592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.651256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.652222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.653183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.653840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.826032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:04.826670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:04.844712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.845485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.846123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:04.847018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:04.847639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:04.848227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.057220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.089598 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8928bb0c-67d3-4de8-ac46-1ed74ff1dbcb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.462109 Oct 18 16:22:05.100014 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2479/4971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:04 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:05.100014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:05.100014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:05.127754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.130713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.131180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.134210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.134911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.137627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.172182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.182342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:05.188228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f44f8b1c-7894-466e-9dae-26f6733bcc0d tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1687 microversion: 2.1 time: 0.366410 Oct 18 16:22:05.208019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2493/4972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:04 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1687 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:05.272505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:05.273178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:05.303991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.304680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.308072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.312636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.316087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.316918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.352774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.363190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.370467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.377843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-60b23c62-8924-48d4-b13f-a2243e0589ab tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.285237 Oct 18 16:22:05.393521 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2480/4973] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:05 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:05.490089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:05.503549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:05.504191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:05.521500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.522260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.522903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.524023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:05.524680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:05.525376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:05.583485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.601310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.603153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:05.614521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23e0fbcc-fb4a-4c05-9755-0cf58e773c42 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1745 microversion: 2.20 time: 0.355160 Oct 18 16:22:05.617577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2494/4974] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:05 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1745 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:05.978738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:06.008297 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff16eb33-13f1-4cc3-b68f-68b5ea9d4885 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1233 microversion: 2.1 time: 0.508468 Oct 18 16:22:06.014558 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2481/4975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:05 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1233 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:06.118801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:06.120002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:06.154751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.158863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.159953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.161674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.162621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.163342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.214853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:06.216568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:06.237120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.238030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.240458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.241672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.243124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.243816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.676200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:06.705789 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11cb6a21-9d1c-4492-b8ad-f771044eec95 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.593560 Oct 18 16:22:06.719121 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2495/4976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:06 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:06.736644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:06.738048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:06.754852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.755503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.756179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.759861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.760377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.760832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.795717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:06.823545 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-add51ee7-a221-48f6-bf3e-32dae2f0ccb7 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1687 microversion: 2.1 time: 0.605085 Oct 18 16:22:06.825601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2482/4977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:06 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1687 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:06.837400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:06.838283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:06.850517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.856008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.858721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:06.865346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:06.873502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:06.875348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:07.068241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:07.090471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:07.094468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:07.117890 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae2ae45a-c73c-4e31-9c34-da54dad0073d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.396711 Oct 18 16:22:07.118513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2496/4978] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:06 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:07.139557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:07.143757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:07.195301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:07.198830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:07.204005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:07.205154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:07.210607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:07.212937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:07.509367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:07.529806 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85dd3265-c722-4ce9-b122-51d96ef32365 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1297 microversion: 2.1 time: 0.399162 Oct 18 16:22:07.533788 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2497/4979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:07 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1297 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:08.020195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f", "name": "network-vif-plugged", "status": "completed", "tag": "d1ba357e-6506-4541-9eaf-eb87da2535bc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:08.036302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.036706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.037318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.056770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] Creating event network-vif-plugged:d1ba357e-6506-4541-9eaf-eb87da2535bc for instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f on n-h1-858383-14 Oct 18 16:22:08.067987 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c6ea9ca5-719c-4d4c-876f-ea6ca8a2a1eb req-99d29a97-f657-4466-80b3-537bfc1f3ada service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401049 Oct 18 16:22:08.079577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2498/4980] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:08.091016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:08.091678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:08.099126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.099545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.102889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.103716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.104195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.104631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.214670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.252596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.255201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.257464 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e030c51-3eb5-4a9f-978b-6053486f6f99 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 1.429862 Oct 18 16:22:08.258949 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2483/4981] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:06 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:08.267717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:08.273414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:08.302514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.303377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.306252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.307294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.307995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.309401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.475725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.491295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-41089ddc-c5a0-4404-af3d-71bb723ae721 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.410233 Oct 18 16:22:08.492215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2499/4982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:08 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:08.504916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:08.505819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:08.530126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.530772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.537034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.537834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.538326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.538771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.783659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.803952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.805451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:08.821439 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73bae5f1-6394-460b-949f-5a227be6758f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.324166 Oct 18 16:22:08.822998 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2500/4983] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:08 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:08.862681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:08.865132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:08.889732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.890246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.890698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:08.891440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:08.891901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:08.892334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:09.165663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:09.175277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f34793a4-d540-4f3b-94a7-a78dac8d8a9f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1620 microversion: 2.1 time: 0.912079 Oct 18 16:22:09.179481 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2484/4984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:08 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1620 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:09.288977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:09.289555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:09.315416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:09.315917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:09.316359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:09.324925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:09.325793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:09.327009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:09.638367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:09.654342 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36532f21-07ca-4b62-bb06-9d1ee75cb0ac tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1295 microversion: 2.1 time: 0.829893 Oct 18 16:22:09.655866 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2501/4985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:08 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1295 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:09.669484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:09.697055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:09.729713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:09.749883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:09.751806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:09.754467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:09.757979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:09.764414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.040775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.050870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.072230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.081149 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69e4b113-8592-4941-a1a9-ce46ef51c06d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.794829 Oct 18 16:22:10.087219 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2485/4986] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:09 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:10.129156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b81207-45cd-44fb-abb4-b7faeb7002ad", "name": "network-vif-deleted", "tag": "d56f83b3-d59b-426e-898b-3e291bf18a52"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:10.181700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.190447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6fe91b5-9cca-42f3-a30f-f6d7f2c876e5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1315 microversion: 2.1 time: 0.528361 Oct 18 16:22:10.191209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2502/4987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:09 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:10.196125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:10.196919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:10.205544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.206349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.208986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.208986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.208986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.209289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.217180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.217798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.218252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.260240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] Creating event network-vif-deleted:d56f83b3-d59b-426e-898b-3e291bf18a52 for instance c7b81207-45cd-44fb-abb4-b7faeb7002ad on n-h2-858383-14 Oct 18 16:22:10.309694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6b2494bc-2f18-40cd-b763-0863f96ba889 req-c6c8b1e4-15db-4859-8b38-af85fd0f6903 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215970 Oct 18 16:22:10.311215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2486/4988] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:10.322002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "name": "network-vif-plugged", "status": "completed", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:10.366092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.375163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.376382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.387507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.402031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.410397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.414326 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] Creating event network-vif-plugged:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:22:10.422003 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dde0ce95-345e-494b-a737-4e39da18d574 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.229495 Oct 18 16:22:10.423992 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9f9b0ab1-5336-4235-a288-11d73cd3b3f4 req-a7a70638-6fd2-49c7-bfb7-94bce2d81de7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111203 Oct 18 16:22:10.425709 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2503/4989] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:10 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:10.427255 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2487/4990] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:10.430872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:10.431845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:10.439758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.440574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.441272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.443113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.443836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.444597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.543563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.564517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.565427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.566547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lazy-loading 'fault' on Instance uuid c7b81207-45cd-44fb-abb4-b7faeb7002ad {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:22:10.679565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:10.681694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.686329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:10.696635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4d335e7-9e9c-4717-a1bc-f077eea5f3b4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 200 len: 1335 microversion: 2.1 time: 0.269688 Oct 18 16:22:10.709194 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2504/4991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:10 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:10.726928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.729904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.733766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.739281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:10.740160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:10.741876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:10.760878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:10.874355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:10.968295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:10.981352 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f27f97c-b3fc-44d2-9cd5-28a0f585e81b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1295 microversion: 2.1 time: 0.304343 Oct 18 16:22:10.982053 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2488/4992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:10 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1295 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:11.113805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:11.114424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:11.134362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.142518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.157455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.158851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.159727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.160561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.219188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:11.219882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:11.229815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.233521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.236385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.240787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.241540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.244527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.480934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:11.519340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.539859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.543184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.545094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c1b0396-280a-46eb-b454-9ee50a489b89 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.436135 Oct 18 16:22:11.546942 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2505/4993] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:11 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:11.560192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:11.561096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:11.579104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.579932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.580598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.581572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.584008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.586635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.720462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.734355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.736064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.745154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ef3d5e7e-5682-4b64-b4b8-2d00b84974dd tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.196883 Oct 18 16:22:11.745759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2506/4994] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:11 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:11.774642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:11.775544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: c7b81207-45cd-44fb-abb4-b7faeb7002ad] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:11.785348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.786760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.787447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.789043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:11.789692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:11.790281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:11.810068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad HTTP/1.1 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c7b81207-45cd-44fb-abb4-b7faeb7002ad'} Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:11.812173 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. Oct 18 16:22:11.816197 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:11.818771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 404 to user: Instance c7b81207-45cd-44fb-abb4-b7faeb7002ad could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:11.820223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc2d2596-d79a-44f1-ae08-a5c83ddbe624 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad" status: 404 len: 111 microversion: 2.1 time: 0.056295 Oct 18 16:22:11.821390 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2507/4995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:11 2022] GET /compute/v2.1/servers/c7b81207-45cd-44fb-abb4-b7faeb7002ad => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:11.830573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ec9824f-d193-4302-b17a-00fa32bfd7f3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '.version_select at 0x7f5fd21920d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:11.890055 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ec9824f-d193-4302-b17a-00fa32bfd7f3 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725496763" status: 202 len: 0 microversion: 2.1 time: 0.063496 Oct 18 16:22:11.903515 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2508/4996] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:22:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725496763 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:22:11.948129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:11.967011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80fa80da-8477-43d0-9c9b-aaa4f9537295 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1502 microversion: 2.1 time: 0.751991 Oct 18 16:22:11.980207 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2489/4997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:11 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1502 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:12.007545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:12.008426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:12.044601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.048194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.056322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:12.064200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.070245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.070732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:12.305868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:12.330644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60349b6b-8377-40dc-9f1f-f8fe69cda76d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1295 microversion: 2.1 time: 0.328125 Oct 18 16:22:12.337678 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2509/4998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:12 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1295 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:12.577751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:12.579019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:12.622177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.627239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.627850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:12.633880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.642118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.643256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:12.799073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:12.810294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:12.872133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.873172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.874077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:12.878494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:12.883617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:12.890232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:13.482906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:13.498255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:13.501451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:13.549824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6160fc35-3901-4265-bd91-816f6ff91536 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.774864 Oct 18 16:22:13.562129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2510/4999] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:12 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:13.571341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:13.584878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:13.621645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:13.622713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:13.626896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:13.628151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:13.628906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:13.629635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:14.320757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:14.352432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:14.360381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:14.367983 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39edbe5d-0e00-4c17-baaa-38f90097571f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 1.796306 Oct 18 16:22:14.375234 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2490/5000] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:12 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:14.586837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:14.587460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:14.603707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:14.614850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:14.615359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:14.615809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:14.639359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:14.643933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:14.644548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:14.646521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1a6d17e-99b3-463f-ac30-3a4868e120c1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 1.082587 Oct 18 16:22:14.664180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2511/5001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:13 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:14.756397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:14.757345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:14.794440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:14.795405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:14.797586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:14.804046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:14.805034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:14.806277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:14.907675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:14.915177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1683b63-f366-4a25-aca5-fa5237044791 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/ips" status: 200 len: 150 microversion: 2.1 time: 0.168125 Oct 18 16:22:14.957473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2512/5002] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:22:14 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/ips => generated 150 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:15.363423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.384253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.399376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.411949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:15.412578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:15.444039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:15.446273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbbf936c-4105-44f8-9781-ec2343b561e4 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.862664 Oct 18 16:22:15.447811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:15.451722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2491/5003] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:14 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:15.465214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:15.466774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:15.467591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:15.473616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:15.699503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:15.702434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:15.722737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:15.734761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:15.736776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:15.738059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:15.739672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:15.740383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:15.898984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.924152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.932361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:15.940606 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fbea292-01c9-468f-b0b4-919e5478d7cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.533253 Oct 18 16:22:15.958126 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2513/5004] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:15 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:16.479732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:16.480544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:16.481476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:16.497026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:16.499152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:16.499793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:16.511282 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbd9c997-0fe9-4ae7-b3cd-26cec6075963 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.816736 Oct 18 16:22:16.519737 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2492/5005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:15 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:16.537158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:16.537750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:16.538211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:16.702962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:16.729962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:16.732527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:16.791586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15fbdfea-16b7-40e1-9e51-6a18850efb44 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.315570 Oct 18 16:22:16.796482 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2514/5006] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:16 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:16.977550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:16.978957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:17.028422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.031954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.034180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.040532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.043550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.044500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.181408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65db2e51-c050-498f-a68b-edd60f921aa2"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:17.187041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:17.248908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.256615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.259658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.260588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.265136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.265775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.696244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:17.714416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:17.717481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:17.719029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9a3bbe6-a2ff-4452-a88a-b28f558971d5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.750192 Oct 18 16:22:17.720101 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2493/5007] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:16 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:17.726195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:17.727052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:17.775227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.775749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.776377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.777997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:17.783828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:17.785231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:17.995413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-349542ac-a3df-47d3-8f1c-5685d6ea4a12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818302 Oct 18 16:22:18.017475 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2515/5008] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:22:17 2022] POST /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:18.041026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:18.057519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:18.120473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:18.121580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:18.122029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:18.122730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:18.135392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:18.135850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:18.138372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:18.151477 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd14fa5b-2a81-4ee5-9620-10dd2e82e385 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.430038 Oct 18 16:22:18.152200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2494/5009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:17 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:18.395183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:18.412951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:18.417344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:18.433416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5cca4f0-fee1-4acd-81a7-f1f4cc606f43 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.412752 Oct 18 16:22:18.437399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2516/5010] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:18 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:18.527971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e5c2d1-8e68-4a2a-9937-274a2ba7db84", "tag": "7453ff4a-5274-491e-ae6d-6583bc6a72a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:18.556786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:18.557362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:18.557781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:18.608589 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] Creating event network-changed:7453ff4a-5274-491e-ae6d-6583bc6a72a3 for instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 on n-h2-858383-14 Oct 18 16:22:18.617078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fed18a01-0d19-4787-b59d-78a0de2af81d req-d91a8e30-5bac-4037-a895-7cffdb4389e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093499 Oct 18 16:22:18.625344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2495/5011] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:18.750133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:18.751558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:18.765646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1369142794", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8b6d5875-5bce-4f4c-8d1f-8f265fde7dcf"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:18.782738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:18.783242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:18.783694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:18.784420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:18.784888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:18.785349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:18.957742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] validate_networks() for [('8b6d5875-5bce-4f4c-8d1f-8f265fde7dcf', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:22:19.500652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:19.520716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:19.524370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:19.530340 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b578a89-fe82-405a-8d97-908695a8f8c8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.781592 Oct 18 16:22:19.541183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2496/5012] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:18 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:19.553907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:19.553907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:19.579794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:19.580427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:19.580919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:19.581742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:19.582556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:19.583006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:19.954257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:19.968468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e70d4794-f259-4178-9eaf-95394ac95f3a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.435906 Oct 18 16:22:19.970942 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2497/5013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:19 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:19.979635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:19.981717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:19.999776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.007825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.008574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.009567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.010180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.017715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.114568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:22:20.117765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:22:20.119408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:22:20.121459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:22:20.122458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:22:20.199527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.206211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.208147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.210049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.211127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:20.212469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.216270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.234718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:20.237509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:20.243731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66ac84d5-4c52-469e-aab2-4d7b6a7e50b6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.268039 Oct 18 16:22:20.244748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2498/5014] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:19 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:20.268830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88365e69-201f-47c8-ba6c-e01e9f6ddec9"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:20.271639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:20.284003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.285022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.286167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.287045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.288170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.289974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.305453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Getting quotas for project 9599b689baf44de59137f3412a88577f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:22:20.320467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Getting quotas for user 04835125a13745349ea6709f44f0cebf and project 9599b689baf44de59137f3412a88577f. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:22:20.347794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:22:20.350453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:22:20.469618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-753e4c67-a0e6-4eed-9f2e-9f68fc233926 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830095 Oct 18 16:22:20.472071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2517/5015] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:22:20.500534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-370e2cd3-a6bd-45af-b66a-e58ec7b77efe tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:20.504300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-370e2cd3-a6bd-45af-b66a-e58ec7b77efe tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:20.716319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-370e2cd3-a6bd-45af-b66a-e58ec7b77efe tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:20.728917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-370e2cd3-a6bd-45af-b66a-e58ec7b77efe tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1228 microversion: 2.1 time: 0.238318 Oct 18 16:22:20.731367 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2518/5016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:20 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1228 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:20.746681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:20.753817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:20.778475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.781759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.784908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:20.788892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:20.791787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:20.792356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.080956 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61047e9e-8c94-4616-abfe-69b31710c566 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834012 Oct 18 16:22:21.082254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2499/5017] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:22:20 2022] POST /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:21.114818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:21.120662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:21.143362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.144173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.144793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.146740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.147898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.149400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.265956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.279908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.308564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.318495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f39c8d2e-8d3a-498b-b1d0-5560b44921ad tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.586033 Oct 18 16:22:21.323242 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2519/5018] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:20 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:21.341010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:21.364430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:21.413976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.414774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.418800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.423595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.427131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.430271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.470432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.479898 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ddbf208-805f-4a54-bceb-cceefad6cbf1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.396223 Oct 18 16:22:21.485865 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2500/5019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:21 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:21.609701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.619922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.622458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:21.630764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a98577b3-c33b-4fc1-8630-56181af2b553 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.302464 Oct 18 16:22:21.632086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2520/5020] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:21 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:21.776215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:21.776917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:21.801943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.803279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.803728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:21.811654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:21.812138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:21.812578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:22.076032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:22.095602 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2dc6b033-c121-411a-b1c2-7ae4728a1b83 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1232 microversion: 2.1 time: 0.326544 Oct 18 16:22:22.099337 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2501/5021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:21 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1232 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:22.356894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:22.359383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:22.406163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:22.410383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:22.412766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:22.420320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:22.425074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:22.426075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:22.516042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:22.516935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:22.524160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:22.524454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:22.524933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:22.525620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:22.539371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:22.540001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:23.054796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.068829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.078690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.081896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd34ee26-f16d-473a-8505-f73a1a3dcac4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.731414 Oct 18 16:22:23.088498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2521/5022] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:22 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:23.105645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:23.112137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:23.139888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:23.142101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:23.149228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:23.151931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:23.152956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:23.153830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:23.274264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.325077 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e44e4bc-72a2-497b-8e36-d45204eceb9d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.810341 Oct 18 16:22:23.333572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2502/5023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:22 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:23.348777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.364742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.371354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:23.379315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:23.379548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:23.385026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:23.392149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-403ddaa9-b40b-4301-ac80-fcd1d802bd89 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.300327 Oct 18 16:22:23.393465 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2522/5024] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:23 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:23.437205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:23.438042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:23.440962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:23.447318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:23.448193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:23.448840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.139316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:24.140116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:24.156889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.162192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.164644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.166599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.170918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.174600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.206515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:24.234673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b28541c6-1588-46b4-b81e-3203697535d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1288 microversion: 2.1 time: 0.882180 Oct 18 16:22:24.245239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2503/5025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:23 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1288 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:24.364699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:24.365926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:24.386894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.390856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.391370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.392118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.398757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.400637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.437278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:24.779231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:24.805586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:24.818833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:24.822389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce5d0fe9-5e28-4624-95e7-fd5455968911 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.688297 Oct 18 16:22:24.825782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2523/5026] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:24 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:24.836819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:24.841320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:24.857311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.858337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.859054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:24.861645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:24.864459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:24.865227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:25.032506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:25.045545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:25.055783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:25.087641 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24e536d4-53ab-417a-ba71-3ff5bf2cffbc tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.255793 Oct 18 16:22:25.088858 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2524/5027] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:24 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:25.093174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:25.103247 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-773b1309-2d53-4d1c-97b1-fb6565d78fc3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.744870 Oct 18 16:22:25.109915 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2504/5028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:24 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:25.280731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:25.281763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:25.298802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:25.303237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:25.304085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:25.305105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:25.306427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:25.307201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:25.470840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:25.483835 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66fad9e6-2507-49cd-baef-af6d29db0794 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1286 microversion: 2.1 time: 0.207733 Oct 18 16:22:25.487453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2525/5029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:25 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:25.877915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:25.878739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:25.906689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:25.908073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:25.909752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:25.910964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:25.911684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:25.912386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.144777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:26.149063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:26.165146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.170578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.171048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.171814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.181223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.181764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.291341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.306935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.310906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.315103 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e58b3a6-cdca-4952-bbe1-cb368baaea5e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.443518 Oct 18 16:22:26.336720 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2505/5030] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:25 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:26.352306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:26.355957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:26.372104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.379706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.380549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.381547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.383911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.386583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.544770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.569276 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51586857-8a2a-4308-822c-27d4fe3eba58 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.433183 Oct 18 16:22:26.570250 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2526/5031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:26 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:26.574866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.586352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:26.590141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.598992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.600234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:26.607825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.609145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.610248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.611599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:26.612770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:26.613987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:26.618450 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d60dd2b2-1d52-4921-b760-ebdddafc14d1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.280085 Oct 18 16:22:26.619437 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2506/5032] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:26 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:26.751276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:26.778307 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca2c3f2f-48e8-450e-97b4-7045b32012c1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1286 microversion: 2.1 time: 0.206659 Oct 18 16:22:26.779278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2527/5033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:26 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:27.343622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e5c2d1-8e68-4a2a-9937-274a2ba7db84", "name": "network-vif-plugged", "status": "completed", "tag": "7453ff4a-5274-491e-ae6d-6583bc6a72a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:27.349119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:27.349951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:27.366602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.368774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.369565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.371628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.372422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.374200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.387928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.395959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.396591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.463307 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] Creating event network-vif-plugged:7453ff4a-5274-491e-ae6d-6583bc6a72a3 for instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 on n-h2-858383-14 Oct 18 16:22:27.487121 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9225da31-c9af-416c-bdda-896591d95815 req-70d4ae85-ef3c-43c6-b085-6de2722eff90 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148015 Oct 18 16:22:27.488287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2507/5034] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:27.584178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.595565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:27.596405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:27.598568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.601672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.603197 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84324cff-1520-429a-98cf-da9fd13ec89d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.259255 Oct 18 16:22:27.603943 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2528/5035] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:27 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:27.623332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.624226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.624929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.625922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.626597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.627237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.655692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:27.656321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:27.675029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.675559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.676012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.682483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.687078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.687549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.824549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.832298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:27.843580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.851026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:27.866671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ae77cfc-3fbb-4732-8a30-3e7f483cf232 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.220610 Oct 18 16:22:27.879116 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2529/5036] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:27 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:27.884474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:27.885422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:27.903241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.904015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.904616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:27.905560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:27.908342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:27.908963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:28.122912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:28.132237 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7aa6f244-4ede-432c-a5a7-7ff0d41f9511 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.251742 Oct 18 16:22:28.142198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2530/5037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:27 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:28.205121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:28.217528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5707fb41-d0c6-45b1-ba5d-b76c8b1d089e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.622944 Oct 18 16:22:28.218495 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2508/5038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:27 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:28.635218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:28.636438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:28.657261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:28.664065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:28.664732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:28.674741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:28.682582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:28.684355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:28.878056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:28.890165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:28.892087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:28.893915 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6245bd57-5919-4644-bc25-100e6e7c1463 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.262840 Oct 18 16:22:28.909132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:28.909706 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2531/5039] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:28 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:28.910517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:28.926241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b7561-2440-43c4-85cd-99a89507e066", "tag": "895541ad-45b7-4322-b0d1-d42f78df72bd"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:28.927100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:28.927797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:28.936169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:28.946697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:28.947457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:28.948084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:28.967433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:28.980908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:28.987580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.013357 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] Creating event network-changed:895541ad-45b7-4322-b0d1-d42f78df72bd for instance 5d3b7561-2440-43c4-85cd-99a89507e066 on n-h1-858383-14 Oct 18 16:22:29.022826 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e6207c46-27ae-4213-9663-fe20578fd4d0 req-5b5056b6-9baa-4f04-8497-b099c800b066 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100955 Oct 18 16:22:29.033837 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2532/5040] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:29.123240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:29.142846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:29.144360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:29.155239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:29.156479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:29.186008 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f337c38d-cf35-41eb-bbfe-86976c9d219b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.281489 Oct 18 16:22:29.186612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2509/5041] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:28 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:29.186908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.188383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.189095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.190031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.190650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.191251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.248044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:29.249218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:29.267223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.267993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.268625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.269590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.270251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.271549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.433686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:29.444734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96430e78-b300-40dc-9b68-d3b749c3208a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.293684 Oct 18 16:22:29.446021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2533/5042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:29 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:29.796702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:29.806432 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbad6ac7-9774-423c-b62f-9b8abd0593ba tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1362 microversion: 2.1 time: 0.566316 Oct 18 16:22:29.811702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2510/5043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:29 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:29.933508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:29.942420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:29.985988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.986916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.987982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:29.989919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:29.990464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:29.991101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.205158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.217476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.218881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:30.219364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.219588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:30.220395 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa77164f-462f-4287-9b03-6327b84e8e41 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.296785 Oct 18 16:22:30.232916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.233659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.234724 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2534/5044] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:29 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:30.235618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.236519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.239058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.239722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.337803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.357239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.358982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.367062 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cf09145-8530-47ff-b9f9-e10f243b6b0e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.152784 Oct 18 16:22:30.381543 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2511/5045] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:30 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:30.475604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:30.476534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:30.479276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:30.492082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.498040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.499043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.500423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.501392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.504816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.722109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:30.732448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:30.741590 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba56a935-df36-465f-9d2f-44c01985ac8c tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.270083 Oct 18 16:22:30.755187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2535/5046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:30 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:30.847227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:30.850353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:30.862174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.863032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.864029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:30.865163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:30.866735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:30.867377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.072438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.083778 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b20ac696-f4e3-46d6-9cb9-1b201aa40643 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1549 microversion: 2.1 time: 0.244682 Oct 18 16:22:31.101045 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2512/5047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:30 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:31.116206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:31.117470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:31.133388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.134003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.138172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.139281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.139763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.140195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.237042 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f4a6a5f-9e1f-4cd4-98fd-fb6c3d645851 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123625 Oct 18 16:22:31.237042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2536/5048] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:22:31 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:31.251750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:31.252923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:31.276277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.278280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.278931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.279859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.282892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.283523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.395974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:31.397639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:31.407066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.407820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.408751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.410722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.411405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.412007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.509647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.525825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.529881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.548292 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c0fe4af-1d2a-447b-b9b9-6082bfe1d4e8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.150028 Oct 18 16:22:31.549748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2537/5049] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:31 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:31.715568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.738880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.740396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:31.748804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-086e572b-8a68-4d3a-9d70-3187b0f05788 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.501590 Oct 18 16:22:31.750051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2513/5050] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:31 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:31.783827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:31.784455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:31.791342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.791834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.792804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:31.793880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:31.794349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:31.794788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:32.037700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:32.051213 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9745c39a-d83c-4f44-9121-62252e1add9d tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.271108 Oct 18 16:22:32.052489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2538/5051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:31 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:32.577353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:32.578728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:32.585782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:32.588317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:32.589513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:32.590378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:32.591367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:32.592079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:32.592758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:32.753334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:32.768817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:32.773310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:32.775878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:32.777238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:32.783075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c83ada3-53ae-42de-a0e0-2ed22df98b49 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.210085 Oct 18 16:22:32.784309 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2514/5052] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:32 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:32.814408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:32.815581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:32.816245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:32.818349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:32.819269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:32.819871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:33.079794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:33.081615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:33.106709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:33.117778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:33.118514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:33.119260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:33.119628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:33.120938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:33.121568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:33.130833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:33.133231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:33.134727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e75f2147-d899-493b-be6d-3e9a34fa7203 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.363537 Oct 18 16:22:33.135836 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2539/5053] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:32 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:33.560505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:33.572730 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-094b2dff-e4b5-453f-b5fb-9838ff861c74 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.496854 Oct 18 16:22:33.578289 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2515/5054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:33 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:33.819773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:33.820414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:33.849576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:33.851286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:33.852463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:33.853836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:33.854319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:33.855916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.005409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.017834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.019797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.028093 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e77dc3d7-3bd0-436e-885b-cb36a8069229 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.212044 Oct 18 16:22:34.029511 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2540/5055] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:33 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:34.082440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e5c2d1-8e68-4a2a-9937-274a2ba7db84", "tag": "7453ff4a-5274-491e-ae6d-6583bc6a72a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:34.128865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:34.128865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:34.128865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.154625 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] Creating event network-changed:7453ff4a-5274-491e-ae6d-6583bc6a72a3 for instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 on n-h2-858383-14 Oct 18 16:22:34.165669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:34.166591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:34.181599 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d8a40053-8300-492c-98d2-f1100f3c8f61 req-6ac5dbc5-7d81-4317-8033-2dc1daeae26d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103880 Oct 18 16:22:34.186880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:34.187392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:34.189614 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2516/5056] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:34.190182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.190927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:34.194099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:34.197223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.605937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:34.606652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:34.623816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:34.628174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:34.630112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.633508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:34.644800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:34.647348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:34.701685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.718769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.731059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:34.736308 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc298541-cee3-415f-9b05-100b0edd6786 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.575497 Oct 18 16:22:34.738441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2541/5057] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:34 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:35.059690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:35.060353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:35.076737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:35.077253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:35.077701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:35.078402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:35.078856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:35.079278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:35.126280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:35.135314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b5e2b94-0e6f-4046-aa1d-2ee51920f4da tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.534626 Oct 18 16:22:35.149381 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2517/5058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:34 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:35.194635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:35.209753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:35.221165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:35.226959 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ccf72cee-df5b-49c0-b906-ccf76bb22fb1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.171853 Oct 18 16:22:35.246919 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2542/5059] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:35 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:35.774037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:35.774669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:35.785492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:35.786059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:35.786509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:35.787228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:35.787692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:35.788217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:36.162645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:36.163992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:36.184184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:36.187541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:36.190400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:36.191426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:36.193247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:36.193935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:36.258922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.306088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.309281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.326695 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-996f48fb-8c94-4f81-89f4-f614beb3d9fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1740 microversion: 2.20 time: 0.557966 Oct 18 16:22:36.327215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2518/5060] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:35 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1740 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:36.331983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:36.337772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:36.367569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:36.368365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:36.369022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:36.369944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:36.372499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:36.376467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:36.549715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.558545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f725ae95-6704-4699-8adc-a4046dfb3bd8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.399959 Oct 18 16:22:36.565329 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2543/5061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:36 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:36.601821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.620931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.622931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:36.642719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ec3139c-12ee-48f3-8aad-8c7237a0a9e3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.314267 Oct 18 16:22:36.649193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2519/5062] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:36 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:37.353295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:37.355739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:37.364625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.365154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.365595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.366325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.366776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.367266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.530462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.539853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.541329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.544040 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31fd7f90-eaf0-4a2d-8dd3-e6372a297ea6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1722 microversion: 2.20 time: 0.195440 Oct 18 16:22:37.545712 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2544/5063] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:37 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:37.582003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:37.583218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:37.592231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.592706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.593297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.593925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.594480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.594785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.682215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:37.683302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:37.692703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.693488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.694126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.695368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:37.695985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:37.696572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:37.823381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.840317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.842689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:37.849611 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd67b03a-d470-42f6-b8c5-a5558492dcae tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1558 microversion: 2.91 time: 0.171225 Oct 18 16:22:37.850728 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2545/5064] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:37 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:38.130390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:38.144219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c58ed362-2898-427e-90c2-356b7aba0aa0 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.565902 Oct 18 16:22:38.145172 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2520/5065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:37 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:38.163673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:38.164542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:38.173982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.174709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.175342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.176214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.176838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.177465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.205793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:22:38.246536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:38.325514 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3884c726-b97e-4ddb-87bb-c5b62dc8eca4 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 204 len: 0 microversion: 2.1 time: 0.184309 Oct 18 16:22:38.328315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2546/5066] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:38 2022] DELETE /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:38.336812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:38.337741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:38.347190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.348483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.349213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.350141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.350940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.352104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.450787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b7561-2440-43c4-85cd-99a89507e066", "name": "network-vif-plugged", "status": "completed", "tag": "895541ad-45b7-4322-b0d1-d42f78df72bd"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:38.493436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.496744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.497323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.523544 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] Creating event network-vif-plugged:895541ad-45b7-4322-b0d1-d42f78df72bd for instance 5d3b7561-2440-43c4-85cd-99a89507e066 on n-h1-858383-14 Oct 18 16:22:38.530338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3fd4fbb9-261f-4a1f-b86d-ef8f6ba859fa req-88bb0466-f0d4-4bf5-862d-d2c79e1467d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085856 Oct 18 16:22:38.532428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2547/5067] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:22:38.578112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:38.578880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:38.587510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.587991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.588439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.589200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.589655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.590080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.590970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:38.616638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2be8105-105e-4327-9227-16bee2cba941 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1506 microversion: 2.1 time: 0.283976 Oct 18 16:22:38.618954 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2521/5068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:38 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:38.791729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:38.803852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:38.806778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:38.810056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da48630f-a317-42cf-ad7c-eb39978601e2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1722 microversion: 2.20 time: 0.236002 Oct 18 16:22:38.811358 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2548/5069] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:38 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:38.885999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:38.887670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:38.895803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.896528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.897211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.920308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:38.920822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:38.921311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:38.947175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:39.067098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:39.084594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:39.086294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:39.092428 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dbec76b-2518-48fc-b395-bcba071c5a73 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.212610 Oct 18 16:22:39.093303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2522/5070] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:38 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:39.171712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:39.172631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:39.179587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.180314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.180924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.181819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.182615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.184039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.405352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:39.414552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-127b8264-b489-4a0c-bf48-e80ad2f2c4d8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.247447 Oct 18 16:22:39.415578 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2549/5071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:39 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:39.643951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:39.644647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:39.646798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a032d9f-0294-4fc2-9c24-be424e104d0c", "name": "network-vif-deleted", "tag": "36874c11-5d80-4d7c-9b61-aa1cc3fd9d81"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:39.652742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.653839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.654482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.655347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.655955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.656539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.658402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.659041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.659798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.674211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] Creating event network-vif-deleted:36874c11-5d80-4d7c-9b61-aa1cc3fd9d81 for instance 2a032d9f-0294-4fc2-9c24-be424e104d0c on n-h2-858383-14 Oct 18 16:22:39.683259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f66097f4-e28d-48fd-8f12-79e33e00508e req-52cf3e75-c2dd-4059-bb6c-bf2f69a90c73 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039919 Oct 18 16:22:39.684936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2550/5072] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:22:39.728589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:39.738014 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e71adc5d-0ad3-460d-bb6e-b7e184ed615f tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1464 microversion: 2.1 time: 0.098106 Oct 18 16:22:39.738587 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2523/5073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:39 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1464 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:39.841406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:39.842136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:39.849192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.849701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.850493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:39.857767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:39.858271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:39.858719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.069476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.079467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.081488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.082934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d1bbfde0-d261-4c90-ada0-68c8964f1128 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1722 microversion: 2.20 time: 0.246099 Oct 18 16:22:40.083929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2551/5074] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:39 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:40.122799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:40.123709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:40.131090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.131858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.132463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.133363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.133785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.134220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.216667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.225218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.226741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.233390 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c56f6c76-0651-4540-9283-8b179d0cc7e5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.116075 Oct 18 16:22:40.234122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2524/5075] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:40 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:40.440868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:40.441599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:40.448347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.450236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.451046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.452439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.452954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.453764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.646238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.670565 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c7a4dcc-da6f-42d2-bc24-be51948b1b2f tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1328 microversion: 2.1 time: 0.233327 Oct 18 16:22:40.674597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2552/5076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:40 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:40.763327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:40.763949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:40.770856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.771569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.772209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.773101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:40.773713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:40.774298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:40.877201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:40.888024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-426dbdf3-3ece-4bf6-aed1-9328300c4ee6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 200 len: 1293 microversion: 2.1 time: 0.129864 Oct 18 16:22:40.889582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2525/5077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:40 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:41.109970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:41.110954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.125918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.126646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.128887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.131393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.131781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.132226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.225878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:41.226393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.235812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.236332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.236770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.241486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.245190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.245873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.292241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:22:41.500493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.509398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2847a83-b6e3-41d3-aa6a-ed66ecb77c24 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 204 len: 0 microversion: 2.1 time: 0.274813 Oct 18 16:22:41.510246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2526/5078] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:41 2022] DELETE /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:41.517241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.519161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.523171 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-001d829c-cdae-4673-a080-699a851532ae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1725 microversion: 2.20 time: 0.418519 Oct 18 16:22:41.524088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:41.525736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.526215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2553/5079] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:41 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:41.537162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "name": "network-vif-unplugged", "status": "completed", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:41.543512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.544337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.544945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.546260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.548386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.549059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.564605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.565110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.565543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.595451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] Creating event network-vif-unplugged:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:22:41.607143 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-feffef51-5883-4f2f-b548-8d9693ff318d req-5b5bc40f-7dce-4a1c-8ea7-27336b1d2876 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078647 Oct 18 16:22:41.609113 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2554/5080] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:41.617165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:41.621178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.629329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.633066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.633759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.636198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.636981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.637901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.655712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.667865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.669671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.677069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7cdd6a7b-7501-4016-a3b6-dab31ead436c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.163674 Oct 18 16:22:41.678258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2527/5081] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:41 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:41.683973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24ba64e9-310e-428c-8591-a0a30ae4323e"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:41.687233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.704582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.707013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.707537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.714743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.715471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.716226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.890903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:41.901396 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7bdbbcb0-e5a1-4587-ad73-f6938f6d3776 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1554 microversion: 2.1 time: 0.290340 Oct 18 16:22:41.902439 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2555/5082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:41 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:41.912465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:41.913458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:41.920577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.921364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.922027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:41.922880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:41.923483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:41.924948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.123213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:42.136939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dba142d-316f-401d-b983-55433b6129c8 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1529 microversion: 2.1 time: 0.233019 Oct 18 16:22:42.137690 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2556/5083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:41 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1529 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:42.142505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.143555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 2a032d9f-0294-4fc2-9c24-be424e104d0c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.165162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.165685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.166139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.167440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.168212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.168861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.192387 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c HTTP/1.1 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '2a032d9f-0294-4fc2-9c24-be424e104d0c'} Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.195531 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 404 to user: Instance 2a032d9f-0294-4fc2-9c24-be424e104d0c could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:42.205568 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e1219526-32ab-4c54-9369-cc2570d597db tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c" status: 404 len: 111 microversion: 2.1 time: 0.058498 Oct 18 16:22:42.211623 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2557/5084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:42 2022] GET /compute/v2.1/servers/2a032d9f-0294-4fc2-9c24-be424e104d0c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:42.228197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.228828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.250762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.251286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.251738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.252702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.253189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.253614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.392187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db507da1-8368-4577-bbb4-8cbbe01b0401 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.712530 Oct 18 16:22:42.398861 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2528/5085] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Oct 18 16:22:41 2022] POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 188 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:22:42.398861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.398861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.409889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.413971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.419446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.420430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.421185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.421877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.483762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:22:42.537543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:42.547359 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ae2d9a3-a132-4b2a-83ec-7a7a4b9c3ff1 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1529 microversion: 2.1 time: 0.334311 Oct 18 16:22:42.561376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2558/5086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:42 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1529 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:42.666354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9609a66-ff75-4865-85ee-c4e8c8e55f2c tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 204 len: 0 microversion: 2.1 time: 0.271978 Oct 18 16:22:42.670456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2529/5087] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:42 2022] DELETE /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:42.673049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.673804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.676033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:42.676734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.684123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.684630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.685113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.685832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.686298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.686730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.687888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.688694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.689302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.690008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.690471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.690933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.710683 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] HTTP exception thrown: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Request method failure captured: Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 HTTP/1.1 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtK52e_fcKZUnb09Ux5Hhm9w-SQ-WhShmlieiG9ts4hlt0LjAB2nu4kw43pJkNcMGuGQQ4WLG4gALjmYJpGzTmxY4WjDIKTGxpTDR1xrM4ufiTCjfjjc80z9hh9RLdtg7Wb4A6LjEQ8qrjHRXUukDsS3eFGcrCmmouGeBCx-PWWebRk Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d22ddab1f1244cc1b07e9f1cd9d3ef5d Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}] Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d22ddab1f1244cc1b07e9f1cd9d3ef5d Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1806919498-project Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: f25c575f2f9444c9a02df81a363eea39 Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498-project Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5d3b7561-2440-43c4-85cd-99a89507e066'} Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:42.712269 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Returning 404 to user: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:42.717313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68d90453-a92f-437f-890b-2bc5c0a30bc8 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 404 len: 111 microversion: 2.1 time: 0.145297 Oct 18 16:22:42.719398 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2559/5088] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:42 2022] DELETE /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:22:42.724720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.725374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.733635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 16:22:42.733856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.734353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.734796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.735766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.736224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.736658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.883836 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f561b1c-9514-4a62-a055-b72c159a5905 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/action" status: 202 len: 0 microversion: 2.20 time: 0.212037 Oct 18 16:22:42.885285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2530/5089] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:22:42 2022] POST /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:42.893279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.894209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.902698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.903881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.904348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.905318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.906470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.906470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.937535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:42.947160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8bd311f-a895-4645-8b59-82c21aeb57c2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.226301 Oct 18 16:22:42.959504 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2560/5090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:42 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:42.965014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:42.965761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:42.988283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.988779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.989253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:42.995766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:42.996653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:42.997143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.005155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.030230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:43.054372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.055827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.067598 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61c3742a-e85f-4622-9e92-2d314939358f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.180624 Oct 18 16:22:43.068602 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2531/5091] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:42 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:43.074643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:43.075565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.084933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.085927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.087346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.088353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.089612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.091016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.194174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.206258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fccc212e-06f4-4111-97a8-0d31519f3578 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1529 microversion: 2.1 time: 0.245249 Oct 18 16:22:43.207138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2561/5092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:42 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1529 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:43.234359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:43.235746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.243771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.244606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.246074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.247022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.247668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.248262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.334933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.345141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.348212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.349853 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcc786f6-7009-41ed-b4b0-77607d211aa0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1751 microversion: 2.20 time: 0.279738 Oct 18 16:22:43.350682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2532/5093] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:43 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1751 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:43.363316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Action: 'update', calling method: >, body: {"server": {"name": "5d3b7561-2440-43c4-85cd-99a89507e066_new"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:43.367241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.375424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.378542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.381979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.382844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.385527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.387998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.433079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] HTTP exception thrown: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Request method failure captured: Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: request: PUT /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 HTTP/1.1 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 64 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtK52e_fcKZUnb09Ux5Hhm9w-SQ-WhShmlieiG9ts4hlt0LjAB2nu4kw43pJkNcMGuGQQ4WLG4gALjmYJpGzTmxY4WjDIKTGxpTDR1xrM4ufiTCjfjjc80z9hh9RLdtg7Wb4A6LjEQ8qrjHRXUukDsS3eFGcrCmmouGeBCx-PWWebRk Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d22ddab1f1244cc1b07e9f1cd9d3ef5d Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d22ddab1f1244cc1b07e9f1cd9d3ef5d"}]}] Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d22ddab1f1244cc1b07e9f1cd9d3ef5d Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1806919498-project Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: f25c575f2f9444c9a02df81a363eea39 Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1806919498-project Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "5d3b7561-2440-43c4-85cd-99a89507e066_new"}} Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5d3b7561-2440-43c4-85cd-99a89507e066', 'body': {'server': {'name': '5d3b7561-2440-43c4-85cd-99a89507e066_new'}}} Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:43.438578 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:43.443136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] Returning 404 to user: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:43.444728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87b1e0e3-34e0-452e-bc28-f05d116b7f79 tempest-ServersNegativeTestMultiTenantJSON-1806919498 tempest-ServersNegativeTestMultiTenantJSON-1806919498-project] 10.222.0.78 "PUT /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 404 len: 111 microversion: 2.1 time: 0.085064 Oct 18 16:22:43.453570 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2533/5094] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:22:43 2022] PUT /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:43.458693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:43.459281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.468306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.475986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.475986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.475986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.475986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.475986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.548929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:22:43.612414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:43.623933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7d6ea67-0a4c-4eee-8e5e-14ed0f087109 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1554 microversion: 2.1 time: 0.400331 Oct 18 16:22:43.625082 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2562/5095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:43 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1554 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:43.739567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f00c9d5b-f340-4913-80a8-5efe8a95f47a tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 204 len: 0 microversion: 2.1 time: 0.284168 Oct 18 16:22:43.741084 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2534/5096] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:22:43 2022] DELETE /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:22:43.749169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:43.749813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.766827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:43.790576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.791447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.795021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.796040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:43.797089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:43.798650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:43.990040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:43.991049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:43.996024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.008085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.010753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.011503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.012418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.014205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.014870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.025687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8534956e-b13d-4849-8c1c-2ec54487d8f6 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1535 microversion: 2.1 time: 0.280948 Oct 18 16:22:44.027602 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2563/5097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:43 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:44.103981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:44.104662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:44.133399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.134018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.136606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.137617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.138254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.143310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.286474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.302318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.303764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.315678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.321346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1975fd8b-97ab-454e-95fd-fd19f0291cec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.221097 Oct 18 16:22:44.322130 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2564/5098] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:44 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:44.338496 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95a222e2-a7e5-41cf-8125-79b709831aa9 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.356457 Oct 18 16:22:44.344579 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2535/5099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:43 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:44.375970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:44.376895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:44.383003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.383654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.384349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.385259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.386512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.387105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.570055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.577993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:44.587037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.588890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.590516 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0030679-b3e3-472e-9c16-414bca306667 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1751 microversion: 2.20 time: 0.218381 Oct 18 16:22:44.591827 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2565/5100] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:44 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:44.677820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:44.679804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:44.687019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.687795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.688443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.689453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:44.690089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:44.690711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:44.722783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e15bf25-ba94-418c-ab0e-9db2c0891e9b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: .version_select at 0x7f5fd18d51f0>, body: {"keypair": {"name": "tempest-keypair-1777339290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3HCTyQVyU9NKSlonu05u2ydS5QbXv5v2u0fPbFwxa+fs5yMdhcy/IhSQxlWQkRe+2pU/61VSkJRbBeT1oLtj2v6Tf2MEkp7Ym4X25/31p7Byo7Ez9FJEExmNdhE4H0Og=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:44.771545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3e15bf25-ba94-418c-ab0e-9db2c0891e9b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:22:44.782162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3e15bf25-ba94-418c-ab0e-9db2c0891e9b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:22:44.828526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e15bf25-ba94-418c-ab0e-9db2c0891e9b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109503 Oct 18 16:22:44.839582 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2566/5101] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:22:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:44.878234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:44.894569 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9da60fcc-eb1a-40c9-ad91-eede880da17b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1554 microversion: 2.1 time: 0.235636 Oct 18 16:22:44.905507 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2536/5102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:44 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:45.053351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:45.054114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.078893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.356935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:45.357592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:45.368392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.370597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.371246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.372133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.372850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.373536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.585631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:45.602862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:45.610950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:45.626353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a715f79f-c30e-41be-899c-3abbe82139b9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.273926 Oct 18 16:22:45.629521 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2537/5103] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:45 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:45.640662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:45.642655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:45.658749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.662776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.663449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.664365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.665010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.666074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.858658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:45.875064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-906f1524-e47a-4899-8f1f-c4cadd762276 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1535 microversion: 2.1 time: 0.822294 Oct 18 16:22:45.892226 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2567/5104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:45 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1535 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:45.898627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:45.903654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:45.930667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.935019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.935712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:45.936723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:45.938642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:45.940680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.301501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:46.313679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-38082f03-2358-4058-ba2d-77aaabf2c9a2 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.682804 Oct 18 16:22:46.316684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2538/5105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:45 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:46.344954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:46.345614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:46.379479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.391922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.397762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.398853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.399578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.400253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.562784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:46.573166 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5bcc00aa-3693-433e-9d77-616b139a3745 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.231609 Oct 18 16:22:46.574067 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2539/5106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:46 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:46.587672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f", "name": "network-vif-deleted", "tag": "d1ba357e-6506-4541-9eaf-eb87da2535bc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:46.617200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.625936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.626846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.656152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] Creating event network-vif-deleted:d1ba357e-6506-4541-9eaf-eb87da2535bc for instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f on n-h1-858383-14 Oct 18 16:22:46.667635 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-782294a1-f2dc-4a1f-8503-5d1b543e7cb2 req-8c652ce4-b664-4266-b7c2-2ce8421086bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084754 Oct 18 16:22:46.672661 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2540/5107] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:46.681577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:46.687986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:46.706787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.707583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.708351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.709317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.709949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.710547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.868417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:46.888763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:46.891009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:46.898800 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb067442-cf68-4d17-a4cd-1af21f9e9fd1 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.224400 Oct 18 16:22:46.899922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2541/5108] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:46 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:46.936437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:46.937453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:46.947342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.970147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.971519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:46.977020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:46.977750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:46.979109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.141951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.180883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04835125a13745349ea6709f44f0cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9599b689baf44de59137f3412a88577f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.208294 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-49e0458f-9c08-4a5b-805f-660d1f4205f4 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 200 len: 1493 microversion: 2.1 time: 0.285965 Oct 18 16:22:47.227364 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2542/5109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:46 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 1493 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:47.279263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.282694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.284133 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5093409b-d6bf-423e-ba81-6ebc67cfeb60 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 1.390301 Oct 18 16:22:47.286047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2568/5110] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:45 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:47.365138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:47.376734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:47.403364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:47.406646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:47.407199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.408025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:47.408429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:47.408908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.601771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:47.602390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:47.613514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:47.618856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:47.619534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.621232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:47.621861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:47.622476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.833883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.853656 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51e39e80-1b2a-4bd6-a423-a6e17fa8c1ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.256709 Oct 18 16:22:47.872593 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2569/5111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:47 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:47.881521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6370e14d-fed1-42dc-af35-c4a2309ddfaf", "name": "network-vif-deleted", "tag": "43212c5c-29b1-4994-b693-f8defbdd7426"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:47.910244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:47.913454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:47.914985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:47.948877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc60ef5fff74c2eab3f81450c33a4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aec8b651e6d4b89bd98c593b6e932a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:47.970636 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] Creating event network-vif-deleted:43212c5c-29b1-4994-b693-f8defbdd7426 for instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf on n-h2-858383-14 Oct 18 16:22:47.975912 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68163619-86ea-4a8b-b49d-423725b3c942 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 200 len: 1521 microversion: 2.1 time: 0.633924 Oct 18 16:22:47.982934 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2543/5112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:47 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:47.984796 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ae6b3ed8-9445-4d2c-81e3-c230b068c7ae req-040f525d-9f74-41a5-839d-b4cc3c270d33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109097 Oct 18 16:22:47.995506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2570/5113] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:48.006608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:48.009816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:48.029777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:48.046965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.050674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.051186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.052254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.056560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.058131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.236212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:48.236920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] [instance: 5d3b7561-2440-43c4-85cd-99a89507e066] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:48.251316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.252065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.252716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.253638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.254260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.264304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.306193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] HTTP exception thrown: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Request method failure captured: Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 HTTP/1.1 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtKnUeUAmawnKdNb3Kz9Z2LCupGJGr-7zWaMaoTjuls0uTAkHATNH_MKfeerfBga-Sb9WUAYh1FqbuJt4RKf947svBAa5V2eTV3D_SPFGOYu_aBiote8p-gMzt6F2VjsiLT3dBGU3osV6JgCBXiDf59k4PPOCCEebyJXGZxYtpIZeqA Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9599b689baf44de59137f3412a88577f Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1504170293 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9599b689baf44de59137f3412a88577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9599b689baf44de59137f3412a88577f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9599b689baf44de59137f3412a88577f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9599b689baf44de59137f3412a88577f"}]}] Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1504170293 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9599b689baf44de59137f3412a88577f Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1504170293 Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1504170293-project Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 04835125a13745349ea6709f44f0cebf Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1504170293-project Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5d3b7561-2440-43c4-85cd-99a89507e066'} Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:48.310012 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. Oct 18 16:22:48.313927 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:48.316276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] Returning 404 to user: Instance 5d3b7561-2440-43c4-85cd-99a89507e066 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:48.317366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a600b9f-34d3-4409-b9d4-feb28e39d899 tempest-ServersNegativeTestMultiTenantJSON-1504170293 tempest-ServersNegativeTestMultiTenantJSON-1504170293-project] 10.222.0.78 "GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066" status: 404 len: 111 microversion: 2.1 time: 0.086059 Oct 18 16:22:48.319844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2571/5114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:48 2022] GET /compute/v2.1/servers/5d3b7561-2440-43c4-85cd-99a89507e066 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:48.330598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:48.333731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:48.348251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.349129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.349790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.350700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.351499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.352125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.442773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:48.452122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:48.454726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:48.462256 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9c3cf0d-7cb4-4459-9c10-07eba10d2f88 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.477902 Oct 18 16:22:48.465322 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2544/5115] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:47 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:48.802693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b7561-2440-43c4-85cd-99a89507e066", "name": "network-vif-deleted", "tag": "895541ad-45b7-4322-b0d1-d42f78df72bd"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:48.815970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.816848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.817532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.830872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] Creating event network-vif-deleted:895541ad-45b7-4322-b0d1-d42f78df72bd for instance 5d3b7561-2440-43c4-85cd-99a89507e066 on n-h1-858383-14 Oct 18 16:22:48.836290 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f488bfe8-622d-44c5-b56d-fc68a4c55de0 req-91739d50-ffb7-484a-b2ec-7dccc3aaef86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Oct 18 16:22:48.841394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2545/5116] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:22:48.883198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:48.884325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:48.899865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.900717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.902167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:48.903156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:48.905989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:48.906716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:49.061668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.070653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.078244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.079521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ed0806b-2496-4233-b100-1046b1cc4f6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.752885 Oct 18 16:22:49.082108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2572/5117] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:48 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:49.087238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:49.088183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] [instance: 6370e14d-fed1-42dc-af35-c4a2309ddfaf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:49.099821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:49.100753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:49.101500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:49.112608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.117619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:49.122030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:49.123205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:49.161433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e013d76e-2dcd-45df-89ef-03abd4674f26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.276839 Oct 18 16:22:49.162367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2546/5118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:48 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:49.181259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] HTTP exception thrown: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Request method failure captured: Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf HTTP/1.1 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtFCJIVqIMEXnpHL8MkmExeuqfUedCiVOCSK2k_ny6nRPggEDoBWR2gCeZjjlrlA2LObrEU7g27mbf57rq9OKo_5SytbbHwYBDykn6ReAhkz-bXlmQr9q5xmDNMCJMf-XBI2CydA37Kspm9iah_fkNkhx8q-qlN0md_wPUoVAz2aBvU Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9aec8b651e6d4b89bd98c593b6e932a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9aec8b651e6d4b89bd98c593b6e932a2"}]}] Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9aec8b651e6d4b89bd98c593b6e932a2 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-257861292 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1cc60ef5fff74c2eab3f81450c33a4e7 Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-257861292-project Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6370e14d-fed1-42dc-af35-c4a2309ddfaf'} Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:49.191514 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:22:49.196814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] Returning 404 to user: Instance 6370e14d-fed1-42dc-af35-c4a2309ddfaf could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:49.199043 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f3f9f22-a480-4b0d-9a18-e298c966bbb6 tempest-ServerRescueNegativeTestJSON-257861292 tempest-ServerRescueNegativeTestJSON-257861292-project] 10.222.0.78 "GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf" status: 404 len: 111 microversion: 2.1 time: 0.115262 Oct 18 16:22:49.210006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2573/5119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:49 2022] GET /compute/v2.1/servers/6370e14d-fed1-42dc-af35-c4a2309ddfaf => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:49.500263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:49.501662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:49.512839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:49.513983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:49.514711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:49.515888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:49.517132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:49.518251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:49.698137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-693719917", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4fdb82c-83da-439d-8df3-8e5dbfce3308"}], "security_groups": [{"name": "tempest-securitygroup--682180335"}], "key_name": "tempest-keypair-1777339290", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:49.742779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.761235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.762765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:49.786078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3465917f-6b71-4372-99ee-460a01e30a5c tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.286987 Oct 18 16:22:49.786756 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2547/5120] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:49 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:50.111010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:50.116228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:50.130162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] validate_networks() for [('a4fdb82c-83da-439d-8df3-8e5dbfce3308', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:22:50.149500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.150262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.151146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:50.154211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.155129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.155732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:50.486192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:50.490618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:50.500292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:50.501766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:50.502997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff939164-5ec2-44bf-be5b-73c768372d52 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.396360 Oct 18 16:22:50.503567 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2548/5121] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:50 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:50.554145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:50.554767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:50.603242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.614072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.617860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:50.619244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.620458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.620892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:50.747992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:50.766973 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48077434-b42d-4c62-8c09-9cd5b2271ade tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.216171 Oct 18 16:22:50.768241 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2549/5122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:50 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:50.822976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:50.823601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:50.847924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.848651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.849351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:50.850269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:50.850728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:50.851156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.025563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.044687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.053370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.073391 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-975b4313-009f-4dc3-80fa-ce9ef08f229e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.253983 Oct 18 16:22:51.074728 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2550/5123] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:50 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:51.532194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:51.534223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:51.547079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.547973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.548670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.549688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.552603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.553360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.632760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:22:51.633432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:22:51.633697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:22:51.634500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:22:51.635112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:22:51.662771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.668705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.669531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.671649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.672326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.672927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.715177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:22:51.722157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:22:51.786297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:22:51.789267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:22:51.879198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.888758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.894894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:51.902989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5de56793-d0bc-4139-b8c4-e0b9b36e8e6e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.374741 Oct 18 16:22:51.904346 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2551/5124] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:51 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:22:51.918157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:51.919542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:51.926115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.926690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.927231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.928019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:51.928565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:51.936599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:51.968092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd375097-2146-4b22-839c-40917806971e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.290866 Oct 18 16:22:51.969129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2574/5125] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:22:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:22:51.981243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06b5c009-587a-4734-a98a-515c9f7b9234 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:52.001436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06b5c009-587a-4734-a98a-515c9f7b9234 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:52.123598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-06b5c009-587a-4734-a98a-515c9f7b9234 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:52.131162 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06b5c009-587a-4734-a98a-515c9f7b9234 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1241 microversion: 2.1 time: 0.154606 Oct 18 16:22:52.138784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2575/5126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:51 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:52.148773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:52.158473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:52.160480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-358e8ad2-dafe-4483-88f5-c55fd53d303c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.254971 Oct 18 16:22:52.161101 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2552/5127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:51 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:52.180509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:52.204739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:52.207604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:52.208094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:52.215834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:52.216607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:52.217296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:52.942472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:52.950748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:52.975063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:52.976670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:52.977269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:52.979373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:52.981202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:52.982285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:53.124406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.145384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.158351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.184986 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7ea5fbe-6339-46c3-b06f-fdf85b574859 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 1.041680 Oct 18 16:22:53.185659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2576/5128] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:52 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:53.204215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:53.205636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:53.226169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:53.238513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:53.239441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:53.242934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:53.245784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:53.248962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:53.251534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.278397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.293513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.295230 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be30087d-211c-4bf1-ac2f-2095aa66362a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.363867 Oct 18 16:22:53.296444 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2553/5129] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:52 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:53.309659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:53.313852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:53.325099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:53.325989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:53.326979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:53.328058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:53.330381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:53.331081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:53.445541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.456920 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a39d83d-2550-4c65-91ea-266accdf3a01 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.159219 Oct 18 16:22:53.465316 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2554/5130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:53 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:53.507133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:53.527495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a67e183-f06e-4a19-8838-b44a555ad436 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1293 microversion: 2.1 time: 0.324090 Oct 18 16:22:53.531172 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2577/5131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:53 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:54.219284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:54.220617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:54.241417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.242212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.243048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.246405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.247898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.249718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.329014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:54.329910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:54.350075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.350577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.351038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.351762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.352224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.363065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.426998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:54.446006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:54.447589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:54.464919 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de70fea7-33d4-4415-b7c4-8c52f9a422d5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.251404 Oct 18 16:22:54.482209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2555/5132] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:54 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:54.494344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:54.495580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:54.513830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.514368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.514827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.515554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.516014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.516444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.645430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:54.665479 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-abcf3723-702f-47e0-a499-6ac36808253b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.173752 Oct 18 16:22:54.680187 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2556/5133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:54 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:54.686270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:54.687211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:54.712029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.712525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.713012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.721917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:54.722747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:54.723492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:54.903132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:54.939468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-979f5310-3f27-47bc-a31d-74a471103ec1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1299 microversion: 2.1 time: 0.257890 Oct 18 16:22:54.943662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2557/5134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:54 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:55.499958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:55.501249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:55.528108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:55.533871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:55.534213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:55.534985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:55.535470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:55.535910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:55.625899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.657624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.659229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.668480 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d34ee34-90b6-4f9b-bab3-8f37f5426769 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 1.343270 Oct 18 16:22:55.673409 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2578/5135] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:54 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:55.689131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:55.689962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:55.698884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:55.700465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:55.701119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:55.702765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:55.703473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:55.704250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:55.828551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.846775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.858125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.877741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d7403aab-c6df-4643-a7b4-55742226c96d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.384159 Oct 18 16:22:55.889029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2558/5136] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:55 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:55.944398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:55.978001 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0e3ec22-fe8e-4038-aa87-35909fce00f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 200 len: 1346 microversion: 2.1 time: 0.290293 Oct 18 16:22:55.993652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:55.993652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:56.003629 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2579/5137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:55 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 1346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:56.020446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.022393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.023016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:56.024532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.029524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.030225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:56.270639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:56.281816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9d7a2f0-0e0e-4cf5-a90a-e84eb0313294 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1299 microversion: 2.1 time: 0.305044 Oct 18 16:22:56.297091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2559/5138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:55 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:22:56.698488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:56.699253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:56.726067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.729879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.731492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:56.732261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.732732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.733185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:56.923882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:56.925150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:56.942940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.951379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.953744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:56.954688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:56.956718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:56.957364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.194475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:57.222738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:57.225952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:57.246028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4210c8c7-1772-49fb-8d48-18aa793909c0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.326646 Oct 18 16:22:57.264254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2560/5139] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:56 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:57.279631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:57.286267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:57.300704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.301536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.302155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.310135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.310637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.311088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.346285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f HTTP/1.1 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f'} Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:57.348008 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98f65e1b-4859-4039-b1fd-be87ab4ee478 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 404 len: 111 microversion: 2.1 time: 0.083829 Oct 18 16:22:57.352566 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2561/5140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:57 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:57.373472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:57.375216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:57.382805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.383310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.396110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.396899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.401273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.401915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.777372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:57.788422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9544354e-ad2a-45e1-87c8-6d993dc0c03d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1299 microversion: 2.1 time: 0.437340 Oct 18 16:22:57.805235 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2562/5141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:57 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1299 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:57.820768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:57.827190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:57.848666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.849479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.849479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.850187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:57.850644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:57.851080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:57.894900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f/os-volume_attachments HTTP/1.1 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': 'f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f'} Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:22:57.896849 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df3201a6-4aa5-4b70-8497-15d14df59b4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092134 Oct 18 16:22:57.901775 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2563/5142] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:22:57 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:58.219026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.240848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.242486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.251644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e38421bd-88ec-4fa3-b0c7-4a44411cbc04 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 1.556353 Oct 18 16:22:58.255068 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2580/5143] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:56 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:58.279810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:58.280686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:58.316883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:58.317416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:58.317864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:58.318591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:58.319063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:58.319503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:58.348458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-992097897", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:58.474457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:22:58.644157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.658376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.667374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:58.673990 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-54dc6061-1725-4b1e-94d9-fd94fa128573 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.399371 Oct 18 16:22:58.689504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2564/5144] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:58 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:22:58.820577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:58.824063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:58.837088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:58.843563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:58.845210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:58.846235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:58.846926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:58.857698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:59.926458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:59.956631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f29eec4f-087f-4aca-ae04-bed347a6e4a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 1.141013 Oct 18 16:22:59.960252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2565/5145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:58 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:59.965269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:59.971126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:59.984076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:59.986848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:59.989051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:59.989980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:59.991917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:59.992619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:00.493561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:00.499162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:00.531125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:00.550637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:00.555052 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b25dace5-9960-4df7-a5c3-5832c988fd70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.593524 Oct 18 16:23:00.563872 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2566/5146] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:22:59 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:00.588821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:00.590518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:00.644275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:00.649386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:00.650009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:00.657733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:00.658250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:00.658712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:00.925040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:00.983284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:00.988430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:01.014005 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3548821-fd28-4943-933c-6afda1fd5285 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.448658 Oct 18 16:23:01.016313 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2567/5147] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:00 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:01.032190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:01.033394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:01.053656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:01.054333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:01.054923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:01.055926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:01.065847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:01.066666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:01.699600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:01.909294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:23:01.909982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:23:01.910615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:23:01.911299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:23:01.911870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:23:01.927579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:01.932211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:01.934013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:01.938829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:01.939496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:01.942967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:01.995193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:23:02.003796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:23:02.038737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:23:02.053136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:23:02.156792 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eda1fb3a-d3d6-418b-8b0a-fa9113f45e7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.813088 Oct 18 16:23:02.173479 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2581/5148] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:23:02.185555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:02.186092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:02.202170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:02.202741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:02.203196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:02.203929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:02.204385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:02.204816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:02.618461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:02.628712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c4930ece-1299-4cd7-a309-e1682cb58f53 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 1.601816 Oct 18 16:23:02.639341 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2568/5149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:01 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:02.651736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:02.652744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:02.663461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:02.666352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:02.667225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:02.668414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:02.671676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:02.673368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:02.886911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:02.907618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:02.911256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:02.921770 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c587ede-2755-4e5b-baca-5820787e8ab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.280914 Oct 18 16:23:02.923578 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2569/5150] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:02 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:02.943625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3435e672-d7db-4f8b-910e-bbf21d1edf8a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:02.944628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3435e672-d7db-4f8b-910e-bbf21d1edf8a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:03.030003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:03.039203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:03.040655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:03.042429 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ade955a-0b65-46ee-8eec-25812d95ef31 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.867863 Oct 18 16:23:03.043006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2582/5151] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:02 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:03.080836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3435e672-d7db-4f8b-910e-bbf21d1edf8a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:03.093515 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3435e672-d7db-4f8b-910e-bbf21d1edf8a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862" status: 200 len: 1214 microversion: 2.1 time: 0.155590 Oct 18 16:23:03.094517 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2570/5152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:02 2022] GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:03.121524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2001e5b4-1329-4654-a21c-b98f56625a0c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:03.122025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2001e5b4-1329-4654-a21c-b98f56625a0c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:03.173238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2001e5b4-1329-4654-a21c-b98f56625a0c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:23:03.662123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:03.663201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:03.672259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:03.673520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:03.674217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:03.675193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:03.675900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:03.676593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:03.887352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.scheduler.client.report [None req-2001e5b4-1329-4654-a21c-b98f56625a0c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Deleted allocations for instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 Oct 18 16:23:03.908066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:03.918208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2001e5b4-1329-4654-a21c-b98f56625a0c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862" status: 204 len: 0 microversion: 2.1 time: 0.801010 Oct 18 16:23:03.932261 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2583/5153] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:23:03 2022] DELETE /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:03.954232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:03.958003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:03.966989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:03.969512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:03.973701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:03.974737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:03.975366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:03.975971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:04.013106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 HTTP/1.1 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c045ccb7-6eb6-45ee-bcce-f335f2f61862'} Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:04.030545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:23:04.036047 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:04.045966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:04.047122 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5aec301c-a230-4cfa-b049-e73d6c20244b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862" status: 404 len: 111 microversion: 2.1 time: 0.112904 Oct 18 16:23:04.057574 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2584/5154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:03 2022] GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:04.085829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:04.086755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:04.111539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:04.123164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:04.126738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:04.128696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:04.130780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:04.134317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:04.140105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:04.153902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa8a97ec-ceab-4a53-9443-38a341d0e07e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.495770 Oct 18 16:23:04.155860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2571/5155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:03 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:04.165345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:04.169460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:04.179953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:04.183733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:04.191683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:04.193513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:04.197247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:04.199112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:04.317435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:04.331221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:04.333413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:04.342039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-237e9165-5255-4199-824a-7ba09726fda5 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.283002 Oct 18 16:23:04.343575 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2585/5156] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:04 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:04.350717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-67109514", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:04.563596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:23:05.330825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:05.354767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:05.362584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:05.367559 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e396282b-0fc0-4c7c-ac46-8d18b0190f18 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 1.210344 Oct 18 16:23:05.371260 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2572/5157] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:04 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:05.405150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644119af-a262-46f4-955f-dd2c671bf9ac", "tag": "6b87334b-6af6-487c-bdc6-7b911404c061"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:05.433281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:05.436105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:05.438505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:05.491180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] Creating event network-changed:6b87334b-6af6-487c-bdc6-7b911404c061 for instance 644119af-a262-46f4-955f-dd2c671bf9ac on n-h2-858383-14 Oct 18 16:23:05.507780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ecac11d9-ccb1-43c0-9788-4b05793e7c73 req-1cf45855-9a22-43a8-89a7-0a189bd37e5e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107867 Oct 18 16:23:05.511914 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2573/5158] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:05.527087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:05.538698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:05.546301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:05.547070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:05.556243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:05.557891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:05.559330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:05.559928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:05.971954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:05.985825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-128714fd-cf3c-4f5b-955a-ebf78763311a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.472159 Oct 18 16:23:05.986537 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2574/5159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:05 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:06.011180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:06.012042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:06.022776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.030732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.032494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.036779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.037434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.037998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.258113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.270804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.272335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.285580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d65cf073-b791-4f8c-916f-5360f19bb8f2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1553 microversion: 2.91 time: 0.286875 Oct 18 16:23:06.286108 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2575/5160] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:05 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:06.411996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:06.412642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:06.419991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.420402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.420841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.425625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.426502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.436695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.763696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:23:06.764282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:23:06.764865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:23:06.765429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:23:06.765954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:23:06.785510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.788664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.790060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.795560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:06.796430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:06.797326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:06.840423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:23:06.847296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:23:06.869912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:23:06.873452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:23:06.910459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.930446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.943948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:06.945993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ae74bea-266b-4adb-9189-ffa9b1479cb8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.538197 Oct 18 16:23:06.961020 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2576/5161] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:06 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:06.975208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12293c5e-84ff-441d-afd8-774e18cd7f4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626076 Oct 18 16:23:06.980324 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2586/5162] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:23:06.996831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bcda7586-b228-4208-87c1-3e2ec282ad0e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:07.001051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bcda7586-b228-4208-87c1-3e2ec282ad0e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:07.010472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:07.023728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:07.052722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.054491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.055940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:07.057286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.060720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.065204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:07.208397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bcda7586-b228-4208-87c1-3e2ec282ad0e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:07.217863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bcda7586-b228-4208-87c1-3e2ec282ad0e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1213 microversion: 2.1 time: 0.232757 Oct 18 16:23:07.221100 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2577/5163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:06 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:07.318023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:07.318658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:07.328421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.329415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.329415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:07.330112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.330582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.331021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:07.458915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:07.472809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6331f8f1-b7d3-4029-b570-2e5e1e391b3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.466974 Oct 18 16:23:07.473487 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2587/5164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:07 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:07.512686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:07.534859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:07.542577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:07.558944 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c922292-8396-4663-800e-c4c529f45187 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1535 microversion: 2.91 time: 0.246183 Oct 18 16:23:07.560610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2578/5165] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:07 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:07.978314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:07.979935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:07.991094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.991602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.992049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:07.992770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:07.993255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:07.993689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.226563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.250272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:08.255529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:08.263630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.269823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.272753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6a93afb-9d95-40e3-acb2-31b47bd9e5a5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 0.298466 Oct 18 16:23:08.280503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.281035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.281461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.282170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.282622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.283043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.285136 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2588/5166] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:07 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:08.376176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.396563 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e216aeb-bfb5-41ed-a184-cbad4313ef4d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1217 microversion: 2.1 time: 0.155100 Oct 18 16:23:08.397937 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2579/5167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:08 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:08.502423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:08.503261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:08.512428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.513238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.514595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.515871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.517961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.519624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.598953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:08.600165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:08.608887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.609601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.610673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.611876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:08.615902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:08.616567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:08.765172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.774600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46422455-9a4f-43ed-b135-7d02244d8a15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.281365 Oct 18 16:23:08.777752 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2589/5168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:08 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:08.808083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.817080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.818878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:08.838424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:08.844531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-57469b91-fb04-452b-81c5-0fe329eb63f0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1535 microversion: 2.91 time: 0.253925 Oct 18 16:23:08.845791 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2580/5169] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:08 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1535 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:09.328733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:09.329721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:09.347614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:09.348291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:09.349061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:09.353125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:09.354836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:09.358640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:09.374261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:09.424901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:09.426074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:09.468044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:09.472064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:09.475013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:09.478926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:09.479621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:09.482222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:09.879426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:09.893175 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93a7f0b0-e53a-45a3-8161-5b52258c8206 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1209 microversion: 2.1 time: 0.472415 Oct 18 16:23:09.909066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2581/5170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:09 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1209 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:10.115405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-544ae00c-a885-4540-a6c8-940eaaec65ee tempest-ExtensionsTest-47665505 tempest-ExtensionsTest-47665505-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:10.118218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-544ae00c-a885-4540-a6c8-940eaaec65ee tempest-ExtensionsTest-47665505 tempest-ExtensionsTest-47665505-project] 10.222.0.78 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.217192 Oct 18 16:23:10.124711 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2582/5171] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:23:09 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:10.139517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:10.145755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:10.152355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:10.153229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:10.154150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:10.155216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:10.155840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:10.156432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:10.551014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.577372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-453e4e8c-f6b5-4026-b5ed-e4d381401cc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.451004 Oct 18 16:23:10.581766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2583/5172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:10 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:10.600252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:10.601157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:10.638320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:10.638828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:10.641389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:10.642193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:10.643864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:10.647029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:10.863093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.873304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.892725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.897911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.903241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9051aebb-7014-485e-b0dc-3bc07ffc487d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1753 microversion: 2.20 time: 1.595088 Oct 18 16:23:10.909335 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2590/5173] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:09 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1753 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:10.911139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.913613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:10.921337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d625ba0e-419d-4d4e-ae78-057d49f33942 tempest-ExtensionsTest-47665505 tempest-ExtensionsTest-47665505-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:10.924695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d625ba0e-419d-4d4e-ae78-057d49f33942 tempest-ExtensionsTest-47665505 tempest-ExtensionsTest-47665505-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013367 Oct 18 16:23:10.927336 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2591/5174] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:23:10 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:23:10.941471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7176ed6a-00d7-476f-8b65-f9e3fc9f5f8b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1478 microversion: 2.91 time: 0.356649 Oct 18 16:23:10.971551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2584/5175] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:10 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1478 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:10.976746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:10.983257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:11.006460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:11.014598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.016365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.019309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.020409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.021880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:11.023010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.025385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.060853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.061911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.062704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.073609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.074363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.075019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.221777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-14". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 16:23:11.312178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:11.362152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa0b242c-6f4e-413b-9b8b-04e0d50651f8 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action" status: 202 len: 0 microversion: 2.91 time: 0.365824 Oct 18 16:23:11.367741 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2585/5176] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:23:10 2022] POST /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:11.388113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:11.388762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:11.399527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:11.412435 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5da11cbf-55b3-433e-be32-c86a2fa49d05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1273 microversion: 2.1 time: 0.474771 Oct 18 16:23:11.415056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2592/5177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:10 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:11.417240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.419135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.419706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.422156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.422650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.424137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.606797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:11.608047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:11.634944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.638602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.639268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:11.640667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:11.642356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:11.644839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.085829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.100210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.110639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.131553 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d518a8d-c578-4d39-ba87-6a94bf4e21ca tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1486 microversion: 2.91 time: 0.759367 Oct 18 16:23:12.134481 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2586/5178] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:11 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1486 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:12.146321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644119af-a262-46f4-955f-dd2c671bf9ac", "name": "network-vif-plugged", "status": "completed", "tag": "6b87334b-6af6-487c-bdc6-7b911404c061"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:12.172154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:12.173309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:12.174371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.196214 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] Creating event network-vif-plugged:6b87334b-6af6-487c-bdc6-7b911404c061 for instance 644119af-a262-46f4-955f-dd2c671bf9ac on n-h2-858383-14 Oct 18 16:23:12.205818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-88f28cc6-04c6-44ca-80b3-74c4b074a4d4 req-f354871a-a37f-4cbc-bfce-bb51678ac523 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068822 Oct 18 16:23:12.208358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2587/5179] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:12.218000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:12.219775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:12.233413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:12.234085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:12.234744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.236029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:12.236661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:12.237292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.396008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.408056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-450e2608-80d7-4de0-80c4-f52021ff914b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.806703 Oct 18 16:23:12.409332 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2593/5180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:11 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:12.444244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:12.445077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:12.452622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:12.453693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:12.454306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.455332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:12.455969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:12.456562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:12.601237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.619453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.621170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.622477 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f843afc-1a2e-491f-8e71-879f7aa5bf3b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.413175 Oct 18 16:23:12.623348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2588/5181] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:12 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:12.690686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:12.700820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec38249e-516e-4a43-903e-36ef80baec21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1271 microversion: 2.1 time: 0.262126 Oct 18 16:23:12.702243 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2594/5182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:12 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:13.169225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:13.170411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:13.195175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.195591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.196038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.196818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.197390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.204287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.391683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:13.410886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:13.412350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:13.425973 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa63d3b4-885b-40f0-9589-adaf75793a08 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.262233 Oct 18 16:23:13.440161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:13.441443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2589/5183] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:13 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:13.442265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:13.458422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.464531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.465363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.466507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.467359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.468021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.652234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:13.653152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:13.666044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.666782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.670154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.671088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.671717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.672296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.911033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:13.924888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b4a4ed81-e7d1-4877-a293-0cd9338fbc31 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1366 microversion: 2.1 time: 0.493543 Oct 18 16:23:13.944499 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2595/5184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:13 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:13.955041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:13.959577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:13.975845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.979499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.980186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.981146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:13.982268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:13.984289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:13.986195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:13.998237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.000446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.003684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81f4bbdb-52b6-4d90-8282-62929835eb1d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.355565 Oct 18 16:23:14.024646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2590/5185] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:13 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:14.208074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.234442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2251e230-5458-498a-9317-162672ed50d8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.284491 Oct 18 16:23:14.252073 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2596/5186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:13 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:14.461816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:14.463239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:14.484432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:14.485472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:14.486933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:14.488199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:14.489087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:14.489801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:14.616609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.645104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.649510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:14.658457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0d1d11d-8b18-464a-8832-93b3591e2013 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.201585 Oct 18 16:23:14.660515 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2591/5187] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:14 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:14.957250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:14.958350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:14.967036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:14.968193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:14.968802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:14.969728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:14.970854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:14.971439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:14.997299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c89df31b-d608-47fe-8d7b-da8418482e75 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Action: 'create', calling method: .version_select at 0x7f5fd163c3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1376665589"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:15.369508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:15.383146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b0c278a-8370-42e1-86ba-96a28e6dd7a8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1556 microversion: 2.1 time: 0.434404 Oct 18 16:23:15.384255 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2592/5188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:14 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1556 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:15.397429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30267f7c-6b96-4670-92cf-17b744bd3a70", "tag": "eecc9d97-0dae-44e1-a516-152624241eb8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:15.427716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:15.430551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:15.432462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:15.457349 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] Creating event network-changed:eecc9d97-0dae-44e1-a516-152624241eb8 for instance 30267f7c-6b96-4670-92cf-17b744bd3a70 on n-h1-858383-14 Oct 18 16:23:15.464919 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7648fb28-7ea1-4a72-8960-a8453a298777 req-445bfc28-e828-48cc-b5ac-601e172830a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078563 Oct 18 16:23:15.466335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2593/5189] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:15.474073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:15.475045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:15.485595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:15.486715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:15.487394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:15.488322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:15.489499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:15.490764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:15.713876 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c89df31b-d608-47fe-8d7b-da8418482e75 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.006905 Oct 18 16:23:15.714648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2597/5190] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Oct 18 16:23:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 16:23:15.719774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:15.720676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:15.743893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:15.744451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:15.745464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:15.746317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:15.746786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:15.747318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:16.078549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.089314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.097033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.106927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20af47f0-52ba-4281-930f-9a92480cc294 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.636708 Oct 18 16:23:16.107833 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2594/5191] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:15 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:16.110900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.122258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf4e15e4-c018-4268-8ed6-e0fa15be4e26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.406301 Oct 18 16:23:16.123140 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2598/5192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:15 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:16.128309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:16.128823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:16.141523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:16.144521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:16.152166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:16.152666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:16.153166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:16.154059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:16.155170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:16.156142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:16.156822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:16.158015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:16.158461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:16.158836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:16.159347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:16.159857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:16.333394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.356573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bdfefd34-3820-4473-8331-6de2bd00617d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245252 Oct 18 16:23:16.357674 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2595/5193] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:23:16 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:16.362851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-485369f1-a176-4a9e-b9f4-49af9ae416ae tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd6536e50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:16.366886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.369437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:16.390369 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4fbd3906-179e-4694-ba24-8f9ec25acad7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.265792 Oct 18 16:23:16.393089 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2599/5194] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:16 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:16.457159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-485369f1-a176-4a9e-b9f4-49af9ae416ae tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 200 len: 345 microversion: 2.1 time: 0.098298 Oct 18 16:23:16.477557 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2596/5195] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:16 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:17.139204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:17.140099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:17.155422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:17.156327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:17.170010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:17.171079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=26 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:17.174847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.177274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.177930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.180462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.180904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.181367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.182182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.182877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.183485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.184231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.184693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.185157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.237180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:17.414546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.434593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.436406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.438314 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81e7d220-85c3-4de7-b902-4e4a573fbc7b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.303378 Oct 18 16:23:17.440010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2600/5196] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:17 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:17.568603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.589279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1cfdffc7-e261-48c2-bfd1-1d00566df852 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.441398 Oct 18 16:23:17.590464 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2597/5197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:17 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:17.611350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:17.613104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:17.629883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.630411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.630813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.638499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:17.638942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:17.639396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:17.663684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f61f0a04-7d16-4ecc-a4c0-5fa1175e66af tempest-ComputeTenantNetworksTest-576309183 tempest-ComputeTenantNetworksTest-576309183-project] Calling method '.version_select at 0x7f5fd163c820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:17.893503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.925515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.937940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:17.956422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d1d918e-1a38-4899-8703-0e39b573bab8 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.364534 Oct 18 16:23:17.961944 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2598/5198] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:17 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:17.989384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0398ed80-1c41-4207-b3b8-3f2f5f2643dd tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd16944c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.118698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0398ed80-1c41-4207-b3b8-3f2f5f2643dd tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 200 len: 346 microversion: 2.1 time: 0.149721 Oct 18 16:23:18.119575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2599/5199] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:17 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:18.139117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b957d16-e66f-426f-988f-db4545dbe5a4 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Action: 'create', calling method: .version_select at 0x7f5fd149aca0>, body: {"snapshot": {"volume_id": "63472a4a-8df7-4493-a78b-b6bb1536b061", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-499407109"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:18.553564 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f61f0a04-7d16-4ecc-a4c0-5fa1175e66af tempest-ComputeTenantNetworksTest-576309183 tempest-ComputeTenantNetworksTest-576309183-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.111847 Oct 18 16:23:18.554429 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2601/5200] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:23:17 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:18.567308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.569087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:18.579467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:18.580557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:18.581346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:18.582747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:18.583805 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b957d16-e66f-426f-988f-db4545dbe5a4 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.454321 Oct 18 16:23:18.584362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:18.589144 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2600/5201] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 18 16:23:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:23:18.595420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbe13881-0031-4cd5-940d-43c3f7ec3c34 tempest-ComputeTenantNetworksTest-576309183 tempest-ComputeTenantNetworksTest-576309183-project] Calling method '.version_select at 0x7f5fd2196d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.597701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:18.850912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:18.878554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:18.880550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:18.881817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-45018076-5d08-4bc0-9776-7c1e1a827b2b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.326160 Oct 18 16:23:18.882385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2602/5202] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:18 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:18.896830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5cf6a3d6-9a81-4ef9-9d97-5f498f0edd05 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd1641940>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.949596 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5cf6a3d6-9a81-4ef9-9d97-5f498f0edd05 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.065583 Oct 18 16:23:18.950289 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2603/5203] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:18 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:18.957312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.958402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:18.973043 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbe13881-0031-4cd5-940d-43c3f7ec3c34 tempest-ComputeTenantNetworksTest-576309183 tempest-ComputeTenantNetworksTest-576309183-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks/65c81cc0-1c4e-469e-ab63-2ad678dcd619" status: 200 len: 140 microversion: 2.1 time: 0.386482 Oct 18 16:23:18.973824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2601/5204] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:23:18 2022] GET /compute/v2.1/os-tenant-networks/65c81cc0-1c4e-469e-ab63-2ad678dcd619 => generated 140 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:18.984606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97ef50cb-2218-4636-84ad-1636b9c09ea7 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd149ae50>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:18.995967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:18.998740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:18.999350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.000211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.002507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.004301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.091119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97ef50cb-2218-4636-84ad-1636b9c09ea7 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.116080 Oct 18 16:23:19.098619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2602/5205] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:23:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:19.102254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644119af-a262-46f4-955f-dd2c671bf9ac", "tag": "6b87334b-6af6-487c-bdc6-7b911404c061"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:19.122356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.122844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.123453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.152119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] Creating event network-changed:6b87334b-6af6-487c-bdc6-7b911404c061 for instance 644119af-a262-46f4-955f-dd2c671bf9ac on n-h2-858383-14 Oct 18 16:23:19.163934 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c8bcbba3-41cd-4b81-85b0-a274531f710f req-5299f80b-0200-4033-b71e-d8a5049bc999 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071020 Oct 18 16:23:19.169447 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2603/5206] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:19.175181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:19.180710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:19.200310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.201083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.204208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.205685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.208001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.209922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.549132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:19.559425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c26043fe-7e5a-4f92-b3af-9a902b324e2c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.607973 Oct 18 16:23:19.560220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:19.580218 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2604/5207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:18 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:19.586022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7eb0988-d7b4-468c-8604-c1f1a139de92 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd163c310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:19.591592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:19.601167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:19.609828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a293827c-d78c-4aff-a1a8-0219dc75d9d3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.437951 Oct 18 16:23:19.611070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2604/5208] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:19 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:19.639684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7eb0988-d7b4-468c-8604-c1f1a139de92 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.058273 Oct 18 16:23:19.640639 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2605/5209] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:19 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:19.910775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:19.911877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:19.927218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.928672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.929171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:19.933412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:19.933912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:19.934361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:20.218634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:20.236186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:20.241454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:20.242982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f10e296-0838-4ad3-9de4-25d6a545d148 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.337628 Oct 18 16:23:20.246627 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2605/5210] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:19 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:20.587324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:20.588619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:20.603324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:20.611281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:20.613371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:20.622640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:20.623142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:20.623774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:20.643356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:20.644576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:20.659153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:20.659986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:20.662881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:20.664917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:20.666563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:20.667818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:20.922551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:20.988445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.032027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.091492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e25c3113-3f68-40a0-85a8-5b1e882b0adb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.452442 Oct 18 16:23:21.117734 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2606/5211] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:20 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:21.133767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea3df303-996e-4ea7-8e99-2e9a573f76ba tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd653fc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:21.151739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.185009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b4cfce9-11b6-417a-96ad-bab8709b83f7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.602277 Oct 18 16:23:21.187522 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2606/5212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:20 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:21.275059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:21.275974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:21.297687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:21.300406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:21.302863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:21.304756 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea3df303-996e-4ea7-8e99-2e9a573f76ba tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.185210 Oct 18 16:23:21.305851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:21.311274 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2607/5213] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:21 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:21.312529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:21.319431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:21.686198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.702303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.704064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:21.705328 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-768ae797-13d3-47ae-afe3-d3ff050f3b1c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.435909 Oct 18 16:23:21.705894 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2607/5214] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:21 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:22.121038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.121645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:22.135822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.136330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.137369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.139285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.140090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.143842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.214367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.215280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:22.232065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.236049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.239329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.241652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.244544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.245068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.332710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:22.345053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:22.347733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:22.354027 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f096c3c-f1a8-462b-8aa0-107c6f76ff27 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.238004 Oct 18 16:23:22.357321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2608/5215] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:22 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:22.361331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98ffcbc0-966b-44c9-aa52-ea3399a65135 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd6536f70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.418388 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98ffcbc0-966b-44c9-aa52-ea3399a65135 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 287 microversion: 2.1 time: 0.061871 Oct 18 16:23:22.419730 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2609/5216] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:22 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:22.432781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff835f70-595f-487d-af73-1a21d1b06dd9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd215d550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.593906 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff835f70-595f-487d-af73-1a21d1b06dd9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 202 len: 0 microversion: 2.1 time: 0.166159 Oct 18 16:23:22.594526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2610/5217] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:23:22 2022] DELETE /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:23:22.604666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f08265b5-6f89-40f3-bd9d-7c9c706781a7 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd155d310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.628682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:22.644637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1318b001-d107-4e6c-891a-16c9e72deec2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.436846 Oct 18 16:23:22.645645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2608/5218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:22 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:22.679408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f08265b5-6f89-40f3-bd9d-7c9c706781a7 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.080637 Oct 18 16:23:22.679976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2611/5219] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:22 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:23:22.737873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:22.738482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:22.747676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.748428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.749067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.750664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:22.751289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:22.751963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:22.997623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.012179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.017357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.019617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d7072f2-382b-4e41-abfd-b13f4c8d2538 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.284907 Oct 18 16:23:23.031280 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2609/5220] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:22 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:23.039433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30267f7c-6b96-4670-92cf-17b744bd3a70", "name": "network-vif-plugged", "status": "completed", "tag": "eecc9d97-0dae-44e1-a516-152624241eb8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:23.071375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:23.072908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:23.073492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:23.093560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] Creating event network-vif-plugged:eecc9d97-0dae-44e1-a516-152624241eb8 for instance 30267f7c-6b96-4670-92cf-17b744bd3a70 on n-h1-858383-14 Oct 18 16:23:23.099231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a815e2dc-eb2f-4fbe-9455-cae0acceda9c req-3490ba5d-10a0-476a-bd2e-0cd3c72274f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064260 Oct 18 16:23:23.100523 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2612/5221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:23.397496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:23.398178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:23.406486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:23.412564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:23.413338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:23.414305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:23.415043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:23.417107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:23.555206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.569453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.575953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.582448 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2117d68-cd7e-4960-b9ad-2894fddff12d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.188990 Oct 18 16:23:23.593824 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2610/5222] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:23 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:23.671182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:23.671932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:23.687415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:23.688087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:23.688804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:23.689727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:23.690399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:23.691044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:23.693782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07eab353-6035-4a67-8a07-8e5f48a3a78f tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd1643310>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:23.739112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07eab353-6035-4a67-8a07-8e5f48a3a78f tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.048573 Oct 18 16:23:23.745126 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2611/5223] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:23 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:23.938239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:23.955470 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa21a985-0f3e-4e12-a2fc-c8d2ba53db16 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1313 microversion: 2.1 time: 0.289839 Oct 18 16:23:23.957979 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2613/5224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:23 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:24.055160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:24.055810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:24.073233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:24.073829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:24.074214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:24.074925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:24.075378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:24.088478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:24.240948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.245395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:24.255678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.264449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.271479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-454fa498-6987-4b20-b299-b305cc1941fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.221593 Oct 18 16:23:24.272528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2612/5225] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:24 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:24.612729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:24.613369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:24.619709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:24.620484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:24.621113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:24.623571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:24.624582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:24.625508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:24.728309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:24.752693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b5511a7-659e-4948-8f72-f22a95ea80ce tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd1643f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:24.818384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.842897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.844339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:24.858292 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b5511a7-659e-4948-8f72-f22a95ea80ce tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 200 len: 286 microversion: 2.1 time: 0.110181 Oct 18 16:23:24.860323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2613/5226] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:24 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:24.872328 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ffe8b24-01e1-4281-9ffc-2e056eec09f3 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.264086 Oct 18 16:23:24.882503 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2614/5227] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:24 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:24.985862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:24.986431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:24.998282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:24.998743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:24.999142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:24.999844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.000299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.000852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.204873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:25.233713 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5bbc5f32-4e35-4289-811e-05748932e88f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1500 microversion: 2.1 time: 0.240780 Oct 18 16:23:25.234928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2614/5228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:24 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1500 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:25.263292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:25.264646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:25.277715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.278228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.278658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.279414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.282826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.283276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.299872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:25.300490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:25.308260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.308787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.309204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.309901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.315351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.315793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.467390 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-604bcf2d-d20b-4de7-8b6b-afdd32b86baa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70/action" status: 202 len: 0 microversion: 2.1 time: 0.208532 Oct 18 16:23:25.468905 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2615/5229] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:23:25 2022] POST /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:23:25.486460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:25.487416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:25.496687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.497219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.497902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.498958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.499762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.500375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.590147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:25.608313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:25.615706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:25.620872 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5721e89c-04f6-45a8-9a78-c0e9d965075a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.324929 Oct 18 16:23:25.623667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2615/5230] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:25 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:25.743366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:25.754293 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a58e944-8b36-41c1-8e7a-98b550083411 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1505 microversion: 2.1 time: 0.274479 Oct 18 16:23:25.769393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2616/5231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:25 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:25.874693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4937dfa1-0a04-441e-b4ff-be98bdf195e5 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd1643dc0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:25.907854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:25.908773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:25.922060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.924096 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4937dfa1-0a04-441e-b4ff-be98bdf195e5 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] HTTP exception thrown: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. Oct 18 16:23:25.924732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.925313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.927778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:25.928313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4937dfa1-0a04-441e-b4ff-be98bdf195e5 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Request method failure captured: Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 HTTP/1.1 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtLyfPq3KZ9pPkC-DSeb0YAJ91F-c9znPd3GVPbDBbsiMn-bv9CuA0AlrnU9Ykhb2X-KI9uZkT3vC3SMpF16oY0SLPnMJ_BGU6o0yudCYU8OX1KuzcG1_7Pli7ItBRG0SjXTuJQaH0wLFw4Nd3FELJIF7LCGpx6bS3lKJWsWnmcAK-w Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}] Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: fadd33c078ae49d9956ada671d731b99 Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: exception: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a76d6987-b6e7-41d6-856e-e78cc11154b4'} Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. (HTTP 404) (Request-ID: req-ac26dcf2-6dec-4434-9962-a218ccde9e5d) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:23:25.934288 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. Oct 18 16:23:25.938533 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:25.944200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4937dfa1-0a04-441e-b4ff-be98bdf195e5 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Returning 404 to user: Snapshot a76d6987-b6e7-41d6-856e-e78cc11154b4 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:25.946186 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4937dfa1-0a04-441e-b4ff-be98bdf195e5 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4" status: 404 len: 111 microversion: 2.1 time: 0.078194 Oct 18 16:23:25.950792 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2616/5232] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:23:25 2022] GET /compute/v2.1/os-snapshots/a76d6987-b6e7-41d6-856e-e78cc11154b4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:25.951791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:25.964100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-330feb68-db52-4902-9452-7e37af3c1662 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd169bf70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:26.142108 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-330feb68-db52-4902-9452-7e37af3c1662 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 202 len: 0 microversion: 2.1 time: 0.187042 Oct 18 16:23:26.147063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:26.148496 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2617/5233] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:23:25 2022] DELETE /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:23:26.164488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de750d70-7229-41f0-9788-47a1e9c05704 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd201c0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:26.185069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:26.197519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:26.205902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72f2667d-f230-497c-a69c-0862fa3ef734 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.302243 Oct 18 16:23:26.207740 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2617/5234] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:25 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:26.295467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de750d70-7229-41f0-9788-47a1e9c05704 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 200 len: 345 microversion: 2.1 time: 0.141886 Oct 18 16:23:26.303511 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2618/5235] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:26 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:26.667579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:26.682089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:26.731401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:26.734462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:26.736352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:26.739428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:26.740254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:26.744803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:26.783335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:26.784337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:26.793389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:26.798207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:26.798910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:26.799876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:26.802091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:26.809685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.047907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.074632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.085566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.087136 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd2bd377-2325-49dc-9f24-856a9c43a8c9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.442279 Oct 18 16:23:27.087777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2618/5236] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:26 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:27.132964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.144626 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdb6a238-6104-4228-b8fe-dff2d86ab8e1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1485 microversion: 2.1 time: 0.369602 Oct 18 16:23:27.145834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2619/5237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:26 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1485 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:27.175981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:27.177036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:27.190090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.190624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.191678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.196815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.197407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.197912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.244469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:23:27.247782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:27.248402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:27.257761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.258263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.258713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.267175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.267727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.268186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.398318 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e1eb1b4-31df-428b-8bf4-62be90ea9e5d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 204 len: 0 microversion: 2.1 time: 0.224289 Oct 18 16:23:27.403147 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2619/5238] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:23:27 2022] DELETE /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:27.420503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24213a52-aacb-4587-a223-d58ebe43eb5f tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd24aa9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:27.428765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.438790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.448892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.460286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7dfa613-aaf1-4c61-8b86-d92012ff117d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.217077 Oct 18 16:23:27.462699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2620/5239] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:27 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:27.483067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:27.486040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:27.504484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.505180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.505627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.507926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:27.508498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:27.509022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:27.576220 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24213a52-aacb-4587-a223-d58ebe43eb5f tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 200 len: 345 microversion: 2.1 time: 0.170660 Oct 18 16:23:27.583671 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2620/5240] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:27 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:27.749034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:27.762486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67dbb13c-bebe-4659-9862-dbdc11157a61 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1491 microversion: 2.1 time: 0.294110 Oct 18 16:23:27.789144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2621/5241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:27 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1491 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:28.123691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:28.126143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:28.137578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.138096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.138833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:28.139724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.140892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.142678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:28.471017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.483582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.486481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.488127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc462818-0886-4db4-a076-e4cdf228e9cf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.372718 Oct 18 16:23:28.489051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2621/5242] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:28 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:28.495919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:28.497340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:28.506875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.507845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.509241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:28.510707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.511708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.512531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:28.593123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f9ff8c9-30a9-45e0-8098-10e9022e450c tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd149a5e0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:28.707537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.713855 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f9ff8c9-30a9-45e0-8098-10e9022e450c tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 200 len: 345 microversion: 2.1 time: 0.125745 Oct 18 16:23:28.714516 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2622/5243] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:28 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:28.731278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.734194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:28.741948 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fbc83a9c-a5ed-4824-a192-d1089f5b74cb tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.250765 Oct 18 16:23:28.744869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2622/5244] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:28 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:28.788595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:28.790886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:28.810135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.812107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.814250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:28.815736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:28.820817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:28.821641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:29.246898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:29.258585 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c943f0ab-abec-4c6f-b955-65a31e7fefdb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1491 microversion: 2.1 time: 0.473913 Oct 18 16:23:29.263499 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2623/5245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:28 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1491 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:29.523099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:29.525679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:29.548850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:29.549590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:29.550180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:29.551384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:29.555451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:29.556682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:29.728037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb641ee9-d225-470a-af21-8a2f6f04e61b tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd2105b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:29.787938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-fb641ee9-d225-470a-af21-8a2f6f04e61b tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] HTTP exception thrown: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb641ee9-d225-470a-af21-8a2f6f04e61b tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Request method failure captured: Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 HTTP/1.1 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtLyfPq3KZ9pPkC-DSeb0YAJ91F-c9znPd3GVPbDBbsiMn-bv9CuA0AlrnU9Ykhb2X-KI9uZkT3vC3SMpF16oY0SLPnMJ_BGU6o0yudCYU8OX1KuzcG1_7Pli7ItBRG0SjXTuJQaH0wLFw4Nd3FELJIF7LCGpx6bS3lKJWsWnmcAK-w Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}] Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: fadd33c078ae49d9956ada671d731b99 Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: exception: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '63472a4a-8df7-4493-a78b-b6bb1536b061'} Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. (HTTP 404) (Request-ID: req-325f08af-4055-48de-a01c-70ca72694aad) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:23:29.790809 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.795680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb641ee9-d225-470a-af21-8a2f6f04e61b tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Returning 404 to user: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:29.799110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb641ee9-d225-470a-af21-8a2f6f04e61b tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 404 len: 109 microversion: 2.1 time: 0.073083 Oct 18 16:23:29.799692 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2624/5246] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:29 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:29.809434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:29.818260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:29.858202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:29.860770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:29.865161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:29.868914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:29.871793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:29.873660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:29.875074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:29.875386 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b1d7e0b-54cc-4202-a575-46461b5b657a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.364649 Oct 18 16:23:29.877041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:29.877766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:29.886198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2623/5247] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:29 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:29.901328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f815f197-ee95-4526-baac-ffd3fa2831f9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd1652820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:29.935746 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f815f197-ee95-4526-baac-ffd3fa2831f9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] HTTP exception thrown: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f815f197-ee95-4526-baac-ffd3fa2831f9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Request method failure captured: Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 HTTP/1.1 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtLyfPq3KZ9pPkC-DSeb0YAJ91F-c9znPd3GVPbDBbsiMn-bv9CuA0AlrnU9Ykhb2X-KI9uZkT3vC3SMpF16oY0SLPnMJ_BGU6o0yudCYU8OX1KuzcG1_7Pli7ItBRG0SjXTuJQaH0wLFw4Nd3FELJIF7LCGpx6bS3lKJWsWnmcAK-w Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}] Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: fadd33c078ae49d9956ada671d731b99 Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '63472a4a-8df7-4493-a78b-b6bb1536b061'} Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. (HTTP 404) (Request-ID: req-0f8ee826-0be1-4eb6-a25e-b810b2eb7c72) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:23:29.938008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:29.942554 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:29.948002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f815f197-ee95-4526-baac-ffd3fa2831f9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Returning 404 to user: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:29.949160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f815f197-ee95-4526-baac-ffd3fa2831f9 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 404 len: 109 microversion: 2.1 time: 0.052550 Oct 18 16:23:29.950182 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2624/5248] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:23:29 2022] DELETE /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:29.958450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28e2d954-4935-4b53-995a-0171e0183856 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Calling method '.version_select at 0x7f5fd173c9d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:30.000488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-28e2d954-4935-4b53-995a-0171e0183856 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] HTTP exception thrown: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28e2d954-4935-4b53-995a-0171e0183856 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Request method failure captured: Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 HTTP/1.1 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtLyfPq3KZ9pPkC-DSeb0YAJ91F-c9znPd3GVPbDBbsiMn-bv9CuA0AlrnU9Ykhb2X-KI9uZkT3vC3SMpF16oY0SLPnMJ_BGU6o0yudCYU8OX1KuzcG1_7Pli7ItBRG0SjXTuJQaH0wLFw4Nd3FELJIF7LCGpx6bS3lKJWsWnmcAK-w Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1548b1d53a040f29ba41ddb37f1497f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1548b1d53a040f29ba41ddb37f1497f"}]}] Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: e1548b1d53a040f29ba41ddb37f1497f Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185581043 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: fadd33c078ae49d9956ada671d731b99 Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185581043-project Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '63472a4a-8df7-4493-a78b-b6bb1536b061'} Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. (HTTP 404) (Request-ID: req-289c980e-7507-4ec8-b4d8-44956b660dc3) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:23:30.002995 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. Oct 18 16:23:30.007878 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:30.015501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28e2d954-4935-4b53-995a-0171e0183856 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] Returning 404 to user: Volume 63472a4a-8df7-4493-a78b-b6bb1536b061 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:30.016057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28e2d954-4935-4b53-995a-0171e0183856 tempest-VolumesSnapshotsTestJSON-1185581043 tempest-VolumesSnapshotsTestJSON-1185581043-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061" status: 404 len: 109 microversion: 2.1 time: 0.061366 Oct 18 16:23:30.017160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2625/5249] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:23:29 2022] GET /compute/v2.1/os-volumes/63472a4a-8df7-4493-a78b-b6bb1536b061 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:23:30.171319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:30.189352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:30.194384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:30.209830 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2baf3d5-c42b-45ee-a5c1-f081aa4a5803 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.408060 Oct 18 16:23:30.212397 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2625/5250] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:29 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:30.249537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30267f7c-6b96-4670-92cf-17b744bd3a70", "name": "network-vif-deleted", "tag": "eecc9d97-0dae-44e1-a516-152624241eb8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:30.266828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:30.267619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:30.268414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:30.288376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:30.290619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:30.304267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:30.310308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:30.312742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:30.314856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:30.315329 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] Creating event network-vif-deleted:eecc9d97-0dae-44e1-a516-152624241eb8 for instance 30267f7c-6b96-4670-92cf-17b744bd3a70 on n-h1-858383-14 Oct 18 16:23:30.315983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:30.319785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:30.334862 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c414e570-8d16-4d0b-bbfb-c03ea3df892c req-eb438a30-c8c0-4a31-86cd-e6c1c0d5711e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092707 Oct 18 16:23:30.342293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2626/5251] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:23:30.466485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:30.480119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48cc91be-12a7-4df9-82af-43af1af563a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 200 len: 1283 microversion: 2.1 time: 0.198874 Oct 18 16:23:30.500145 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2626/5252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:30 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 1283 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:30.908962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:30.909693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:30.938905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:30.939352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:30.939802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:30.945606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:30.946212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:30.946785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:31.242824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:31.243654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:31.250306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:31.266095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:31.266754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:31.267215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:31.268572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:31.269082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:31.269526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:31.470022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.480317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.482249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.483630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88c007d2-ed12-495e-b67d-e54b809ceeec tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.580968 Oct 18 16:23:31.484708 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2627/5253] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:30 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:31.504043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:31.504337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.504847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:31.527365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.528744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:31.529960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:31.530469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:31.530945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:31.531853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:31.532740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:31.543176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:31.575118 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6433a9f3-94b1-49fe-95a2-015f6d668842 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.336143 Oct 18 16:23:31.575725 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2627/5254] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:31 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:31.595146 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 HTTP/1.1 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '30267f7c-6b96-4670-92cf-17b744bd3a70'} Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:31.597431 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:23:31.602495 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:31.605490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:31.607778 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07da38d6-2365-460c-83c4-5999b65e9477 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 404 len: 111 microversion: 2.1 time: 0.107850 Oct 18 16:23:31.612276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2628/5255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:31 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:23:32.009800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1572925643", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:32.516739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:32.517466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:32.529575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:32.530059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:32.532060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:32.539166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:32.542523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:32.543457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:32.938837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:32.960200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:32.962445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:32.963804 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c5053f5-a60e-401a-b91a-8b223206e03f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.451716 Oct 18 16:23:32.981788 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2629/5256] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:32 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:32.986917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:32.988195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:33.006799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:33.007345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:33.007846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:33.009219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:33.009695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:33.010226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:33.106587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:33.117031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:33.120017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:33.127410 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-646cdf5a-71bd-4484-9b6f-5eae7abfbdb0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.144940 Oct 18 16:23:33.128256 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2630/5257] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:32 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:33.993696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:34.000274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:34.016975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:34.018636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:34.019081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:34.021652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:34.022822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:34.024265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:34.326394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.340238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.344774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.353057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f61d58d8-3772-4c17-ae07-fae28c96db93 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.363507 Oct 18 16:23:34.354311 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2631/5258] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:33 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:34.377946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:34.380252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:34.388230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:34.400948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:34.403168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:34.404003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:34.407076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:34.407737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:34.410978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:34.583452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.602111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.606559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:34.639930 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c6aa9d5-31e1-4427-8fa5-e84357c80b06 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.278286 Oct 18 16:23:34.661017 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2632/5259] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:34 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:35.379899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:35.381400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:35.392116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:35.393159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:35.396725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:35.399257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:35.402227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:35.403212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:35.724404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.741127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.743981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.745366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-320afba1-5be0-4246-a28e-9b065b25897b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.369283 Oct 18 16:23:35.761930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2633/5260] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:35 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:35.771568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:35.773079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:35.781406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:35.782650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:35.783660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:35.784709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:35.785366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:35.786122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:35.887981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.897792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.900820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:35.907143 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afc672d1-cc43-4fdb-83a8-3b65b52d4e80 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.143638 Oct 18 16:23:35.919509 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2634/5261] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:35 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:36.785123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:36.787100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:36.808438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:36.812839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:36.815761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:36.818029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:36.822819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:36.828144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:37.240205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.274346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.278399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.281166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-230cbcd8-b6f9-47a9-accb-6f5882984f9c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.504284 Oct 18 16:23:37.282601 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2635/5262] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:36 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:37.290793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:37.292132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:37.302759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:37.303808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:37.305008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:37.307146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:37.308149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:37.309078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:37.390727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.394559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:37.402141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.403656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:37.409826 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6064285-7e67-403e-adbf-348d0b7533b0 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.125463 Oct 18 16:23:37.413035 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2636/5263] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:37 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:38.317440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:38.318524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:38.332196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:38.333376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:38.338026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:38.340284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:38.343406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:38.347480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:38.601925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.614996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.616842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.619163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c133ce6-be41-45a2-b03c-91fe6edd4ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.308233 Oct 18 16:23:38.630534 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2637/5264] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:38 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:38.651479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:38.653024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:38.659611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:38.660346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:38.661926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:38.669108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:23:38.675299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:38.676012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:38.676658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:38.765535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.779697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.782519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:38.788883 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6df6eee-f4e7-42f0-82dd-471c358dc1e2 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.147865 Oct 18 16:23:38.790330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2638/5265] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:38 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:39.650005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:39.651325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:39.668934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.669470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.669925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.675372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.676022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.676967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.751479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:23:39.752695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:23:39.753508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:23:39.754220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:23:39.754841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:23:39.766587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.767355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.767959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.768854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.769776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.770224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.789950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:23:39.796070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:23:39.811541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:23:39.814441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:23:39.872540 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b1226774-8ec4-44a3-957c-eb5826c0bb74 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.868400 Oct 18 16:23:39.873683 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2628/5266] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 7870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:23:39.878354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:39.879228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:39.888283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.889235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.889907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.890927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:39.891646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:39.892161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:39.951358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:39.965507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:39.967580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:39.968946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14cd3296-2abd-411e-babe-6841d07abeda tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.325618 Oct 18 16:23:39.978033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2639/5267] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:39 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:39.985955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-836df6f5-40e7-45e0-84e0-286438a0e421 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:39.986715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:39.987615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-836df6f5-40e7-45e0-84e0-286438a0e421 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:39.997233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:39.999199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:40.005438 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e13db3cc-3e53-447a-8a83-0a6a51480945 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.130619 Oct 18 16:23:40.006582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2629/5268] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:39 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:40.066545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-836df6f5-40e7-45e0-84e0-286438a0e421 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:40.074366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-836df6f5-40e7-45e0-84e0-286438a0e421 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1215 microversion: 2.1 time: 0.094820 Oct 18 16:23:40.074960 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2640/5269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:39 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:40.995939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:40.996658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:41.003663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.004534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.005271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.006195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.006857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.007488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.037077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:41.037805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:41.051964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.052462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.052927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.053648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.054116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.054545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.171483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.184834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.188949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.210914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca10a051-be94-4c7d-a312-d795ebcbdf32 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.177417 Oct 18 16:23:41.213815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2641/5270] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:41 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:41.221760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:41.223494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:41.238939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.243809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.246189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.248004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:41.248874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:41.250869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.251965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:41.268487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.272526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.280752 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4828482-2b7b-4cc9-aa7e-a3526f4fabaf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.288318 Oct 18 16:23:41.282638 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2630/5271] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:40 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:41.397406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:41.420306 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f89a6ba-3af3-4794-b2fe-efccdd9936d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1267 microversion: 2.1 time: 0.204782 Oct 18 16:23:41.423255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2642/5272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:41 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:42.246782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:42.248085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:42.255895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.256626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.257526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.258474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.259355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.260144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.318704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:42.319947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:42.334583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.335083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.337263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.338207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.340382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.341609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.379000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.392653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.396700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.421965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cfc8fd79-0ee0-4bed-9f7f-971b866f574e tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.179530 Oct 18 16:23:42.430722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2631/5273] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:42 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:42.450672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:42.451678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:42.460039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.461021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.462407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.464891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:42.466287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:42.467405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:42.477779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:42.569275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.588608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.593892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.597073 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b730cb44-012a-4165-8170-c2dfcc468dee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.282344 Oct 18 16:23:42.599012 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2643/5274] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:42 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:42.852814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:42.869665 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97294fc9-8227-4ea3-9bf7-7f895f084d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.418240 Oct 18 16:23:42.884202 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2632/5275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:42 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:43.462002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:43.462761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:43.479116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.481205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.483877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:43.487351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.487554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.489713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:43.633239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:43.633860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:43.648819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.649293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.649939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:43.651053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.651867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.652609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:43.662186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:43.676964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:43.678474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:43.693087 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf67a57c-0fb8-46d3-a728-a5bf84422fb7 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.235787 Oct 18 16:23:43.696646 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2644/5276] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:43 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:43.902556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:43.905937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:43.927958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.932852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.933675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:43.936080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:43.936677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:43.941624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:44.111683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.128335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.139210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.140723 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-923fd677-10e2-426c-9415-8d930a846e3a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.512241 Oct 18 16:23:44.142022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2633/5277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:43 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:44.175163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e31613e-3519-4a5f-aea9-c4c8d1be7fc5", "tag": "99017324-b87a-41a1-bf0c-8d0d772751d1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:44.193611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:44.198947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.204908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:44.209692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:44.217377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b297113e-8466-4e2e-a51e-aa428d0077ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.323237 Oct 18 16:23:44.218574 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2645/5278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:43 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:44.230218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] Creating event network-changed:99017324-b87a-41a1-bf0c-8d0d772751d1 for instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 on n-h1-858383-14 Oct 18 16:23:44.236780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fcdf043e-7961-497f-9ed3-67dc3ca735e5 req-2896d959-55cb-4e24-b16f-0de3d4ea8aab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068960 Oct 18 16:23:44.237908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2634/5279] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:23:44.731573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:44.732302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:44.741610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:44.742183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:44.743333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:44.744157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:44.744698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:44.745228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:44.839361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.861068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.862391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:44.870742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf93644d-961b-4eb9-97fa-20fc99b825ff tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.146086 Oct 18 16:23:44.871559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2646/5280] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:44 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:45.172284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:45.173664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:45.180709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.181525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.181973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:45.182706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.183244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.183679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:45.264949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:45.266779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:45.279865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.280475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.281220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:45.282426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.283116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.283883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:45.341625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:45.357522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:45.359232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:45.361263 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6c3a69a-3d90-49a4-a82b-a06e641d48c1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.194030 Oct 18 16:23:45.362772 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2635/5281] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:45 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:45.441936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:45.452602 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4566b18b-4316-4285-b981-c5467a340fc9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.196664 Oct 18 16:23:45.453599 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2647/5282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:45 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:45.904726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:45.906629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:45.930687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.931286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.931742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:45.932867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:45.933016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:45.937544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:46.065855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.075052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.076951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.082409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c60a1815-f5c4-4a73-ba3e-b36c1cb112a9 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.182905 Oct 18 16:23:46.083446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2636/5283] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:45 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:46.388240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:46.388861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:46.402792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:46.403848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:46.404343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:46.405232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:46.405693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:46.406422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:46.476160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:46.479380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:46.505205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:46.506152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:46.509885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:46.511074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:46.513099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:46.514164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:46.591490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.609208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.612425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.614428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7850d616-0bf2-454a-91cb-30f2e817a16d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.229937 Oct 18 16:23:46.615424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2648/5284] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:46 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:46.734764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:46.745562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9d35126-2057-4fbb-ac7f-0d366f4e3b98 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.273483 Oct 18 16:23:46.746742 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2637/5285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:46 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:47.113332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:47.114188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:47.122694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.123820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.124550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.125907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.126851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.127666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.235453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.257017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.257017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.259760 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-371086e0-ce07-4ec9-81d2-a286a0aaa512 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.150854 Oct 18 16:23:47.259945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2649/5286] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:47 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:47.643014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:47.643742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:47.653828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.654467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.654915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.655620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.656077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.656508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.769490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:47.770208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:47.781333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.781922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.782444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.783230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:47.783780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:47.784282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:47.818039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.828789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.831106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.832786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26dd4de1-29c9-45b3-9457-783af7b119e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.195053 Oct 18 16:23:47.837474 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2638/5287] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:47 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:47.980116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:47.989167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06bb2bea-6c1b-420d-b85c-fb80c9f0cd9c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.223625 Oct 18 16:23:47.989988 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2650/5288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:47 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:48.288758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:48.290554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:48.299482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:48.300473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:48.307146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:48.308144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:48.310730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:48.313566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:48.427255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:48.440257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:48.447405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:48.457735 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7294f250-a449-408d-82f5-67a6338138bf tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.174426 Oct 18 16:23:48.465697 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2639/5289] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:48 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:48.862112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:48.862735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:48.875034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:48.877183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:48.877781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:48.878639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:48.879323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:48.879912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:49.022539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:49.023209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:49.047319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:49.049727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:49.051005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:49.052930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:49.054021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:49.056273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:49.209857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.225994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.230238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.231488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2666980-7399-480b-9876-0958795fec08 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.373820 Oct 18 16:23:49.232064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2651/5290] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:48 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:49.291930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.300503 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4d22340-d464-4393-a438-6c27832393a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.281777 Oct 18 16:23:49.302330 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2640/5291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:49 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:49.494418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:49.495039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:49.526955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:49.527788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:49.531816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:49.534031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:49.536664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:49.537318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:49.707048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.726019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.729819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:49.745377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9e44116-84bd-4a06-88e1-8943d216d8ec tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1544 microversion: 2.91 time: 0.255156 Oct 18 16:23:49.759006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2652/5292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:49 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1544 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:50.264537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:50.265246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:50.274530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:50.276094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:50.279618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.280238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.281639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.282796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.285569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.286182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.329169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:50.329836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:50.338260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:50.340408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.341306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.342479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.343378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.344376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.345071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.543340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.554591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.556694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.558190 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83a2e90c-210a-4603-a4da-0d8818cbf79a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.297782 Oct 18 16:23:50.558982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2641/5293] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:50 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:50.602370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.612241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e37ea9c-131d-4b7e-a560-3bd932fd94a8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.288233 Oct 18 16:23:50.613326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2653/5294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:50 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:50.790823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:50.792300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:50.810569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.811998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.812814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.814633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.815085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.815528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.922184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.935844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.937547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:50.945246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de6a04fa-9013-4633-bdf2-ccc82b1e0b5f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1531 microversion: 2.91 time: 0.161018 Oct 18 16:23:50.946848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2642/5295] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:50 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1531 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:50.974188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:50.975136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:50.981392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.982139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.982916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:50.983959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:50.984933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:50.986122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.010369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:51.044707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31613e-3519-4a5f-aea9-c4c8d1be7fc5", "name": "network-vif-plugged", "status": "completed", "tag": "99017324-b87a-41a1-bf0c-8d0d772751d1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:51.063147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.063923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.065291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.080154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] Creating event network-vif-plugged:99017324-b87a-41a1-bf0c-8d0d772751d1 for instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 on n-h1-858383-14 Oct 18 16:23:51.080939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] Lazy-loading 'services' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:23:51.094022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-412472bd-8508-4f42-80ae-e422c358a131 req-c852bc4c-8394-41a0-9688-10b431672da6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054194 Oct 18 16:23:51.094711 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2643/5296] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:51.114054 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2aa8f0e-c4a8-4c30-a3f1-f0f4dc638651 tempest-UnshelveToHostMultiNodesTest-835105000 tempest-UnshelveToHostMultiNodesTest-835105000-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1938 microversion: 2.91 time: 0.143438 Oct 18 16:23:51.115236 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2654/5297] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:50 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1938 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:51.179944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:51.180870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:51.194095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.194742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.195272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.196794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.197452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.198032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.230823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:23:51.394862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d602f94-2418-4229-b75d-c98826531bc6 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 204 len: 0 microversion: 2.91 time: 0.220292 Oct 18 16:23:51.397038 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2644/5298] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:23:51 2022] DELETE /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:23:51.407881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:51.408978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:51.422110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.424372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.425100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.425987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.426617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.427458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.570407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.585716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:51.586979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:51.587457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.590132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.600344 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ebf44d88-2178-4fec-80d1-9168f3268b96 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.198174 Oct 18 16:23:51.601654 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2655/5299] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:51 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:51.626831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.627414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.628108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.629183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.629837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.630539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.645707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:51.646311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:51.662019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.663429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.666953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.669476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:51.670383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:51.670703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:51.858486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.870587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.873816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.875439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9272bd74-27ec-4846-a6d0-27d6f2fd7f79 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.294755 Oct 18 16:23:51.888563 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2645/5300] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:51 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:51.915191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:51.926508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c31da21d-340d-43b5-b066-544b6e0783a1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1315 microversion: 2.1 time: 0.288939 Oct 18 16:23:51.952110 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2656/5301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:51 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:23:52.632190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:52.632822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:52.649456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.650196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.651016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:52.652130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.653197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.653639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:52.786715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:52.810704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:52.813898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:52.833160 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2026e8ac-8972-4529-9c58-9568cc2b3e8f tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.204737 Oct 18 16:23:52.834071 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2646/5302] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:52 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:52.903880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:52.904488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:52.912772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.913845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.916390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:52.918482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.920961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.924289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:52.956851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:52.962819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:52.975329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.976210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.977806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:52.979181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:52.979898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:52.980752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.220149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.225570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.227338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.229247 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-866ae24a-cd5a-40c3-912c-ac9c375dcf1a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.329129 Oct 18 16:23:53.230574 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2657/5303] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:52 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:53.242071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.265200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fe1933d-2c64-4ad7-96bd-52dd32c6e4e2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1502 microversion: 2.1 time: 0.307675 Oct 18 16:23:53.265200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2647/5304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:52 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:53.290715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:53.292945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:53.310844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.314254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.315262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.317326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.318845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.319768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.372450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lazy-loading 'flavor' on Instance uuid 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:23:53.605868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-023de01e-95e6-42e6-9d06-2d1c339086da tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5/action" status: 202 len: 0 microversion: 2.1 time: 0.324814 Oct 18 16:23:53.606499 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2658/5305] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:23:53 2022] POST /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:23:53.615576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:53.616827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:53.628141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.628632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.629106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.632029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.632677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.634230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.663330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:53.840267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.849225 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb0a3af8-9226-4265-9451-2b61c145f1cf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.237574 Oct 18 16:23:53.849983 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2648/5306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:53 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:53.893996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:53.895817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:53.904484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.905221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.905320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.906022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.906482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.906913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.999266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.022015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.025676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.035267 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a553d4b9-1f16-4cda-be53-33d1081fad1b tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1537 microversion: 2.91 time: 0.148830 Oct 18 16:23:54.036334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2659/5307] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:53 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:54.257332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:54.258043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:54.265137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:54.265918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:54.266535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:54.267453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:54.268139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:54.268912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:54.481627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.495428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.497380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.499280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d886e4f4-e416-4dcd-8efe-eff9bd401b37 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.245757 Oct 18 16:23:54.521422 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2649/5308] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:54 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:54.875767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:54.876686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:54.884542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:54.885140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:54.885591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:54.886357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:54.886818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:54.887493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.069924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:55.071847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:55.088623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:55.090641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:55.094328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.096901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.102458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:55.104660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:55.106950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.111681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ac975ed-b842-4aff-9866-dbf7c33103a6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.240828 Oct 18 16:23:55.113284 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2660/5309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:54 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:55.192248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:55.192857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:55.193573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.194342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lazy-loading 'fault' on Instance uuid d1e38843-5225-4f4a-a6af-9c7030447680 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:23:55.253642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.262798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.265283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61cf7ea9fbe3487294ed6d52cfa2fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dcdad6004d0c8038949a765d259e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.275108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0de2de7-e431-400d-8984-eb30f378582d tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 200 len: 1542 microversion: 2.91 time: 0.212789 Oct 18 16:23:55.284415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2650/5310] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:55 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:55.559112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:55.560121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:55.578225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:55.580173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:55.590429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.598366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:55.599862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:55.601038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:55.845297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.861172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.862572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:55.863752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f77c0e0-0f33-4c3b-8b5d-4aa31197ca3c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.314161 Oct 18 16:23:55.864324 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2661/5311] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:55 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:23:56.138195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:56.138818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:56.147681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.148181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.148645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:56.149382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.149836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.150851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:56.319077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:56.319730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] [instance: d1e38843-5225-4f4a-a6af-9c7030447680] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:56.326685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.327396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.328019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:56.328890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.329563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.330333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:56.337103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:56.348557 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f0c9810-5edd-4ed0-937d-695143a3fc05 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.215897 Oct 18 16:23:56.365619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2651/5312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:56 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:56.383267 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] HTTP exception thrown: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Request method failure captured: Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 HTTP/1.1 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtI9XGDGjJ_dgO0kL1OilgSuOzC1RRP_bq3fUGVOWtuFtUd8smSqD04FmB3oACSeswivyEcJdytb0gaO-eCNeh_VwbhM1i3tW7A5FS2juaA-h93QavivmtClSuUNpw1glT3QvROhQIi5zQDw9SV_pmexhcdA3_kQR6dYTWYxAuP3y0o Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.91 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 2137dcdad6004d0c8038949a765d259e Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1225452296 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2137dcdad6004d0c8038949a765d259e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2137dcdad6004d0c8038949a765d259e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2137dcdad6004d0c8038949a765d259e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2137dcdad6004d0c8038949a765d259e"}]}] Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1225452296 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 2137dcdad6004d0c8038949a765d259e Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1225452296 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-UnshelveToHostMultiNodesTest-1225452296-project Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 61cf7ea9fbe3487294ed6d52cfa2fec0 Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1225452296-project Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'd1e38843-5225-4f4a-a6af-9c7030447680'} Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. Oct 18 16:23:56.385305 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. Oct 18 16:23:56.389504 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:23:56.391696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] Returning 404 to user: Instance d1e38843-5225-4f4a-a6af-9c7030447680 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:23:56.393507 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f828e8b-852f-4fce-b34a-dae7b561ea56 tempest-UnshelveToHostMultiNodesTest-1225452296 tempest-UnshelveToHostMultiNodesTest-1225452296-project] 10.222.0.78 "GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680" status: 404 len: 111 microversion: 2.91 time: 0.078412 Oct 18 16:23:56.395237 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2662/5313] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:56 2022] GET /compute/v2.1/servers/d1e38843-5225-4f4a-a6af-9c7030447680 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:23:56.891358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:56.894161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:56.898858 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:23:56.905933 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea (ip 10.222.0.78) !!! Oct 18 16:23:56.932898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.935906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.938070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:56.940918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:56.941932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:56.942950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.215649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:57.226128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:57.229283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:57.230709 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2772cc79-17a7-4981-b89c-a38346153883 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.343638 Oct 18 16:23:57.231755 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2652/5314] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:56 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:57.382159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:57.384600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:57.397357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.400525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.401334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.409979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.411626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.412087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.672568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:57.676552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:57.677137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:57.684056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.688038 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd62ddb4-73c2-4ec9-9c01-7281837c5aa6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.310767 Oct 18 16:23:57.689488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.691789 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2663/5315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:57 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:57.692182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.693028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.693511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.695928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.723631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59a7f1c9-a187-44a0-ba67-d151f863b886 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/ips" status: 200 len: 147 microversion: 2.1 time: 0.051049 Oct 18 16:23:57.724919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2653/5316] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:23:57 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/ips => generated 147 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:23:58.140318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "name": "network-vif-plugged", "status": "completed", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:58.162176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.162942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.163477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.179230 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] Creating event network-vif-plugged:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:23:58.186219 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-75b8b9be-6856-4f0f-b77e-87d3acb73544 req-aadeb469-f79b-4d6b-8caf-043988e17076 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050514 Oct 18 16:23:58.187457 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2664/5317] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:58.262960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:58.264347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:58.273751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.274589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.275367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.276186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.276871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.277553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.524653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:58.542088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:58.544836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:58.546644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c787d032-45ed-462c-9504-b399b78ff93b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.291054 Oct 18 16:23:58.547514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2654/5318] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:58 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:23:58.726404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:58.728302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:58.736225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.736717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.737350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.738516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.739134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.739849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.996382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:59.005642 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5dfe0e13-1392-4ac2-948b-141d90e72af5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.290718 Oct 18 16:23:59.006231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2665/5319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:58 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:59.574140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:59.574908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:59.583276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:59.599000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:59.599879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:59.600912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:59.602314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:59.602783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:59.870074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:59.888023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:59.893945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:59.902992 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a8aed15-a76a-4212-b189-2a21e1bed32e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.328969 Oct 18 16:23:59.907529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2655/5320] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:23:59 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:24:00.039628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:00.040765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:00.060960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.063949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.065032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:00.066547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.067551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.068573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:00.396668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:00.415003 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ca1df84-8086-4e3d-bcad-e4cb585328a9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.382217 Oct 18 16:24:00.416119 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2666/5321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:00 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:00.951965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:00.952731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:00.968636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.969517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.974094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:00.977031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.977883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.979690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.255083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:01.310858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:01.312326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:01.313586 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be91572b-0d2a-413e-9c2c-efa40681cb62 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1809 microversion: 2.20 time: 0.366496 Oct 18 16:24:01.318406 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2656/5322] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:24:00 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1809 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:24:01.322618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82f0b575-3e6b-402a-9b19-068576d50c66"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:01.334896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:01.355177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.358145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.374252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.375086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.375571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.376137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.443187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:01.444192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:01.446915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:01.463948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.465609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.466171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.467064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.468494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.469312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.689260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:01.701541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ce40768-6088-415b-9c51-d780c23dcdc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.262597 Oct 18 16:24:01.708270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2657/5323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:01 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:01.902258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-269073f4-6da0-423a-8582-bc24da81f42e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592615 Oct 18 16:24:01.903373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2667/5324] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:24:01 2022] POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:02.342133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:02.342757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:02.361080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.361562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.362190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.363085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.363743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.364548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.629032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:02.639264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:02.647529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:02.649917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de32c102-5dcc-4bc3-89b6-7b248c7bdba5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1796 microversion: 2.20 time: 0.312777 Oct 18 16:24:02.669366 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2658/5325] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:24:02 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1796 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:24:02.730273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:02.731618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:02.759066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.759468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.766565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.768872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.771054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.775063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.929536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1008049723", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:02.995627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:03.005065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-033821d3-c992-4466-abeb-4c60f5f0b1d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.281764 Oct 18 16:24:03.008099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2659/5326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:02 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:03.060576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:24:03.433067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:24:03.433880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:24:03.434736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:24:03.435784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:24:03.436569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:24:03.439863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:03.451074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:03.451897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:03.452536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:03.453595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:03.454350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:03.457610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:03.503148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Getting quotas for project d8b4d8a393a549d8b9d65fab5f050025. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:24:03.509588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Getting quotas for user 0946acd9a88a44a18a04c50bf9312322 and project d8b4d8a393a549d8b9d65fab5f050025. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:24:03.524778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:24:03.528528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:24:03.598679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d92b5490-183b-4c6d-98e4-23fb5eee91ba tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104844 Oct 18 16:24:03.599444 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2668/5327] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:24:03.611569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c994b3c7-8ff4-457d-aa89-309922c80554 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:03.612339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c994b3c7-8ff4-457d-aa89-309922c80554 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:03.708852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c994b3c7-8ff4-457d-aa89-309922c80554 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:03.721087 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c994b3c7-8ff4-457d-aa89-309922c80554 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1214 microversion: 2.1 time: 0.111958 Oct 18 16:24:03.729873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2660/5328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:03 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:04.031525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:04.032294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:04.080296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:04.082614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:04.085301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:04.089992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:04.092621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:04.099270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:04.144804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:04.490346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:04.499947 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-238f2b4c-7705-4ab2-a4a6-f90097e6ad47 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.472430 Oct 18 16:24:04.520969 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2669/5329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:04 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:04.747082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:04.748797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:04.774640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:04.775455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:04.776123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:04.777097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:04.777905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:04.778567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:05.009576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:05.025485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ecf1687-4707-48fd-9081-ac16f56d7857 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1210 microversion: 2.1 time: 0.283088 Oct 18 16:24:05.026084 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2661/5330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:04 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:05.530881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:05.531522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:05.541193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:05.542377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:05.543028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:05.543963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:05.544618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:05.545280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:05.796614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:05.816667 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ee17c3f-66e6-4d61-97ce-cb71a7930779 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.291074 Oct 18 16:24:05.817911 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2670/5331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:05 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:06.059255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:06.061676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:06.083354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.083866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.084336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:06.085088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.085554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.086381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:06.193394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:06.221171 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fdff67ef-ca3b-4a0f-81e3-669c4a105e42 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1272 microversion: 2.1 time: 0.167149 Oct 18 16:24:06.223646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2662/5332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:06 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:06.855470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:06.857320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:06.883558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.889245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.890017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:06.890899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.895346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.897801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:07.257361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:07.257361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:07.266260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:07.267033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:07.267647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:07.268796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:07.269441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:07.270025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:07.329791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:07.343520 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b3e4328-3c27-41d1-942b-baf92a5ab74f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.503111 Oct 18 16:24:07.346417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2671/5333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:06 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:07.611108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:07.634819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88716eff-7244-45c6-9540-a49c251ab4bb tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.390301 Oct 18 16:24:07.635725 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2663/5334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:07 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:08.387369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:08.388880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:08.405235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.406191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.406877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:08.408780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.410737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.414223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:08.658797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:08.659520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:08.689090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.695851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.702580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:08.703453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.705972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.707794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:09.315232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:09.330618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5782ba8b-a4aa-42bc-9609-3b694ae268a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.960709 Oct 18 16:24:09.332205 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2672/5335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:08 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:09.441059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:09.449800 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f0bc693-bee0-4db4-945b-52a75dd9186a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.794688 Oct 18 16:24:09.450539 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2664/5336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:08 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:09.712303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11", "tag": "713f5a38-288d-438c-97c4-f3562e7c6990"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:09.739318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:09.754999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:09.758345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:09.780431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] Creating event network-changed:713f5a38-288d-438c-97c4-f3562e7c6990 for instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 on n-h1-858383-14 Oct 18 16:24:09.790120 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5109094f-de90-4163-93b1-0f51959b40d7 req-a40ef390-3f40-4bf3-8911-8da87aa0e312 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083429 Oct 18 16:24:09.791948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2673/5337] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:10.357749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:10.359189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:10.367410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:10.368344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:10.369919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:10.371055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:10.371753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:10.372423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:10.478979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:10.480162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:10.500252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:10.501024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:10.501554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:10.502357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:10.505683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:10.506225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:10.575043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:10.584212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd0b0cd6-fb96-41ae-8d7d-27986550c321 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.232991 Oct 18 16:24:10.588575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2665/5338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:10 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:10.711364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:10.723458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a590153c-3d2c-47b9-becd-131951529f30 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.248823 Oct 18 16:24:10.723458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2674/5339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:10 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:11.612546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:11.613188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:11.621972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.622543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.623046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.623885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.624490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.625215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.629604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:11.747662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:11.748449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:11.755331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.755953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.756546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.757924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.758568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.759276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.780414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:11.790133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ab8fbf1-5234-4175-986b-aba878008b52 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.182168 Oct 18 16:24:11.796830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2666/5340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:11 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:11.906455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:11.914727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-64b4ae52-2226-46e8-9d60-978c85ce5a40 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.170891 Oct 18 16:24:11.915629 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2675/5341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:11 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:12.817313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:12.819245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:12.829241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.830023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.830622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.831874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.832450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.832949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.941698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:12.942923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:12.951662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.952389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.952828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.953554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.954173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.954793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:13.222754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:13.251306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6fa6ff17-5b35-4b6e-ae8a-b654b0497d4c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.434092 Oct 18 16:24:13.265049 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2667/5342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:12 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:13.372017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:13.383295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-277053f6-6751-4067-8913-74626d04572c tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.446701 Oct 18 16:24:13.384209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2676/5343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:12 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:14.288151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:14.289714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:14.293043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.303139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:14.305643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:14.306180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:14.306937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:14.307600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:14.308046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:14.406257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:14.408051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:14.411584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.411783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.427825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:14.430619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:14.433601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:14.434356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:14.434832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:14.435265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:14.542108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:14.551999 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4b12ee9-375c-4a0b-846a-8894379b2014 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.268438 Oct 18 16:24:14.553316 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2668/5344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:14 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:14.673038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:14.684423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddd5d988-d01f-468b-95fa-fcd9d14a378f tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.281883 Oct 18 16:24:14.685426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2677/5345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:14 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:15.477048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:15.484871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:15.485648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:15.486130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:15.514571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:24:15.586595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:15.588074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:15.599683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:15.601798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:15.603706 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62036ba7-6350-4710-b389-1a065781df22 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action" status: 202 len: 0 microversion: 2.1 time: 0.130808 Oct 18 16:24:15.604626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:15.605465 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2669/5346] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:24:15 2022] POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:24:15.609657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:15.611457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:15.613771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:15.624790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:15.625842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:15.633694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:15.635312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:15.636086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:15.637147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:15.637993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:15.638944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:15.938885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:15.975289 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e14c51b9-4ed0-4958-a631-4ea9d365a3d5 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.354872 Oct 18 16:24:15.979079 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2670/5347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:15 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:15.995519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:15.996393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:16.003128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:16.004614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:16.006663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:16.008197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:16.016094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:16.016864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:16.035341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:16.070279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30585a4a-e80c-4f41-b91a-18008255e810 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.491420 Oct 18 16:24:16.081034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2678/5348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:15 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:16.301650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:16.312482 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23773ff1-ee33-47e4-a32c-77cb38002a27 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.331913 Oct 18 16:24:16.321252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2671/5349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:15 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:17.007946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:17.008829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:17.023342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.026036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.027808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.028582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.031834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.032342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.100469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:17.101932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:17.127445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.132911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.135064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.137170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.144109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.146430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.339560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:17.354195 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d3e39ae-989b-4b63-abbc-e0549fcd9cad tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.351274 Oct 18 16:24:17.362793 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2679/5350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:17 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:17.370275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11", "name": "network-vif-plugged", "status": "completed", "tag": "713f5a38-288d-438c-97c4-f3562e7c6990"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:17.393794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.394601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.395291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.415834 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] Creating event network-vif-plugged:713f5a38-288d-438c-97c4-f3562e7c6990 for instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 on n-h1-858383-14 Oct 18 16:24:17.424511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-225de544-7e69-4eff-8ad3-f86685fa2a87 req-3b717353-8883-4290-99fc-77ef70a45062 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059300 Oct 18 16:24:17.434023 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2680/5351] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:17.454213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:17.455374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:17.464243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.465667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.466662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.467782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:17.468826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:17.470028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:17.473410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:17.491878 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2711a82-7ee0-4f4e-be82-0ac54c61d224 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.397021 Oct 18 16:24:17.492527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2672/5352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:17 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:17.666698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:17.675352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-910b75f7-4ec1-424d-b2a3-edda0ab8a685 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.239177 Oct 18 16:24:17.675961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2681/5353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:17 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:18.381134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:18.383094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:18.391124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.391903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.392282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.393209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.393674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.394171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.517157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:18.518765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:18.543114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.545676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.550587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.551787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.552586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.557131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.686906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:18.698172 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b05ff58e-810d-4b06-a3af-30311e82cbf0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.321116 Oct 18 16:24:18.699011 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2673/5354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:18 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:18.721961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:18.722890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:18.731652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.732388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.733413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.734350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:18.735538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:18.736140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:18.851932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:18.866947 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e3522b8-1d85-47a4-81d8-6f9a3d01b92c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.354060 Oct 18 16:24:18.868135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2682/5355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:18 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:18.972603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:18.999411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afff1b92-e3c8-4155-af6a-cc529419b7f3 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1314 microversion: 2.1 time: 0.288725 Oct 18 16:24:19.002203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2674/5356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:18 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:19.728376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:19.729843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:19.737600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:19.738751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:19.739626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:19.740599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:19.741876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:19.742508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:19.898026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:19.898867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:19.914445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:19.916748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:19.917321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:19.918472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:19.919622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:19.922952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:20.164468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:20.176028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16716dc6-c3ce-47de-989f-d2fb03332523 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.282835 Oct 18 16:24:20.176976 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2675/5357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:19 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:20.190448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:20.191223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:20.213823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:20.214390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:20.216563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:20.218747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:20.219259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:20.219811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:20.266849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:20.345052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6fff97ef-0143-4ba2-8345-f879d6df4e55 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.622218 Oct 18 16:24:20.369281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2683/5358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:19 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:20.486732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:20.503363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef42d6f0-8652-480d-b726-d4e183d912ac tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1464 microversion: 2.1 time: 0.325015 Oct 18 16:24:20.504317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2676/5359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:20 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:20.887988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Calling method '.version_select at 0x7f5fd636f0d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:20.915604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:20.916290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:20.916954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:20.967362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:20.968412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:20.969085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:20.996553 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a4eefb0-b86d-4280-989f-9c2cb7835f5c tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/d8b4d8a393a549d8b9d65fab5f050025?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686" status: 200 len: 695 microversion: 2.1 time: 0.466928 Oct 18 16:24:20.997948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2684/5360] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 18 16:24:20 2022] GET /compute/v2.1/os-simple-tenant-usage/d8b4d8a393a549d8b9d65fab5f050025?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686 => generated 695 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:21.014508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '.version_select at 0x7f5fd646c430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.045274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.054701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.055311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.080897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.081685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.082612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.109650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f3a3872-7a62-4996-8432-95a597973d85 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/d8b4d8a393a549d8b9d65fab5f050025?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686" status: 200 len: 695 microversion: 2.1 time: 0.098902 Oct 18 16:24:21.111044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2677/5361] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 18 16:24:21 2022] GET /compute/v2.1/os-simple-tenant-usage/d8b4d8a393a549d8b9d65fab5f050025?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686 => generated 695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:21.127433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Calling method '.version_select at 0x7f5fd15b14c0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.140342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.141119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.142135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.165502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.166259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.166965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.206375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.207232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:21.224471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.225275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.226535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.227405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.228069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.228704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.459636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:21.471711 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d4b59117-ce04-46df-bdd1-a81105a0a8ef tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.265250 Oct 18 16:24:21.472407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2678/5362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:21 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:21.479030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.479437 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90adebfd-a0b1-48e3-ad7c-8ce3cc6ad927 tempest-TenantUsagesTestJSON-1517744262 tempest-TenantUsagesTestJSON-1517744262-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686&detailed=1" status: 200 len: 58210 microversion: 2.1 time: 0.356439 Oct 18 16:24:21.479644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:21.480275 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2685/5363] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 18 16:24:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T16%3A24%3A20.524686&end=2022-10-19T16%3A24%3A20.524686&detailed=1 => generated 58210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:24:21.498146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.498645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.499092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.499820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.500286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.500728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.634687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.635191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:21.643001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.643706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.644771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.645848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.646472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.647199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.683739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:24:21.785888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:21.793028 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38746082-b9fd-45e2-a9a3-1b91542d778e tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 204 len: 0 microversion: 2.1 time: 0.162929 Oct 18 16:24:21.794307 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2686/5364] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:24:21 2022] DELETE /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:24:21.798111 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff6ca91f-e28e-448e-b3d8-2cea5b21cab8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.324106 Oct 18 16:24:21.813682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2679/5365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:21 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:21.819127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:21.820719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:21.832940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.833793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.834688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.836396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:21.837155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:21.837790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:21.842857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:22.013705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:22.023014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5d05eee-073d-4d34-9c10-853cdf60fad7 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1470 microversion: 2.1 time: 0.222389 Oct 18 16:24:22.024196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2687/5366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:21 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:22.500104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:22.500861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:22.512703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:22.514415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:22.518680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:22.520122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:22.520918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:22.521944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:22.720987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:22.728853 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f6f5c28-eece-43bc-bcaf-38ea8577c299 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.235409 Oct 18 16:24:22.729647 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2680/5367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:22 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:22.822669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:22.823292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:22.831191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:22.831677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:22.832113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:22.832808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:22.833308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:22.833736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:23.023152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:23.034441 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-deb7d72e-dcd4-4a4c-a3a1-79ed8c7a11dd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.216431 Oct 18 16:24:23.046892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:23.047888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:23.050264 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2688/5368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:22 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:23.057451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:23.058473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:23.059858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:23.062027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:23.063175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:23.064446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:23.232917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:23.242963 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5955c09c-e9c9-40a0-b55f-5665fb02f9a6 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1470 microversion: 2.1 time: 0.199955 Oct 18 16:24:23.243822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2681/5369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:23 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:23.752749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:23.753738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:23.761042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:23.762261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:23.763199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:23.764132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:23.765169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:23.765827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:23.997865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:24.018851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5716c04d-56ba-43cf-892a-0dd96e1ab9c2 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1508 microversion: 2.1 time: 0.269917 Oct 18 16:24:24.019452 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2689/5370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:23 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:24.062471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:24.063110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:24.086308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.087430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.087949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.088925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.089629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.090258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.133633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11", "name": "network-vif-deleted", "tag": "713f5a38-288d-438c-97c4-f3562e7c6990"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:24.144984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.145495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.145934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.147188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:24.174782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] Creating event network-vif-deleted:713f5a38-288d-438c-97c4-f3562e7c6990 for instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 on n-h1-858383-14 Oct 18 16:24:24.186338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6d0bc235-21aa-4593-8855-12c682df81d4 req-9ee72d2e-51b9-4f79-bf9e-c5435d0c40da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057303 Oct 18 16:24:24.187425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2690/5371] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:24.267727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:24.269442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:24.284777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.286260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.286934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.289764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.291175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.291830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.388796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:24.389340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:24.389789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:24.390822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lazy-loading 'fault' on Instance uuid df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:24:24.458992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:24.476230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0946acd9a88a44a18a04c50bf9312322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4d8a393a549d8b9d65fab5f050025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:24.478646 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-809da14c-95d7-404b-a6e4-e2388590c7bd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.421771 Oct 18 16:24:24.480491 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2682/5372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:24 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:24.492084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc3d3d00-3599-4c50-a910-1d284a0fb701 tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 200 len: 1304 microversion: 2.1 time: 0.227663 Oct 18 16:24:24.494180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2691/5373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:24 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:25.044870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:25.045848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:25.065751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.067567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.068204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.069803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.070669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.071586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.375656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:25.384405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e0ccac5-1a51-4295-bdb0-a7ecada7b01b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1529 microversion: 2.1 time: 0.344283 Oct 18 16:24:25.397134 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2683/5374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:25 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1529 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:25.511572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:25.518127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:25.527394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:25.530350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] [instance: df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:25.536469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.537214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.537904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.538044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.538909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.539338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.539721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.540313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.540439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.541475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:25.542026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:25.542663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:25.575893 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] HTTP exception thrown: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Request method failure captured: Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 HTTP/1.1 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtMgepQq6d9gVu5iN3HGzAnUREpn_SIYeioJqKX099ukLbWfA1L2N6WU60UZeZEsPf52C7sfxhnNNP6i9_WQZZTfjFBvhT0jD3cN--5uhliWWio_rbFxpza0AHp3aIPtXjcJ_rtps63rzAMYE6Fv6667YgZUQZTan4dJSVXYNICs0ik Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d8b4d8a393a549d8b9d65fab5f050025 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TenantUsagesTestJSON-1756525909 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d8b4d8a393a549d8b9d65fab5f050025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d8b4d8a393a549d8b9d65fab5f050025"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d8b4d8a393a549d8b9d65fab5f050025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d8b4d8a393a549d8b9d65fab5f050025"}]}] Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TenantUsagesTestJSON-1756525909 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d8b4d8a393a549d8b9d65fab5f050025 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1756525909 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TenantUsagesTestJSON-1756525909-project Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0946acd9a88a44a18a04c50bf9312322 Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TenantUsagesTestJSON-1756525909-project Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11'} Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:25.578298 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] Returning 404 to user: Instance df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20d2a35b-36f7-478b-ad64-9b1469a2876a tempest-TenantUsagesTestJSON-1756525909 tempest-TenantUsagesTestJSON-1756525909-project] 10.222.0.78 "GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11" status: 404 len: 111 microversion: 2.1 time: 0.058021 Oct 18 16:24:25.587710 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2684/5375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:25 2022] GET /compute/v2.1/servers/df94c5cc-23bf-4f7a-8cf8-fa1f9b97ad11 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:24:25.798263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:25.817718 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01fa68a7-b624-4473-b8d1-f9a39879ac68 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.306405 Oct 18 16:24:25.830242 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2692/5376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:25 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:26.411762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:26.413234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:26.430866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:26.431673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:26.432216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:26.435027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:26.435732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:26.436453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:26.720594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:26.733996 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c711e5e4-1f5a-4c2c-872b-88e1c201e4f6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1529 microversion: 2.1 time: 0.327467 Oct 18 16:24:26.734841 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2685/5377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:26 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1529 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:26.854721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:26.856279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:26.865373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:26.866901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:26.867636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:26.868536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:26.869217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:26.869834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:27.112537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:27.143233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-194c3c82-e221-4c49-a711-613e54cf5086 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.291685 Oct 18 16:24:27.160278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2693/5378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:26 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:27.771378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:27.774376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:27.794104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:27.795758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:27.797663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:27.798941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:27.801078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:27.802849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:28.077885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:28.087712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd9f45a1-62a4-4e4c-91cf-5f51f8e8b93a tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1529 microversion: 2.1 time: 0.329794 Oct 18 16:24:28.089235 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2686/5379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:27 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1529 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:28.174692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:28.177172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:28.205082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:28.210030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:28.211201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:28.212514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:28.213385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:28.216492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:28.521581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:28.557508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-35f493e0-9b45-4506-881f-fccee5d0d3b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.388487 Oct 18 16:24:28.561492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2694/5380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:28 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:29.119665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:29.120302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:29.121394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Calling method '.version_select at 0x7f5fd188b1f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:29.126009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.126512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.126953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.164104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.165831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.167194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.167374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.167693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.168437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.169400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.171295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.171782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.201720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.203793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.206263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.225801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a78508ef-1b93-468f-bb28-46f59e15daff tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898 tempest-PortsAdminExtendedAttrsIpV6TestJSON-607147898-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.526942 Oct 18 16:24:29.253915 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2687/5381] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:24:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:29.351472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31613e-3519-4a5f-aea9-c4c8d1be7fc5", "name": "network-vif-plugged", "status": "completed", "tag": "99017324-b87a-41a1-bf0c-8d0d772751d1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:29.373333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.373752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.374566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.418181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] Creating event network-vif-plugged:99017324-b87a-41a1-bf0c-8d0d772751d1 for instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 on n-h1-858383-14 Oct 18 16:24:29.456207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4cb0fad0-f685-4159-ab39-37077cb25c75 req-fe0ee109-03d5-4a9c-b76d-ce781cc7d950 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109041 Oct 18 16:24:29.459977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2688/5382] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:29.602689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:29.604364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:29.618195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.619163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.620045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.621212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:29.622804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:29.623675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:29.843549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:29.865589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4cc9ba5-f3a7-4730-b383-0e134cd38f33 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1529 microversion: 2.1 time: 0.756155 Oct 18 16:24:29.867822 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2695/5383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:29 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1529 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:30.354960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:30.370965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99824020-f0c6-41c5-8e75-76d449e85e74 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1724 microversion: 2.1 time: 0.775757 Oct 18 16:24:30.385624 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2689/5384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:29 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1724 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:30.893334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:30.894562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:30.910593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:30.911105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:30.911558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:30.917423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:30.923700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:30.925467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:31.164663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:31.400811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:31.401634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:31.404823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:31.425936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:31.426741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:31.427929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:31.431668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:31.433212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:31.433877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:32.186967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:32.198560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5396153-b253-4e3d-ad6b-6c3d93da8180 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 1.311046 Oct 18 16:24:32.203860 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2696/5385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:30 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:32.301158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:32.316516 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-daad4cbc-fc17-4c01-9842-d6e42121bbb4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1701 microversion: 2.1 time: 0.921715 Oct 18 16:24:32.319846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2690/5386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:31 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1701 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:32.371115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:32.406581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:32.407659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:32.408295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:32.473548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Going to try to start instance {{(pid=120570) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:24:32.606135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be84f4cb-f8a2-4323-b118-ae423fe882a3 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action" status: 202 len: 0 microversion: 2.1 time: 0.265403 Oct 18 16:24:32.608228 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2697/5387] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:24:32 2022] POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:24:32.618397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:32.623972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:32.641675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=72 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:32.664257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:32.664868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:32.669737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:32.673534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:32.674311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:32.676509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:33.242226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:33.252537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:33.265967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:33.273225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:33.277934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:33.285680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:33.293116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:33.294268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:33.855340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:33.924824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c5fd3e4b-64bb-4480-966d-60022e8bd79d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.691742 Oct 18 16:24:33.926190 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2698/5388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:33 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:33.983143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:33.995720 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16ab4a1b-3c48-41a9-8dcf-67c27161feab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1710 microversion: 2.1 time: 1.381958 Oct 18 16:24:34.004500 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2691/5389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:32 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1710 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:34.878653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:34.879405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:34.911236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:34.913457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:34.914191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:34.915019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:34.915968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:34.916599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:34.917216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:34.956468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:34.957548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:34.985076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:34.986595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:34.986595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:34.986984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:34.987497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:34.988132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.017530 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9952b76a-cfd7-4f31-9be6-e3471a0d2a34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/ips" status: 200 len: 150 microversion: 2.1 time: 0.148036 Oct 18 16:24:35.021369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2699/5390] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:24:34 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/ips => generated 150 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:35.041955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88365e69-201f-47c8-ba6c-e01e9f6ddec9"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:35.074826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:35.112587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.117226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.118538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.126973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.131827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.134513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.418817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/os-volume_attachments HTTP/1.1 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 74 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: {"volumeAttachment": {"volumeId": "88365e69-201f-47c8-ba6c-e01e9f6ddec9"}} Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '644119af-a262-46f4-955f-dd2c671bf9ac', 'body': {'volumeAttachment': {'volumeId': '88365e69-201f-47c8-ba6c-e01e9f6ddec9'}}} Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:24:35.421396 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 400 to user: Invalid volume: volume 88365e69-201f-47c8-ba6c-e01e9f6ddec9 is already attached to instances: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4f3035ac-a9c1-473a-b59f-2d8ac7265f34 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.395374 Oct 18 16:24:35.431498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2700/5391] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:24:35 2022] POST /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac/os-volume_attachments => generated 174 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:24:35.440322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:35.442401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:35.464352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.465897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.466615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.467594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.468291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.469276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.845831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:35.864509 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed7a81b1-7433-4987-9156-cf32d69ab8b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1714 microversion: 2.1 time: 0.429392 Oct 18 16:24:35.864509 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2701/5392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:35 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1714 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:35.911696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:35.912374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:35.927160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:35.953793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.954323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.954750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:35.955495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:35.955968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:35.957133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5cab88e-68b4-4aa4-b1bf-cd0e63705349 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 1.002619 Oct 18 16:24:35.972083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2692/5393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:34 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:35.974588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:36.138803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:24:36.261052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:36.470019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14f12021-bb16-4b96-95d5-70f81d21c812 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 204 len: 0 microversion: 2.1 time: 0.580886 Oct 18 16:24:36.475270 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2702/5394] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:24:35 2022] DELETE /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:24:36.486872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:36.487602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:36.514721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:36.515493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:36.516117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:36.517952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:36.521411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:36.523486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:36.994963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:36.997590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:37.016843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:37.018612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:37.019303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:37.020284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:37.021667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:37.025217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:37.488907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:37.498217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b4a75167-95a1-4f3f-8c3d-224cf5d61e94 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1681 microversion: 2.1 time: 1.018328 Oct 18 16:24:37.508435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2693/5395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:36 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1681 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:38.406557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:38.416861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-635939e7-32c5-4d51-a705-3b9c02a8275f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 1.428485 Oct 18 16:24:38.425368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2703/5396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:36 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:38.541919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:38.544116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:38.563303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:38.565325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:38.570239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:38.573802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:38.576011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:38.577094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:39.472808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:39.473435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:39.485049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:39.486056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:39.486660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:39.487590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:39.488859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:39.489488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:39.523002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:39.533834 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3a6cf3d-b967-42e9-8868-87220c653f8d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1681 microversion: 2.1 time: 1.001739 Oct 18 16:24:39.534439 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2694/5397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:38 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1681 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:39.795534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:39.795534 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-276954ae-6039-4c70-8a85-8ce8d94958c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.324925 Oct 18 16:24:39.805720 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2704/5398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:39 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:40.560925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:40.561639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:40.578533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:40.579029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:40.579468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:40.580186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:40.580642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:40.581092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:40.822667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:40.824229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:40.857393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:40.858121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:40.859109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:40.861589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:40.863441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:40.864873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:40.874414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:40.892569 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab9e7a95-2c40-42f8-9cb2-1a5ee864a53a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1614 microversion: 2.1 time: 0.335734 Oct 18 16:24:40.893405 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2695/5399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:40 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1614 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:41.394706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:41.422387 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c03bede-df41-41d8-857f-98e6b6b0e2a5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.599333 Oct 18 16:24:41.429238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2705/5400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:40 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:41.933684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:41.934332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:41.989223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:41.991722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:41.992385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:42.000042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:42.000696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:42.005078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:42.148086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644119af-a262-46f4-955f-dd2c671bf9ac", "name": "network-vif-deleted", "tag": "6b87334b-6af6-487c-bdc6-7b911404c061"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:42.220966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:42.221635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:42.222307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:42.282561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] Creating event network-vif-deleted:6b87334b-6af6-487c-bdc6-7b911404c061 for instance 644119af-a262-46f4-955f-dd2c671bf9ac on n-h2-858383-14 Oct 18 16:24:42.315110 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fed077b9-c98a-4dbe-91f3-1e09c6ec0f87 req-bebf87c4-c805-447c-9c45-50af5886a502 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174913 Oct 18 16:24:42.315825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2706/5401] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:42.487254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:42.488397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:42.518383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:42.519038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:42.519632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:42.520815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:42.527981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:42.527981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:42.670541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:42.682790 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9521ebf4-61fb-4394-96fa-58e9f8e06937 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 200 len: 1614 microversion: 2.1 time: 0.763530 Oct 18 16:24:42.685673 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2696/5402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:41 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 1614 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:43.185696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:43.204541 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-018f981a-dee3-49a6-9b16-e2a3de0485ea tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.729298 Oct 18 16:24:43.208812 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2707/5403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:42 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:43.711906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:43.714444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:43.732038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:43.734184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:43.734926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:43.736164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:43.742276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:43.743081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:43.816007 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac HTTP/1.1 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '644119af-a262-46f4-955f-dd2c671bf9ac'} Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:24:43.817824 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:24:43.824668 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:24:43.838239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:24:43.839131 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6563ff08-6cb8-409a-ac41-0c3846e73e96 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 404 len: 111 microversion: 2.1 time: 0.132768 Oct 18 16:24:43.839718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2697/5404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:43 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:24:43.850211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d6c0b0a-dd18-4137-933d-9374392f5a65 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '.version_select at 0x7f5fd201ce50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:43.934270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d6c0b0a-dd18-4137-933d-9374392f5a65 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777339290" status: 202 len: 0 microversion: 2.1 time: 0.089458 Oct 18 16:24:43.942339 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2708/5405] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777339290 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:24:44.251766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:44.254145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:44.281272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:44.285033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:44.294991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:44.299799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:44.300983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:44.306289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:46.250238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:46.289596 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de9d9aba-4446-4587-8f71-c5d825a66f37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 2.056480 Oct 18 16:24:46.291019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2698/5406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:44 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:47.123945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:47.125980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:47.168414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.170789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.171325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.175845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.176491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.177028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.333313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:47.334735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:47.338949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'services' on Instance uuid 5a91d7db-776b-4e39-8ce9-ab78b91a89bd {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:24:47.348921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.351482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.354264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.355377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.357805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.360793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.536027 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c12b271-e7c5-45d6-b355-362478e05b6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments/88365e69-201f-47c8-ba6c-e01e9f6ddec9" status: 202 len: 0 microversion: 2.1 time: 0.424897 Oct 18 16:24:47.538573 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2709/5407] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:24:47 2022] DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments/88365e69-201f-47c8-ba6c-e01e9f6ddec9 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:24:47.553091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:47.567082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:47.591392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.592763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.598148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.600387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:47.601278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:47.614230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:47.719954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb7263be-f548-4d3e-9de0-72f85a57e508 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174774 Oct 18 16:24:47.739626 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2710/5408] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:47 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:48.265772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:48.297795 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e896d7c-39fc-47eb-97b3-1fc8ce21f33f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.968606 Oct 18 16:24:48.298643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2699/5409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:47 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:48.742162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:48.754104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:48.792165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:48.793145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:48.793840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:48.795124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:48.812114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:48.815907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:49.018693 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7dd224e9-f43f-4fca-a997-a8bc8ebc7f87 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278245 Oct 18 16:24:49.020071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2711/5410] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:48 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:49.333402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:49.334665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:49.370867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:49.372205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:49.373087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:49.374318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:49.375134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:49.375899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:49.887043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:49.922409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39ac2449-e19c-4cbd-8d86-b645f156edcc tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.596470 Oct 18 16:24:49.923941 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2700/5411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:49 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:50.040098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:50.044756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:50.058324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:50.059551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:50.060561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:50.063137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:50.064222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:50.065255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:50.194135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-89f0fdd2-48e0-4bea-9984-e2b015b4aba2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160845 Oct 18 16:24:50.224353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2712/5412] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:50 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:50.959916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:50.967540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:50.995929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:50.996742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:50.997275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:50.998124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:50.998683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:50.999241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:51.140776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1114866685", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e45154d8-c7d4-4540-811b-4b3851cf5069"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:51.338135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] validate_networks() for [('e45154d8-c7d4-4540-811b-4b3851cf5069', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:24:52.069535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:52.084102 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ac9e7d0-ee48-4a19-93ab-5012c29499f1 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 1.127631 Oct 18 16:24:52.089067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2713/5413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:50 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:52.102923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:52.106127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:52.126596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:52.127396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:52.127999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:52.128906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:52.129586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:52.130191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:52.210277 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8e9f2be-77d7-478d-9ea8-1ecc99c3323d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123374 Oct 18 16:24:52.218183 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2714/5414] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:52 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:52.447495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:24:52.448234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:24:52.454214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:24:52.461897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:24:52.467973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:24:52.519882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:52.521134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:52.523898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:52.525552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:52.526619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:52.527621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:52.554476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:52.611912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Getting quotas for project f60dce1cd8eb41018541468ed4be516e. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:24:52.637504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Getting quotas for user 509c1d87110a4122b3e7be91772ff2aa and project f60dce1cd8eb41018541468ed4be516e. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:24:52.666667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:24:52.671851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:24:52.933993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3cb1102e-e0a5-471c-8bb2-8dfe6a77a765 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321084 Oct 18 16:24:52.936163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2701/5415] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:24:52.952307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9460f21-454b-44e2-9b80-621a685460cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:52.956490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9460f21-454b-44e2-9b80-621a685460cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:53.126498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:53.128103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:53.163861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:53.167402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:53.168782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:53.177555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:53.179855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:53.182043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:53.359042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9460f21-454b-44e2-9b80-621a685460cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:53.378201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9460f21-454b-44e2-9b80-621a685460cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1224 microversion: 2.1 time: 0.431801 Oct 18 16:24:53.397930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2715/5416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:52 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1224 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:53.423709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:53.432653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:53.457270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:53.459802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:53.461423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:53.463096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:53.464510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:53.466156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:53.729632 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29990fb6-4e13-48a9-a1cc-4c549223e541 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.329951 Oct 18 16:24:53.740085 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2716/5417] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:53 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:53.968087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:54.007171 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f33e1be0-d8f4-4290-b663-89d891a246ba tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.888049 Oct 18 16:24:54.022932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2702/5418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:53 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:54.428582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94cda290-a358-4942-b880-43792d696e85 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:54.429922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94cda290-a358-4942-b880-43792d696e85 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:54.758496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:54.761423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:54.784643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:54.787101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:54.787769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:54.788727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:54.791634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:54.792263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:54.910607 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02e8f745-3d08-4e31-afec-56c723f604aa tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157925 Oct 18 16:24:54.911285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2703/5419] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:54 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:55.074518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:55.076838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:55.087461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94cda290-a358-4942-b880-43792d696e85 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:55.096633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94cda290-a358-4942-b880-43792d696e85 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1224 microversion: 2.1 time: 0.673070 Oct 18 16:24:55.102976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2717/5420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:54 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1224 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:55.116205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:55.117785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:55.118486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:55.119620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:55.120308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:55.120956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:55.674409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:55.716566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ded2c4bd-f066-4bf3-824f-786133a36309 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.648626 Oct 18 16:24:55.729798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2704/5421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:55 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:55.931092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:55.936914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:55.958329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:55.961633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:55.963407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:55.965173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:55.967385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:55.968074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:56.062868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-75f7bf12-cf56-4951-a63e-83bb462f0c29 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139251 Oct 18 16:24:56.067753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2718/5422] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:55 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:56.144668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:56.146761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:56.179094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:56.181395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:56.182810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:56.186429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:56.188821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:56.192730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:56.421624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:56.448411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-887dec1e-f14f-408a-9312-95fd8448e5fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1276 microversion: 2.1 time: 0.308345 Oct 18 16:24:56.461766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2705/5423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:56 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:56.768683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:56.776791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:56.851043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:56.853645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:56.854470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:56.886786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:56.888478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:56.899802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:57.086918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:57.089750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:57.123376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:57.123873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:57.124386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:57.125181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:57.125585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:57.125991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:57.343987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-79aab9db-6ab7-4c8b-8828-196826286069 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.265943 Oct 18 16:24:57.353130 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2706/5424] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:57 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:57.478601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:57.479932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:57.543967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:57.544568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:57.545152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:57.557854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:57.558729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:57.570455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:57.687922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:57.717370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a74cb24d-694e-480f-b7b4-b71c819cf7c4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.950032 Oct 18 16:24:57.719487 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2719/5425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:56 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:57.966163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:57.975694 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-612ad816-70fb-451c-9ec0-979f6fa66399 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1282 microversion: 2.1 time: 0.503912 Oct 18 16:24:57.989047 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2707/5426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:57 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1282 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:58.368499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:58.373128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:58.394530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:58.397028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:58.398004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:58.399890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:58.400984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:58.403274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:58.497223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7b33d9d-9413-4e4a-bde6-30ee92da0bad tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135521 Oct 18 16:24:58.500081 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2720/5427] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:58 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:58.764045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:58.770444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:58.821450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:58.822639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:58.827453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:58.832597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:58.834099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:58.838457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:59.007513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:59.008633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:59.031577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:59.032679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:59.033762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:59.035831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:59.038114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:59.040700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:59.143481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:59.304134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:59.338274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0e520f1-96ae-49a5-b94e-3c5ad72412fe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1282 microversion: 2.1 time: 0.341883 Oct 18 16:24:59.339006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2721/5428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:58 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1282 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:24:59.518603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:59.521843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:59.565178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:59.565441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:59.566893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:59.569826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:59.575321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:59.588605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:59.588605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:59.600357 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8972126e-29c0-492e-9bbc-bc473fb4cdaa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.837743 Oct 18 16:24:59.603697 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2708/5429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:58 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:59.825584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-923feeaa-5b31-4232-84ec-414dbdc46a26 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.312522 Oct 18 16:24:59.826420 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2722/5430] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:24:59 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 197 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:25:00.415721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:00.417792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:00.430834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:00.431612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:00.433053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:00.436847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:00.437725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:00.438448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:00.644534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:00.663694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:00.705482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:00.706373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:00.715380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:00.716704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:00.725682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:00.726619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:01.176520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:01.188319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bde4068f-30e1-4ca6-bd52-24eae6fcd6a8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.777710 Oct 18 16:25:01.198998 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2709/5431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:00 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:01.204943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:01.209107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:01.230635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:01.239762 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-065d8f56-846b-466a-908c-3901b84f5416 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.604733 Oct 18 16:25:01.243713 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2723/5432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:00 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:01.292467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:01.298926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:01.301032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:01.301839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:01.312175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:01.313229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:01.442298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f911017-4ed6-488e-a6df-3ec190b21db5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.238045 Oct 18 16:25:01.443580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2710/5433] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:25:01 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd/os-volume_attachments => generated 25 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:25:01.753036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:01.760944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:01.820518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:01.837266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:01.842803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:01.847383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:01.850028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:01.851115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:02.004310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:25:02.258829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:02.259484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:02.312681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:02.316755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:02.318874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:02.322910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:02.323835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:02.331269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:02.355612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51b59f40-d591-44ee-92ba-d5cda9155fdc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 204 len: 0 microversion: 2.1 time: 0.622693 Oct 18 16:25:02.365522 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2724/5434] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:25:01 2022] DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:25:02.392847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:02.400132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:02.439873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:02.447490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:02.452086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:02.455692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:02.461440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:02.461913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:02.554756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:02.654638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:03.016672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:03.026591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-230822c1-350f-4758-9ee5-0806eb61edbe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.775197 Oct 18 16:25:03.041919 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2711/5435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:02 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:03.057455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:03.066306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:03.099620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:03.105028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:03.112958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:03.123205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:03.125388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:03.134477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:03.135563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:03.294249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:03.307679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03fdddd1-3017-4a50-b5a2-67df75384f45 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 0.937374 Oct 18 16:25:03.321395 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2725/5436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:02 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:03.335904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:03.356539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:03.357044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:03.357483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:03.385332 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] Creating event network-changed:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:25:03.406861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-beff84b7-9c97-471d-8914-6da6b2b4b469 req-7265e55b-2e39-4447-9658-9b0061cf6fc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084091 Oct 18 16:25:03.407481 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2726/5437] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:03.741466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:03.775766 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5faf6324-bbc5-4e76-a3a1-c562d7c8d513 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1681 microversion: 2.1 time: 0.730224 Oct 18 16:25:03.794435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2712/5438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:03 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1681 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:04.073890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:04.077613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:04.121172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.121701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.122158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:04.122936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.123374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.133583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:04.336146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:04.337245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:04.352122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.366132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.367343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:04.368903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.371092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.372687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:04.870977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:04.898419 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-204c93c3-d99d-4cac-abf3-ead9659e1351 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.835365 Oct 18 16:25:04.917108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2727/5439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:04 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:04.925723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:04.928101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:04.935437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.936205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.937793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:04.954169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:04.956182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:04.959041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:05.096234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:05.359051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:05.373275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:05.378201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72e905b6-ad13-42ec-ab34-4ed9f2103c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1681 microversion: 2.1 time: 0.459601 Oct 18 16:25:05.379092 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2728/5440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:04 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1681 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:05.399994 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-001912c8-d1ca-4998-9bf9-01611410fdd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1524 microversion: 2.1 time: 1.068399 Oct 18 16:25:05.403539 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2713/5441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:04 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1524 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:05.931712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:05.932945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:05.948758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:05.952078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:05.960224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:05.963262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:05.966430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:05.986511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:05.990662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:06.431559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:06.433034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:06.462415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:06.466059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:06.467504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:06.469265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:06.470445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:06.471629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:06.582090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:06.596592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3102e0ba-24f3-4c4e-b9f4-3f14668c4bd2 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.669654 Oct 18 16:25:06.605579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2729/5442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:05 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:06.611323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:06.612249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:06.634693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:06.635479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:06.636198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:06.637145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:06.637811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:06.640799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:07.115012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:07.128912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b098bde7-39f3-4398-b174-8fa71b958802 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1506 microversion: 2.1 time: 0.521766 Oct 18 16:25:07.133283 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2730/5443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:06 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:07.550943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:07.584625 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef7335ef-bdd4-4f6d-b1ab-7bfa3426251f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1681 microversion: 2.1 time: 1.162659 Oct 18 16:25:07.585593 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2714/5444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:06 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1681 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:07.659871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:07.663977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:07.683195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:07.683700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:07.684230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:07.691977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:07.692772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:07.693451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:08.139581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:08.162919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:08.163814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:08.165210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a1a67c3-84a4-45e2-887f-3fddde74a9cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.512848 Oct 18 16:25:08.173332 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2731/5445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:07 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:08.191075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:08.191869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:08.196046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:08.197786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:08.199448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:08.200090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:08.626774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:08.627395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:08.639089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:08.640984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:08.641983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:08.644380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:08.646530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:08.648356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:09.257093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:09.272515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d908a815-8584-4c3d-8167-1d1f50e75565 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1613 microversion: 2.1 time: 0.647454 Oct 18 16:25:09.296440 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2732/5446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:08 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1613 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:09.309477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a91d7db-776b-4e39-8ce9-ab78b91a89bd", "name": "network-vif-deleted", "tag": "bd19bdb7-4041-42fb-907b-550c06966f0e"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:09.338177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:09.339390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:09.341145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:09.380784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] Creating event network-vif-deleted:bd19bdb7-4041-42fb-907b-550c06966f0e for instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd on n-h1-858383-14 Oct 18 16:25:09.398946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3fefff74-2ec6-4eaa-89f0-7c5f9a819310 req-f1a333d6-a617-4db6-802b-33859d4d3102 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098263 Oct 18 16:25:09.401170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2733/5447] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:09.414161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:09.429997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:09.451631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:09.452489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:09.453356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:09.473350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:09.474592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:09.475346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:09.540872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:09.562841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-702486c1-dc81-427b-827b-9f782bbb3e3b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1506 microversion: 2.1 time: 1.408104 Oct 18 16:25:09.566916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2715/5448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:08 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1506 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:10.008485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:10.009429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:10.032915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.038266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.039008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.042317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.044313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.045559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.095803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1cb0b2eb-f9ce-428b-ae0b-361d470952ff tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments/24ba64e9-310e-428c-8591-a0a30ae4323e" status: 200 len: 194 microversion: 2.20 time: 0.524578 Oct 18 16:25:10.100835 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2716/5449] 10.222.0.78 () {60 vars in 1454 bytes} [Tue Oct 18 16:25:09 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments/24ba64e9-310e-428c-8591-a0a30ae4323e => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:10.146237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31613e-3519-4a5f-aea9-c4c8d1be7fc5", "name": "network-vif-unplugged", "status": "completed", "tag": "99017324-b87a-41a1-bf0c-8d0d772751d1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:10.190116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.190766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.193187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.226921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] Creating event network-vif-unplugged:99017324-b87a-41a1-bf0c-8d0d772751d1 for instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 on n-h1-858383-14 Oct 18 16:25:10.246363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-11684905-1e61-426e-bea0-ca1f9d58dbc3 req-8c980b7f-79aa-4e08-9782-4140eee82b54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107655 Oct 18 16:25:10.248010 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2717/5450] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:25:10.271888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:10.277990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:10.309132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.309937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.310745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.311925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.312671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.313286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.422414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:10.442357 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3cd4071-e34e-4492-aec1-e79246a456c3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 1.035562 Oct 18 16:25:10.444284 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2734/5451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:09 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:10.455959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:10.456872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:10.474765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.475623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.477493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.477734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.478503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.479498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.544946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.546200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.547209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.548266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'fault' on Instance uuid 5a91d7db-776b-4e39-8ce9-ab78b91a89bd {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:10.617748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lazy-loading 'services' on Instance uuid e268bc7b-0f4b-4eba-b006-0eb28c380aea {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:10.659026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:10.753799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:10.788359 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3981f3aa-8e9c-4c48-ad97-cb21ff44e32e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1330 microversion: 2.1 time: 0.339989 Oct 18 16:25:10.803581 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2735/5452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:10 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1330 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:10.812770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:10.834806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:10.871492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.872329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.873101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.882969 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0818c0e4-e70e-49cf-ac3f-10104c67c2fe tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments/24ba64e9-310e-428c-8591-a0a30ae4323e" status: 202 len: 0 microversion: 2.20 time: 0.617065 Oct 18 16:25:10.888821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.889975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.890753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.894284 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2718/5453] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Oct 18 16:25:10 2022] DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments/24ba64e9-310e-428c-8591-a0a30ae4323e => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:25:10.936367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:10.946052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:10.968040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.970415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.971876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:10.975784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:10.977513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:10.983978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:11.135849 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac0850be-ed35-46bb-8953-e1b9dcb09d2c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.233175 Oct 18 16:25:11.144144 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2719/5454] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:10 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:11.473195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:11.475105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:11.495005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:11.495613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:11.496150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:11.498112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:11.498690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:11.499246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:11.809198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:11.847241 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3b7b396-62fa-4193-bbe2-a944c67ba4f7 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 0.380815 Oct 18 16:25:11.862569 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2720/5455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:11 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:11.910289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:11.913749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:11.959335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:11.962388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:11.963306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:11.965285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:11.967057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:11.968440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:12.053510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:12.054666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:12.055422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:12.056338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'fault' on Instance uuid 5a91d7db-776b-4e39-8ce9-ab78b91a89bd {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:12.248712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:12.261176 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fac0e35b-cdf3-4731-b24e-241ceb7a8362 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1330 microversion: 2.1 time: 0.396164 Oct 18 16:25:12.282690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2721/5456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:11 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1330 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:12.290209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:12.293011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:12.301544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:12.302649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:12.303611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:12.306561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:12.307507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:12.308157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:12.358541 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3115c161-92a7-4c4a-82a2-0f332c0eea53 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072912 Oct 18 16:25:12.359977 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2722/5457] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:12 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:12.805446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:12.836117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6e08d15-2838-4a7d-92a5-99eb65654a00 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1506 microversion: 2.1 time: 2.030537 Oct 18 16:25:12.836738 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2736/5458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:10 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1506 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:12.889715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:12.890559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:12.916110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:13.295059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:13.301417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:13.354930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:13.355811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:13.356596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:13.366457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:13.371515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:13.372507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:13.476432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:13.556238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:13.556238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:13.556569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:13.556794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'fault' on Instance uuid 5a91d7db-776b-4e39-8ce9-ab78b91a89bd {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:13.861811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:13.877216 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b893a31f-a8e9-4895-848f-f8bfdd035c0b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 200 len: 1330 microversion: 2.1 time: 0.586038 Oct 18 16:25:13.886137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2737/5459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:13 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 1330 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:13.924238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:13.961490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:14.000025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.001207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.002107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.007145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.008442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.011681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.182088 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4c12296-248a-4ce3-acc9-8bf15f361e7c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.291729 Oct 18 16:25:14.185349 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2738/5460] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:13 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:14.209040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:14.216463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:14.232987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:14.235955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.237825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.240395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.241304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.242948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.244071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.257153 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-17a7f1b5-7a4c-42af-a93c-8794bdac238b tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 1.364794 Oct 18 16:25:14.265485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2723/5461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:12 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:14.847552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:14.878091 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e17b4f03-78dd-483f-99c0-4dae0713521f tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 200 len: 1449 microversion: 2.1 time: 0.690262 Oct 18 16:25:14.887932 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2739/5462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:14 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 1449 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:14.909431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:14.910410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:14.923118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.924210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.924869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.925826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.936563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:14.943931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:14.955648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.959110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.963376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.964155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.966907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.981855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:14.984155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:14.988220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:14.994562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd HTTP/1.1 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5a91d7db-776b-4e39-8ce9-ab78b91a89bd'} Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:14.999929 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:25:15.011987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-da3cfb8e-7250-4fe6-847a-691f9ed48bb0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 404 len: 111 microversion: 2.1 time: 0.102905 Oct 18 16:25:15.017777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2724/5463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:14 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:25:15.023139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d956e838-4d72-4036-9783-97bf2cc9acbd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '.version_select at 0x7f5fd6527ca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:15.082249 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d956e838-4d72-4036-9783-97bf2cc9acbd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21573099" status: 202 len: 0 microversion: 2.1 time: 0.064952 Oct 18 16:25:15.089792 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2725/5464] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21573099 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:25:15.155855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:25:15.179198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Working on deleting snapshot 2b0cb11b-1f7c-4334-a7fb-962782f2dabd from shelved instance... Oct 18 16:25:15.200706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:15.203101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:15.218705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:15.219224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:15.219625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:15.233601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:15.234971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:15.235837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:15.328644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93315980-e2c4-4cd5-8d01-4f3b1d56444c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.131891 Oct 18 16:25:15.336953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2726/5465] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:15 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:15.342671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:15.343301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:15.381504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:15.382241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:15.382999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:15.393978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:15.403059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:15.404327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:16.535341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:16.563039 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87f552c7-2e74-45c9-bae9-a87b32bc3323 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 1.231125 Oct 18 16:25:16.563779 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2727/5466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:15 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:16.586568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "name": "network-vif-plugged", "status": "completed", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:16.629283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:16.633067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:16.637534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:16.690791 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] Creating event network-vif-plugged:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:25:16.708953 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-864e0bd1-b144-46a7-8b91-51fb7aefac78 req-2f7780c2-3ddd-42af-8f1a-1b28b9d8a3f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134145 Oct 18 16:25:16.715600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2728/5467] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:16.738007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:16.750285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:16.771808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:16.776079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:16.777776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:16.780620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:16.783725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:16.784779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:16.830734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Doing local delete in cell 7d78fc6f-3bd2-4209-b2d1-7724df142ab0(cell1) {{(pid=120570) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 16:25:16.832444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:16.835245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:16.836510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:16.838188 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 16:25:16.855928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] deallocate_for_instance() {{(pid=120570) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 16:25:16.895494 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c78e2fb9-0102-4afc-af47-0da71b9b3c94 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.176550 Oct 18 16:25:16.901486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2729/5468] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:16 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:17.602676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:17.604373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:17.624189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:17.627287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:17.630855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:17.632504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:17.634112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:17.636683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:18.718690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:18.735603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2f6ad5f-ca08-4120-a6fa-bdd6c6d07f16 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1324 microversion: 2.1 time: 1.138039 Oct 18 16:25:18.736353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2730/5469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:17 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1324 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:18.763703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:18.766886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:18.784536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:18.785761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:18.786872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:18.788417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:18.797156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:18.798297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:18.917267 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0231f9fd-ed5b-4c9b-9f4e-09ee06dfae61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.173225 Oct 18 16:25:18.917874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2731/5470] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:18 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:19.214620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Updating instance_info_cache with network_info: [] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:25:19.301361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31613e-3519-4a5f-aea9-c4c8d1be7fc5", "name": "network-vif-deleted", "tag": "99017324-b87a-41a1-bf0c-8d0d772751d1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:19.395144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.397641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.405680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.492409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_external_events [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] Unable to find a host for instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5. Dropping event network-vif-deleted {{(pid=120571) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 16:25:19.493562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e11f801c-d212-461d-b10e-64ba9b52f5c0 req-10026ecd-2acc-4283-8204-8ffa1f5682bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.198950 Oct 18 16:25:19.495650 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2732/5471] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 202 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 16:25:19.506895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1a4a022-9c24-498a-8a39-13f94871097a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: .version_select at 0x7f5fd3bd9af0>, body: {"keypair": {"name": "tempest-keypair-1910932275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGktGUmP1u74F6Mp95mYjz0YQdRHbZ603GAuiNL4ASKIR2fMrD5yBuhqRKEm254opf/xAqUzsIhrqyUETE5bv+ceEBk7btv21Jykvz5ifx8YtKuUBnkbBV5BQMMS5OcoDA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:19.564030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d1a4a022-9c24-498a-8a39-13f94871097a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:19.591780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d1a4a022-9c24-498a-8a39-13f94871097a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:19.694149 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1a4a022-9c24-498a-8a39-13f94871097a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195786 Oct 18 16:25:19.695165 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2733/5472] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:25:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:19.731032 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-543d1e02-4a7b-4c02-be9e-2ebbd7522bf8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 204 len: 0 microversion: 2.1 time: 4.797959 Oct 18 16:25:19.732067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2740/5473] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:25:14 2022] DELETE /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 0 bytes in 4800 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:25:19.746203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:19.749186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:19.771184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.772572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.773701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.775194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.776423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.777524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.783801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:19.784682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:19.800402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.801222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.802345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.812705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.813233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.813678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.839499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 HTTP/1.1 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9e31613e-3519-4a5f-aea9-c4c8d1be7fc5'} Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:19.845722 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:25:19.853895 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:19.855478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:25:19.857560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-003559ba-7655-4c5c-b748-376e492cf360 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 404 len: 111 microversion: 2.1 time: 0.118534 Oct 18 16:25:19.862960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2734/5474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:19 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:25:19.935764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:19.947045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:19.968056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.970340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.974858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:19.976169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:19.978704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:19.980953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:20.101650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9883091c-fbd2-41d9-a284-64971ffa1b4e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172438 Oct 18 16:25:20.102729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2735/5475] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:19 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:25:20.163701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1370299779", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:20.277218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:25:20.303285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:20.316879 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5dd9e215-b7f5-4d35-8250-6db5bae5811c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1520 microversion: 2.1 time: 0.539447 Oct 18 16:25:20.318402 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2741/5476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:19 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:20.360741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdbc9fb8-d468-4f61-8cd1-107727a9480d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'create', calling method: .version_select at 0x7f5fd2192940>, body: {"pool": null} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:21.606623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:25:21.607399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:25:21.607870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:25:21.608381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:25:21.608806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:25:21.683120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:21.685961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:21.689684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:21.691659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:21.694772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:21.696675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:21.802565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:21.830744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:21.918117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:25:21.975004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:25:22.225175 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-618adb4f-e267-4df9-b678-50d46e467c4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066159 Oct 18 16:25:22.229566 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2736/5477] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:25:22.267578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:22.281753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:22.308945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:22.310560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:22.311538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:22.317823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:22.319156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:22.323065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:22.414983 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e041009-5343-42bb-bafc-8de42f66f19d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182857 Oct 18 16:25:22.419831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2737/5478] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:22 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:25:22.447495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78de959a-d826-4aba-9922-e9b53d0e3b4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:22.449319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-78de959a-d826-4aba-9922-e9b53d0e3b4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:22.746126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78de959a-d826-4aba-9922-e9b53d0e3b4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:22.775953 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78de959a-d826-4aba-9922-e9b53d0e3b4e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1215 microversion: 2.1 time: 0.347783 Oct 18 16:25:22.778573 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2738/5479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:22 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:23.443949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:23.458719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:23.487212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:23.489908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:23.490968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:23.491916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:23.495236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:23.496110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:23.671084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d51bcb2e-9856-438a-b4ce-72264c810ae0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.244489 Oct 18 16:25:23.678693 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2739/5480] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:23 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:25:23.823310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:23.826726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:23.843490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:23.845634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:23.846692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:23.849905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:23.851298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:23.852685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:24.124163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:24.146335 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-190bf4b6-8327-44bb-889e-21bb5d584d37 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1211 microversion: 2.1 time: 0.338424 Oct 18 16:25:24.147610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2740/5481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:23 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1211 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:24.702602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:24.728445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:24.756667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:24.758314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:24.759574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:24.760913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:24.776625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:24.778068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:24.817604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:24.979152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6553764-f8b8-4a91-b267-b024a5d55862 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.288507 Oct 18 16:25:24.984218 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2741/5482] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:25:24 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea/os-volume_attachments => generated 25 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:25.194004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:25.195158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:25.235803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.253425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.255126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:25.261783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.263303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.264151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:25.593088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:25.608395 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8137a105-3c96-4e62-bfe1-0f34285b21a4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1285 microversion: 2.1 time: 0.427940 Oct 18 16:25:25.621350 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2742/5483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:25 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1285 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:25.635366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:25.636096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:25.655152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.655953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.656564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:25.657926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.658538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.659205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:25.697577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:25:25.830787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3699fb9-1d08-47f0-b90c-c9d5f0dad58b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 204 len: 0 microversion: 2.20 time: 0.207599 Oct 18 16:25:25.834591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2743/5484] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:25:25 2022] DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:25:25.846177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:25.846177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:25.874853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:25.913328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.914272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.915459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:25.917044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:25.917858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:25.918509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:26.195741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:26.207404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:26.210300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:26.212162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88f3e06f-bb09-4235-9a0d-c05aecdd3898 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.371135 Oct 18 16:25:26.233970 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2744/5485] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:25 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:26.639882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:26.641511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:26.648713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:26.649621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:26.650290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:26.651721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:26.652793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:26.653599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:26.739067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:26.750251 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70d783bd-e5e4-49a2-89be-63d7340c64ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1273 microversion: 2.1 time: 0.114396 Oct 18 16:25:26.763172 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2745/5486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:26 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:27.245398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:27.250192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:27.265615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:27.266838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:27.267870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:27.269523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:27.271902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:27.273115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:27.589655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:27.603868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:27.605649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:27.607388 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40172d16-d581-42e0-8eb4-272dc3d50d65 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.372163 Oct 18 16:25:27.609218 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2746/5487] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:27 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:25:27.784750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:27.787377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:27.794822 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdbc9fb8-d468-4f61-8cd1-107727a9480d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.436620 Oct 18 16:25:27.798043 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2742/5488] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 18 16:25:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:27.827262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:27.827993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:27.829280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:27.830232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:27.830818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:27.831560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:28.000299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:28.033116 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afdfdb40-e85a-48b9-b2c8-7986b3711ea8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1273 microversion: 2.1 time: 0.257415 Oct 18 16:25:28.051073 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2747/5489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:27 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:28.077909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1901061180", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e45154d8-c7d4-4540-811b-4b3851cf5069"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:28.174592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] validate_networks() for [('e45154d8-c7d4-4540-811b-4b3851cf5069', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:25:28.634566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:28.635258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:28.642381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:28.643001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:28.643513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:28.644330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:28.644918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:28.645563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:28.967103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:28.988533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:28.991644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:28.993685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8825466-98b5-45fb-98bf-fe06da29588c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.363978 Oct 18 16:25:28.994690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2748/5490] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:28 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:29.079364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:29.080167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:29.103732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:29.104751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:29.108932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:29.110368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:29.111330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:29.112222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:29.335599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:29.361125 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50c92261-2ffd-47df-8f59-4916abdcc152 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1273 microversion: 2.1 time: 0.286260 Oct 18 16:25:29.386126 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2749/5491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:29 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:30.024024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:30.026336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:30.047538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:30.059051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:30.063346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:30.069807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:30.070707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:30.071431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:30.313238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:30.856749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:30.868134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:30.868406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:25:30.868879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:25:30.869813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:25:30.870580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:25:30.873514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:25:30.878389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:30.878933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66c2278d-9d23-49b8-9a2a-b389986896b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1724 microversion: 2.20 time: 0.861981 Oct 18 16:25:30.881344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2750/5492] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:30 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1724 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:30.887830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785789545", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4fdb82c-83da-439d-8df3-8e5dbfce3308"}], "security_groups": [{"name": "tempest-securitygroup--1290015392"}], "key_name": "tempest-keypair-1910932275", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:30.916617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:30.918544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:30.919704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:30.921994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:30.922844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:30.923457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:30.971159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Getting quotas for project f60dce1cd8eb41018541468ed4be516e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:30.981986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Getting quotas for user 509c1d87110a4122b3e7be91772ff2aa and project f60dce1cd8eb41018541468ed4be516e. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:31.000450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:25:31.004036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:25:31.068322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63d99b70-19b0-40ca-a90e-980c3a9502dd tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.995402 Oct 18 16:25:31.079729 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2743/5493] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:25:31.081873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:31.083038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:31.100391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:31.100895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:31.101373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:31.102095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:31.102552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:31.102982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:31.209184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] validate_networks() for [('a4fdb82c-83da-439d-8df3-8e5dbfce3308', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:25:31.757046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:32.379802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:32.403156 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd0f3b40-fa1a-4100-8ad1-5156590113f0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 1.331309 Oct 18 16:25:32.407052 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2744/5494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:31 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:32.428898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:32.430055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:32.449792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:32.452204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:32.453621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:32.456186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:32.458544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:32.459638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:32.768940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:32.839507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:32.855630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdb6327f-363f-46ad-b173-3eb0e489e4cc tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1276 microversion: 2.1 time: 0.446794 Oct 18 16:25:32.856725 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2745/5495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:32 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:32.874675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:32.875197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:32.887395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:32.888265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:32.890779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:32.895108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:32.896116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:32.897094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:33.218438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lazy-loading 'services' on Instance uuid 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:33.497106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e7a7b40-ef74-42fa-96e5-0d91da4e5328 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments/82f0b575-3e6b-402a-9b19-068576d50c66" status: 202 len: 0 microversion: 2.1 time: 0.636249 Oct 18 16:25:33.505417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2746/5496] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:25:32 2022] DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments/82f0b575-3e6b-402a-9b19-068576d50c66 => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:25:33.532849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:33.533905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:33.564493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:33.573622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:33.574553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:33.576115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:33.582569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:33.584771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:33.699294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:33.699797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:33.700246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:33.700778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lazy-loading 'fault' on Instance uuid e268bc7b-0f4b-4eba-b006-0eb28c380aea {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:33.869558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:33.892443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:33.895411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:33.897185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a60a25f-b9a0-492b-b4c9-1f0dd4717cbf tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 200 len: 1372 microversion: 2.20 time: 0.386451 Oct 18 16:25:33.899807 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2747/5497] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:33 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 1372 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:33.911134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e268bc7b-0f4b-4eba-b006-0eb28c380aea", "name": "network-vif-deleted", "tag": "59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:33.942631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:33.943971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:33.944885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:25:33.946224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:33.947002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:25:33.947904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:25:33.948514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:25:33.949287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:25:34.004862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.005767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.006386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.007438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.007923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.010094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.010368 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] Creating event network-vif-deleted:59c7f9c9-bc78-4aa9-a5c8-5e1add4ce392 for instance e268bc7b-0f4b-4eba-b006-0eb28c380aea on n-h2-858383-14 Oct 18 16:25:34.034094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-eb42098c-c9a9-481e-8609-5382f31308d4 req-15be614c-563e-4af3-83f9-ee671eee61f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132742 Oct 18 16:25:34.034885 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2748/5498] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:34.050732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:34.053734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:34.080487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:34.084426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.085715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.087072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.088141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.088856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.089552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.107025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:34.140283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:25:34.143152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:25:34.225898 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eee472b7-8454-413b-99a6-7305255394c8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.342341 Oct 18 16:25:34.227464 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2751/5499] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:25:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 3345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:25:34.248549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:34.276744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:34.300171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.309154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.314276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.317596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:34.320195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:34.321443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:34.961958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:34.981924 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99c1acb3-ac55-46ea-9b96-f6d22effe9bf tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.944904 Oct 18 16:25:34.983164 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2749/5500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:34 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:35.164497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:35.182146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8774b360-4d22-4599-ba3b-3dc6caf3a0c8 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1282 microversion: 2.1 time: 0.949906 Oct 18 16:25:35.196222 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2752/5501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:34 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1282 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:35.200945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:35.202881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:35.234260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:35.238211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:35.239674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:35.241056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:35.241931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:35.255987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:35.329348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea HTTP/1.1 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e268bc7b-0f4b-4eba-b006-0eb28c380aea'} Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:35.333470 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:25:35.342134 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:25:35.345648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:25:35.347142 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de15d058-6e82-4622-b371-a081f9a848ea tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 404 len: 111 microversion: 2.20 time: 0.161826 Oct 18 16:25:35.349332 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2753/5502] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:35 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:25:35.364788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f1c7e64-4638-405a-b843-b1ccd69c380c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '.version_select at 0x7f5fd12c60d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:35.387531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a04da56-e9df-4428-b346-3709c24b1554 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:35.398049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a04da56-e9df-4428-b346-3709c24b1554 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:35.411271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f1c7e64-4638-405a-b843-b1ccd69c380c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087589318" status: 204 len: 0 microversion: 2.20 time: 0.055573 Oct 18 16:25:35.412718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2754/5503] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087589318 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:25:35.674100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a04da56-e9df-4428-b346-3709c24b1554 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:35.682639 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a04da56-e9df-4428-b346-3709c24b1554 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1241 microversion: 2.1 time: 0.697899 Oct 18 16:25:35.688332 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2750/5504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:34 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1241 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:36.034369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:36.035458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:36.059548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.063846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.066364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.068546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.073202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.074396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.139544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1306daa-db3c-4a72-a389-17405ac6a96e", "tag": "2d653143-0fbf-47ba-8273-5e462bed7c5f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:36.187781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:36.200706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.201312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.201774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.240254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] Creating event network-changed:2d653143-0fbf-47ba-8273-5e462bed7c5f for instance f1306daa-db3c-4a72-a389-17405ac6a96e on n-h2-858383-14 Oct 18 16:25:36.252506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e9aeba26-0991-43a1-83b7-797c7bb39246 req-65db72e8-f4b6-48b9-a8bc-ab2b9590cf70 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119056 Oct 18 16:25:36.255155 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2751/5505] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:25:36.267952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:36.269346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:36.279156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.280138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.281436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.282456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.283206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.283858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.521889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:36.550863 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2fa97412-d0fc-4257-a238-61261d9472a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1282 microversion: 2.1 time: 0.289609 Oct 18 16:25:36.552410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2752/5506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:36 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:36.719194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:36.720165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:36.751945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.752622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.753474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.755347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:36.756222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:36.769107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:36.787057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:36.797605 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed880e6b-a8c7-48d1-8a44-2125af30844c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.769277 Oct 18 16:25:36.802121 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2755/5507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:36 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:36.992892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:37.007547 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be516aba-e116-4f54-b3ef-4fc27d49fa20 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1237 microversion: 2.1 time: 0.293045 Oct 18 16:25:37.009286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2753/5508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:36 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1237 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:37.594397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:37.595944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:37.610974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:37.612437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:37.613561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:37.615066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:37.615728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:37.616293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:37.845633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:37.846527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:37.867019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:37.876538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:37.881829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:37.892334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:37.893434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:37.894425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:38.710951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:38.747007 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f592f7a5-7697-450f-b19b-a5d8b5e7ab76 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.903265 Oct 18 16:25:38.761537 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2754/5509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:37 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:38.792936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:38.793623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:38.824910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:38.825804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:38.826378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:38.827143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:38.827656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:38.828287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:38.889982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:38.934170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89202570-c807-4fd7-bf6b-aaabf1838c01 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 1.345665 Oct 18 16:25:38.961289 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2756/5510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:37 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:39.015149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:39.030256 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78943600-5671-4623-8cf7-d9d9f0100222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1293 microversion: 2.1 time: 0.276291 Oct 18 16:25:39.036285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2755/5511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:38 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:39.211493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1632b80a-758f-48ce-b660-38edc1254ab9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: .version_select at 0x7f5fd12adc10>, body: {"keypair": {"name": "tempest-keypair-816311255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9r28r9j9eCipUOmc031lLQwJXD+JrG2HEJe7hJ4P0Ywxxh4dh2dAHcLWM7QAo3BosrDWjJ6j4JuLpz+80FX1cTXZeFGkJVEHPLxuuZRl3R6g596v21h8YT4q3zPoZW5w=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:39.259001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1632b80a-758f-48ce-b660-38edc1254ab9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:39.275857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-1632b80a-758f-48ce-b660-38edc1254ab9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for user 9d2663d26c42412c8acb3ded09320213 and project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:39.347191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1632b80a-758f-48ce-b660-38edc1254ab9 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.141330 Oct 18 16:25:39.355793 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2757/5512] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:25:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 16:25:39.780490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:39.781726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:39.799355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:39.801914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:39.804325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:39.805841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:39.808230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:39.809406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:39.976389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:39.977187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:40.008752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:40.009282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:40.009820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:40.021914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:40.022512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:40.022989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:40.650353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:40.672978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1cce051-ff2e-40c4-b3f6-2e5ca7cf918a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.703187 Oct 18 16:25:40.674030 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2758/5513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:39 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:40.679958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:40.680898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:40.698372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:40.708418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:40.709163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:40.709888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:40.710628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:40.710628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:40.710957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:40.740637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2f7360da-635e-461a-b6b2-0fc551d5f079 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.965857 Oct 18 16:25:40.752980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:40.755461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2756/5514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:39 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:40.980183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:41.000668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ce0c7ae-5829-4082-9520-404647a4490a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1299 microversion: 2.1 time: 0.324847 Oct 18 16:25:41.024916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2759/5515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:40 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:41.710429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:41.712001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:41.717371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:41.734364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:41.736456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:41.742869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:41.744053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:41.744779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:41.746214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:41.778886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:41.780265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:41.804590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:41.805613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:41.806403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:41.812978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:41.814085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:41.815036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:42.364105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:42.411560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9feb67dd-6e72-4573-9737-ec54163ad736 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.640502 Oct 18 16:25:42.429403 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2760/5516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:41 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:42.491795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:42.496126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:42.549420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:42.550372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:42.552036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:42.561222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:42.563482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:42.563977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:42.683587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:42.704237 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24fe3e60-7747-4bff-804c-3f151d3b8f5d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.998685 Oct 18 16:25:42.737548 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2757/5517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:41 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:42.873179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1306daa-db3c-4a72-a389-17405ac6a96e", "name": "network-vif-plugged", "status": "completed", "tag": "2d653143-0fbf-47ba-8273-5e462bed7c5f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:42.928515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:42.942273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:42.943717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:42.999130 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] Creating event network-vif-plugged:2d653143-0fbf-47ba-8273-5e462bed7c5f for instance f1306daa-db3c-4a72-a389-17405ac6a96e on n-h2-858383-14 Oct 18 16:25:43.018999 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-dbbe0da8-9743-4711-bee0-95244e5870f2 req-83eb9afc-5f0f-4a06-9dd9-bff5ab07a73a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155712 Oct 18 16:25:43.026704 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2758/5518] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:43.468530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:43.469774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:43.480669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:43.483435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:43.501029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:43.502379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:43.506208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:43.507154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:44.041953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:44.958527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:44.979388 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-effeb1d4-370c-4784-b39d-a814b56f1ab7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 2.547278 Oct 18 16:25:44.983153 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2761/5519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:42 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:45.000700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:45.002134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:45.011067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.011865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.012696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.013964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.014693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.015445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.121719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:45.172064 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ce0f1bc-d675-4dc5-9edc-36033ff5efae tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 1.705271 Oct 18 16:25:45.174393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2759/5520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:43 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:45.201674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61", "tag": "6aded794-07df-4d94-9a68-61213b626e3b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:45.231736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.236400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.237589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.257897 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] Creating event network-changed:6aded794-07df-4d94-9a68-61213b626e3b for instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 on n-h1-858383-14 Oct 18 16:25:45.265124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b18678af-8266-4a04-a810-1ec88cb572f4 req-a5572c8b-f273-47a6-aa8a-069121b68610 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079498 Oct 18 16:25:45.266661 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2760/5521] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:45.629659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:45.640796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.641703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.642455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.695358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:45.718469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Going to try to stop instance {{(pid=120570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:25:45.762653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:45.778110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11fd9413-db40-4e35-a0b4-ae434c5d7fd3 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.792012 Oct 18 16:25:45.779874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2762/5522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:44 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:45.797720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:45.809265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3465d15-13bb-491b-ae3c-f8babdd12860 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action" status: 202 len: 0 microversion: 2.1 time: 0.186785 Oct 18 16:25:45.814278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2761/5523] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:25:45 2022] POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:25:45.822532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:45.823193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:45.830286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.830783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.831255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.832178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.832644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.833099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.030376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:46.031242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:46.051981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.052850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.054043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.055478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.056695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.057800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.371355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:46.385807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0bc056df-7cb5-4738-9068-374da4b82afd tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 0.567360 Oct 18 16:25:46.386644 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2763/5524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:45 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:46.393720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:46.394779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:46.419162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.426379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.427104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.428323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.429381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.430349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.723652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:46.756014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e370e0e8-aaef-49ce-b578-dee5670aa491 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.732711 Oct 18 16:25:46.758477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2762/5525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:46 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:46.807963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:46.808594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:46.824573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.825104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.825545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.826259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.826717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.827145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.873682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:46.906826 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-758b171b-b715-47f1-8acc-1c94a88056f5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1315 microversion: 2.1 time: 0.517013 Oct 18 16:25:46.915992 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2764/5526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:46 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:47.009949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdaf24c8-95cb-4100-af12-870c50388edc", "tag": "5f7f98fa-9d53-4b01-9a38-9ec8b0abce94"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:47.030238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.031489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.032892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.053278 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] Creating event network-changed:5f7f98fa-9d53-4b01-9a38-9ec8b0abce94 for instance cdaf24c8-95cb-4100-af12-870c50388edc on n-h2-858383-14 Oct 18 16:25:47.059796 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a8cfd8d3-b434-4e75-83e5-3d1957332296 req-fa373e0f-cce9-4739-a637-59dac1ff6b31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055269 Oct 18 16:25:47.061120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2765/5527] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:25:47.442394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:47.444282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:47.459295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.461804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.462712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.466163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.467042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.468402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.752617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:47.771513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24dc4f16-6486-4dd6-b236-17c09f6980ae tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.970831 Oct 18 16:25:47.785133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2763/5528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:46 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:47.807062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:47.807913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:47.817581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.818082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.818729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.819628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.820258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.820868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.012757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:48.027672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-699e1aae-f35e-4e4f-a306-38c0c864b008 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 0.597694 Oct 18 16:25:48.035617 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2766/5529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:47 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:48.049204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:48.051128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:48.066480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.068921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.070569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.072168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.073302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.074158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.266000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:48.281943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8229bdec-641f-49e3-be4d-4e21915a785c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.482304 Oct 18 16:25:48.283371 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2764/5530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:47 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:48.600087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1553248481", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38e8d636-af89-408a-8b6a-f4d4507bc5f5"}], "security_groups": [{"name": "tempest-securitygroup--1718191330"}], "key_name": "tempest-keypair-816311255", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:48.784848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] validate_networks() for [('38e8d636-af89-408a-8b6a-f4d4507bc5f5', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:25:48.807851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:48.821762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c4cf15c-3944-4667-9a02-a8e9142981ad tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1503 microversion: 2.1 time: 0.783523 Oct 18 16:25:48.822522 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2767/5531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:48 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1503 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:48.827381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:48.828091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:48.835645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.836520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.837245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.838206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.838882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.839532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.334452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:49.571678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:49.591738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c43a82b8-23e6-4c83-b5dc-485c9835a99f tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.767350 Oct 18 16:25:49.593328 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2768/5532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:48 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:49.624074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:49.635671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.637322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.637998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.681779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:25:49.755127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d132915d-ea7a-4c79-bcc9-80a3f3839ed4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e/action" status: 202 len: 0 microversion: 2.1 time: 0.136949 Oct 18 16:25:49.756743 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2769/5533] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:25:49 2022] POST /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:25:49.765181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:49.766525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:49.775738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.776675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.777658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.779763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.780721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.781620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.870792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:25:49.875442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:25:49.880585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:25:49.881910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:25:49.885809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:25:49.928528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.931741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.932696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.936141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.938284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.939908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.987617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:25:49.999835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Getting quotas for user 9d2663d26c42412c8acb3ded09320213 and project 31333817b5a74a6c9bb6cfcfb4ec940a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:25:50.028189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:25:50.033259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:25:50.158446 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24f40213-4dac-4571-a870-d8ebae7d2246 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.565156 Oct 18 16:25:50.159873 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2765/5534] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:25:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:25:50.166164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:50.167163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:50.174736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.175826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.177107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.178145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.178941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.179597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.706712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:50.719620 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e69ab97-9a0d-4b2f-8252-cc8a4388396f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.557922 Oct 18 16:25:50.720524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2766/5535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:50 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:50.731430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:50.742410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:50.753021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.756454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:50.758127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.758934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.760213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.763576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.764764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.783361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d81ca41-8835-4a77-b877-05cb57b80588 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 1.024655 Oct 18 16:25:50.813258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2770/5536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:49 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:50.845069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:50.849629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:51.043551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:51.060384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:51.069892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:51.069892 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-171291c4-b8ec-4dd5-b8a2-f24e82c9b6f6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1281 microversion: 2.20 time: 0.247223 Oct 18 16:25:51.082443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2771/5537] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:50 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:51.090517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:51.091285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:51.103530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.104304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.105161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:51.106473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.107330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.108135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:51.333157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:51.346978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f117cdc-9f40-461e-9b5f-035f3a252b29 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.263005 Oct 18 16:25:51.349219 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2772/5538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:51 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:51.772097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:51.773838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:51.782376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.783399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.784292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:51.785819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.786516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.787162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.009884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.039745 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40652a3c-8556-4708-8653-23ecbc7c47db tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.317544 Oct 18 16:25:52.040759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2767/5539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:50 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:52.052591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:52.053927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:52.077672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.079667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.082386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.084275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.085489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.086885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.403339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.422638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c8a9596-fe72-4a6b-8cc3-9ec0a8ee66a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.654665 Oct 18 16:25:52.437251 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2773/5540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:51 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:52.457987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:52.461240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:52.471941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.472961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.473952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.475416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.476459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.477452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.679611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.691575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.693820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.696078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dc7c3d6-6978-4e02-937e-36acf7c49852 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1339 microversion: 2.20 time: 0.257181 Oct 18 16:25:52.697303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2774/5541] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:52 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:52.716794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:52.720859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:52.747610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.747610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.748167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.748722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:52.749771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:52.749957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.821837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:52.842608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e5491f5-becb-496f-abac-8e6b93dfa1ab tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 0.799985 Oct 18 16:25:52.844945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2768/5542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:52 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:53.093558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:53.095584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:53.107074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:53.108282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:53.110555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:53.114031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:53.118687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:53.120385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:53.305857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:53.321762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6863fdcf-cd71-4aa2-855b-5a333da955a6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.622081 Oct 18 16:25:53.338700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2775/5543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:52 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:53.475221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:53.485966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:53.506180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:53.507684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:53.508790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:53.510385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:53.511533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:53.514852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:53.866310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:53.921515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:53.928100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65b11e4f-cc7e-4f63-a201-cf84eb9544e3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.465012 Oct 18 16:25:53.955106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2776/5544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:53 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:53.962543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:53.976082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:53.979725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:53.984756 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-70b6fecd-974f-4f8b-ae32-0ac41ba64de9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.889061 Oct 18 16:25:54.001684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2769/5545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:53 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:54.001684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:54.001684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:54.011269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.011767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.012212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.012924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.017711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.018182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.040228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.045318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.048729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.050005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.053914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.054687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.363743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:54.376432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:54.378954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:54.380416 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8580c7dd-e204-4461-81e4-bacafdf956cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1339 microversion: 2.20 time: 0.426341 Oct 18 16:25:54.381675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2777/5546] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:53 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:54.398400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:54.415330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:54.416514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:54.425080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.426251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.427816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.429421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.429707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c75655e-ddc0-482c-b6c6-5f7552271bbf tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 0.432976 Oct 18 16:25:54.430757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.445199 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2770/5547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:53 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:54.447087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.470237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61", "name": "network-vif-plugged", "status": "completed", "tag": "6aded794-07df-4d94-9a68-61213b626e3b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:54.506824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:54.516087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:54.517135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:54.561082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] Creating event network-vif-plugged:6aded794-07df-4d94-9a68-61213b626e3b for instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 on n-h1-858383-14 Oct 18 16:25:54.584254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ebb8a032-a190-4612-8a89-8a9b87171ff9 req-c996ec85-82fd-4269-860d-ca569b97ee37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120927 Oct 18 16:25:54.586004 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2771/5548] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:54.983231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:54.984623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:55.000539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:55.002137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:55.003283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:55.004921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:55.006163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:55.007235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:55.094418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:55.137757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd194823-6231-4c29-9988-4182291d2a2e tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1324 microversion: 2.1 time: 0.739187 Oct 18 16:25:55.140965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2778/5549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:54 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:55.174123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:55.176603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:55.193378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:55.198094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:55.199538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:55.200753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:55.202333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:55.206299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:55.207719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.031581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:56.044780 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a1fc17c-0e37-4dfc-96ed-91321dee9dc0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.902071 Oct 18 16:25:56.059756 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2779/5550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:55 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:56.059756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:56.060259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:56.086992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.087539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.087988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.089191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.089702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.090138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.096977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:56.110987 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc4ead3e-3906-4628-aef1-977249b012d7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 1.134556 Oct 18 16:25:56.114529 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2772/5551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:54 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:56.133446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:56.136240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:56.159617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.161426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.164919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.167645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.169688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.172298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.759485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:56.801118 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b5b6ba4-5df5-4ebd-b750-962e92c4c9da tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1678 microversion: 2.1 time: 0.669501 Oct 18 16:25:56.803978 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2773/5552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:56 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1678 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:56.816873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:56.822127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:56.852107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.854508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.856787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:56.860348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:56.866830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:56.868237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.030649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:57.078102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:57.080731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:57.084603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea5eeb14-9c84-4703-aab0-b1c7acc7f5fb tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 1.031318 Oct 18 16:25:57.085916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2780/5553] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:56 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:57.093729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:57.095333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:57.108222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.109645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.110942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.112476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.114403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.116774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.631152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:57.658129 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-42b9f1bc-2615-4053-94fe-476ce1c5aa90 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 200 len: 1520 microversion: 2.1 time: 0.851949 Oct 18 16:25:57.660914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2774/5554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:56 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 1520 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:57.679576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdaf24c8-95cb-4100-af12-870c50388edc", "name": "network-vif-plugged", "status": "completed", "tag": "5f7f98fa-9d53-4b01-9a38-9ec8b0abce94"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:57.700590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.701295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.702008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.715738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:57.722805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] Creating event network-vif-plugged:5f7f98fa-9d53-4b01-9a38-9ec8b0abce94 for instance cdaf24c8-95cb-4100-af12-870c50388edc on n-h2-858383-14 Oct 18 16:25:57.731259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8f71cc94-e349-4553-8c7f-333a7b07f383 req-9a4d5958-2e83-445e-9f30-762925bca866 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067969 Oct 18 16:25:57.732537 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2775/5555] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:57.740322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:57.741594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:57.754979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.755319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-979b7975-3c6a-4748-9454-bccad85fcd65 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.667909 Oct 18 16:25:57.757606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.760010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.762034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.763526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.764971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.770321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2781/5556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:57 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:57.780697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.218"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:57.795061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:57.823944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.826665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.827848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.829751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:57.831026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:57.832585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:57.890602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:25:57.891884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquired lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:25:58.241894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.258043 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0ffbb1f-9e16-40d4-97ef-b7a755da8d0e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1367 microversion: 2.1 time: 0.523939 Oct 18 16:25:58.263412 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2776/5557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:57 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1367 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:58.279494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:58.289539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:58.299886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.301685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.302557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.303925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.304672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.305610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.549206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.568314 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb6d99a8-5e9a-4808-9528-f9be345f914a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1655 microversion: 2.1 time: 0.301983 Oct 18 16:25:58.570917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2777/5558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:58 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1655 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:58.590252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:58.592155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:58.606419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.607232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.607680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.608406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.608856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.609493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.907189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.923470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.933597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.933597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d968908-336a-4478-a912-c3d1e37ff753 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.348375 Oct 18 16:25:58.933597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2778/5559] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:25:58 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:25:58.942218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:58.965525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.966407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.967212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.025899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Going to try to start instance {{(pid=120570) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:25:59.083646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:59.122740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a79a5142-568d-4ace-a960-7934145ae6b4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action" status: 202 len: 0 microversion: 2.1 time: 0.187373 Oct 18 16:25:59.124962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2779/5560] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:25:58 2022] POST /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:25:59.142362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:59.143132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:59.151460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.152143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.152414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.153333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.154459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.155632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.505733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:59.542845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-415c99b2-daa0-4f26-878a-3ccb7a5c9845 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.410429 Oct 18 16:25:59.544744 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2780/5561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:59 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:59.553857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:59.554673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:59.562982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.564126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.565136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.567639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.568611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.569534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.896805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:59.920063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9220a388-6c86-4840-a165-65c70913f2be tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1664 microversion: 2.1 time: 0.369355 Oct 18 16:25:59.923132 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2781/5562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:59 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1664 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:59.952609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:59.953748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:59.967179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.968192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.968950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.969764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.970326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.970803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.971438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:00.018221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:00.267494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:00.279510 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-325123d8-c6f1-4255-b84b-9087c08856a0 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1557 microversion: 2.1 time: 0.355011 Oct 18 16:26:00.286104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2782/5563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:59 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1557 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:00.302738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:00.303593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:00.313581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.314530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.315411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.317288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.318242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.319052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.691189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:00.714690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:00.716637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:00.716637 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d69606dd-9222-4e7c-95d7-5735d7c2fd4c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.429601 Oct 18 16:26:00.721577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2783/5564] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:00 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:00.742189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:00.762407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.763863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.765127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.792049 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] Creating event network-changed:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h1-858383-14 Oct 18 16:26:00.809533 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-62b39afc-ddad-43fe-97c7-b5418cc723e2 req-ef0f4cf7-e6ef-407f-8bb5-f60198929bb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084025 Oct 18 16:26:00.810418 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2784/5565] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:00.823435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:00.824727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:00.834577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.835182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.835702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.837670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.838434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.838956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:01.056176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:01.134112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e21d4938-6d4b-4f76-812a-8ae7bbe1c6df tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.322304 Oct 18 16:26:01.134918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2785/5566] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:26:00 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:01.142062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:01.148449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:01.168677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:01.178122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:01.178993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:01.180481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:01.181580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:01.182593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:02.172974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:02.186758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77c47f81-4abc-4eca-b7b8-ac82110fecf4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.050663 Oct 18 16:26:02.189725 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2786/5567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:01 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:02.202325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:02.203720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:02.225603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.226440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.227176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:02.228487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.229302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.230165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:02.819167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:02.842679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab38317e-88b3-4e90-9901-171b00812973 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1668 microversion: 2.1 time: 0.650033 Oct 18 16:26:02.857520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2787/5568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:02 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:02.875673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:02.881993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:02.900001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.901543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.902641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:02.904242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.905231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.906061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:03.350461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:03.377478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:03.385127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:03.390683 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87537cba-87f1-4762-95c6-177363f14554 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.530555 Oct 18 16:26:03.415566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2788/5569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:02 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:03.431919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:03.432574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:03.447997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:03.448945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:03.450990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:03.453496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:03.454396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:03.455251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:04.675367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:04.691953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6bbefcb4-be2e-4a1b-993d-aa368d185e59 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.273816 Oct 18 16:26:04.701579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2789/5570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:03 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:04.711644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:04.713928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:04.726383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:04.728299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:04.729500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:04.731083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:04.732324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:04.733690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:04.951297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Building network info cache for instance {{(pid=120571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:05.299431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:05.318952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:05.327843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:05.334298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-114b9ed9-9dfd-4475-a6a7-adbf36d5b69b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.630560 Oct 18 16:26:05.338171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2790/5571] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:04 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:05.355724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:05.390997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.392206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.392824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.422298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] Creating event network-changed:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:26:05.434531 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-01cfbf73-733b-4ecd-883c-0bef735dee49 req-6b72ec4e-b86b-4baf-bb8e-8a7a3b5b2518 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093768 Oct 18 16:26:05.436903 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2791/5572] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:06.314322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:06.315293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:06.328087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:06.332978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:06.333619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:06.335247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:06.336241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:06.337269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:07.494396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:07.528850 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88c6567e-4fca-458e-b3c4-7b0ba30f91e4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.783986 Oct 18 16:26:07.542268 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2792/5573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:05 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:07.570172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:07.571230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:07.574319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:07.587216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:07.588477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:07.589987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:07.591630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:07.593278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:07.594403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:07.814409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=7 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:07.926893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:07.978208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:07.985381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:07.991058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-850cf77f-a8b6-4b68-a4ab-a743424e856d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.437780 Oct 18 16:26:07.992771 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2793/5574] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:07 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:08.033925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdaf24c8-95cb-4100-af12-870c50388edc", "tag": "5f7f98fa-9d53-4b01-9a38-9ec8b0abce94"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:08.074326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:08.076929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:08.079554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:08.113318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] Creating event network-changed:5f7f98fa-9d53-4b01-9a38-9ec8b0abce94 for instance cdaf24c8-95cb-4100-af12-870c50388edc on n-h2-858383-14 Oct 18 16:26:08.157819 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a0d76ec9-d4ac-4562-bd96-a55da90485dc req-688eefbd-e085-4919-af7d-227004696e79 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156778 Oct 18 16:26:08.162276 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2794/5575] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:08.485505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Updating instance_info_cache with network_info: [{"id": "509d4bfa-3961-4033-8e42-52eef73eed38", "address": "fa:16:3e:ab:66:0e", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap509d4bfa-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:08.510051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Releasing lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:26:08.511295 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b708bdd-8e42-4ae1-81bf-a703dfdef002 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action" status: 202 len: 0 microversion: 2.1 time: 10.738276 Oct 18 16:26:08.512142 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2782/5576] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:25:57 2022] POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action => generated 0 bytes in 10740 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:26:08.531039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.218"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:08.559018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:08.575496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:08.579695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:08.579997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:08.580218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:08.580617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:08.581965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:08.582459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:08.582891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:08.600634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:08.601173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:08.601656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:08.602656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:08.603156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:08.603594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:08.677200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:26:08.679030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquired lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:26:09.665661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:09.680655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d78f632-32c0-439d-b262-bccabec3fb7e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.113097 Oct 18 16:26:09.681938 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2783/5577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:08 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:09.687229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:09.688399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:09.695754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:09.697511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:09.698469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:09.699605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:09.700584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:09.701603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:10.002582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:10.033675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:10.035750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:10.039902 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-075221b6-7559-4c2e-8b5e-e7418f49bdae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.356359 Oct 18 16:26:10.069580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2784/5578] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:09 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:10.710211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:10.711588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:10.722513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:10.723597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:10.727031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:10.728832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:10.732774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:10.733489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:11.278364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:11.320534 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e8f6632c-49b9-4b9b-8565-36ea1a65374d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.616250 Oct 18 16:26:11.322380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2785/5579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:10 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:11.344189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:11.345482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:11.363217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:11.364313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:11.365752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:11.367691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:11.368475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:11.369365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:11.905640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:11.952044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:11.955239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:11.958382 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8452806b-ff0c-4579-8107-465efb32f6de tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.633812 Oct 18 16:26:11.960268 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2786/5580] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:11 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:12.348032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:12.353718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:12.381369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:12.383571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:12.389887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:12.391629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:12.392661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:12.395467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:12.852722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:12.873239 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d9bd52d1-f67b-4dad-9594-5bcc491f5a26 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.530545 Oct 18 16:26:12.873887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2787/5581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:12 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:12.901209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "name": "network-vif-plugged", "status": "completed", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:12.950909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:12.955747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:12.957100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:13.002013 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] Creating event network-vif-plugged:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h1-858383-14 Oct 18 16:26:13.013182 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-04c01c23-99cb-4b86-9c02-9734f878260d req-aa9bf855-1c5d-43ef-84c2-8f7b0ce00ed5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137369 Oct 18 16:26:13.020543 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2788/5582] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:13.029554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:13.030547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:13.038029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:13.039099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:13.039842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:13.041559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:13.042238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:13.042837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:13.588445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:13.604044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:13.623639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:13.625413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a1404a0-d186-4644-b6e9-0e25ff548c55 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.602633 Oct 18 16:26:13.630654 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2789/5583] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:13 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:26:13.917389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:13.918951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:13.936260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:13.937199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:13.943220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:13.944538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:13.945253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:13.945935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:14.392422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:14.426094 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ca28c7a7-f67b-42d7-87cb-adbe43889da5 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.515621 Oct 18 16:26:14.472017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2790/5584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:13 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:14.671323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:14.672432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:14.686587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:14.687740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:14.688889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:14.689778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:14.691439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:14.692215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:15.356897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:15.370206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:15.380640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:15.382195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f895fde7-60a5-478e-bce1-0010280b5b61 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1407 microversion: 2.20 time: 0.717942 Oct 18 16:26:15.383374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2791/5585] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:14 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:26:15.489095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:15.493159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:15.507590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:15.508535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:15.511081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:15.512828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:15.513527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:15.514173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:15.784448 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.neutron [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] re-assign floating IP 172.25.2.218 from instance 2be43346-b77d-4f8e-badf-be7b6b1b689f Oct 18 16:26:15.890731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Building network info cache for instance {{(pid=120570) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:16.241669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:16.274909 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48a18919-bee8-48c9-af07-23df51007718 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.796174 Oct 18 16:26:16.277536 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2792/5586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:15 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:16.292517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:16.321051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:16.322351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:16.323373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:16.363771 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] Creating event network-changed:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:26:16.373389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-85d5989c-b347-42b9-a2f9-5d7812d31b8d req-2369b13f-0344-492f-a9dc-928546bdfd4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093503 Oct 18 16:26:16.376052 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2793/5587] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:16.422493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:16.424983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:16.451198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:16.452026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:16.452736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:16.453742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:16.454392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:16.454983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:16.490850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:16.913994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Updating instance_info_cache with network_info: [{"id": "509d4bfa-3961-4033-8e42-52eef73eed38", "address": "fa:16:3e:ab:66:0e", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap509d4bfa-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:16.945791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Building network info cache for instance {{(pid=120570) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:17.167581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:17.181762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:17.184897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:17.187009 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-371cbbe4-d20d-4238-b68e-3c4a2f0a545d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1598 microversion: 2.20 time: 0.773059 Oct 18 16:26:17.188315 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2794/5588] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:26:16 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1598 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:26:17.226022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:17.226535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:17.243745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:17.244693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:17.245704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:17.246844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:17.247656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:17.248349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:17.538760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01e5ede5-223b-4656-8efa-369a0c64729d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.318366 Oct 18 16:26:17.541492 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2795/5589] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:26:17 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:26:17.549084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:17.550819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:17.561203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:17.561979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:17.562630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:17.565680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:17.567334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:17.568092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:18.433954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Updating instance_info_cache with network_info: [{"id": "6aded794-07df-4d94-9a68-61213b626e3b", "address": "fa:16:3e:21:78:54", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6aded794-07", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120570) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:18.463745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Releasing lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:26:18.465251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f6f52eb-5ea4-4472-8287-4f18b4e413b6 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61/action" status: 202 len: 0 microversion: 2.1 time: 9.945800 Oct 18 16:26:18.466962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2795/5590] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:08 2022] POST /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61/action => generated 0 bytes in 9949 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:26:18.476984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61", "tag": "6aded794-07df-4d94-9a68-61213b626e3b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:18.521171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:18.524040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:18.524697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:18.525377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:18.534225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:18.548001 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80301c01-a120-4030-9250-48608293ac39 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 1.001937 Oct 18 16:26:18.549299 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2796/5591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:17 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:18.560452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.218"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:18.582339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] Creating event network-changed:6aded794-07df-4d94-9a68-61213b626e3b for instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 on n-h1-858383-14 Oct 18 16:26:18.593015 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8c0f9227-5da0-419a-95f9-b711248659d6 req-bf46e1f0-c90a-4b08-968e-510d5801d721 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120147 Oct 18 16:26:18.607240 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2796/5592] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:19.589032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:19.590485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:19.598773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:19.599265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:19.599704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:19.600420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:19.600878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:19.601352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:19.851208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:19.863081 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b144ba48-9d59-48a4-80c8-a260c942c413 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.278753 Oct 18 16:26:19.864591 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2797/5593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:19 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:20.247083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:20.265445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:20.266247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:20.266930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:20.268776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:20.269656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:20.270691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:20.891229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:20.892816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:20.913462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:20.914414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:20.915086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:20.919165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:20.922969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:20.927188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:21.653595 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] HTTP exception thrown: Floating IP 172.25.2.218 is not associated with instance 2be43346-b77d-4f8e-badf-be7b6b1b689f. Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Request method failure captured: Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action HTTP/1.1 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 49 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtNS6BKsJW4LL6d5fTTHtixrlEtYpKlBfs3zAEOdyTQXCZQ6scm8DJSjx_Vl0fAi0nLmkcyV0csFnNl6HXPjMcpbgUdP8vuMM3Yfa2dy0vI3cVNJ9I5vfoz0A13ETHBY494Zd6heEkE7K1Lgw5S6RfmPEO_C7EDhKfejc3RUh-TlGuo Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}] Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 509c1d87110a4122b3e7be91772ff2aa Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: {"removeFloatingIp": {"address": "172.25.2.218"}} Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: exception: Floating IP 172.25.2.218 is not associated with instance 2be43346-b77d-4f8e-badf-be7b6b1b689f. Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2be43346-b77d-4f8e-badf-be7b6b1b689f', 'body': {'removeFloatingIp': {'address': '172.25.2.218'}}} Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.218 is not associated with instance 2be43346-b77d-4f8e-badf-be7b6b1b689f. Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.218 is not associated with instance 2be43346-b77d-4f8e-badf-be7b6b1b689f. Oct 18 16:26:21.657296 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:21.664093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Returning 409 to user: Floating IP 172.25.2.218 is not associated with instance 2be43346-b77d-4f8e-badf-be7b6b1b689f. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:21.665711 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-779c23c9-562c-4317-a054-c37b9ddfb5a0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action" status: 409 len: 146 microversion: 2.1 time: 3.114286 Oct 18 16:26:21.672891 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2797/5594] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:18 2022] POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action => generated 146 bytes in 3122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:26:21.680370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.218"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:21.733831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:21.755304 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3f0b35b-fc58-4b41-a219-5bfb788962c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1513 microversion: 2.1 time: 0.870929 Oct 18 16:26:21.755920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2798/5595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:20 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1513 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:22.258765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:22.271668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:22.272471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:22.273455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:22.274459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:22.275152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:22.275894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:22.785932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:22.787075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:22.800539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:22.801479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:22.802496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:22.803686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:22.804471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:22.805331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:23.058028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:26:23.059124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquired lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:26:23.199514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:23.208957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3467a89e-195f-406a-b553-b64b52c38667 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1490 microversion: 2.1 time: 0.429801 Oct 18 16:26:23.214813 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2799/5596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:22 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1490 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:23.247833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:23.248791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:23.262618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:23.264243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:23.264939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:23.272844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:23.273913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:23.274603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:23.339520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:26:23.521678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4aebfc63-7f4b-4a7f-afa1-ed2e44f5642c tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 204 len: 0 microversion: 2.1 time: 0.277351 Oct 18 16:26:23.522761 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2800/5597] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:23 2022] DELETE /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:24.129948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:24.173632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:24.174684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:24.175127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:24.209476 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] Creating event network-changed:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h1-858383-14 Oct 18 16:26:24.224797 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-46b13130-e5c7-4e81-bcad-0c50c928315e req-9ea3b17a-4b8b-4af4-a5e4-583390bb7cbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698786 Oct 18 16:26:24.228688 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2801/5598] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:24.240552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:24.242325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:24.251133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:24.251878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:24.252700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:24.253622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:24.254280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:24.254864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:25.126404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:25.143998 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55975ea5-1f53-49ab-8192-c6e13f989248 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1496 microversion: 2.1 time: 0.913271 Oct 18 16:26:25.153110 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2802/5599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:24 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1496 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:25.810419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Building network info cache for instance {{(pid=120571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:26.184389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:26.191153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:26.217153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:26.217818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:26.218648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:26.219626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:26.222876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:26.223489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:26.809207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Updating instance_info_cache with network_info: [{"id": "6aded794-07df-4d94-9a68-61213b626e3b", "address": "fa:16:3e:21:78:54", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6aded794-07", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:26.834339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Releasing lock "refresh_cache-bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:26:26.838867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ad8af76-c57b-4754-9f8e-224b4f66d3be tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61/action" status: 202 len: 0 microversion: 2.1 time: 5.162509 Oct 18 16:26:26.841069 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2798/5600] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:21 2022] POST /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61/action => generated 0 bytes in 5167 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:26:26.857031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61", "tag": "6aded794-07df-4d94-9a68-61213b626e3b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:26.879215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:26.880788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:26.881946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:26.923533 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] Creating event network-changed:6aded794-07df-4d94-9a68-61213b626e3b for instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 on n-h1-858383-14 Oct 18 16:26:26.941385 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f1a248f8-7ae5-43be-97a8-456f515d7df1 req-cd64b645-b827-4eb0-84d5-6d29349308dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095138 Oct 18 16:26:26.947003 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2799/5601] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:26.961752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:26.962425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:26.994114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:26.995607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:27.000662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:27.013726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:27.014238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:27.014683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:27.072252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:26:27.285107 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-deda33d8-dd74-4df8-9d1a-b848724e1566 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 204 len: 0 microversion: 2.1 time: 0.336145 Oct 18 16:26:27.285912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2800/5602] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:26 2022] DELETE /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:27.320565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.218"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:27.329365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:27.337639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:27.346952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:27.347460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:27.347912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:27.348643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:27.349141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:27.349577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:27.355167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0621c17c-578c-4547-a7ff-b74c5a9974df tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1496 microversion: 2.1 time: 1.176420 Oct 18 16:26:27.356741 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2803/5603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:26 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1496 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:27.441880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:26:27.441880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquired lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:26:28.195045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1306daa-db3c-4a72-a389-17405ac6a96e", "name": "network-vif-deleted", "tag": "2d653143-0fbf-47ba-8273-5e462bed7c5f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:28.246001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.247012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.247790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.303889 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] Creating event network-vif-deleted:2d653143-0fbf-47ba-8273-5e462bed7c5f for instance f1306daa-db3c-4a72-a389-17405ac6a96e on n-h2-858383-14 Oct 18 16:26:28.320512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-05ea1004-d92f-49e4-94c2-ba4bfc4df242 req-cb947b2d-ace9-46f0-8d6c-2825c2c7a025 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129863 Oct 18 16:26:28.322448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2804/5604] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:28.394138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:28.395025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:28.411753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.412262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.414192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.415453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.416241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.416693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.468562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.469094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.469630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.470309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lazy-loading 'fault' on Instance uuid f1306daa-db3c-4a72-a389-17405ac6a96e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:26:28.622653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:28.643662 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9291236b-2955-4547-b126-d58c30bbe3c7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 200 len: 1305 microversion: 2.1 time: 0.254165 Oct 18 16:26:28.653968 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2805/5605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:28 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 1305 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:29.700930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:29.702358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:29.734266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:29.738944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:29.741583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:29.745520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:29.747315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:29.754224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:29.816726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e HTTP/1.1 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f1306daa-db3c-4a72-a389-17405ac6a96e'} Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:29.823295 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:26:29.831490 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:29.838451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:29.847607 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26211787-ee3d-41e1-84cd-df6737541f34 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 404 len: 111 microversion: 2.1 time: 0.158333 Oct 18 16:26:29.870298 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2806/5606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:29 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:30.098968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1936641530", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e49769bd-eb2f-4952-a133-53153b740116"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:30.258379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] validate_networks() for [('e49769bd-eb2f-4952-a133-53153b740116', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:26:31.996967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Building network info cache for instance {{(pid=120571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:32.537620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:26:32.538868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:26:32.539779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:26:32.540435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:26:32.541162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:26:32.564887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:32.566549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:32.569005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:32.571970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:32.572676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:32.575746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:32.637674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:32.647722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Getting quotas for user ce708efbc05d40c7a2a04173d9871991 and project 4eeba274a6f342c1984385aa9a7fd804. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:32.665983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:26:32.668853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:26:32.751499 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aea275c1-6016-4f26-98a4-34d1c8c896d7 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.661577 Oct 18 16:26:32.763034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2807/5607] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:26:32.773182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61", "name": "network-vif-deleted", "tag": "6aded794-07df-4d94-9a68-61213b626e3b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:32.786477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:32.787263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:32.787864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:32.802118 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] Creating event network-vif-deleted:6aded794-07df-4d94-9a68-61213b626e3b for instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 on n-h1-858383-14 Oct 18 16:26:32.809220 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d370c70a-f5d0-4422-9a42-3e41d06ab481 req-d9988147-b1d6-435a-9ffe-8bb8153b6940 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044058 Oct 18 16:26:32.810199 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2808/5608] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:32.816028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-598d80e9-d396-460b-a17f-a96234d6f348 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:32.817204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-598d80e9-d396-460b-a17f-a96234d6f348 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:33.097612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-598d80e9-d396-460b-a17f-a96234d6f348 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:33.107628 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-598d80e9-d396-460b-a17f-a96234d6f348 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1215 microversion: 2.1 time: 0.295854 Oct 18 16:26:33.108247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2809/5609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:32 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:33.865980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Updating instance_info_cache with network_info: [{"id": "509d4bfa-3961-4033-8e42-52eef73eed38", "address": "fa:16:3e:ab:66:0e", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap509d4bfa-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:33.888026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Releasing lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:26:33.889859 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2412792-15c6-4b34-8fbd-c434aaa1051a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action" status: 202 len: 0 microversion: 2.1 time: 6.587151 Oct 18 16:26:33.890685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2801/5610] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:27 2022] POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action => generated 0 bytes in 6589 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:26:33.900335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3997d77-91c8-4ede-add9-b24f6fb09ff0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '.version_select at 0x7f5fd64f8160>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:34.135945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:34.137601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:34.154509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.156393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.157512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.159113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.175205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.175664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.409519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:34.440230 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5aae7686-6ac9-44b1-950f-e74c03cfe86d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1267 microversion: 2.1 time: 0.304949 Oct 18 16:26:34.447869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2802/5611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:34 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:34.481363 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3997d77-91c8-4ede-add9-b24f6fb09ff0 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/e90a3891-e753-42a5-847d-825a560d189b" status: 200 len: 185 microversion: 2.1 time: 0.585023 Oct 18 16:26:34.482585 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2810/5612] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:26:33 2022] GET /compute/v2.1/os-floating-ips/e90a3891-e753-42a5-847d-825a560d189b => generated 185 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:34.497511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.218"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:34.873813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:34.885710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.893211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.896894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.900534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.901348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.902023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.975996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:35.018743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:35.022634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:35.023595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:35.066407 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] Creating event network-changed:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:26:35.101060 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-aaaa31b3-44d5-416e-9ea4-68f57ed4dc39 req-aa28c62e-aac4-43b6-ba46-acb35ccb7511 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129096 Oct 18 16:26:35.103778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2811/5613] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:35.502546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:35.508413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:35.530684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:35.534928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:35.536076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:35.537236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:35.542368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:35.545024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:35.921825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:35.998571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37dc1781-7ed0-49da-86ae-cb617d8696ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1273 microversion: 2.1 time: 0.514848 Oct 18 16:26:36.000417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2812/5614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:35 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1273 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:36.176647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 16:26:36.177802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquired lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 16:26:37.023940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:37.024771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:37.040422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:37.040838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:37.055945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:37.061199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:37.070089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:37.071627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:37.380177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:37.395226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8cf7ae02-c010-47ab-a7ff-8bfd04e64ad0 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.375064 Oct 18 16:26:37.400867 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2813/5615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:37 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:38.427435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.430973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:38.457652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:38.495273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.497428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Building network info cache for instance {{(pid=120571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 16:26:38.498106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.501138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.505795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.509417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.541398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.213025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:39.243799 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d73897cd-ba7d-44f3-afed-e930b28c7d86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.823352 Oct 18 16:26:39.256183 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2814/5616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:38 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:39.275549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:39.320220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:39.321020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:39.325098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.371285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] Creating event network-changed:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:26:39.395052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3c235de2-8ef0-403b-ab80-244c021519a3 req-33dd8748-837c-49a1-960b-43f05766f508 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134023 Oct 18 16:26:39.398766 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2815/5617] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:39.796941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Updating instance_info_cache with network_info: [{"id": "509d4bfa-3961-4033-8e42-52eef73eed38", "address": "fa:16:3e:ab:66:0e", "network": {"id": "e45154d8-c7d4-4540-811b-4b3851cf5069", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-249498834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f60dce1cd8eb41018541468ed4be516e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap509d4bfa-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 16:26:39.816519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Releasing lock "refresh_cache-2be43346-b77d-4f8e-badf-be7b6b1b689f" {{(pid=120571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 16:26:39.818227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32f235f6-c8f6-4197-9b4e-fadba10c7d3c tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action" status: 202 len: 0 microversion: 2.1 time: 5.325783 Oct 18 16:26:39.819971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2803/5618] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:34 2022] POST /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f/action => generated 0 bytes in 5329 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 16:26:39.831450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:39.832205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:39.851786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:39.852432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:39.854515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.855405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:39.857192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:39.858894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.912246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] HTTP exception thrown: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Request method failure captured: Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 HTTP/1.1 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtNS6BKsJW4LL6d5fTTHtixrlEtYpKlBfs3zAEOdyTQXCZQ6scm8DJSjx_Vl0fAi0nLmkcyV0csFnNl6HXPjMcpbgUdP8vuMM3Yfa2dy0vI3cVNJ9I5vfoz0A13ETHBY494Zd6heEkE7K1Lgw5S6RfmPEO_C7EDhKfejc3RUh-TlGuo Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}] Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 509c1d87110a4122b3e7be91772ff2aa Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61'} Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:39.920182 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Returning 404 to user: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:39.926447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-027fc718-b239-49bb-b6ed-abbe280c2120 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 404 len: 111 microversion: 2.1 time: 0.097530 Oct 18 16:26:39.931369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2816/5619] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:39 2022] DELETE /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:39.934432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:39.935080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:39.937119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:39.953969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:39.959187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:39.967750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.969587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:39.974061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:39.975197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:40.043736 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] HTTP exception thrown: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Request method failure captured: Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 HTTP/1.1 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtNS6BKsJW4LL6d5fTTHtixrlEtYpKlBfs3zAEOdyTQXCZQ6scm8DJSjx_Vl0fAi0nLmkcyV0csFnNl6HXPjMcpbgUdP8vuMM3Yfa2dy0vI3cVNJ9I5vfoz0A13ETHBY494Zd6heEkE7K1Lgw5S6RfmPEO_C7EDhKfejc3RUh-TlGuo Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}] Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 509c1d87110a4122b3e7be91772ff2aa Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61'} Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:40.045871 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Returning 404 to user: Instance bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5c9329f-4aeb-4ff1-8753-93b5327fd37a tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61" status: 404 len: 111 microversion: 2.1 time: 0.117209 Oct 18 16:26:40.060162 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2804/5620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:39 2022] GET /compute/v2.1/servers/bc84973b-8e2c-4c6f-b9c1-4b5a169e2f61 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:40.073757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3dc50ff7-3ada-488a-8207-cba6bcc3949d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '.version_select at 0x7f5fd6522c10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:40.282228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:40.284453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:40.311645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:40.312496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:40.313303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:40.314632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:40.315414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:40.316145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.206106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:41.216169 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b1d60181-9da7-4499-a558-91cd0100c9be tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.940519 Oct 18 16:26:41.230978 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2805/5621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:40 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:41.838892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435a6ec9-95af-4e3e-ad27-0b7afbdc6d39", "tag": "674a7804-c632-42b3-861e-97e2a18b3dd2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:41.865804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:41.866651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:41.868776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.889509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] Creating event network-changed:674a7804-c632-42b3-861e-97e2a18b3dd2 for instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 on n-h2-858383-14 Oct 18 16:26:41.909407 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-858fc481-11c3-4274-b844-f9181f12a819 req-67f3bfa9-2e84-45be-b3f5-f6b977738571 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.550297 Oct 18 16:26:41.911266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2806/5622] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:42.271045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:42.272625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:42.291916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.292609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.295302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.296412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.299447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.300150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.612705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:42.778688 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3dc50ff7-3ada-488a-8207-cba6bcc3949d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e90a3891-e753-42a5-847d-825a560d189b" status: 202 len: 0 microversion: 2.1 time: 2.712728 Oct 18 16:26:42.779502 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2817/5623] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:26:40 2022] DELETE /compute/v2.1/os-floating-ips/e90a3891-e753-42a5-847d-825a560d189b => generated 0 bytes in 2716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:26:42.793366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:42.794523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:42.806792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.807951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.809112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.811293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.812218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.812891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.842531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:42.871216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f253b94-6f21-4b0c-a2de-37667ae32ebb tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.602746 Oct 18 16:26:42.872748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2807/5624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:42 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:42.887538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:26:42.963982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:43.098442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd85f97e-d991-413b-8dd2-85ee152031de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 204 len: 0 microversion: 2.1 time: 0.311579 Oct 18 16:26:43.099640 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2818/5625] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:42 2022] DELETE /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:43.114437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:43.115321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:43.125443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:43.128791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:43.130211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:43.130607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:43.131153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:43.131596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:43.452217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:43.475411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bdf8bc7-1e6a-4816-85be-65cbe732e823 tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1526 microversion: 2.1 time: 0.369581 Oct 18 16:26:43.477274 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2808/5626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:43 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1526 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:43.905450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:43.908581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:43.912454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:43.932333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:43.933688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:43.935608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:43.937192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:43.938359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:43.939223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:44.209717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:44.232941 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b37aa6c3-583b-4ab1-81b7-136656993dd8 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.334906 Oct 18 16:26:44.245260 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2819/5627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:43 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:44.519286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:44.520137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:44.532470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:44.533796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:44.534504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:44.535240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:44.535699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:44.536134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:44.540799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:44.922848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:44.950937 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59dad928-879a-4fb0-a585-0b83111e98de tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1526 microversion: 2.1 time: 0.436542 Oct 18 16:26:44.965391 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2809/5628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:44 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1526 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:45.276851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:45.279148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:45.313597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:45.314992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:45.320517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:45.321691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:45.322550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:45.323352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:45.849924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:45.858323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a756fbde-1633-4e08-8bc6-9f00b0ba2f32 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.589537 Oct 18 16:26:45.859169 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2820/5629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:45 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:45.977374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:45.978052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:45.993328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:45.993828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:45.995522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:45.999124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:46.000087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:46.000708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:46.272542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be43346-b77d-4f8e-badf-be7b6b1b689f", "name": "network-vif-deleted", "tag": "509d4bfa-3961-4033-8e42-52eef73eed38"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:46.288982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c1d87110a4122b3e7be91772ff2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60dce1cd8eb41018541468ed4be516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:46.292201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:46.293325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:46.294182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:46.303876 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-38ba5bd1-aa0c-4217-88b1-f260f4eb5ffe tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 200 len: 1484 microversion: 2.1 time: 0.331625 Oct 18 16:26:46.305424 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2810/5630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:45 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 1484 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:46.317392 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] Creating event network-vif-deleted:509d4bfa-3961-4033-8e42-52eef73eed38 for instance 2be43346-b77d-4f8e-badf-be7b6b1b689f on n-h1-858383-14 Oct 18 16:26:46.326771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-226b8542-cc29-4eb3-a1e6-0dbbb340fafe req-08b90f12-966a-4058-bb02-4a55a7f0dd87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061304 Oct 18 16:26:46.327466 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2821/5631] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:46.891582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:46.892807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:46.906195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:46.907088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:46.908240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:46.909797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:46.910872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:46.912534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:47.170314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:47.182141 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cf6d289-b669-4602-8ec5-8a37bae56914 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.297564 Oct 18 16:26:47.182742 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2811/5632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:46 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:47.336229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:47.336947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] [instance: 2be43346-b77d-4f8e-badf-be7b6b1b689f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:47.348541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:47.349070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:47.349711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:47.350615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:47.355788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:47.356488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:47.373625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] HTTP exception thrown: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Request method failure captured: Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f HTTP/1.1 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtNS6BKsJW4LL6d5fTTHtixrlEtYpKlBfs3zAEOdyTQXCZQ6scm8DJSjx_Vl0fAi0nLmkcyV0csFnNl6HXPjMcpbgUdP8vuMM3Yfa2dy0vI3cVNJ9I5vfoz0A13ETHBY494Zd6heEkE7K1Lgw5S6RfmPEO_C7EDhKfejc3RUh-TlGuo Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f60dce1cd8eb41018541468ed4be516e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f60dce1cd8eb41018541468ed4be516e"}]}] Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f60dce1cd8eb41018541468ed4be516e Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472468070 Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 509c1d87110a4122b3e7be91772ff2aa Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472468070-project Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '2be43346-b77d-4f8e-badf-be7b6b1b689f'} Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:47.375763 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:26:47.383684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] Returning 404 to user: Instance 2be43346-b77d-4f8e-badf-be7b6b1b689f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:47.384805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8dbb177d-1c7d-4493-97cf-504bde9c500d tempest-FloatingIPsAssociationTestJSON-1472468070 tempest-FloatingIPsAssociationTestJSON-1472468070-project] 10.222.0.78 "GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f" status: 404 len: 111 microversion: 2.1 time: 0.053915 Oct 18 16:26:47.389782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2822/5633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:47 2022] GET /compute/v2.1/servers/2be43346-b77d-4f8e-badf-be7b6b1b689f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:48.209081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:48.210357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:48.217804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:48.219378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:48.220112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:48.221207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:48.221680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:48.222115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:48.673048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:48.692338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f236329-e43b-4027-910c-cee2c8e5489b tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.489381 Oct 18 16:26:48.693586 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2812/5634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:48 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:49.730175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:49.731222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:49.754570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:49.755507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:49.764967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:49.776213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:49.776835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:49.777333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:50.314973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:50.333805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0930bb5d-2ab3-4b9e-883a-457c55dba32d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.618528 Oct 18 16:26:50.349233 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2823/5635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:49 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:51.308665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435a6ec9-95af-4e3e-ad27-0b7afbdc6d39", "name": "network-vif-plugged", "status": "completed", "tag": "674a7804-c632-42b3-861e-97e2a18b3dd2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:51.343416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:51.346020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:51.347339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:51.374069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:51.374705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:51.386818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:51.392754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] Creating event network-vif-plugged:674a7804-c632-42b3-861e-97e2a18b3dd2 for instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 on n-h2-858383-14 Oct 18 16:26:51.395115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:51.400141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:51.402295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:51.406127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:51.408197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:51.408850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ca3d6f45-7c18-446f-8025-6918f901e512 req-69fc19e0-b627-4e5e-98b1-d1b9342e7c04 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105602 Oct 18 16:26:51.410439 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2813/5636] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:52.043064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:52.061559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-686d546b-03ba-4f4e-94a6-2b04884a2e75 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.688122 Oct 18 16:26:52.062877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2824/5637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:51 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:26:53.108886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:53.112886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:53.166930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:53.167761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:53.168519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:53.177854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:53.178675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:53.179430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:53.776891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:53.791825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7fd5467-3b33-4099-af52-61f66000bf86 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1315 microversion: 2.1 time: 0.701846 Oct 18 16:26:53.809285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2814/5638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:53 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:54.819272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:54.819899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:54.837354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:54.844838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:54.847371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:54.849345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:54.851195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:54.853315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.176041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:55.192597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24cd3689-eaeb-46ed-aca5-892ebc8a6658 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1503 microversion: 2.1 time: 0.376411 Oct 18 16:26:55.207171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2825/5639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:54 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:55.223679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:55.224286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:55.232771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.233717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.236142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.240638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.245902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.246555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.299294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lazy-loading 'flavor' on Instance uuid 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:26:55.521866 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d728875-1dc7-4352-9234-e5145786c3ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "POST /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39/action" status: 202 len: 0 microversion: 2.1 time: 0.288906 Oct 18 16:26:55.530077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2815/5640] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:55 2022] POST /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:26:55.542054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:55.545822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:55.557311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.567329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.571887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.572687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.573211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.573660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.912375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:55.928000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07f10ae5-521e-4e51-92b6-a11809cacd6d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1511 microversion: 2.1 time: 0.392023 Oct 18 16:26:55.943498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2826/5641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:55 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:56.967919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:56.968593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:56.982974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:56.983473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:56.983918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:56.984637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:56.985455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:56.986406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:57.193594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5eae3755-f48c-4da5-acc2-eb8e265754dc tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd6485160>, body: {"keypair": {"name": "tempest-keypair-2123645679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkDdUFR0SNCuyDWJUcrIijxMV9VNmTh6prweDVSMww8Ak1UjKm2DaCPEIwdAhsEgjNT3tD28lm1SGikCxduT+iOruCJQrcPpy6zSad/cWYelFB2JbzzDW2+T6ZsXpru+g=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.214301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5eae3755-f48c-4da5-acc2-eb8e265754dc tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.222404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5eae3755-f48c-4da5-acc2-eb8e265754dc tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:57.258709 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5eae3755-f48c-4da5-acc2-eb8e265754dc tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.300142 Oct 18 16:26:57.267254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2816/5642] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 310 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 16:26:57.275041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1c8c5aa-7923-4ab3-a3fc-84e6f476440f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd132dee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.288204 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1c8c5aa-7923-4ab3-a3fc-84e6f476440f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-2123645679" status: 200 len: 513 microversion: 2.2 time: 0.019069 Oct 18 16:26:57.295707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2817/5643] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 18 16:26:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2123645679 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:57.304201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-447a02b3-7651-4139-9893-6e49ec89456d tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11b49d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.331273 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-447a02b3-7651-4139-9893-6e49ec89456d tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123645679" status: 204 len: 0 microversion: 2.2 time: 0.033183 Oct 18 16:26:57.341816 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2818/5644] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Oct 18 16:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123645679 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:57.359416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acb7d9d1-329e-42f4-a2ac-d45484eeb9dd tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd11d04c0>, body: {"keypair": {"name": "tempest-keypair-825746111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQJ340XusWgsPw6DMh2smIzaOe6C9Wp/j4I4lLDOZarTi1b1fq39nZPlQ/j8nh2yE2Q2CR0hf3zH8mZFCH586TSqtdf9VVpu3ZhPAlD7n91Et1R4JZaZWkJ+N9Kwsc5iQ=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.386778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-acb7d9d1-329e-42f4-a2ac-d45484eeb9dd tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.402518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-acb7d9d1-329e-42f4-a2ac-d45484eeb9dd tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:57.452103 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acb7d9d1-329e-42f4-a2ac-d45484eeb9dd tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.108969 Oct 18 16:26:57.460153 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2819/5645] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:26:57.465665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-054a13a2-0a7d-4ca7-9e0c-4d2fdc85712c tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11d01f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.488775 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-054a13a2-0a7d-4ca7-9e0c-4d2fdc85712c tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825746111" status: 204 len: 0 microversion: 2.2 time: 0.026949 Oct 18 16:26:57.496609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2820/5646] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 18 16:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825746111 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:57.502811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecfc92ce-9724-4fab-b9a4-b337cd2e5aff tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd16fe310>, body: {"keypair": {"name": "tempest-keypair-26219625", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.524448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ecfc92ce-9724-4fab-b9a4-b337cd2e5aff tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.536864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ecfc92ce-9724-4fab-b9a4-b337cd2e5aff tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:57.570689 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecfc92ce-9724-4fab-b9a4-b337cd2e5aff tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.072268 Oct 18 16:26:57.577433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2821/5647] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:26:57.589264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a78d8eac-c0a6-4766-9c68-616ace0082b9 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11d01f0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.637301 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a78d8eac-c0a6-4766-9c68-616ace0082b9 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-26219625" status: 204 len: 0 microversion: 2.2 time: 0.056350 Oct 18 16:26:57.638556 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2822/5648] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 18 16:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-26219625 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:57.656210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0aa75d9c-9f1f-42af-902e-9847ead43168 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd11b4af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1228565290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI1P3nzCh+K0Qs8DggOFmOP+UOTGWLZf1Tj8rWoh1l9wLNmZQTPZ03LvUZj0rkR6eq8bv14fa7Rfl1ybeNYLi4N1gjhuhfNnHY8/XRpNgiJYF6QISCIlY7gjHeXkkWSHg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.691817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0aa75d9c-9f1f-42af-902e-9847ead43168 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.700453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:57.714960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7757239a-9f83-4d86-b93f-96e90299de21 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1494 microversion: 2.1 time: 0.750617 Oct 18 16:26:57.716955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2827/5649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:56 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1494 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:57.718260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0aa75d9c-9f1f-42af-902e-9847ead43168 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:57.742044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.743054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:57.777021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:57.777718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:57.780781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:57.783059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:57.783923 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0aa75d9c-9f1f-42af-902e-9847ead43168 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.134410 Oct 18 16:26:57.785170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:57.785814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2823/5650] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:26:57.795861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:57.801047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0072a97-c032-487e-9f63-a01579e7beee tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd12ad4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-802253049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzJPSZSM9utspAVKsKUYFuuT72LeUet7vzNKPW6MQQQk8Xwg5t56bXw0D6JrWq9uM0EZ4I8cH7hPZhm51zyTDnMYGUVec/k+LgRZ2+OzKC+ZJN4/+kjFYLKppGypAHWfA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.847584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d0072a97-c032-487e-9f63-a01579e7beee tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.864231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-d0072a97-c032-487e-9f63-a01579e7beee tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:57.885559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:26:57.915053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0072a97-c032-487e-9f63-a01579e7beee tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.119381 Oct 18 16:26:57.919836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2824/5651] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 16:26:57.944532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be4bd7c2-c35a-466d-a7f5-bb045d05bce1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd11b4790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1957529974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME4TRqJ84227qDiizz9s1SoAhTuRdcnevy9+0r/sldkAVtReXFjxbD598bSLxBGkWl04L8EINao6djU8pOcIwFz/jYv7yYZLMa97CubvsUNjmklCKOzlFUZcIh2b2mzHw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:57.958669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:57.975323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-be4bd7c2-c35a-466d-a7f5-bb045d05bce1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:57.984085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-be4bd7c2-c35a-466d-a7f5-bb045d05bce1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:58.019261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be4bd7c2-c35a-466d-a7f5-bb045d05bce1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.093499 Oct 18 16:26:58.022756 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2825/5652] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 16:26:58.045932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-246d30f2-8611-4a26-b16f-84bcde2c6d1c tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11d0430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.054243 n-d-858383-14 devstack@n-api.service[120571]: WARNING oslo_db.sqlalchemy.utils [None req-246d30f2-8611-4a26-b16f-84bcde2c6d1c tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:26:58.085464 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-246d30f2-8611-4a26-b16f-84bcde2c6d1c tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.056907 Oct 18 16:26:58.086167 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2826/5653] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 18 16:26:58 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:58.116248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b30dd97d-df20-44a7-b105-0fdea4f28e1f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11b4a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.143519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8471a29a-2d60-4ab9-a08e-28f729efb0ce tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 204 len: 0 microversion: 2.1 time: 0.404483 Oct 18 16:26:58.146879 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2828/5654] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:57 2022] DELETE /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:58.164012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.166390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:58.174579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b30dd97d-df20-44a7-b105-0fdea4f28e1f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957529974" status: 204 len: 0 microversion: 2.2 time: 0.071141 Oct 18 16:26:58.175055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2827/5655] 10.222.0.78 () {60 vars in 1321 bytes} [Tue Oct 18 16:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957529974 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:58.184158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24c4912e-a656-4ab4-ac65-c8195a312218 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd12adf70>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.200642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:58.201185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:58.204733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:58.206412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:58.207231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:58.208323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:58.223078 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24c4912e-a656-4ab4-ac65-c8195a312218 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-802253049" status: 204 len: 0 microversion: 2.2 time: 0.043019 Oct 18 16:26:58.223562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2828/5656] 10.222.0.78 () {60 vars in 1318 bytes} [Tue Oct 18 16:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-802253049 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:58.246448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b512e19-f135-475b-b2f8-34efe6296ac5 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd12cbc10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.284509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b512e19-f135-475b-b2f8-34efe6296ac5 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1228565290" status: 204 len: 0 microversion: 2.2 time: 0.054927 Oct 18 16:26:58.285522 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2829/5657] 10.222.0.78 () {60 vars in 1321 bytes} [Tue Oct 18 16:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1228565290 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:58.306005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24c0f460-2425-49cd-b6fa-673c55e688e1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd6570280>, body: {"keypair": {"name": "tempest-keypair-657538518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcONWVNlCHBDBwiXpJ95JaVvdFR4dSQiBcacBh0+C0eaMJ5Yyc2qdRkiTM7OiXK1yXOdsrOVnrO4mtE43zz4inGnR3pnSQrblR6l603p7dPMG00AGr9njh2rFc0jgtilg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:58.335105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-24c0f460-2425-49cd-b6fa-673c55e688e1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:58.345407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-24c0f460-2425-49cd-b6fa-673c55e688e1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:58.401536 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24c0f460-2425-49cd-b6fa-673c55e688e1 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.103013 Oct 18 16:26:58.402775 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2830/5658] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 18 16:26:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 16:26:58.430333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d93ac5f0-fdce-4a34-8f63-8d34f74b5742 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11d0700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.456518 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d93ac5f0-fdce-4a34-8f63-8d34f74b5742 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-657538518" status: 200 len: 512 microversion: 2.2 time: 0.046830 Oct 18 16:26:58.464129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2831/5659] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 18 16:26:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-657538518 => generated 512 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:58.469794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b902f731-072e-4382-afab-2c2c106f5f82 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd1302310>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.481094 n-d-858383-14 devstack@n-api.service[120571]: WARNING oslo_db.sqlalchemy.utils [None req-b902f731-072e-4382-afab-2c2c106f5f82 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:26:58.494250 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b902f731-072e-4382-afab-2c2c106f5f82 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.025251 Oct 18 16:26:58.494250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2832/5660] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 18 16:26:58 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:58.505053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-659dfcc2-89aa-44f0-b643-9d30a5bf9d8f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd11d0d30>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.546970 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-659dfcc2-89aa-44f0-b643-9d30a5bf9d8f tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657538518" status: 204 len: 0 microversion: 2.2 time: 0.046778 Oct 18 16:26:58.548639 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2833/5661] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 18 16:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657538518 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:26:58.562134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Action: 'create', calling method: .version_select at 0x7f5fd12ff670>, body: {"keypair": {"name": "tempest-keypair-249269055", "type": "x509"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:58.608272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:58.622604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:58.671386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.processutils [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpwsyiibzs/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwsyiibzs/temp.key -subj /CN=5e938d41d3fb4f3e8c47b0c7e09230a8 -extensions v3_req_client {{(pid=120571) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 16:26:58.727301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:58.738936 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50f67196-fbe3-4e91-bed9-bd28c2e9926e tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1500 microversion: 2.1 time: 0.587326 Oct 18 16:26:58.744562 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2829/5662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:58 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1500 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:58.946395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.processutils [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpwsyiibzs/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwsyiibzs/temp.key -subj /CN=5e938d41d3fb4f3e8c47b0c7e09230a8 -extensions v3_req_client" returned: 0 in 0.275s {{(pid=120571) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 16:26:58.949931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.processutils [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpwsyiibzs/temp.key -password pass: {{(pid=120571) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 16:26:58.996986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.processutils [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpwsyiibzs/temp.key -password pass:" returned: 0 in 0.049s {{(pid=120571) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 16:26:59.058507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:59.064976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Getting quotas for user 5e938d41d3fb4f3e8c47b0c7e09230a8 and project 4b2755737eb5470ea5e0d09a98f01587. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:59.087466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-541bbe8f-0319-4b64-9352-a32abe230e64 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.529436 Oct 18 16:26:59.088744 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2834/5663] 10.222.0.78 () {62 vars in 1198 bytes} [Tue Oct 18 16:26:58 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 531 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:59.100249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b6c9c5d-2c55-49b9-9ceb-e9b982cf3343 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd20edd30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:59.109972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b6c9c5d-2c55-49b9-9ceb-e9b982cf3343 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-249269055" status: 200 len: 1533 microversion: 2.2 time: 0.013747 Oct 18 16:26:59.112391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2830/5664] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 18 16:26:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-249269055 => generated 1533 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:59.126141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1461e56-e6b8-4ceb-852f-d9a6844d2e71 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd12ffca0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:59.132892 n-d-858383-14 devstack@n-api.service[120571]: WARNING oslo_db.sqlalchemy.utils [None req-d1461e56-e6b8-4ceb-852f-d9a6844d2e71 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 16:26:59.141016 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1461e56-e6b8-4ceb-852f-d9a6844d2e71 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.020368 Oct 18 16:26:59.142154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2835/5665] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 18 16:26:59 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:59.155742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe00e7ac-0d9f-432a-bee5-e5c39a5a9693 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] Calling method '.version_select at 0x7f5fd1fde8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:59.188616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe00e7ac-0d9f-432a-bee5-e5c39a5a9693 tempest-KeyPairsV22TestJSON-997530829 tempest-KeyPairsV22TestJSON-997530829-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249269055" status: 204 len: 0 microversion: 2.2 time: 0.039357 Oct 18 16:26:59.190423 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2831/5666] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 18 16:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249269055 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:59.770233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:59.771091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:59.790937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:59.791712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:59.793393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:59.795729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:59.797391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:59.798757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:00.229312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:00.244712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a996ab82-aeed-43bf-8f4e-d1948c1ff674 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1500 microversion: 2.1 time: 0.480920 Oct 18 16:27:00.245374 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2836/5667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:59 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1500 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:01.270794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:01.271553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:01.282702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:01.288594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:01.289256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:01.290179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:01.290551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:01.293529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:01.462929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce708efbc05d40c7a2a04173d9871991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eeba274a6f342c1984385aa9a7fd804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:01.485389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55061a43-f0a5-4716-9981-44f8cd4c4302 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 200 len: 1458 microversion: 2.1 time: 0.218351 Oct 18 16:27:01.486540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2832/5668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:01 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:01.627316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435a6ec9-95af-4e3e-ad27-0b7afbdc6d39", "name": "network-vif-deleted", "tag": "674a7804-c632-42b3-861e-97e2a18b3dd2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:01.694068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:01.694592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:01.695036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:01.724255 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] Creating event network-vif-deleted:674a7804-c632-42b3-861e-97e2a18b3dd2 for instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 on n-h2-858383-14 Oct 18 16:27:01.740784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-dd7e426c-f5e0-43f1-97ad-7c03dbfc1a37 req-093cace1-d47b-4ded-a48d-d375ba0730e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117834 Oct 18 16:27:01.742773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2837/5669] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:02.274769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Calling method '.version_select at 0x7f5fd63d1b80>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.309988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.310957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.311907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.315290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.316169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.317682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.410124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93492451-ae42-4d1a-be32-0db4590890bf tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.352340 Oct 18 16:27:02.410865 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2833/5670] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/limits => generated 511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:02.514152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.515794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.533624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1689496077", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:02.536072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.537066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.538734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.541882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.542845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.544898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.562733 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 HTTP/1.1 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '435a6ec9-95af-4e3e-ad27-0b7afbdc6d39'} Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.565521 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.574965 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.578278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.580207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9c332999-b360-4011-9575-33e8288aa110 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 404 len: 111 microversion: 2.1 time: 0.072351 Oct 18 16:27:02.588212 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2838/5671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.595630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.596828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.605968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.606850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.607569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.608934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.609692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.611095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.642537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 HTTP/1.1 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '435a6ec9-95af-4e3e-ad27-0b7afbdc6d39'} Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.646306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.652384 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.654910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.656346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb84b825-fad9-4b82-8084-286e39a84950 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 404 len: 111 microversion: 2.1 time: 0.065905 Oct 18 16:27:02.658324 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2839/5672] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:02 2022] DELETE /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.668096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:27:02.668684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.669521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.679877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.683227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.684161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.686875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.687712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.688535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.707842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 HTTP/1.1 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '435a6ec9-95af-4e3e-ad27-0b7afbdc6d39'} Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.710598 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. Oct 18 16:27:02.715588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.717707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.719071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ba6a9c4-f7f9-4246-9d43-f456a7379452 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39" status: 404 len: 111 microversion: 2.1 time: 0.056684 Oct 18 16:27:02.720733 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2840/5673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/servers/435a6ec9-95af-4e3e-ad27-0b7afbdc6d39 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.737719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.738587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.746698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.748581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.749258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.750311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.751133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.751780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.772952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e HTTP/1.1 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f1306daa-db3c-4a72-a389-17405ac6a96e'} Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.776164 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.781380 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.784881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.786017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-201e5999-41f1-4446-980b-5d535ef8ae7d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 404 len: 111 microversion: 2.1 time: 0.057924 Oct 18 16:27:02.786767 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2841/5674] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:02 2022] DELETE /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.800184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.801269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f1306daa-db3c-4a72-a389-17405ac6a96e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.808785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.809598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.810220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.811094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.811714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.812681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.836121 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e HTTP/1.1 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f1306daa-db3c-4a72-a389-17405ac6a96e'} Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.838435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. Oct 18 16:27:02.845217 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.847302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f1306daa-db3c-4a72-a389-17405ac6a96e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.848459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-10df3c37-2169-4a6e-912a-3a59fa0a6f12 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e" status: 404 len: 111 microversion: 2.1 time: 0.054705 Oct 18 16:27:02.849604 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2842/5675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/servers/f1306daa-db3c-4a72-a389-17405ac6a96e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.862992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.863814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.879281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.879944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.880383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.881397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.882425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.883163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.902612 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 HTTP/1.1 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9e31613e-3519-4a5f-aea9-c4c8d1be7fc5'} Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.905861 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.912713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.917134 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bac1152-8211-4ad7-b378-b830f31412ac tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 404 len: 111 microversion: 2.1 time: 0.061152 Oct 18 16:27:02.918642 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2843/5676] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:02 2022] DELETE /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.931305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.932380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.942179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.943478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.944186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.945345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.946049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.946776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.967868 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 HTTP/1.1 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9e31613e-3519-4a5f-aea9-c4c8d1be7fc5'} Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:02.972023 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. Oct 18 16:27:02.979803 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:02.983462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:02.986415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-094ee759-5c9b-488b-a077-072581239efa tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5" status: 404 len: 111 microversion: 2.1 time: 0.060351 Oct 18 16:27:02.987725 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2844/5677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/servers/9e31613e-3519-4a5f-aea9-c4c8d1be7fc5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:02.998758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:03.002386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:03.017336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.018352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.020091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.021506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.022581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.023501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.065784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 HTTP/1.1 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '30267f7c-6b96-4670-92cf-17b744bd3a70'} Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:03.068349 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.074195 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.076445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:03.078252 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45494979-1954-4842-8a93-705ece518130 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 404 len: 111 microversion: 2.1 time: 0.085668 Oct 18 16:27:03.079575 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2845/5678] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:02 2022] DELETE /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:27:03.090197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:03.094915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: 30267f7c-6b96-4670-92cf-17b744bd3a70] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:03.110503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.115810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.116259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.117202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.117747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.118331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.144045 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 HTTP/1.1 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '30267f7c-6b96-4670-92cf-17b744bd3a70'} Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.146004 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. Oct 18 16:27:03.151118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.152417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance 30267f7c-6b96-4670-92cf-17b744bd3a70 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:03.154122 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3510c4bf-68de-4522-b5fa-7718effe6dc4 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70" status: 404 len: 111 microversion: 2.1 time: 0.069962 Oct 18 16:27:03.157748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2846/5679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:03 2022] GET /compute/v2.1/servers/30267f7c-6b96-4670-92cf-17b744bd3a70 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:03.173287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:03.174250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:03.191280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.191801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.192257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.193003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.193487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.193918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.224508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 HTTP/1.1 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c045ccb7-6eb6-45ee-bcce-f335f2f61862'} Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:03.237052 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f064c61-4be3-4211-9cdc-21f41717bde6 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862" status: 404 len: 111 microversion: 2.1 time: 0.075835 Oct 18 16:27:03.242006 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2847/5680] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:03 2022] DELETE /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:27:03.247444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:03.247732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: c045ccb7-6eb6-45ee-bcce-f335f2f61862] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:03.257393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.257891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.262690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.263311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.263805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.273623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.291629 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 HTTP/1.1 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'c045ccb7-6eb6-45ee-bcce-f335f2f61862'} Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.294624 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. Oct 18 16:27:03.300225 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.303331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance c045ccb7-6eb6-45ee-bcce-f335f2f61862 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:03.304454 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c3c0fc6-84e1-44df-83fa-130f8f319639 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862" status: 404 len: 111 microversion: 2.1 time: 0.061191 Oct 18 16:27:03.305371 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2848/5681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:03 2022] GET /compute/v2.1/servers/c045ccb7-6eb6-45ee-bcce-f335f2f61862 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:27:03.366409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Getting quotas for project 413841261db046f688dfba9ce99b54df. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:03.383757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Getting quotas for user 73f81917919a413784988574f2006dcc and project 413841261db046f688dfba9ce99b54df. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:03.432330 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Request method failure captured: Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 1752 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtPVQoZJuLwYC1zwWZ7Arli-NXjjQ4rme3J72FW7aHQ8Au_lYCRBGBE6DqE6sMwgItTgLNOIm5zxhTvn-W8quEotIm0AWx3-gQkxw8JTA30uBjXhGAlYekUlv8xxhQ_lVGAhH_j9qXkCBsYE5O610lr87gWb6QYvGez7ZTpW3VYewcg Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 413841261db046f688dfba9ce99b54df Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1124008294 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/413841261db046f688dfba9ce99b54df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/413841261db046f688dfba9ce99b54df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_413841261db046f688dfba9ce99b54df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/413841261db046f688dfba9ce99b54df"}]}] Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1124008294 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 413841261db046f688dfba9ce99b54df Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1124008294 Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 73f81917919a413784988574f2006dcc Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1689496077", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:27:03.443650 n-d-858383-14 devstack@n-api.service[120570]: exception: Maximum number of metadata items exceeds 128 Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1689496077', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:03.447095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:03.452885 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e67e415-9077-4920-a24e-6e357c6e6ac3 tempest-AbsoluteLimitsNegativeTestJSON-1124008294 tempest-AbsoluteLimitsNegativeTestJSON-1124008294-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.916400 Oct 18 16:27:03.457900 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2834/5682] 10.222.0.78 () {60 vars in 1148 bytes} [Tue Oct 18 16:27:02 2022] POST /compute/v2.1/servers => generated 87 bytes in 920 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:27:08.450890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:08.455003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:08.466067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.468670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.471437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.474677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.476815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.477569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.623604 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-587849df-7312-46bd-8587-e044204418a8 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176074 Oct 18 16:27:08.627690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2849/5683] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:08 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:27:08.798845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:08.798845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:08.822685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:08.831105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.831904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.832366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.833166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.833639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.834074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.889355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:27:09.063913 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b08140e-7655-44d1-b3ad-e77b1b0cb1e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 204 len: 0 microversion: 2.1 time: 0.274266 Oct 18 16:27:09.077815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2835/5684] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:08 2022] DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:27:09.084838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:09.091318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:09.092170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:09.110818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:09.112667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:09.114955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:09.116850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:09.119051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:09.121200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:09.890148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:09.902429 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7575f1e4-cab3-4607-8cbc-e01172783d4f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1674 microversion: 2.1 time: 0.819450 Oct 18 16:27:09.903689 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2850/5685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:09 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1674 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:10.929484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:10.930370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:10.944825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:10.945481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:10.946018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:10.946952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:10.947514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:10.952494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.009178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:11.413748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:11.415085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:11.426696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.441472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.442324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.443446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.444093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.444717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.495116 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f HTTP/1.1 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f'} Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:11.497117 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.503003 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.513959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:11.515128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5557910-acc1-4fd8-bfde-47e904448ea3 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 404 len: 111 microversion: 2.1 time: 0.106050 Oct 18 16:27:11.516304 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2851/5686] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:11 2022] DELETE /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:11.526415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:11.534424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:11.560526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:11.562492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.563913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.565405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.567582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.568259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.572253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.634633 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f HTTP/1.1 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f'} Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.636363 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:11.641435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c98ad759-fb8a-4b71-926a-bea16f602506 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f" status: 404 len: 111 microversion: 2.1 time: 0.115618 Oct 18 16:27:11.663804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2852/5687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:11 2022] GET /compute/v2.1/servers/f6ea19b3-bcc5-4f7d-bc36-ff5ab23cb85f => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:11.668894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:11.682285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:11.699313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.699822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.700261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.700975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.701465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.701898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.737957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd HTTP/1.1 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'cea3329b-fe6a-4b0b-99b7-4073003b0ffd'} Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:11.742319 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.746579 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.753755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:11.755270 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-44b3681c-9bc1-4745-9d2c-5519a7f0b4b9 tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 404 len: 111 microversion: 2.1 time: 0.090326 Oct 18 16:27:11.755986 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2853/5688] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:11 2022] DELETE /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:11.765694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:11.765694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] [instance: cea3329b-fe6a-4b0b-99b7-4073003b0ffd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:11.785999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.790744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.791335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.792408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:11.796740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:11.796740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.831088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] HTTP exception thrown: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Request method failure captured: Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd HTTP/1.1 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJwk2YZFFH3bmqs2kGuCveqKFw9IDyVuWRvd8W6jmQQ38V6PYocJJhxnxa8x7F5lJVe4t8Z28dvE1ivwj6SdLmGzqVa6vicBPTddJwDPE_MhUwF3QLdtP6N-sndHfIfOZfaRwvSJSOvy8bViqgAuGn3AwHMf8YZ4udl6r6-riNE-wM Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eeba274a6f342c1984385aa9a7fd804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eeba274a6f342c1984385aa9a7fd804"}]}] Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4eeba274a6f342c1984385aa9a7fd804 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-1675919063 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ce708efbc05d40c7a2a04173d9871991 Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-1675919063-project Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'cea3329b-fe6a-4b0b-99b7-4073003b0ffd'} Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:11.832819 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:27:11.837993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] Returning 404 to user: Instance cea3329b-fe6a-4b0b-99b7-4073003b0ffd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:11.839353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-865afc58-4332-4ca5-b69f-f0dd0caff69d tempest-DeleteServersTestJSON-1675919063 tempest-DeleteServersTestJSON-1675919063-project] 10.222.0.78 "GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd" status: 404 len: 111 microversion: 2.1 time: 0.079295 Oct 18 16:27:11.840269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2854/5689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:11 2022] GET /compute/v2.1/servers/cea3329b-fe6a-4b0b-99b7-4073003b0ffd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:27:11.916476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:11.928951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c7030f8-bfe5-4d62-a0b7-8ba7095c1b65 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1674 microversion: 2.1 time: 1.000525 Oct 18 16:27:11.946819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2836/5690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:10 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1674 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:12.978496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:12.979847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:13.002250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:13.003029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:13.003856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:13.008203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:13.008845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:13.010267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:13.044307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:13.477881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:13.493267 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c587ade-cd84-4a70-8f0b-a82511038c20 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1674 microversion: 2.1 time: 0.535707 Oct 18 16:27:13.494602 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2855/5691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:12 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1674 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:14.527692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:14.528317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:14.546979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:14.548764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:14.550844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:14.556008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:14.556685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:14.565579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:14.566308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:14.566938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:15.918904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:15.927575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90b60073-8e71-4887-844a-bded308996c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1674 microversion: 2.1 time: 1.412386 Oct 18 16:27:15.928160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2837/5692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:14 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1674 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:16.953876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:16.954715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:16.964641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:16.965162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:16.965616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:16.966332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:16.966795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:16.985888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:17.091835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e5c2d1-8e68-4a2a-9937-274a2ba7db84", "name": "network-vif-deleted", "tag": "7453ff4a-5274-491e-ae6d-6583bc6a72a3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:17.130070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:17.130556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:17.130990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:17.153643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] Creating event network-vif-deleted:7453ff4a-5274-491e-ae6d-6583bc6a72a3 for instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 on n-h2-858383-14 Oct 18 16:27:17.168424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b5cab6cc-5e29-488b-afc9-454486462668 req-f108df8b-5152-4d13-9c13-0255d8413d0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081241 Oct 18 16:27:17.169363 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2838/5693] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:17.197930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:17.222880 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0f5905ae-74cd-49d4-8563-24444207f22e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 200 len: 1607 microversion: 2.1 time: 0.275044 Oct 18 16:27:17.233407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2856/5694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:16 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 1607 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:18.264497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:18.267076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:18.283876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:18.289201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:18.289842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:18.290786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:18.291922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:18.293109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:18.331369 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 HTTP/1.1 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '69e5c2d1-8e68-4a2a-9937-274a2ba7db84'} Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:18.335487 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:27:18.340526 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:18.342190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:18.343823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa9581b9-05ea-4257-860c-bc73f289f226 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 404 len: 111 microversion: 2.1 time: 0.084968 Oct 18 16:27:18.344909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2839/5695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:18 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:18.353544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-86cbe3a5-b0ae-4efc-bf7f-70571cb5b518 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '.version_select at 0x7f5fd12cba60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:18.398274 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-86cbe3a5-b0ae-4efc-bf7f-70571cb5b518 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675343564" status: 202 len: 0 microversion: 2.1 time: 0.049095 Oct 18 16:27:18.402357 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2857/5696] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675343564 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:27:20.299540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29a878e2-16cf-40dd-a66f-4e9250ab6d0b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: .version_select at 0x7f5fd1fa4700>, body: {"keypair": {"name": "tempest-keypair-495176481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS7hUHxz3JPZL0GTrVaHu2i5jcP5J2cFx7hT7bsoyVmUOUJouwfZzAbsOkMmE4QGCCg7lI8PK6CmMV5zlemL3RaARpeApnml7bKzUN2xLXFPiGi7wMamtHHDXJTSyP27w=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:20.326372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-29a878e2-16cf-40dd-a66f-4e9250ab6d0b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:20.333675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-29a878e2-16cf-40dd-a66f-4e9250ab6d0b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for user 08b0514cd6004596969d5d5caf689179 and project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:20.370343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29a878e2-16cf-40dd-a66f-4e9250ab6d0b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075891 Oct 18 16:27:20.370970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2840/5697] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:27:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:22.518693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:22.519874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:22.536798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:22.540239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:22.541157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:22.544649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:22.545253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:22.545882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:22.602216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1e96417-43c8-480d-a127-2cc5de89375f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/ips" status: 200 len: 150 microversion: 2.1 time: 0.090027 Oct 18 16:27:22.602826 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2858/5698] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:27:22 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:25.375507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1c098f3-8842-4e3d-a4fa-f67d39c6e587"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:25.382302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:25.396428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.400230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.401322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.408308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.409214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.410137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.465754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:25.466954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:25.483370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.486554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.489332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.495617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.496566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.505709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.572004 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a534c8b8-d0c2-4b1a-9a43-e4ccf856aaae tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/ips" status: 200 len: 150 microversion: 2.20 time: 0.110539 Oct 18 16:27:25.578808 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2859/5699] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Oct 18 16:27:25 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/ips => generated 150 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:27:26.043115 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-95dbf12d-ca84-4823-97ed-0504bd82a8a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673199 Oct 18 16:27:26.043914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2841/5700] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:27:25 2022] POST /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:27.626528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1173100787", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1e93acb-d640-4312-86d3-85e2d5485813"}], "security_groups": [{"name": "tempest-securitygroup--1730975487"}], "key_name": "tempest-keypair-495176481", "user_data": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:28.445173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] validate_networks() for [('b1e93acb-d640-4312-86d3-85e2d5485813', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:27:29.085186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37a88f74-ada4-4d25-8c27-3d33384c4ac5 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Action: 'create', calling method: .version_select at 0x7f5fd6598310>, body: {"keypair": {"name": "tempest-keypair-2140384837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFTB55LIMtKbIJUjIkQk9pVfCOd74B8gvw5s9uVF8W7YslCU0mf6ZHtuY0KPVVoGNCnMXd99HNj1sAni3ZGyJMao+FGPHmPMyDT/qfZyzA4vBiDGI+4iq+hXlWLqFsSlQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:29.125831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-37a88f74-ada4-4d25-8c27-3d33384c4ac5 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:29.133155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-37a88f74-ada4-4d25-8c27-3d33384c4ac5 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for user 5527f094f5ee4ada9aaae9885c272d7a and project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:29.200525 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37a88f74-ada4-4d25-8c27-3d33384c4ac5 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.371739 Oct 18 16:27:29.201407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2842/5701] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:27:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:30.297091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:30.298049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:30.325060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.325593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.326033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.326748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.327201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.327632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.381591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lazy-loading 'flavor' on Instance uuid 2d384d91-083f-42f1-a09d-b7168f119c29 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:27:30.503080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:30.504955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:30.506567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:30.507580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:30.508658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:30.552280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.563374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.567359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.569363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.572114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.573117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.610999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:30.640364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Getting quotas for user 08b0514cd6004596969d5d5caf689179 and project 238c6a4d6aa046c6becaba98873f63fc. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:30.691331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:27:30.701734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:27:30.897934 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e406a02-3ccf-416f-86d2-e88960593235 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.274560 Oct 18 16:27:30.902126 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2860/5702] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:27:30.921046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-22e57dae-63f2-4749-9368-3291e6e01d16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:30.929953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-22e57dae-63f2-4749-9368-3291e6e01d16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:31.008252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b79fb3af-b30a-489f-b43d-f5f82bc6a4e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/action" status: 202 len: 0 microversion: 2.20 time: 0.714420 Oct 18 16:27:31.013689 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2843/5703] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:27:30 2022] POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:27:31.029925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:31.037020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:31.055037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:31.055537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:31.055981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:31.056683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:31.057176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:31.066984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:31.363741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-22e57dae-63f2-4749-9368-3291e6e01d16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:31.385768 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-22e57dae-63f2-4749-9368-3291e6e01d16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1237 microversion: 2.1 time: 0.474338 Oct 18 16:27:31.394380 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2861/5704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:30 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1237 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:31.966852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:31.988234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:31.993801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:31.997072 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b8b72c29-5542-4e49-ad2b-4028fb3eefc0 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.981590 Oct 18 16:27:31.997914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2844/5705] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:31 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:32.423568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35913f39-4bae-431d-8442-237b582d8c19 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:32.431899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35913f39-4bae-431d-8442-237b582d8c19 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:32.783903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35913f39-4bae-431d-8442-237b582d8c19 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:32.795459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35913f39-4bae-431d-8442-237b582d8c19 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1237 microversion: 2.1 time: 0.380391 Oct 18 16:27:32.805362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2862/5706] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:32 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1237 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:33.035220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:33.036313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:33.112728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.114574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.120442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.132063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.133692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.135226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.639145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:33.656316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:33.658730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:33.660286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b25e079-a7a3-4f5a-a80f-433e5812a3b7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.635169 Oct 18 16:27:33.662458 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2845/5707] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:33 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:27:33.833096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:33.834763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:33.861353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.862571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.863886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.866551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.871766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.872581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.134872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:34.149397 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90a1df72-747e-451e-9f85-3128730898d4 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1289 microversion: 2.1 time: 0.321388 Oct 18 16:27:34.163994 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2863/5708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:33 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1289 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:34.720728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:34.721446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:34.759330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.760139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.762118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.765617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.771441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.774828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:35.178963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:35.180577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:35.200372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:35.205036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:35.212126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:35.214540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:35.215043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:35.215493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:35.359693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:35.371681 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ebbf20d2-965c-43d6-98c2-3324b0cefdef tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1295 microversion: 2.1 time: 0.199862 Oct 18 16:27:35.386649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2864/5709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:35 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1295 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:35.714055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:35.724451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:35.735671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:35.741417 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4acabe0a-c7f7-49fa-a927-25149fc22df8 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 1.026492 Oct 18 16:27:35.753640 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2846/5710] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:34 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:36.399237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:36.400523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:36.413510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.416315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.417110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.419152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.424213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.425134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.648981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:36.658413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a81c0b6-22ac-4baf-b576-92bb03b31286 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1295 microversion: 2.1 time: 0.263542 Oct 18 16:27:36.678151 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2865/5711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:36 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1295 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:36.779160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:36.780490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:36.817209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.818134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.818808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.819755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.820458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.821795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:37.696133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:37.696762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:37.717386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:37.717884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:37.718375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:37.719166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:37.719701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:37.732718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.099560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:38.116406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:38.122601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:38.124526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7a22d578-cd71-4ae9-8633-cadf0684dfa2 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 1.349752 Oct 18 16:27:38.153667 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2847/5712] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:36 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:39.142997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:39.602482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1103173196", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "97bd62b5-b5a4-42d1-815c-d1d06d969da9"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:39.629194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:39.638098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88c70c2a-095e-4693-99a8-1fc10d729dec tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 1.947870 Oct 18 16:27:39.649643 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2866/5713] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:37 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:39.654915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:39.678821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:39.696553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:39.699362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:39.706342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:39.708163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:39.714043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:39.719036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:39.719887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:39.787403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] validate_networks() for [('97bd62b5-b5a4-42d1-815c-d1d06d969da9', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:27:40.243724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:40.261887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:40.266016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:40.274274 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6c443265-63eb-4dc2-a7ef-a7936a11cb47 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.621421 Oct 18 16:27:40.275058 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2867/5714] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:39 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:40.299452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a544916e-da85-4e7b-9c3a-69c6e9ddb106", "tag": "a5c423c8-2fb1-4a0f-94db-39493cb478cc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:40.325710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:40.329896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:40.330859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:40.390727 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] Creating event network-changed:a5c423c8-2fb1-4a0f-94db-39493cb478cc for instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 on n-h1-858383-14 Oct 18 16:27:40.411154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d20e2b3a-4a2c-4574-a765-257c93094f0d req-d1e053be-e5bd-4b76-8e9c-534d2b1e6dc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132357 Oct 18 16:27:40.428554 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2868/5715] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:40.669253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:40.677542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:40.678542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:40.694321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:40.694831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:40.698981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:40.700382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:40.702177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:40.703621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:41.028276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:41.038867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9234f794-9e72-41de-8f9a-46f9844a78df tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 0.370456 Oct 18 16:27:41.041181 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2869/5716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:40 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:41.305130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:41.305908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:41.314463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:41.322504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:41.323123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:41.324001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:41.324595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:41.325210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:41.643189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:41.658990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:41.661459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:41.680035 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f956b4b-9e1c-433b-8b4e-e8e79b582f17 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.378711 Oct 18 16:27:41.698939 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2870/5717] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:41 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:41.836691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:41.838213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:41.840212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:41.840632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:41.841983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:41.866567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:41.867064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:41.867508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:41.871378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:41.872783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:41.875003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:41.917922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:41.957743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:41.972544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for user 83c668dcae65428e99d6dab21f00fe88 and project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:42.022561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:27:42.026306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:27:42.071300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:42.071896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:42.079356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:42.102763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:42.103544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:42.105419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:42.106177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:42.106645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:42.113190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:42.147764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c572853-864a-44c6-87e8-4d9a6eecedbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.162625 Oct 18 16:27:42.153074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2848/5718] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:27:42.380987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:42.394140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0813f2c0-1445-4589-9770-b782b36a842c tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 0.334027 Oct 18 16:27:42.395348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2871/5719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:42 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:42.477575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1490365375", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "97bd62b5-b5a4-42d1-815c-d1d06d969da9"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:42.638828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] validate_networks() for [('97bd62b5-b5a4-42d1-815c-d1d06d969da9', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:27:42.728687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:42.730292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:42.748967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:42.757706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:42.762489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:42.763528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:42.766830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:42.770423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:42.817792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:43.384466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:43.391825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=73 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:43.401486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:43.403089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:43.404529 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9199e100-0931-4900-98b4-73a23a49859c tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.681192 Oct 18 16:27:43.410863 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2872/5720] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:42 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:27:43.425074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:43.426349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:43.439279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:43.439786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:43.440225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:43.443282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:43.444594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:43.445886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:43.908761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:43.931182 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97ebd5f4-bb9b-4196-bbe6-4502e1172353 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 0.510821 Oct 18 16:27:43.953887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2873/5721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:43 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:44.211351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:44.211855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:44.212232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:44.212635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:44.213248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:44.238523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.242987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.245139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:44.248861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.252623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.254186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:44.364451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:44.394706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for user 83c668dcae65428e99d6dab21f00fe88 and project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:44.440788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:44.441446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:44.456688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.460648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:27:44.468893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.472647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:44.474811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.481637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:27:44.482739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.489088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:44.612436 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdc0b8c9-66fd-400c-a102-cd2bcee3280e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141186 Oct 18 16:27:44.614489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2849/5722] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:27:44.814719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:44.836282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:44.837998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:44.847813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc96bb7b-1710-4d57-8263-ad2b4e5d2287 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1743 microversion: 2.20 time: 0.412707 Oct 18 16:27:44.857595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2874/5723] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:44 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1743 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:44.960147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:44.960833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:44.987342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.990481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.991121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:44.992190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:44.992820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:44.993681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:45.000121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-128152314", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "451", "networks": [{"uuid": "97bd62b5-b5a4-42d1-815c-d1d06d969da9"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:45.146048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] validate_networks() for [('97bd62b5-b5a4-42d1-815c-d1d06d969da9', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:27:45.721127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:45.737102 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fce77313-6151-4c32-9ca3-d89e4b464775 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 0.781010 Oct 18 16:27:45.742604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2850/5724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:44 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:45.753735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1c098f3-8842-4e3d-a4fa-f67d39c6e587"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:45.756918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:45.782833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:45.783629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:45.784239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:45.785159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:45.786060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:45.786649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.020824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments HTTP/1.1 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 74 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: {"volumeAttachment": {"volumeId": "b1c098f3-8842-4e3d-a4fa-f67d39c6e587"}} Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': 'cdaf24c8-95cb-4100-af12-870c50388edc', 'body': {'volumeAttachment': {'volumeId': 'b1c098f3-8842-4e3d-a4fa-f67d39c6e587'}}} Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:46.024792 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc Oct 18 16:27:46.031511 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:27:46.035011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 400 to user: Invalid volume: volume b1c098f3-8842-4e3d-a4fa-f67d39c6e587 is already attached to instances: cdaf24c8-95cb-4100-af12-870c50388edc {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:46.036126 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3df7b565-15c0-4ff6-ab37-5deb3f058e84 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.290662 Oct 18 16:27:46.036953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2851/5725] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:27:45 2022] POST /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:27:46.059200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:46.060080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:46.087364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.089978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.091841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.094581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.099674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.102776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.317466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:46.320639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:46.321224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:46.321653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:46.322079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:46.339963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.342328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.344972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.348907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.349671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.350308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.409472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:46.428824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Getting quotas for user 83c668dcae65428e99d6dab21f00fe88 and project d11b952197c4461badbca0712357944b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:46.481796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:27:46.490868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:27:46.541022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:46.555306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:46.556758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:46.558009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24e72ede-2a85-4cef-9b7e-11f07e024070 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1743 microversion: 2.20 time: 0.519773 Oct 18 16:27:46.564959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2852/5726] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:46 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1743 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:46.583024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:46.583550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:46.606840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.607483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.608014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.613663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.618351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.619060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.654199 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0338f04e-13ca-4884-b59d-37a74acc2ca2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659428 Oct 18 16:27:46.663013 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2875/5727] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:27:46.674574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72d3d5dd-2e95-4ec5-9487-b57a89bde154 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:46.674963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72d3d5dd-2e95-4ec5-9487-b57a89bde154 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:46.792906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72d3d5dd-2e95-4ec5-9487-b57a89bde154 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:46.815786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72d3d5dd-2e95-4ec5-9487-b57a89bde154 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1220 microversion: 2.1 time: 0.145162 Oct 18 16:27:46.817844 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2876/5728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:46 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:46.837642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:46.839188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:46.864366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.871276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.871847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.872688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:46.873404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:46.873946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:46.895766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'services' on Instance uuid cdaf24c8-95cb-4100-af12-870c50388edc {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:27:47.105885 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d51c52a2-bf9b-4b78-afb8-d9c2f451fb57 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments/b1c098f3-8842-4e3d-a4fa-f67d39c6e587" status: 202 len: 0 microversion: 2.1 time: 0.539451 Oct 18 16:27:47.119347 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2853/5729] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:27:46 2022] DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments/b1c098f3-8842-4e3d-a4fa-f67d39c6e587 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:27:47.147456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:47.172134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:47.199785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.200238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.200871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.202405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.203514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.204162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.250562 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11050040-a695-4c36-8bec-63d89469a6c5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130005 Oct 18 16:27:47.251426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2854/5730] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:47 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:47.591454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:47.593237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:47.604777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.605631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.607180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.608126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.611341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.612023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.861572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:47.895310 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f14ae61-fa6c-4346-b775-33bf27e30b94 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 1.072030 Oct 18 16:27:47.903553 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2877/5731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:46 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:47.911973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:47.922478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:47.958255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.959412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.966251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.973796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.974484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.975105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:48.211592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:48.236808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0b00952-13c9-4800-8b87-37e53f310999 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1224 microversion: 2.1 time: 0.331727 Oct 18 16:27:48.237816 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2878/5732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:47 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1224 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:48.272428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:48.279600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:48.305642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:48.306177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:48.308351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:48.310430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:48.310928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:48.311437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:48.423131 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b6bdf33-cfa8-4dfb-a14e-b44698871739 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163036 Oct 18 16:27:48.433414 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2879/5733] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:48 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:49.073240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a544916e-da85-4e7b-9c3a-69c6e9ddb106", "name": "network-vif-plugged", "status": "completed", "tag": "a5c423c8-2fb1-4a0f-94db-39493cb478cc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:49.099155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.099652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.106498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.169105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] Creating event network-vif-plugged:a5c423c8-2fb1-4a0f-94db-39493cb478cc for instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 on n-h1-858383-14 Oct 18 16:27:49.191231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2a05f45f-e3cf-4a4d-a82c-ee06a9d10067 req-1292a664-4d3b-4a13-a2c5-7c4f1f7368ea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463051 Oct 18 16:27:49.193348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2880/5734] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:49.213329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:49.214193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:49.236306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.236815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.242635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.248676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.250023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.256371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.439467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.456601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.462526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.466765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2573a85e-7c9b-48a4-a004-b2470b376710 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1743 microversion: 2.20 time: 1.880570 Oct 18 16:27:49.467351 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2855/5735] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:47 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1743 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:27:49.487484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:49.492838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:49.513490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.516820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.522417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.523768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.524480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.532967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.768455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.803435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5aabe535-7baa-47dc-87dc-5c3326dffdc1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 0.607829 Oct 18 16:27:49.807846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2881/5736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:49 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:49.819014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:49.825154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:49.834857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.835540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.836155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.837083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:49.837694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:49.838761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.919875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8e43d05-0f9a-4bdf-a54e-e5a43a7054b7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109817 Oct 18 16:27:49.924332 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2882/5737] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:49 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:49.980819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.990529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22cce0ed-ecf0-48e6-84b5-ec920306bcbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1278 microversion: 2.1 time: 0.516027 Oct 18 16:27:49.991112 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2856/5738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:49 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1278 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:50.496461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:50.497131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:50.504402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.504888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.517275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.518083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.518570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.519015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.838905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:50.840135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:50.848363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.849433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.850161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.851071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.851704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.852307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.944696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:50.962723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:50.970578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:50.972195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7c9a30c-e67f-454d-bff6-b27808b9169f tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.479836 Oct 18 16:27:50.998670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2883/5739] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:50 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:51.007209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:51.024149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:51.037773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.041924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.042819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.045194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.046134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.049432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.187496 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e839bead-b434-48c8-92e5-0c0a2670a45c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186697 Oct 18 16:27:51.188115 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2884/5740] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:50 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:51.227651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:51.230982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:51.254971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.257538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.258214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.263443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.267132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.267790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.511062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:51.527378 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b44ce952-660e-44c6-be60-2fcecdd30aed tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1278 microversion: 2.1 time: 0.317751 Oct 18 16:27:51.533316 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2885/5741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:51 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1278 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:51.818574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "name": "network-vif-plugged", "status": "completed", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:51.865649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.866287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.866824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.913100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] Creating event network-vif-plugged:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h1-858383-14 Oct 18 16:27:51.938079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2f8e1e59-a822-4196-b6b6-10e9f025e36e req-f4b138e0-aa5c-450d-b699-5acd8e9fd971 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125107 Oct 18 16:27:51.939170 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2886/5742] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:52.005678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:52.006756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:52.020440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.021380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.027654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.031241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.031995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.033065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.517335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.536337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.538337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.539754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a7fd3df-dbbb-4bec-a7ce-2b9b370509c7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.539435 Oct 18 16:27:52.540535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2887/5743] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:51 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:52.546674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:52.551497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:52.558822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.559608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.560249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.561219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.561858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.562462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.608248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.635346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba584117-f59c-4504-a568-e3f23db16788 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093450 Oct 18 16:27:52.644281 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ae54dd2-b471-46ef-a4ec-ab9dd6bfa90f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1363 microversion: 2.1 time: 1.809149 Oct 18 16:27:52.644566 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2888/5744] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:52 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:52.649991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:52.650618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:52.678864 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2857/5745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:50 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1363 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:52.680260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.680874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.681651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.682388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.682850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.683805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.887851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.903032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0db1f8b6-6ffc-493f-ae3a-ac6d95acca1a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1278 microversion: 2.1 time: 0.256841 Oct 18 16:27:52.927450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2889/5746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:52 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:53.572245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:53.583554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:53.632082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.639154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.648618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:53.652018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:53.652134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.656830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.659034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.660847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.665973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.670325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.671659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.672589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.673247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.673837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.777282 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f37b027e-c32c-4df4-9bd1-73f0e629fd61 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133090 Oct 18 16:27:53.778658 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2890/5747] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:53 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:53.793638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:53.795305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:53.827349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.830242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.834719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.843017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.844371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.846631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.131481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.156634 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d046be68-1ea2-46e9-a7ea-22098fe711f1 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1549 microversion: 2.1 time: 0.369449 Oct 18 16:27:54.168246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2891/5748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:53 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1549 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:54.168246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:54.168246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:54.210770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.211249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.211703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.212441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.212905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.221775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.315899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:54.318030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:54.424621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:54.623066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.642651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.649975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.651610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dee2632c-e9ad-416c-8f30-a31ff3f1da33 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 1.087502 Oct 18 16:27:54.678428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2858/5749] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:53 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:54.694471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:54.701064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:54.743797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.750222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.751343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.761859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.767790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.769168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.825058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.836328 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61872bd4-37bd-48f2-928c-89a291b42262 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.677755 Oct 18 16:27:54.836936 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2892/5750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:54 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:54.868239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:54.875954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:54.896654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.897394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.898030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.898937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.901136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.901819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.981304 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e152ba32-0acc-471a-afd7-2e19e20ae526 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.297226 Oct 18 16:27:54.991858 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2859/5751] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:27:54 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-interface => generated 284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:55.042573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53f86312-eb8a-4e01-8d16-167797bb93b5 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181974 Oct 18 16:27:55.049764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2893/5752] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:54 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:55.716535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:55.721472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:55.749026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.749942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.751580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:55.752764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.755948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.759490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:55.864842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:55.865503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:55.877601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.878478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.879142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:55.880124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.880806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.881480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.370888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:56.800747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:56.885653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.930428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.942557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.953492 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-022ff15b-3e60-476a-9e7d-d1ec21b99a4a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 1.243789 Oct 18 16:27:56.959187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2860/5753] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:55 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:57.000312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:57.016272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:57.074690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:57.075687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:57.078018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:57.089502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:57.090357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:57.093313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:57.171285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac0b626f-2267-4822-a139-acc62cecd7e2 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209823 Oct 18 16:27:57.193772 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2861/5754] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:56 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:57.494940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:57.553979 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96e9d18a-0282-47de-bcf7-096846502b7d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 1.693078 Oct 18 16:27:57.564417 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2894/5755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:55 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:57.983821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:57.984456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:58.012439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.012972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.019171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.024593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.026406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.026874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.209491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:58.215752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:58.238029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.239141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.240125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.241259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.242334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.243297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.332926 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-371f0a9e-deaf-4e2a-8c7d-4d1be9600e74 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127407 Oct 18 16:27:58.342070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2895/5756] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:58 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:58.580363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:58.581132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:58.595247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.598839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.599304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.605853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.606396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.606860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.771620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:58.806688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:58.809475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:58.811750 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a18b5875-a28c-49fb-8077-0ef5c80120ee tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.832962 Oct 18 16:27:58.825908 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2862/5757] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:57 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:27:59.140309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5d42ac-981e-4d5d-9ab6-63b5f90813c4", "tag": "0e69dd46-71d1-492b-b934-fc9fc0128076"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:59.156408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.157218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.157852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.172240 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] Creating event network-changed:0e69dd46-71d1-492b-b934-fc9fc0128076 for instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 on n-h2-858383-14 Oct 18 16:27:59.181756 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-256f4075-d36d-48e4-8641-4c20258dd2bd req-c6dae0a3-85c2-43aa-9991-50070602269e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045766 Oct 18 16:27:59.196154 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2863/5758] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:59.351576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:59.364687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:59.411564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.415021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.415844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.417585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.418582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.419353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.474456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab94b9e7-db57-4927-8431-42b7ae373cae tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128874 Oct 18 16:27:59.476402 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2864/5759] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:27:59 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:59.575362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03078c63-3a43-4ddb-83a7-17b03eb47865", "tag": "86070468-cf21-4818-883c-438f91c79e50"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:59.604189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.605833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.606556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.634811 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] Creating event network-changed:86070468-cf21-4818-883c-438f91c79e50 for instance 03078c63-3a43-4ddb-83a7-17b03eb47865 on n-h1-858383-14 Oct 18 16:27:59.654566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ce652b1e-b171-4935-90eb-2ff394526ac3 req-4c63821a-4d6c-4af3-824b-1c864420b92a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077130 Oct 18 16:27:59.659827 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2865/5760] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:59.840398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:59.841220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:59.851789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.852295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.852734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.855590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.857453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.860812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.457505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:00.471885 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d619097-318b-4dee-acd7-746ad24378c9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 1.896306 Oct 18 16:28:00.484433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2896/5761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:58 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:00.528190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:00.534106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:00.550941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.552652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.553207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.555474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.560792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.562759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.606743 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f6df888-05e3-43d4-8396-ceefa1f9fe1b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109926 Oct 18 16:28:00.607669 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2897/5762] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:28:00 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:28:00.771387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:00.772302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:00.837631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.840604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.844785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.852279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.852800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.853280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.973285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:28:01.162087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:01.179357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:01.189306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:01.195113 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1daf5ae8-a0ca-44db-92c6-299f3698ffef tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 1.358553 Oct 18 16:28:01.198285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2866/5763] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:27:59 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:01.308285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9d632fc-12c4-4268-a725-a5aabd15c7d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 204 len: 0 microversion: 2.1 time: 0.535094 Oct 18 16:28:01.314870 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2898/5764] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:28:00 2022] DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:28:01.321235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:01.322369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:01.338419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.340257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5ba36f-95cc-417d-a76a-1b3088fc1b7d", "tag": "c365146a-b399-4187-bef5-84017684ddc0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:01.341260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.342858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.343896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.346138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.346901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.358846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:01.393763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.400014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.405241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.466306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] Creating event network-changed:c365146a-b399-4187-bef5-84017684ddc0 for instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d on n-h2-858383-14 Oct 18 16:28:01.477299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-687c7f3b-e260-4bc1-8df7-0e17f32bc9c2 req-c2006c34-46ca-4631-b270-9239ec75a375 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145839 Oct 18 16:28:01.483963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2899/5765] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:01.559596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:01.560330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:01.602680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.605176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.607152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.610801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.611772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.612507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.078436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.092006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12087395-147f-4af8-b129-9d389a9b375f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.582940 Oct 18 16:28:02.106362 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2900/5766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:01 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:02.112638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a544916e-da85-4e7b-9c3a-69c6e9ddb106", "tag": "a5c423c8-2fb1-4a0f-94db-39493cb478cc"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:02.143308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:02.144257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:02.148846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.191164 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] Creating event network-changed:a5c423c8-2fb1-4a0f-94db-39493cb478cc for instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 on n-h1-858383-14 Oct 18 16:28:02.213092 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f04400f2-9e31-44b2-aec1-d04d2e849b78 req-37e5a84b-d38d-4f15-9568-b4a22d8fb7b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115786 Oct 18 16:28:02.220213 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2901/5767] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:02.234761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:02.241662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:02.267606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:02.278106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:02.279381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.295987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:02.297554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:02.298767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.600529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.611935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e6c7b9c-ba4d-4e30-97ff-93eecdb01ac7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1682 microversion: 2.1 time: 1.295820 Oct 18 16:28:02.620172 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2867/5768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:01 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1682 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:02.682156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.698923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.700958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.703159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0101920a-ac99-4636-bdd2-fffdfd9d8ca3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.473762 Oct 18 16:28:02.704057 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2902/5769] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:02 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:03.146192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:03.147122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:03.158944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:03.159747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:03.160531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:03.162312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:03.165299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:03.165998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:03.669687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:03.673612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:03.707587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:03.714572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:03.718782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:03.719841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:03.725182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:03.725751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:03.942329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:03.966510 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c5932da-788e-4d05-bfe8-8b112ccd1428 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.819667 Oct 18 16:28:03.967881 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2868/5770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:03 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:03.974250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:03.974867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:04.011607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:04.014549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:04.015327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:04.019592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:04.022386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:04.022875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:05.424570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:05.432938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a0ebba7-df7b-4766-a7de-f06fd8e85d15 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1614 microversion: 2.1 time: 1.767124 Oct 18 16:28:05.451062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2903/5771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:03 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1614 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:05.468345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:05.469173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:05.490421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:05.490920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:05.491419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:05.492087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:05.512520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:05.513088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:06.300612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:06.325828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:06.338561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:06.346275 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-59499892-0c73-414b-8377-3977c0c54da4 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 2.377254 Oct 18 16:28:06.372959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2869/5772] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:03 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:06.473028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:06.473968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:06.488423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:06.489388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:06.490053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:06.493741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:06.494844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:06.500385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:07.016342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:07.033865 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e27267e4-3b55-40f2-b7f7-3b9923a97c45 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1614 microversion: 2.1 time: 0.565177 Oct 18 16:28:07.049557 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2870/5773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:06 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1614 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:07.387730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:07.389458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:07.399225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:07.407229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:07.408002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:07.409239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:07.409912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:07.410529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:07.460851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:07.473843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e78f99ae-fb04-46c0-9f72-fcef9280d56f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 2.017700 Oct 18 16:28:07.492239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2904/5774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:05 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:08.065726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:08.067018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:08.095945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.114580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.119127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.123016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.124812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.127606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.144155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:08.174425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:08.179328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:08.184236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a789eba-4acd-4954-9151-61cf4266422e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.800662 Oct 18 16:28:08.199462 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2871/5775] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:07 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:08.219220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03078c63-3a43-4ddb-83a7-17b03eb47865", "name": "network-vif-plugged", "status": "completed", "tag": "86070468-cf21-4818-883c-438f91c79e50"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:08.247506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.248876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.249660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.274489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] Creating event network-vif-plugged:86070468-cf21-4818-883c-438f91c79e50 for instance 03078c63-3a43-4ddb-83a7-17b03eb47865 on n-h1-858383-14 Oct 18 16:28:08.280960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d65ecba0-9764-4780-9924-48b1e5fc3465 req-1d547b9c-a5df-40c7-a79a-e388434dd8b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079951 Oct 18 16:28:08.282334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2872/5776] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:08.504625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:08.506171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:08.523345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.524165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:08.524792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.525439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.527268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.537144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.537936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.541816 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0cdaa3c-5f46-45fd-80ed-ab9c0c089382 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1614 microversion: 2.1 time: 0.475211 Oct 18 16:28:08.542506 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2905/5777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:08 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1614 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:09.214429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:09.215421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:09.241925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.251962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.252795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.253784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.254419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.262865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.533252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:09.543824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85684b77-5b7e-4e9a-9702-c57e24d9e102 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 1.045385 Oct 18 16:28:09.552859 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2873/5778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:08 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:09.563185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdaf24c8-95cb-4100-af12-870c50388edc", "name": "network-vif-deleted", "tag": "5f7f98fa-9d53-4b01-9a38-9ec8b0abce94"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:09.607543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.613017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.616082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.659578 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] Creating event network-vif-deleted:5f7f98fa-9d53-4b01-9a38-9ec8b0abce94 for instance cdaf24c8-95cb-4100-af12-870c50388edc on n-h2-858383-14 Oct 18 16:28:09.692436 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-cd963feb-b129-4a45-a4e3-97599589745e req-5de230c3-65dd-4ef2-88ce-949515aac5c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134138 Oct 18 16:28:09.699604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2874/5779] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:09.722984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:09.725754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:09.756471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:09.762701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.764338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.765317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.768685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.769719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.770450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.863048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.865301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.866090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.868873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'fault' on Instance uuid cdaf24c8-95cb-4100-af12-870c50388edc {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:28:10.067234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:10.071380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:10.082416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3eb969b8-0958-4533-aac6-712ab856597f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 200 len: 1331 microversion: 2.1 time: 0.377393 Oct 18 16:28:10.086404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:10.089811 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2875/5780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:09 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 1331 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:10.103823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:10.106465 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d7c6ed5-1598-44fd-9711-f05855506ba3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.896159 Oct 18 16:28:10.117573 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2906/5781] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:09 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:10.575310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:10.577486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:10.607032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:10.607891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:10.608519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:10.609462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:10.610667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:10.611315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.134374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:11.137209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:11.165237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.166133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.166750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.167681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.169679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.181934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.229585 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc HTTP/1.1 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'cdaf24c8-95cb-4100-af12-870c50388edc'} Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:28:11.234258 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:28:11.241136 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:28:11.245124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:28:11.246261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75583429-ca04-4f76-9f5e-10c2f263e125 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 404 len: 111 microversion: 2.1 time: 0.116164 Oct 18 16:28:11.251827 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2907/5782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:11 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:28:11.259578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:11.265664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:11.276767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.280803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.281722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.282730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.286122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.286920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:12.225934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:12.235862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:12.247824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:12.249929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7f4df8c-2be5-4b86-8477-ead9b25b474d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.996258 Oct 18 16:28:12.260874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2908/5783] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:11 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:12.281590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fef1f9b6-d222-456c-bf30-8e4fc335f727 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '.version_select at 0x7f5fd114bdc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:12.300258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:12.309807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:12.337426 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d0ea33c-f161-4aee-9ce9-36d32923c55d tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 1.765973 Oct 18 16:28:12.342294 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2876/5784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:10 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:12.361957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fef1f9b6-d222-456c-bf30-8e4fc335f727 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910932275" status: 202 len: 0 microversion: 2.1 time: 0.099766 Oct 18 16:28:12.362632 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2909/5785] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910932275 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:28:13.283908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:13.284858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:13.304655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.307714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.309270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.310246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.312446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.315077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.371726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:13.372354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:13.406765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.407920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.408396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.409208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.409684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.410128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.476607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:13.784862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:13.797951 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-42b663a1-db32-4d3c-b4f4-8dac7334f9bb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.431042 Oct 18 16:28:13.810284 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2910/5786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:13 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:14.828186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:14.828864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:14.836530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:14.849145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:14.851863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:14.855121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:14.855807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:14.857818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:15.053616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:15.074675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:15.095500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:15.109687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ba3d9f7-05ce-4253-9fa8-ca00fbd41ad7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 1.832493 Oct 18 16:28:15.113118 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2877/5787] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:13 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:15.303627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d42ac-981e-4d5d-9ab6-63b5f90813c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e69dd46-71d1-492b-b934-fc9fc0128076"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:15.403176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:15.406804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:15.407836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:15.433851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] Creating event network-vif-plugged:0e69dd46-71d1-492b-b934-fc9fc0128076 for instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 on n-h2-858383-14 Oct 18 16:28:15.452493 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-28d951ff-cdd8-4d84-91d5-0eaf784d04bc req-7139a0d7-8b17-4869-9592-18af837f1575 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154659 Oct 18 16:28:15.461615 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2878/5788] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:15.540769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:15.601576 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc367f20-e432-4ee6-9d30-5ec0722b5806 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.775056 Oct 18 16:28:15.605608 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2911/5789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:14 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:16.138007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:16.140127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:16.158597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.168810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.174534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:16.181510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.182474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.186221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:16.724238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:16.724875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:16.770412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.770897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.785806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:16.786898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.789728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.790377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:17.104822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:17.136590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:17.138863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:17.145266 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32fc4478-b5e7-4a86-a60d-9a963230734e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 1.014096 Oct 18 16:28:17.146584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2879/5790] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:16 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:17.179965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:17.197565 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f3c17058-321f-42c6-9c17-a66e911d6f83 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.538226 Oct 18 16:28:17.198217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2912/5791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:16 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:17.306362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6c4fa0d-db1a-4c2c-9f1d-c80a917de72e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: .version_select at 0x7f5fd64fe5e0>, body: {"keypair": {"name": "tempest-keypair-493069750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfn7tzpBCKqgqFtzntBhva6Xmzu2oBlzpC+Qn5CVnJJIGR+CtJ6ElcxtWvk2bDoUIa6umAi16RoqOb2eetfHg0ZtFZ8J/YqQJy+skFL/1E+JRla534tmE9QzPe3Ix6EZg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:17.330456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d6c4fa0d-db1a-4c2c-9f1d-c80a917de72e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:17.336769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d6c4fa0d-db1a-4c2c-9f1d-c80a917de72e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:17.374988 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6c4fa0d-db1a-4c2c-9f1d-c80a917de72e tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072421 Oct 18 16:28:17.377849 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2880/5792] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:28:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:17.535395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5ba36f-95cc-417d-a76a-1b3088fc1b7d", "name": "network-vif-plugged", "status": "completed", "tag": "c365146a-b399-4187-bef5-84017684ddc0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:17.559509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:17.559996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:17.560464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:17.599070 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] Creating event network-vif-plugged:c365146a-b399-4187-bef5-84017684ddc0 for instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d on n-h2-858383-14 Oct 18 16:28:17.624527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5a489618-49d2-43c4-a067-9896bb8313d3 req-03cce2df-0d05-46eb-9cfd-0d3fd1278a21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090482 Oct 18 16:28:17.627780 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2913/5793] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:18.175346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:18.176472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:18.207983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.208481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.208922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.215903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.218379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.218886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.225146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:18.226647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:18.243570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.247804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.249487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.251680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.252492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.255957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.592764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:18.608349 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e58d518a-a128-4fc4-bd39-dac8cd7b7a6c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1320 microversion: 2.1 time: 0.387684 Oct 18 16:28:18.625886 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2914/5794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:18 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:18.710586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:18.730493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:18.733102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:18.736206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e2398f6-e331-4047-976f-06408bfc5cbd tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.564522 Oct 18 16:28:18.737464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2881/5795] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:18 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:19.343798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1782009545", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "de6dc0e6-dcf2-4168-b7e0-7b34e79384e2"}], "security_groups": [{"name": "tempest-securitygroup--1330689748"}], "key_name": "tempest-keypair-2140384837", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "15ef0024-7662-420b-b606-11e5b37157f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:19.651977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:19.653700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:19.666468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:19.674511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:19.675542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:19.684216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:19.685182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:19.686405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.328658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:20.347795 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15d7e131-876f-408e-92c3-df40415b4465 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1511 microversion: 2.1 time: 0.699693 Oct 18 16:28:20.352016 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2882/5796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:19 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1511 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:20.366130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:20.371590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:20.380470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.388043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.393643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.394777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.395490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.396076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.456679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] validate_networks() for [('de6dc0e6-dcf2-4168-b7e0-7b34e79384e2', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:28:20.756127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:20.769048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:20.773560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:20.776137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c51c4589-170b-4e28-8758-a426e1846ef5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.422658 Oct 18 16:28:20.780550 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2883/5797] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:20 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:20.787602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:20.796853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:20.812575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.813430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.816075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.817158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.817813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.821072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.205361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:21.214119 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f7b27ca-e785-4e09-8d5b-6355ffce292e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1511 microversion: 2.1 time: 0.432110 Oct 18 16:28:21.215386 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2884/5798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:20 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:21.243318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:21.244260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:21.261139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:21.263208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:21.264401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.265635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:21.267025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:21.267714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.546293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:21.571737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-862cc06f-78cb-4826-b6eb-0b3aac11f9f6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1511 microversion: 2.1 time: 0.335440 Oct 18 16:28:21.582773 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2885/5799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:21 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:21.589784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-771576077", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4fdb82c-83da-439d-8df3-8e5dbfce3308"}], "security_groups": [{"name": "tempest-securitygroup--1915857659"}], "key_name": "tempest-keypair-493069750", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:21.786188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] validate_networks() for [('a4fdb82c-83da-439d-8df3-8e5dbfce3308', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:28:21.861874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:21.879822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for user 5527f094f5ee4ada9aaae9885c272d7a and project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: dict_keys(['metadata_items']) {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:21.935202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:28:21.939526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:28:21.940524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:28:21.944189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:28:21.945526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:28:21.982890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:21.987948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:21.988655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.995459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.001942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.002902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.057901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:22.072923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Getting quotas for user 5527f094f5ee4ada9aaae9885c272d7a and project 9c6af1f8b7c04cbb9ac28658f20a36e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:22.290509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:28:22.292852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15ef0024-7662-420b-b606-11e5b37157f0',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:28:22.699408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12e0d57f-fed7-4737-8f3f-36b6ae90ced1 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.360926 Oct 18 16:28:22.705413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2915/5800] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:28:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:28:22.720591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:22.731704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:22.734116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:22.750181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.751220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.751890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.753073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.753864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.754464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.852497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:28:22.853131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:28:22.853411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:28:22.853818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:28:22.854225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:28:22.865880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.866693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.867290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.868172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.868824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.869605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.892804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:22.900361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Getting quotas for user a51c470236904eb0a85bfee1703d3c71 and project f7edbad9c1fb4c1a823575d5b5c6cd08. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:22.916816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:28:22.920111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:28:22.986385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e1a0b9f-9f44-4a81-822c-ff36aa566bbf tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.402055 Oct 18 16:28:22.987398 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2886/5801] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:28:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:28:22.994310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:22.994936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:23.015172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:23.017126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:23.019206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:23.020017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:23.021650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:23.023499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:23.033093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:23.087038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:23.280558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.309241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:23.309613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:23.310101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:23.348770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.362030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.363840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.365513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-986468f1-a141-42b7-b6f0-8abe342316cc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1738 microversion: 2.20 time: 0.376920 Oct 18 16:28:23.366850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2887/5802] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:22 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:23.389698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db8d5c18-fa92-4e44-8bf3-415e1901ffe7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:23.389934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db8d5c18-fa92-4e44-8bf3-415e1901ffe7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:23.490030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db8d5c18-fa92-4e44-8bf3-415e1901ffe7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.498134 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db8d5c18-fa92-4e44-8bf3-415e1901ffe7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1122 microversion: 2.1 time: 0.129895 Oct 18 16:28:23.500266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2888/5803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:23 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1122 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:23.505184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10081ae0-33ee-45fb-8224-811b1cab89ce tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:23.506643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10081ae0-33ee-45fb-8224-811b1cab89ce tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:23.586288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10081ae0-33ee-45fb-8224-811b1cab89ce tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:23.597589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10081ae0-33ee-45fb-8224-811b1cab89ce tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1240 microversion: 2.1 time: 0.096035 Oct 18 16:28:23.599841 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2889/5804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:23 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:23.935681 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03265383-86f6-4556-a03d-b6d0a1348895 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.223687 Oct 18 16:28:23.957853 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2916/5805] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:28:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:23.970708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:23.995060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:24.000941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1103173196', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:24.020460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.021754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.024531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.025801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.028349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.029980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.222394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:24.315347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:24.322005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.322852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.323010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.400461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:24.401318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:24.409352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.409845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.410281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.410976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.411605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.412194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.662895 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3c9bccd-8fff-4813-8dcd-daf308e51fbb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1103173196" status: 200 len: 1514 microversion: 2.1 time: 0.697743 Oct 18 16:28:24.663902 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2890/5806] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:28:23 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1103173196 => generated 1514 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:24.669227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:24.670683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:24.691017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.692390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.693237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.694527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.695357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.696724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.789751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:24.818851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bfba7906-9e11-42d3-a362-4bc394286543 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1220 microversion: 2.1 time: 0.153353 Oct 18 16:28:24.821843 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2891/5807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:24 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1220 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:24.839951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:24.841654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:24.855904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.856731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.858680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.859693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:24.860639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:24.861694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.968541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:24.981665 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e89bc07-0564-4f93-9e72-bb10b7eaebcc tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1236 microversion: 2.1 time: 0.158288 Oct 18 16:28:24.984045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2892/5808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:24 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1236 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:24.990321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:24.996733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.006330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:25.020601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.021337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.021529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.024517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.026132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.026578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.196668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:25.354625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.367993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.368574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.369269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.590687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40a94210-f314-4309-8d52-5848c1456de7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.605340 Oct 18 16:28:25.592957 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2893/5809] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:28:24 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:25.627908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:25.641470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.642891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.645482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.servers [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Removing options 'limit' from query {{(pid=120570) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 16:28:25.646562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:25.662627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.663300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.663923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.664812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.665999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.666843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.677405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.679723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.695786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1e75614-c41f-4096-a0bb-91fa346b0553 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1720 microversion: 2.20 time: 1.299946 Oct 18 16:28:25.701440 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2917/5810] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:24 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1720 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:25.770736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.789753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.790239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.790676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.812559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "name": "network-vif-unplugged", "status": "completed", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:25.860873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.865940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.866754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.896914 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] Creating event network-vif-unplugged:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h1-858383-14 Oct 18 16:28:25.910233 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7e711fd9-3100-4f27-85da-0b7e5f3086c0 req-1bf79024-4a80-44aa-b0f7-6b16f5c88664 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103667 Oct 18 16:28:25.922904 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2918/5811] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:28:25.947842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:25.948969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:25.965242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.965953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.966639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.970195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.971383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.972036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.105864 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ad1a42a-9356-428d-92f4-51a0d063b61e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.481818 Oct 18 16:28:26.108401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2894/5812] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 16:28:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.109273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.114108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.114952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:26.131342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab6f2b3e-6837-4ec4-8646-a1a815580542 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1238 microversion: 2.1 time: 0.206288 Oct 18 16:28:26.135243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.149236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.149236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.149236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.149236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.149593 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2919/5813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:25 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1238 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.149698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.163088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.177934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.183127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:26.197823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.202851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.204056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.207038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.208240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.209842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.288372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.294134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:26.296737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0fad5bfa-5df7-4f38-8d98-d81f742c16e7 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1310 microversion: 2.1 time: 0.186977 Oct 18 16:28:26.309986 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2895/5814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1310 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.349621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-405dc4a5-9545-417a-a0f4-9504b69cb715 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.204399 Oct 18 16:28:26.350663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2920/5815] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.373283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.380086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.380532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.servers [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Removing options 'limit' from query {{(pid=120570) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 16:28:26.381228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:26.393874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.394349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.394786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.395508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.395953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.396372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.464838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:26.559600 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1182ab3-c1d0-4f97-bcbd-e6c91267d553 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.195275 Oct 18 16:28:26.570540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2896/5816] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.574289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.594517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.595472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:26.602930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.613771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.614402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.615341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.616087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.616780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.686226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:26.731122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.732481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:26.742810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.742810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.743289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.743757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.744204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.745195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.749704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-770217f5-29d5-4001-a21b-19c3706c5d31 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.180103 Oct 18 16:28:26.751062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2921/5817] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers => generated 1011 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.776163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.787169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.788194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:26.822216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.822727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.823180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.828132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.829207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.830035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.009315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:27.064177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.079630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.084375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.093801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-defc3cbf-91b9-43a0-a765-04cc9864fa43 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1720 microversion: 2.20 time: 0.366701 Oct 18 16:28:27.095002 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2897/5818] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1720 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:27.142029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8f2e58b-2689-4f9f-b239-c54ad5af7acf tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.378670 Oct 18 16:28:27.153733 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2922/5819] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:28:27.158458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:27.159039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:27.159846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:27.169932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.169932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.servers [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Removing options 'limit' from query {{(pid=120571) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 16:28:27.169932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:27.173402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.174256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.174860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.175663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.176187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.176568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.180328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.190002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.191809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.193034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.194597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.195577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.412324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.437278 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f88d4f34-ec83-4da8-b21b-c1bd24a77783 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1238 microversion: 2.1 time: 0.284204 Oct 18 16:28:27.438326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2898/5820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:27 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:27.443376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:27.446389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:27.463675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.464581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.465275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.466888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.467609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.468267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.634011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.643466 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e87f977-fd7b-489b-b6e2-66adc1c73056 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1310 microversion: 2.1 time: 0.203838 Oct 18 16:28:27.645951 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2899/5821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:27 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:27.806803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-48a67870-78d3-46e1-82e3-89bb669d322f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.651640 Oct 18 16:28:27.807418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2923/5822] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:28:27 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:27.823400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:27.829304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.835207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1103173196', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:27.841033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.841931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.842596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.843595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.844295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.844959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.018133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:28.119835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:28.120695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.139808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.145702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.146329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.147193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.147764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.148307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.178647 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7a6157ee-9c8c-43c1-aafa-37cf63505c23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1103173196" status: 200 len: 346 microversion: 2.1 time: 0.359127 Oct 18 16:28:28.191353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2900/5823] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:28:27 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1103173196 => generated 346 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:28.196699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:28.208669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.220062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.222088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.266056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Going to try to stop instance {{(pid=120570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:28:28.345424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b50f5832-11c3-4db1-9e6b-6e2e6e0f0285 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "POST /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4/action" status: 202 len: 0 microversion: 2.1 time: 0.150047 Oct 18 16:28:28.364391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2901/5824] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:28:28 2022] POST /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:28:28.373613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:28.374619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.382351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.383065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.383831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.384723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.385636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.386224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.605416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.609941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:28.624683 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-500340be-c23c-49b2-8a7e-35d00932a7b0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.254996 Oct 18 16:28:28.626487 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2902/5825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:28 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:28.636193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:28.639177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.664227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.664877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.665431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.666973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.667439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.668020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.725207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.743643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.750650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.752389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4ccaa31-5068-4967-985b-28dbee2683ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1723 microversion: 2.20 time: 0.636591 Oct 18 16:28:28.753272 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2924/5826] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:28 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1723 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:28.759747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:28.761430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.783958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.784454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.785130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.786410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.787035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.787854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.797817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.806279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36b85048-629b-4820-a300-fc7b3f5b59df tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1238 microversion: 2.1 time: 0.178082 Oct 18 16:28:28.812315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2903/5827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:28 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:28.824160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc8e430f-adf8-4f31-a035-1f159ec1ffec"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:28.827626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.842190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.844866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.845343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.846049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.849523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.850077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.982817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:29.003211 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f10b8131-201d-4582-af07-e3aa7529b7c3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1298 microversion: 2.1 time: 0.248034 Oct 18 16:28:29.007869 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2925/5828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:28 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1298 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:29.614997 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf4c2d51-bcfe-45a4-afc2-d9f7bcfa65b3 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.801141 Oct 18 16:28:29.617021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2904/5829] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Oct 18 16:28:28 2022] POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments => generated 188 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:28:29.653073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:29.654533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:29.668721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.669820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.671434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:29.710080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.710776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.711244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:29.852565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:29.853274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:29.879723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.880266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.881159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:29.883247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.883718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.884152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.063479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:30.093358 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2bb02e1-527c-407a-882c-f1990aba8f54 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.444850 Oct 18 16:28:30.094995 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2926/5830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:29 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:30.101802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:30.102704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:30.111588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.112464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.113174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.114591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.115295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.115963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.162987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:30.174285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d711981-863f-408f-9b27-da80accd59d3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1238 microversion: 2.1 time: 0.337883 Oct 18 16:28:30.182859 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2905/5831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:29 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1238 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:30.203806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:30.206763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:30.229443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:30.252380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.256676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.259587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.260803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.265123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.266063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.301626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:30.785515 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee2d9fba-0390-43a1-9e85-913387e74d38 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments/dc8e430f-adf8-4f31-a035-1f159ec1ffec" status: 202 len: 0 microversion: 2.20 time: 0.688964 Oct 18 16:28:30.790633 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2927/5832] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Oct 18 16:28:30 2022] DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments/dc8e430f-adf8-4f31-a035-1f159ec1ffec => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:28:30.918982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:30.920180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:30.941547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.942269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.942890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:30.950439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:30.951220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:30.958369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.082662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 16:28:31.259480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dfc1069c-a69b-4069-9260-f2fd7f77cdcc tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/action" status: 202 len: 0 microversion: 2.20 time: 0.345115 Oct 18 16:28:31.263688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2928/5833] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 18 16:28:30 2022] POST /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:28:31.268665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:31.269343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.275665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.276162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.276601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.277614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.277899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.279428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.690575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:31.702105 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-230cd35c-4990-439d-9c89-92b5d54f8d5c tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 1.513580 Oct 18 16:28:31.718168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2906/5834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:30 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:31.737618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:31.741884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.757515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.760357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.761732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.764643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.765464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.767798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.773934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:31.782674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f945d6be-9e0b-4407-84c2-2fb3242ef15e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.517771 Oct 18 16:28:31.785779 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2929/5835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:31 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:31.797243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:31.797243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.811990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.817161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.817944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.818946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.819540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.820180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.180211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.191310 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e46b119-7c54-4df3-acd5-83d799e7f0ad tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1306 microversion: 2.1 time: 0.471572 Oct 18 16:28:32.192599 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2907/5836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:31 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1306 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:32.718980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.730458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:32.731106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:32.738202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.739651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.740852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb186b0a-8f1d-4cf4-ae90-878ff972b620 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1671 microversion: 2.20 time: 0.953381 Oct 18 16:28:32.751624 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2930/5837] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:31 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1671 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:32.753443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.754154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.754782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.755746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.756627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.757349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.811549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:32.813210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:32.828301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.829273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.832279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.837713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.838388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.839004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:33.099640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:33.108609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9c24d38-b2ae-4499-9b89-0c6bcad6f5e6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.381406 Oct 18 16:28:33.109255 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2908/5838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:32 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:33.220098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:33.221022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:33.230331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:33.231249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:33.232467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:33.233503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:33.234520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:33.236310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:33.271295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:33.459933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:33.469852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-418b67f9-1686-473c-bfcf-f8eca60aa1dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.663167 Oct 18 16:28:33.478777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2931/5839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:32 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:33.560398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:33.574028 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93f13d73-1c16-412f-9a74-9ef1586f7257 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1306 microversion: 2.1 time: 0.361105 Oct 18 16:28:33.592358 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2909/5840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:33 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:33.792232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:33.795160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:33.809709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:33.814486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:33.818923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:33.819916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:33.820900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:33.822185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.140351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:34.141812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:34.166412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.167376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.168272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.170011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.170728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.171604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.751891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:34.768353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7335a5f0-0271-4d43-9c7b-5dc444fffad3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.628838 Oct 18 16:28:34.770340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2910/5841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:34 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:34.783326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68fde45-4b28-42e5-a0cc-1ab3dd27d429", "tag": "8afbb950-63a8-490c-ad79-ab53f216f869"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:34.842173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.843045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.843776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.875370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] Creating event network-changed:8afbb950-63a8-490c-ad79-ab53f216f869 for instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 on n-h1-858383-14 Oct 18 16:28:34.883587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d1fe768c-1225-462b-afda-419448aab9f2 req-331b0252-2102-4d7d-a96d-b36360922965 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111216 Oct 18 16:28:34.901658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2911/5842] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:34.923663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:34.924694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:34.942206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.943028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.944135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.946615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.947303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.948283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:35.112578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:35.154427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:35.159104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:35.160400 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c83b5b3-f399-47ca-b532-8f48adfc25ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1671 microversion: 2.20 time: 1.373427 Oct 18 16:28:35.161036 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2932/5843] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:33 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1671 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:35.180895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:35.181553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:35.199790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:35.200870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:35.201678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:35.202468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:35.202942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:35.211662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:35.747866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=20 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:35.948948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:35.963799 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a723f000-9a23-4ea5-800a-b77fe591c2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1306 microversion: 2.1 time: 0.801644 Oct 18 16:28:35.966898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2933/5844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:35 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1306 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:35.977031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:35.983643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:35.996538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:35.998153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:35.998942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.002068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.002767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.003393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.452692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.465370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfebdc91-3b59-4062-9712-2aff4132422f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 1.557191 Oct 18 16:28:36.465603 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2912/5845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:34 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:36.472353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:36.473433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:36.483324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.484871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.485994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.487748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.488433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.489840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.856780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.866381 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dbf4b0e-9995-4c1a-a585-6e154bd59afd tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.896630 Oct 18 16:28:36.867534 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2934/5846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:35 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:36.941654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.966176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.967740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.969646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e9376ba-971f-46ca-8b7d-7c9d37133a28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.501284 Oct 18 16:28:36.970542 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2913/5847] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:36 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:36.974543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac08dc22-4c3d-4bbc-b63b-df6addda91ee", "tag": "872cd60b-9d52-476a-bbf8-1b119e87190c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:36.987338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.987819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.988449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.003409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] Creating event network-changed:872cd60b-9d52-476a-bbf8-1b119e87190c for instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee on n-h1-858383-14 Oct 18 16:28:37.008944 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6920880f-5f44-44a5-b4ed-21f8304d9e16 req-947e24b1-74d7-4ba4-b904-cc9186a5d17b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039446 Oct 18 16:28:37.009800 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2935/5848] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:37.012567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:37.013280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:37.020254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.020845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.021379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.022217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.022888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.023401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.465587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:37.489809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce370b2a-77f6-4280-b26f-b00f8b40f832 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.482488 Oct 18 16:28:37.491312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:37.493355 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2914/5849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:37 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:37.496224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:37.496956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:37.525136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.526397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.527757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.530479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.531454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.532448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.751407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:37.772865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c59f0918-e8e5-4265-beb5-392d2049e39a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.282440 Oct 18 16:28:37.789457 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2936/5850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:37 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:37.892230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:37.893165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:37.896883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:37.902925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.903942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.904742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.906292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.906961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.907557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.003493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:38.005068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:38.016899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.017448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.017817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.018522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.018972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.019394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.207460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.231311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.234402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.236178 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01e44d2b-189f-4b89-a339-7122e4fe7d28 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.239886 Oct 18 16:28:38.237306 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2937/5851] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:37 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:38.242851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:38.254610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.255857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.256535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.273301 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] Creating event network-changed:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h2-858383-14 Oct 18 16:28:38.281049 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-71050c06-8a8b-4e6d-b59d-bfe38391a7ea req-daf7ec08-6b23-4d21-8ff7-b63e81a7669e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041644 Oct 18 16:28:38.283011 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2938/5852] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:38.348336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.362690 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69061769-d44e-4a10-a2b3-1f8f008b02f1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.476153 Oct 18 16:28:38.364566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2915/5853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:37 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:38.527129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:38.531216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:38.542466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.543302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.544113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.546335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.547552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.548581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.741752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.754740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a443a28-eeba-4bed-b333-2096c0a64a51 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.235588 Oct 18 16:28:38.755618 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2939/5854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:38 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:38.808127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:38.810976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:38.821358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.822415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.824317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.826133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.827182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.828171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.209365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:39.222488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3e0ef9d-84ce-4df0-9282-b08c510bf969 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.417730 Oct 18 16:28:39.224618 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2916/5855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:38 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:39.270874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:39.272233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:39.277915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:39.292413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.293400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.294552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.295950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.296693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.297428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.393114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:39.394410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:39.406523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.407483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.408087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.409710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.412326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.413102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.488147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:39.613082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:39.624599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:39.627044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:39.629218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-779afef4-78c1-48fa-a2e3-eb49459f0b54 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.365934 Oct 18 16:28:39.630493 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2940/5856] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:39 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:39.790701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:39.791585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:39.801615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.803023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.803791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.804733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.805412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.806306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.082779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:40.097161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-680f7bfc-e3cd-4220-824c-a78e423457ac tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.316746 Oct 18 16:28:40.098367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2941/5857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:39 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:40.124432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:40.136740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a87c64e-44ad-487f-bafc-afee5fdf8993 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.752550 Oct 18 16:28:40.154999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2917/5858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:39 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:40.251832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:40.253176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:40.323515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:40.324243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:40.324447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.331465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:40.332038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:40.335717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.396560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:40.661854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:40.664237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:40.687160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:40.689068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:40.691335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.693038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:40.694393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:40.695248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.884488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:40.895558 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66fec65a-f0f9-4215-9ffc-6f86b8674ad0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.649602 Oct 18 16:28:40.900196 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2942/5859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:40 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:41.120299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:41.121216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:41.135445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.136217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.136831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:41.138947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.145729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.146455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:41.429084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:41.439761 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-014cf5c4-7e11-4365-9196-b6b46bd7addf tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.323122 Oct 18 16:28:41.441700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2943/5860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:41 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:41.471108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:41.472728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:41.491556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.492968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.494145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:41.495592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.496366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.497782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.402769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:42.427237 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e33699db-03e9-41b1-9815-d3a827a1ffc1 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.983610 Oct 18 16:28:42.428266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2944/5861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:41 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:42.451776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:42.476280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:42.481074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:42.498642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:42.500578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:42.506087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.508436 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52240324-f724-4d9c-932c-f7dfe095c923 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 1.852331 Oct 18 16:28:42.530606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2918/5862] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:40 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:42.536670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.538212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.565803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:42.567096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:42.568082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.571147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.576009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.599980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.607764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.608279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.609092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.609937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.614778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.369881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:43.384060 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cf15a55c-ed0c-400d-91d8-46634df2a183 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.946095 Oct 18 16:28:43.385450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2945/5863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:42 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:43.425468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:43.463931 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a892260-2bbf-4b7b-b01d-d4cf68a828ec tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.907928 Oct 18 16:28:43.487657 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2919/5864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:42 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:43.495384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:43.496467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:43.509606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.510099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.510834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.519940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.523575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.524737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.553544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:43.559028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:43.567642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.568543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.569245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.570340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.571054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.571880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.025016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:44.033300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b61bc0c3-9a57-4bcd-b14c-af56714babed tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.542139 Oct 18 16:28:44.038662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2946/5865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:43 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:44.179476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:44.191532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:44.193656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:44.195093 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ca6c23c-be74-4fdc-9ef9-c6c6ae50808d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.649677 Oct 18 16:28:44.209151 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2920/5866] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:43 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:44.360299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68fde45-4b28-42e5-a0cc-1ab3dd27d429", "name": "network-vif-plugged", "status": "completed", "tag": "8afbb950-63a8-490c-ad79-ab53f216f869"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:44.392831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.403823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.404577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.412435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:44.413204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:44.427289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.429779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.431109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.440293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.451360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.454102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.469783 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] Creating event network-vif-plugged:8afbb950-63a8-490c-ad79-ab53f216f869 for instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 on n-h1-858383-14 Oct 18 16:28:44.483623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c185814f-c236-4bb3-9361-70eeaf9ae1fb req-72f9eaa6-78bf-44ce-a858-d39a29c50b47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125141 Oct 18 16:28:44.485973 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2947/5867] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:44.532060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:44.534291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:44.562725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.565956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.568563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.577147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.578753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.586427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.008537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.019881 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4369038-f980-44e8-9742-7b8c6abbf344 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.507541 Oct 18 16:28:45.030417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.050589 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2948/5868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:44 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:45.073241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-59b390fc-36fe-4509-943c-fd5040a88883 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.653902 Oct 18 16:28:45.075559 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2921/5869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:44 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:45.077420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:45.078234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:45.100910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.102361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.103161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.113450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.123605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.124980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.240106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:45.241089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:45.272656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.273393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.274022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.275145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.275802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.276406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.718664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.761850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29fe11d8-4f1c-4eae-9c19-515710e8145a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.689098 Oct 18 16:28:45.762984 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2949/5870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:45 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:45.781569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.802066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.811369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.815176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5490c074-4118-43eb-b5a5-2600288896fa tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.584131 Oct 18 16:28:45.817385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2922/5871] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:45 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:46.068775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:46.069926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:46.097050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.097931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.098657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.104825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.108412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.113323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.116000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:46.117489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:46.139891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.143481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.144571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.149466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.150725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.151869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.543073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:46.563086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-76d4c70c-5f36-4789-9181-1977de65f91f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.454576 Oct 18 16:28:46.585618 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2923/5872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:46 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:46.803025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:46.810013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:46.810283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:46.830670 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88bc7884-15c7-415b-a188-f0a6c316bfb0 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.768794 Oct 18 16:28:46.841803 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2950/5873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:46 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:46.852432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.853651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.854985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.858872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.860797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.862071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.874350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:46.875012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:46.886619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.887293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.887958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.889353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.890256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.891004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.504365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.521166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f45a5326-07d6-45a1-826a-165e9cab7856 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1366 microversion: 2.1 time: 0.728351 Oct 18 16:28:47.522165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2924/5874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:46 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1366 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:47.542523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.565624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.567688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.569064 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7df2af53-b661-4eaf-a8ec-382ab83062a7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.709168 Oct 18 16:28:47.573413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2951/5875] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:46 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:47.593236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:47.594036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:47.624771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.630366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.630939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.631812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.632395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.639084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.872756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:47.886821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:47.896850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.917764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.919200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.924476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.925371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.925945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:48.105861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:48.117458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdba3ca8-0eaf-4c4b-9390-2d6ddb31b391 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1521 microversion: 2.1 time: 0.528107 Oct 18 16:28:48.125094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2925/5876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:47 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:48.314686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:48.323731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa9069bb-80a7-4300-8112-539a72b6bbca tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.460097 Oct 18 16:28:48.349392 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2952/5877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:47 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:48.550866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:48.555042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:48.570370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.571866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.573256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:48.576550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.577278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.580700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:48.612095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:48.615109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:48.645606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.646314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.646891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:48.647789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.648327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.649316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.009857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.024539 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cffbbef8-7cc7-4164-8dbe-f8272194b967 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1557 microversion: 2.1 time: 0.481822 Oct 18 16:28:49.025811 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2926/5878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:48 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1557 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:49.039506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.057593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:49.058456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:49.059894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.062885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.064825 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbe690b5-ee30-4540-985b-68ff603a4f2e tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.464921 Oct 18 16:28:49.066248 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2953/5879] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:48 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:49.084707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.085957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.086660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.092267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.094177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.094832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.155639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:49.156463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:49.173484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.185859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.186960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.188558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.189583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.190486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.528691 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-afa52af8-02b9-4dc8-83b9-b8245f431392 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.475447 Oct 18 16:28:49.529645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2927/5880] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:28:49 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-interface => generated 285 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:49.535041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:49.536617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:49.554376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.555270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.555270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.556008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.556607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.557204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.576314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.600937 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-950f70f6-6d3f-4fe7-9517-47c0d9353b2c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1498 microversion: 2.1 time: 0.449949 Oct 18 16:28:49.607646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2954/5881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:49 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1498 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:49.649980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:49.663329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.683512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:28:49.691591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.694270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.703327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.704810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.705504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.706116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.766317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:28:49.827818 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fde687c6-8cca-4b29-ba97-97f07bb34433 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.194082 Oct 18 16:28:49.840282 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2955/5882] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Oct 18 16:28:49 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:49.849213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:49.872826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:49.873679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:49.874307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.974559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Going to try to start instance {{(pid=120571) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:28:50.075959 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05eca36f-a928-462c-ae99-725260c6d6dd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "POST /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4/action" status: 202 len: 0 microversion: 2.1 time: 0.232757 Oct 18 16:28:50.081980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2956/5883] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:28:49 2022] POST /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:28:50.097280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:50.098761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:50.141128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.152465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.157549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.166710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.167541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.168080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.563054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:50.583009 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a3020bb-0513-4f86-87b7-c67c662667d0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 0.498963 Oct 18 16:28:50.584824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2957/5884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:50 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:50.601860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:50.602575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:50.628546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.632849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.633515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.634326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.634834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.635270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.682806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:51.077568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:51.096474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:51.105053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:51.112480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2d9aa33-4c83-4898-80e1-186afe84eae6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.519969 Oct 18 16:28:51.129629 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2958/5885] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:50 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:51.170015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:51.193369 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e728f4a9-2407-49df-8e3b-a451e93e6499 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 1.662000 Oct 18 16:28:51.194877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2928/5886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:49 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:51.614178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:51.614649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:51.634820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.015247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:52.033869 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d78f1208-7c70-4c27-96b6-f925265a060a tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 0.424473 Oct 18 16:28:52.036033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2959/5887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:51 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:52.145139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:52.145886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:52.171819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.173202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.173879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.174870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.175532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.176136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.229779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:52.230678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:52.263448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.264438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.265301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.266326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.267084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.267835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.700161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:52.743454 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd1bdcca-8b26-4860-a1e0-fabe686da3f4 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 0.513761 Oct 18 16:28:52.766541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2960/5888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:52 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:52.780329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac08dc22-4c3d-4bbc-b63b-df6addda91ee", "name": "network-vif-plugged", "status": "completed", "tag": "872cd60b-9d52-476a-bbf8-1b119e87190c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:52.792757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.793342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.794286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.815106 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] Creating event network-vif-plugged:872cd60b-9d52-476a-bbf8-1b119e87190c for instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee on n-h1-858383-14 Oct 18 16:28:52.831157 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-cf35946d-f621-4cd2-a417-26a5150a4999 req-27a72c0c-1ee6-4011-a237-9779e4b9c3c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061558 Oct 18 16:28:52.831998 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2961/5889] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:53.071011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:53.072276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:53.118634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.119424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.120057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:53.120952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.122158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.138193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:53.722791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:53.742068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:53.762439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a5521cbc-f7c5-4a7c-96ad-9e59252b41ad tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 0.698876 Oct 18 16:28:53.772259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:53.785358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:53.788972 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23b13397-5922-4ffd-8803-99fc971f831a tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 1.649321 Oct 18 16:28:53.796901 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2929/5890] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:52 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:53.809587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:53.816084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:53.825544 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2962/5891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:53 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:53.853599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.854618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.855284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:53.857504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.858970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.859842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:54.849386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:54.850582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:54.881722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:54.885176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:54.885955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:54.887207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:54.891513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:54.894367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:55.334395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.349853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.351676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.353197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acee33c9-3f7b-4a62-8eae-8ed60bc32870 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.518678 Oct 18 16:28:55.353779 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2963/5892] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:54 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:28:55.379349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:55.380174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:55.407609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.426111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:55.431507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:55.432094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:55.433172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:55.439147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f995096-b454-47e6-8214-bd870c26ce98 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1294 microversion: 2.1 time: 1.634211 Oct 18 16:28:55.439147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2930/5893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:53 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1294 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:55.439556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:55.440008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:55.676825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.688644 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4527d5c5-871d-43d2-90f7-78e6e04421b9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 0.333670 Oct 18 16:28:55.702712 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2964/5894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:55 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:56.384652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:56.385301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:56.400446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.400952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.401427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.402143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.409611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.411115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.479185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:56.480223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:56.506006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.532439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.533025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.548624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.549519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.550143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.902848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:56.912828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:56.916818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:56.921361 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9059cd55-c14e-45bd-92cd-3b627287a7ab tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.540173 Oct 18 16:28:56.928782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2931/5895] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:56 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:56.944895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:56.954970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:56.969758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:56.981319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.982165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.982897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.984325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.986629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.987221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.010299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f0ac09c3-8758-4a61-9212-470a3c969c8d tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1486 microversion: 2.1 time: 0.538939 Oct 18 16:28:57.011056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2965/5896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:56 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1486 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:57.044705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68fde45-4b28-42e5-a0cc-1ab3dd27d429", "tag": "8afbb950-63a8-490c-ad79-ab53f216f869"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:57.114186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:57.115318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:57.116131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.160183 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] Creating event network-changed:8afbb950-63a8-490c-ad79-ab53f216f869 for instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 on n-h1-858383-14 Oct 18 16:28:57.175059 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-87a3fb58-23ea-41ce-8fe9-7aafbaff1c61 req-ba97e991-00b0-494f-baa7-33f2ae1fd2e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155915 Oct 18 16:28:57.177752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2966/5897] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:57.188043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:57.189071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:57.201252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:57.202697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:57.203800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.205610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:57.207006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:57.209134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.414895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a88d18c-9bc2-465e-883d-eaf63ac797cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234119 Oct 18 16:28:57.415786 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2967/5898] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:28:57 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:57.976192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:57.980873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:58.001435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:58.001971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:58.002417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:58.003147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:58.008461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:58.010875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:58.469166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:58.503394 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca1d3b97-b924-4c27-b02e-27edb6cd1172 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 1.569805 Oct 18 16:28:58.521836 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2932/5899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:56 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:58.670110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:58.702601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:58.704896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:58.710718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d7c7ed95-dda7-4c88-8379-079c12131692 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.746785 Oct 18 16:28:58.721666 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2968/5900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:57 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:28:59.546277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:59.552819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:59.585737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.587830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.592319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:59.593084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.594052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.597120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:59.760235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:59.762855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:59.786238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:59.849168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.851342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.852372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:59.853396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.854151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.854831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.273048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.285587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f356edbe-bded-4c85-a0db-79ddebab5a23 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1507 microversion: 2.1 time: 0.751366 Oct 18 16:29:00.288055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2933/5901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:59 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1507 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:00.303353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:00.304038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:00.318786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:00.320090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:00.320643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.322541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:00.323077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:00.323671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.351982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:00.363724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.374398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.380474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.383136 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05cc2f14-a038-43d1-bcd9-c29a787bfb95 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.630836 Oct 18 16:29:00.386849 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2969/5902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:28:59 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:29:00.392818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac08dc22-4c3d-4bbc-b63b-df6addda91ee", "tag": "872cd60b-9d52-476a-bbf8-1b119e87190c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:00.414178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:00.418976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:00.425689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.454451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] Creating event network-changed:872cd60b-9d52-476a-bbf8-1b119e87190c for instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee on n-h1-858383-14 Oct 18 16:29:00.475695 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a71b017a-0e2b-4559-b31c-44afe3bae1a4 req-6d8cf9db-3910-410b-bf03-b4c229275c20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086536 Oct 18 16:29:00.482470 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2970/5903] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:00.651136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.679551 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db60aca4-33b0-4df5-941f-b3d5f47a64cb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1486 microversion: 2.1 time: 0.381421 Oct 18 16:29:00.680172 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2934/5904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:00 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1486 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:01.335245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:01.338350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:01.350548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.353235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.355070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:01.357871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.360291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.361213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:01.421904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:01.423004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:01.430384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=58 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:01.448753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.450742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.452006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:01.453848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.454910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.455941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:01.998810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.025870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.028871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.056498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bed88e2-eebf-48d4-9f85-6a5fd7b931a6 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.643358 Oct 18 16:29:02.061293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2935/5905] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:01 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:29:02.096856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.112105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f335e2fa-5d66-40a8-810e-5632b6482790 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1511 microversion: 2.1 time: 0.788261 Oct 18 16:29:02.129262 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2971/5906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:01 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1511 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:02.162545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:02.173126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.173921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.compute.servers [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Removing options 'limit' from query {{(pid=120570) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 16:29:02.175297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:02.177715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:02.178861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:02.179896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:02.181475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:02.182551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:02.184104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:02.186921 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-37d5d290-6979-4056-8174-48ea39355c45 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.031485 Oct 18 16:29:02.200944 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2936/5907] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:29:02 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:29:02.211731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:02.212602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:02.238059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:02.239466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:02.240405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:02.242312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:02.243197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:02.244136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.005425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:03.006239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:03.018266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.019456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.020195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.021265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.022016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.022989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.095597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-307be231-94c8-4295-988d-e88756a3d75f tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/ips" status: 200 len: 146 microversion: 2.1 time: 0.083404 Oct 18 16:29:03.095597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2937/5908] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:29:02 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/ips => generated 146 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:03.125286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:03.125924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:03.150433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.157701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.158491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.162751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.165503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.168841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.278732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:03.325053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ddb79c81-37cd-4c90-9cb3-e1b6b9425a39 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1511 microversion: 2.1 time: 1.121906 Oct 18 16:29:03.332451 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2972/5909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:02 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1511 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:03.370553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:03.372925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:03.391811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.395909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.397073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.398529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.399518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.400293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.528046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:03.544067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:03.548227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:03.548846 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d58a9e53-c554-43ef-b8f5-a911f43f54e5 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.435975 Oct 18 16:29:03.556207 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2938/5910] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:03 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:29:03.951769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "name": "network-vif-plugged", "status": "completed", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:03.968132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.969039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.969727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.997673 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] Creating event network-vif-plugged:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h2-858383-14 Oct 18 16:29:04.009282 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f727be9f-30c6-4398-83b5-41e920ac557a req-0a9524f5-b10c-446e-a04b-4f5712e384eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062473 Oct 18 16:29:04.011042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2939/5911] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:04.017576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.032621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea15899d-ff48-4edd-873e-bdcdd608b637 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1511 microversion: 2.1 time: 0.667646 Oct 18 16:29:04.049873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2973/5912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:03 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1511 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:04.076491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:04.078473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:04.097588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.099311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.100456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.102111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.104539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.105888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.440857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.460393 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ecd93bd8-9684-473d-a360-b18a92eb3b38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1511 microversion: 2.1 time: 0.395431 Oct 18 16:29:04.461998 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2940/5913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:04 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:04.516519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:04.536600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.537550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:04.609418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:04.610729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:04.622561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.623412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.624356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.625641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.626395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.627020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.788157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.788817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.792089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.794188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.794958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.799867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.950619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.960716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.962503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.963939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56fdbf8a-9607-42f8-b4b4-e48c39517e8b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.362870 Oct 18 16:29:04.965684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2941/5914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:04 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:29:05.041627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:05.153548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c23f367a-8086-404d-a37c-5c9fe8d6f4d7 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.661484 Oct 18 16:29:05.155048 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2974/5915] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Oct 18 16:29:04 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:05.174829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:05.177448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:05.200113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.201216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.201832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:05.202748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.203564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.204441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:05.526919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:05.549067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e94708a-dc20-4ac9-923c-5b3c98760863 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1511 microversion: 2.1 time: 0.383710 Oct 18 16:29:05.550135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2942/5916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:05 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:05.585640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:05.587927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:05.601228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.601867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.602550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:05.603485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.603847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.604570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.008960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:06.009857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:06.017881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.018751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.019409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.020302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.020952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.021636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.221468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:06.239807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-159f7d2a-e755-47b9-b275-81517c933d35 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1511 microversion: 2.1 time: 0.662844 Oct 18 16:29:06.248466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2975/5917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:05 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1511 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:06.254598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb087ed-0d47-4d92-8795-ca9715aae251"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:06.263555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:06.279199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.281018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.283642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.286919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.287881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.288788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.524400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:06.551017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:06.553871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:06.558093 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39517a2f-df71-40b4-8dd5-82216f6c72f1 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.552433 Oct 18 16:29:06.560291 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2943/5918] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:06 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:29:06.579926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:06.583332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:06.598091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.599239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.600581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.602119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.603734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.605383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.741653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:06.991877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:07.018596 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-769ed1d6-f37b-4e1c-b7b6-2115432985f4 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1511 microversion: 2.1 time: 0.455779 Oct 18 16:29:07.024517 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2944/5919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:06 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:07.062084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:07.069526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:07.070599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:07.112045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.112940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.117611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.119523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.120250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.120727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.241069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b80766fc-0b50-464e-b2c8-abee236d68f2 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.990326 Oct 18 16:29:07.242090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2976/5920] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:29:06 2022] POST /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:07.302536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:07.434038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:07.453305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.467141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.467902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.619501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:07.632309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:07.653282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.654038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.661422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.669908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.673275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.673818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.906868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a170a556-7949-4d86-b558-02135d800e11 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.848320 Oct 18 16:29:07.909442 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2945/5921] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:29:07 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:07.948163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:07.965984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:07.967736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:08.145943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:08.177721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:08.180118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:08.187367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b13cb5d-3670-4a09-bcda-175742c66d5b tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1729 microversion: 2.20 time: 0.580724 Oct 18 16:29:08.195543 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2977/5922] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:07 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1729 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:08.213317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:08.419749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:08.599623 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0dfa07aa-35bb-4506-a58d-8441ef9cb614 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.656681 Oct 18 16:29:08.604079 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2946/5923] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Oct 18 16:29:07 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:08.658548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:08.689238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:08.691279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:08.741183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:08.743900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:08.745104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:08.747995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:08.748491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:08.748944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:08.936472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:09.095319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59c75aaf-5dfc-456b-9818-8698617d8ffb tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.447409 Oct 18 16:29:09.113048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:09.116891 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2978/5924] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 18 16:29:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:09.120194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:09.125790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:09.139305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.140130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.140772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.141520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.141978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.142403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.244805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:09.246243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:09.263480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.267535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.271514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.273425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.274726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.288883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.357400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:09.466922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d89be851-7c90-4552-a12a-48be891b9be3 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.359893 Oct 18 16:29:09.477541 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2947/5925] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Oct 18 16:29:09 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:09.483582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:09.492722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:09.493857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': '1103173196', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:09.507388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.509157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.509782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.513103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.513841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.514476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.799706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:10.054837 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43ea0d9a-9abf-4357-a891-3a1fc04146c6 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=1103173196" status: 200 len: 346 microversion: 2.1 time: 0.575542 Oct 18 16:29:10.065745 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2948/5926] 10.222.0.78 () {58 vars in 1156 bytes} [Tue Oct 18 16:29:09 2022] GET /compute/v2.1/servers?name=1103173196 => generated 346 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:10.076467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:10.080045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:10.095540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:10.102736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:10.107101 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73624fae-73b3-43c7-a393-5b2870ad1c82 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1716 microversion: 2.20 time: 0.866769 Oct 18 16:29:10.108088 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2979/5927] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:29:09 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1716 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:29:10.108636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:10.110847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:10.130594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:10.131504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:10.132202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:10.133474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:10.136115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:10.136621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:10.876927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:11.024668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc87c5f6-33e8-474a-80e7-06b1c89ea517 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.952607 Oct 18 16:29:11.025814 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2949/5928] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Oct 18 16:29:10 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:11.048873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:11.055339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:11.059212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-110317319', 'deleted': False, 'project_id': 'd11b952197c4461badbca0712357944b'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:11.065116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=77 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:11.076672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.078526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.079089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.082668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.083297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.085376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.373875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:11.475881 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2adfd352-93d5-4e05-8823-0aacd3978962 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-110317319" status: 200 len: 346 microversion: 2.1 time: 0.435915 Oct 18 16:29:11.489234 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2980/5929] 10.222.0.78 () {58 vars in 1228 bytes} [Tue Oct 18 16:29:11 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-110317319 => generated 346 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:11.506149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:11.509466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:11.526875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.527829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.533523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.534933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.538053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.538720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.627061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:11.667305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:11.890942 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f4143769-e5b4-466d-abff-8b0a7ea91532 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 204 len: 0 microversion: 2.1 time: 0.392720 Oct 18 16:29:11.898326 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2950/5930] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:11 2022] DELETE /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:11.905128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:11.906030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:11.927341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.929749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.930404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.931371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.932007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.932631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:13.642205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:13.651348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5612c9c-02c8-459b-a436-f718babc0e01 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1517 microversion: 2.1 time: 1.751391 Oct 18 16:29:13.656137 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2981/5931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:11 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1517 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:14.682542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:14.684914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:14.695067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:14.695838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:14.696470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:14.697412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:14.698052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:14.699254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:15.438498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:15.451824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4799b1e-d7e8-47c5-83b8-7e26dabdbfbd tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1517 microversion: 2.1 time: 0.774318 Oct 18 16:29:15.468125 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2951/5932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:14 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1517 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:15.771081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5ba36f-95cc-417d-a76a-1b3088fc1b7d", "name": "network-vif-deleted", "tag": "c365146a-b399-4187-bef5-84017684ddc0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:15.847962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:15.856063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:15.857352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:15.966406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] Creating event network-vif-deleted:c365146a-b399-4187-bef5-84017684ddc0 for instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d on n-h2-858383-14 Oct 18 16:29:15.993519 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e8b16c6d-4270-4950-8afa-4da2c043210d req-a87714f6-de66-4b08-a1fd-4b3126a58d64 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234379 Oct 18 16:29:16.005239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2982/5933] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:16.507151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:16.508828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:16.520673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:16.521724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:16.522481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:16.523367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:16.523997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:16.525186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:16.611630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:16.612421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:16.613070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:16.613813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lazy-loading 'fault' on Instance uuid bd5ba36f-95cc-417d-a76a-1b3088fc1b7d {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:29:16.868736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:16.888670 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3a46ced-9266-43ee-b4f8-158db0232be9 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 200 len: 1310 microversion: 2.1 time: 0.381878 Oct 18 16:29:16.897873 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2952/5934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:16 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 1310 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:17.942941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:17.945587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: bd5ba36f-95cc-417d-a76a-1b3088fc1b7d] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:17.999904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.001664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.006498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.014653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.015287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.016037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.048218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] HTTP exception thrown: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Request method failure captured: Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d HTTP/1.1 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtP65jOuicuLZCmgnL4I_2G3qr5klk8aTt9riE13_F7SHB3HJWE7TKNXB_ZGIWn9OfrYkcNORgzPqipywf79eEEvLtYZFylIjp8FoAaJpQ51uI1dtp1xRnobYv0U1M7JMDSZ6uPLGkdvwA403FJwXWxUDLfKG1tqWZ21GmzmKnEaPK4 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d11b952197c4461badbca0712357944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d11b952197c4461badbca0712357944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}] Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 83c668dcae65428e99d6dab21f00fe88 Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'bd5ba36f-95cc-417d-a76a-1b3088fc1b7d'} Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:18.050066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. Oct 18 16:29:18.056071 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:18.058542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Returning 404 to user: Instance bd5ba36f-95cc-417d-a76a-1b3088fc1b7d could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:18.060379 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a25630f-a826-4418-b64d-891c6fb572ff tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d" status: 404 len: 111 microversion: 2.1 time: 0.125102 Oct 18 16:29:18.064712 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2983/5935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:17 2022] GET /compute/v2.1/servers/bd5ba36f-95cc-417d-a76a-1b3088fc1b7d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:18.073201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:18.074518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:18.083279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:18.086948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.087548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.088192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.089890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.091455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.092087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.150720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:18.415665 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b95d08d-ceb7-49a2-9de4-f9d41f13731c tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "DELETE /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 204 len: 0 microversion: 2.1 time: 0.346663 Oct 18 16:29:18.416931 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2953/5936] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:18 2022] DELETE /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:18.428854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:18.430478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:18.441682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.442705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.443327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.444645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.445319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.445936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.692215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-447184862", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:18.770252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:29:18.840948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:18.870330 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9e2ed9e-a212-4a7c-a228-989ea7a66211 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1517 microversion: 2.1 time: 0.446828 Oct 18 16:29:18.874623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2984/5937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:18 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:19.361079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:29:19.361714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:29:19.362127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:29:19.362634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:29:19.363056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:29:19.374108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.375432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.375874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.376621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.377102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.377658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.419768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Getting quotas for project ff3a0d95dfba48baa0c42c2189bbf5a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:29:19.425614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Getting quotas for user 1e19905859b1410abd0103590d7e1745 and project ff3a0d95dfba48baa0c42c2189bbf5a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:29:19.442150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:29:19.444981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:29:19.541324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19d4960b-0806-45d6-9f8e-ee8e3fa1d731 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854694 Oct 18 16:29:19.550569 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2954/5938] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:29:19.568202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-abd50fb3-1516-4fb9-bbf9-0a1441a992ab tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:19.570694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-abd50fb3-1516-4fb9-bbf9-0a1441a992ab tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:19.791435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-abd50fb3-1516-4fb9-bbf9-0a1441a992ab tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:19.811296 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-abd50fb3-1516-4fb9-bbf9-0a1441a992ab tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1214 microversion: 2.1 time: 0.258940 Oct 18 16:29:19.834007 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2985/5939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:19 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:19.905198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:19.909117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:19.943196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.946082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.947345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.953972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.962993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.967104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:20.870042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b444da0f-563b-4438-bdcb-8bea26d573e0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:20.874290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b444da0f-563b-4438-bdcb-8bea26d573e0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.175472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b444da0f-563b-4438-bdcb-8bea26d573e0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:21.217114 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b444da0f-563b-4438-bdcb-8bea26d573e0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1214 microversion: 2.1 time: 0.355532 Oct 18 16:29:21.224312 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2986/5940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:20 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:21.315031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:21.333649 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df8764fe-7bf1-43b2-93dc-b7a3c7da5652 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1517 microversion: 2.1 time: 1.436993 Oct 18 16:29:21.335918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2955/5941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:19 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1517 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:22.265028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:22.266880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:22.285682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03078c63-3a43-4ddb-83a7-17b03eb47865", "name": "network-vif-deleted", "tag": "86070468-cf21-4818-883c-438f91c79e50"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:22.311662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:22.321493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.333548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.335965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.345847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.351579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.353407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.364039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.365167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.365167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.400962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] Creating event network-vif-deleted:86070468-cf21-4818-883c-438f91c79e50 for instance 03078c63-3a43-4ddb-83a7-17b03eb47865 on n-h1-858383-14 Oct 18 16:29:22.416721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d292d4d3-3c8a-4279-a5ed-408a7b83202f req-9fc8b5eb-158b-4329-bf06-ff082d5c884d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136927 Oct 18 16:29:22.420190 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2956/5942] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:22.432430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:22.435293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:22.452670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.455810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.457056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.458933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.460215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.461305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.863587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:22.889919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24f628b4-f933-4ede-825b-af641ef46026 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 200 len: 1306 microversion: 2.1 time: 0.467070 Oct 18 16:29:22.890560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2957/5943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:22 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 1306 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:22.896885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:22.939412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b08e3b02-760a-4e84-8522-5701f7897173 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1274 microversion: 2.1 time: 0.682856 Oct 18 16:29:22.943848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2987/5944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:22 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1274 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:23.918472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:23.920472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 03078c63-3a43-4ddb-83a7-17b03eb47865] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:23.930930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:23.931709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:23.932323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:23.933815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:23.934462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:23.935093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:23.967169 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] HTTP exception thrown: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Request method failure captured: Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 HTTP/1.1 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtP65jOuicuLZCmgnL4I_2G3qr5klk8aTt9riE13_F7SHB3HJWE7TKNXB_ZGIWn9OfrYkcNORgzPqipywf79eEEvLtYZFylIjp8FoAaJpQ51uI1dtp1xRnobYv0U1M7JMDSZ6uPLGkdvwA403FJwXWxUDLfKG1tqWZ21GmzmKnEaPK4 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d11b952197c4461badbca0712357944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d11b952197c4461badbca0712357944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}] Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 83c668dcae65428e99d6dab21f00fe88 Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '03078c63-3a43-4ddb-83a7-17b03eb47865'} Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:23.970674 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. Oct 18 16:29:23.980605 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:23.992281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:23.995871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Returning 404 to user: Instance 03078c63-3a43-4ddb-83a7-17b03eb47865 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:23.996976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:24.008666 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b3a50bc-539c-4409-82a0-292de5bd8f38 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865" status: 404 len: 111 microversion: 2.1 time: 0.093911 Oct 18 16:29:24.013956 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2958/5945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:23 2022] GET /compute/v2.1/servers/03078c63-3a43-4ddb-83a7-17b03eb47865 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:24.021094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:24.021633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:24.027559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.028459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.028967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.029960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.030478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.030959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.050028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.054102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.055013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.058041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.058822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.060804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.107761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:24.207863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:24.221656 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c35ec4e-b631-451a-8aa5-005f9b4c5248 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1272 microversion: 2.1 time: 0.237859 Oct 18 16:29:24.222905 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2988/5946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:23 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:24.286709 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d256fb4d-ceb4-47bc-8d7b-a1b743ccc385 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 204 len: 0 microversion: 2.1 time: 0.267190 Oct 18 16:29:24.287350 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2959/5947] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:24 2022] DELETE /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:24.304124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:24.305856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:24.316699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.318055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.320048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.321664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.322599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.323456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.686550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:24.700319 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e0dc871-69e1-4cb3-b95d-0b281a043a7f tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1517 microversion: 2.1 time: 0.407759 Oct 18 16:29:24.718589 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2989/5948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:24 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:25.251419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:25.252525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:25.261522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.262321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.263276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.264876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.266218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.267543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.721083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:25.736311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7cf6e110-fb2a-4d9a-8050-052d0b973e52 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.489841 Oct 18 16:29:25.746378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:25.747812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:25.750551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2960/5949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:25 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:25.759624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.762517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.764206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.765789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.766857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.767560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.074684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:26.093383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee53be1f-8261-4443-b4ca-56f00094a8a2 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1517 microversion: 2.1 time: 0.352957 Oct 18 16:29:26.096132 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2990/5950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:25 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:26.558046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:26.561139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:26.569150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.569689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.570331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.571293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.571820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.572491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.614351 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0005dc0a-c116-41c9-bf16-b05cddce9891 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061278 Oct 18 16:29:26.615185 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2961/5951] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:29:26 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:26.627870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:26.628364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:26.635460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.637300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.637771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.638731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.639538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.639989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.687490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5665e5d-f621-48c6-b588-f323cba2aa34 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251" status: 200 len: 194 microversion: 2.1 time: 0.063344 Oct 18 16:29:26.689246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2991/5952] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Oct 18 16:29:26 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:26.780869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:26.782074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:26.806696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.808254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.810526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:26.811756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:26.812490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:26.813162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:27.127830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:27.128634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:27.146196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:27.147278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:27.148333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:27.149928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:27.150502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:27.150942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:27.538961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:27.560803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e4b3fce-14a5-495a-aefe-34607c8024f0 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1517 microversion: 2.1 time: 0.441207 Oct 18 16:29:27.563001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2992/5953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:27 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1517 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:27.600433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:27.617338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eeb8c644-2848-42bf-9173-4b837bf60864 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.845097 Oct 18 16:29:27.619649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2962/5954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:26 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:28.593397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d42ac-981e-4d5d-9ab6-63b5f90813c4", "name": "network-vif-deleted", "tag": "0e69dd46-71d1-492b-b934-fc9fc0128076"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:28.602875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:28.604356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:28.622578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.633121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.636548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.637595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.640763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.641991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.643134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.643809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.645545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.712015 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] Creating event network-vif-deleted:0e69dd46-71d1-492b-b934-fc9fc0128076 for instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 on n-h2-858383-14 Oct 18 16:29:28.739731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-702691a1-89f4-40cd-b30b-83653b1b659c req-48ebd505-0e14-4443-845b-d5bbfa38fdf3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150017 Oct 18 16:29:28.741400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2993/5955] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:28.756626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:28.762362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:28.773226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.775577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.777271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.778321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.778633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:28.779215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.779556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:28.779721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.780324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:28.780545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lazy-loading 'fault' on Instance uuid 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:29:29.021040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c668dcae65428e99d6dab21f00fe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b952197c4461badbca0712357944b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:29.049278 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ec9f48a-d450-40dd-9f7f-a4f76351554e tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 200 len: 1311 microversion: 2.1 time: 0.448368 Oct 18 16:29:29.053306 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2963/5956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:28 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:29.101768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:29.116022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06484b61-2553-4ae5-9974-0f38b7df4471 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.372780 Oct 18 16:29:29.117431 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2994/5957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:28 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:29.775936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06195b6-cecf-42e5-8176-aa3ae7026159"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:29.783112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:29.787646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:29.791491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:29.801789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:29.802701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:29.803223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:29.804117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:29.804708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:29.805222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:29.811948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:30.088119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:30.089606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] [instance: 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:30.108780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:30.109805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:30.111645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:30.113294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:30.115383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:30.116255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:30.138808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] HTTP exception thrown: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Request method failure captured: Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 HTTP/1.1 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtP65jOuicuLZCmgnL4I_2G3qr5klk8aTt9riE13_F7SHB3HJWE7TKNXB_ZGIWn9OfrYkcNORgzPqipywf79eEEvLtYZFylIjp8FoAaJpQ51uI1dtp1xRnobYv0U1M7JMDSZ6uPLGkdvwA403FJwXWxUDLfKG1tqWZ21GmzmKnEaPK4 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d11b952197c4461badbca0712357944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d11b952197c4461badbca0712357944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d11b952197c4461badbca0712357944b"}]}] Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: d11b952197c4461badbca0712357944b Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-115423241 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 83c668dcae65428e99d6dab21f00fe88 Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ListServerFiltersTestJSON-115423241-project Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '5f5d42ac-981e-4d5d-9ab6-63b5f90813c4'} Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:30.141445 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. Oct 18 16:29:30.146133 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:29:30.148324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] Returning 404 to user: Instance 5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:30.149630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-270d0ce4-d1cc-4e65-8738-a846ee694763 tempest-ListServerFiltersTestJSON-115423241 tempest-ListServerFiltersTestJSON-115423241-project] 10.222.0.78 "GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4" status: 404 len: 111 microversion: 2.1 time: 0.076295 Oct 18 16:29:30.156223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2995/5958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:30 2022] GET /compute/v2.1/servers/5f5d42ac-981e-4d5d-9ab6-63b5f90813c4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:30.164645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:30.165865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:30.173602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:30.174576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:30.175647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:30.176914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:30.177757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:30.178513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:30.204912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:30.396355 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5456764d-6d5c-410a-a7c7-1efc88bcc125 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "POST /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621592 Oct 18 16:29:30.404052 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2964/5959] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:29:29 2022] POST /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:30.800162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6920a22-1395-405c-928f-356cb618384f", "tag": "1442f79e-a5bb-44a0-be34-a84ba78eb9e3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:30.853686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:30.855537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:30.856335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:30.887852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] Creating event network-changed:1442f79e-a5bb-44a0-be34-a84ba78eb9e3 for instance b6920a22-1395-405c-928f-356cb618384f on n-h2-858383-14 Oct 18 16:29:30.896297 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-37032134-2b7d-447b-b0c2-8b81623031f8 req-22351dad-5a51-4569-8f68-d5caf8b4686e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121697 Oct 18 16:29:30.897955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2965/5960] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:31.160977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:31.188467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:31.200824 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a922df8a-67cd-441e-8d41-8889ff752792 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 1.041725 Oct 18 16:29:31.205968 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2996/5961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:30 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:32.238512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:32.239467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:32.282602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:32.292520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:32.298631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:32.299347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:32.300252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:32.300794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:32.301505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:32.803792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:32.816831 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1fc090f1-c695-4d87-a4d3-cbb3e8233b36 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.588546 Oct 18 16:29:32.818224 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2966/5962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:32 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:33.858678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:33.860302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:33.876037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:33.877137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:33.877775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:33.878854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:33.879480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:33.880207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:34.238168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:34.252323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5036608b-8d19-456d-9c23-80ffcbedd002 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.401206 Oct 18 16:29:34.271465 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2997/5963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:33 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:35.280252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:35.280929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:35.303679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:35.304369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:35.305083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:35.313473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:35.317991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:35.321575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:35.656344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:35.680373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acddd667-a59e-4a8e-b84d-3ceb371928e3 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.401100 Oct 18 16:29:35.681602 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2967/5964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:35 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:36.711657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:36.712520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:36.730449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:36.730955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:36.731395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:36.732249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:36.732710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:36.733192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:37.273582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:37.285829 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5033a985-edd3-4ba8-b4a6-755299eda5a0 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.579522 Oct 18 16:29:37.286832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2998/5965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:36 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:38.196748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:38.202651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:38.216101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Searching by: {'deleted': False, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:38.233028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.234529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.237894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.244109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.245232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.246770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.276435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6920a22-1395-405c-928f-356cb618384f", "name": "network-vif-plugged", "status": "completed", "tag": "1442f79e-a5bb-44a0-be34-a84ba78eb9e3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:38.316406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.318141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.318359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.330850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:38.359840 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] Creating event network-vif-plugged:1442f79e-a5bb-44a0-be34-a84ba78eb9e3 for instance b6920a22-1395-405c-928f-356cb618384f on n-h2-858383-14 Oct 18 16:29:38.370915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8deadbf3-07a0-4f49-9eb5-a3e374f95b72 req-2562d0c5-3e6a-4e2e-a4ca-ae30ab8f6422 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099263 Oct 18 16:29:38.372872 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 2999/5966] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:38.394374 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f034432a-c672-41e1-9ed1-e55c3c5747c3 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.202479 Oct 18 16:29:38.407962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2968/5967] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:29:38 2022] GET /compute/v2.1/servers => generated 344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:38.412276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:38.415041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:38.424034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:38.433991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:38.435056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Searching by: {'deleted': False, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2'} {{(pid=120570) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:29:38.443039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.443764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.444555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.445569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.446299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.446958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.452987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.453524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.457033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.457960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.462362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.462980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.518845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.multi_cell_list [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:29:38.594538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:38.604485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.605097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.605921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.841597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:38.858201 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-759fed96-3acf-4d6c-96b3-f888d1712d24 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.483292 Oct 18 16:29:38.882784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3000/5968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:38 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:39.049327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e695f784-f72a-43b0-80fd-a92975bd90a9 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1608 microversion: 2.1 time: 0.635840 Oct 18 16:29:39.049929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2969/5969] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:29:38 2022] GET /compute/v2.1/servers/detail => generated 1608 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:39.087754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-82e16254-2fcb-4a40-8d20-c572c30601a2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:39.100654 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-82e16254-2fcb-4a40-8d20-c572c30601a2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022708 Oct 18 16:29:39.103804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3001/5970] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:29:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:39.421352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:39.422759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:39.440300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.441110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.441770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.442702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.443350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.443956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.553614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:39.819220 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-81a73ac2-b476-4816-bef1-89344e3d3d28 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 204 len: 0 microversion: 2.1 time: 0.402011 Oct 18 16:29:39.825742 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2970/5971] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:39 2022] DELETE /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:39.834515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:39.835326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:39.854534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.855191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.855651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.859281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.861386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.864417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.887563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:39.888282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:39.903182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.903679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.906573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.909950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.917813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.918407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:40.725979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:40.740932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:40.741832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8d8c8aa-5eea-4cad-8134-1af10694dfdb tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1611 microversion: 2.1 time: 0.915343 Oct 18 16:29:40.747452 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3002/5972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:39 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1611 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:40.751036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02b6c36c-3719-4bbb-bea7-238088b81c7f tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1314 microversion: 2.1 time: 0.868402 Oct 18 16:29:40.761762 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2971/5973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:39 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:41.786599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:41.787296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:41.796206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:41.796957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:41.811827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=50 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:41.816236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.819263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.821307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.821955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:41.822585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.823553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.828629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:41.829311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.830559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:41.831753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.833974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.850064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.262328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:42.279183 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15d6297f-fdef-4152-b703-b808d78e0db2 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1464 microversion: 2.1 time: 0.487314 Oct 18 16:29:42.305374 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2972/5974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:41 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1464 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:42.446999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:42.449693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:42.456269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.469526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.470634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.477939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.479594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.483993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.547397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:42.679575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:42.691323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6034ee4-0b3e-4e12-92a2-2da1bc9346cc tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1611 microversion: 2.1 time: 0.910005 Oct 18 16:29:42.693067 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3003/5975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:41 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1611 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:42.769911 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e704c587-ce4d-4790-a9d1-ba5458488074 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 204 len: 0 microversion: 2.1 time: 0.326098 Oct 18 16:29:42.772244 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2973/5976] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:42 2022] DELETE /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:42.795082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:42.798392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:42.811684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.812455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.813916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.815008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.815781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.816483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:43.183319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:43.207348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-856f1f2f-0ade-498b-bf89-0a1ecd38d6ec tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1470 microversion: 2.1 time: 0.428507 Oct 18 16:29:43.208837 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3004/5977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:42 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:43.732175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:43.733554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:43.742768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:43.743548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:43.744172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:43.746242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:43.747039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:43.747660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:43.964860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:43.974922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-53e1adc2-5cc9-49f5-8604-4f9e10f402a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1543 microversion: 2.1 time: 0.247762 Oct 18 16:29:43.989821 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2974/5978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:43 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1543 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:44.233889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:44.234509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:44.258954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:44.259460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:44.259929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:44.261443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:44.261909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:44.262342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:45.004147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:45.005432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:45.013580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:45.014603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:45.015233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:45.016178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:45.016810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:45.017443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:45.197054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:45.210777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:45.221629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-521c6ff9-a4b6-4e6c-a888-4955cb8b9d2c tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1543 microversion: 2.1 time: 0.220792 Oct 18 16:29:45.223161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2975/5979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:44 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:45.361991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac08dc22-4c3d-4bbc-b63b-df6addda91ee", "name": "network-vif-deleted", "tag": "872cd60b-9d52-476a-bbf8-1b119e87190c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:45.387541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:45.388030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:45.388492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:45.441616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:45.455629 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66d6af7b-c25c-4d59-858b-8fda1af8006b tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1470 microversion: 2.1 time: 1.225853 Oct 18 16:29:45.461332 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3005/5980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:44 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1470 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:45.480243 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] Creating event network-vif-deleted:872cd60b-9d52-476a-bbf8-1b119e87190c for instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee on n-h1-858383-14 Oct 18 16:29:45.508704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0bdf403a-4dcb-4063-8ef3-a7bc0c015f1a req-b249452c-0f11-4160-b413-e8455e4767e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152046 Oct 18 16:29:45.512542 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2976/5981] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:45.774874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-816602308", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e2cd85c5-7d08-47d7-ac19-3d4be2363218"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:45.900022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] validate_networks() for [('e2cd85c5-7d08-47d7-ac19-3d4be2363218', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:29:46.255215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:46.256597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:46.287297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:46.288138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:46.288876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:46.290106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:46.290937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:46.302650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:46.825534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:46.849121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f72ec272-ddeb-4d89-99fe-a36c3bf2443b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.605426 Oct 18 16:29:46.880135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2977/5982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:46 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:46.902223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6920a22-1395-405c-928f-356cb618384f", "name": "network-vif-deleted", "tag": "1442f79e-a5bb-44a0-be34-a84ba78eb9e3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:46.960302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:46.969924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:46.974141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.009350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] Creating event network-vif-deleted:1442f79e-a5bb-44a0-be34-a84ba78eb9e3 for instance b6920a22-1395-405c-928f-356cb618384f on n-h2-858383-14 Oct 18 16:29:47.019778 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fd2d04d3-ecf1-44a0-9284-2ca118dd38bf req-c55e5376-c942-4b00-81de-c98683a3b820 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126080 Oct 18 16:29:47.023003 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2978/5983] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:47.073176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:47.074321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:47.090336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.090828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.091475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.092372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.093523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.097636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.176884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:29:47.178027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:29:47.178681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:29:47.179365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:29:47.179975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:29:47.202873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.203640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.204566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.206908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.207889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.210706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.217165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.217793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.220123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.220756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lazy-loading 'fault' on Instance uuid b6920a22-1395-405c-928f-356cb618384f {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:29:47.279964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Getting quotas for project 95e9fcede8164144ba3c05683a2bc44c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:29:47.300311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Getting quotas for user 23622288141c4af2b2dfb82941f3b2e0 and project 95e9fcede8164144ba3c05683a2bc44c. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:29:47.333431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:29:47.340754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:29:47.359017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e19905859b1410abd0103590d7e1745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:47.373181 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bacc73cf-422d-48bf-8afa-7afe8891ac10 tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 200 len: 1304 microversion: 2.1 time: 0.347838 Oct 18 16:29:47.376120 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2979/5984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:47 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 1304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:47.465286 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-770dcb8c-57be-498b-84e6-fe8ad600450c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002348 Oct 18 16:29:47.465963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3006/5985] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:29:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:29:47.487276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0eecb1e7-d970-4e69-9787-43cc0937643c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:47.488477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0eecb1e7-d970-4e69-9787-43cc0937643c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:47.623312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0eecb1e7-d970-4e69-9787-43cc0937643c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:47.638734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0eecb1e7-d970-4e69-9787-43cc0937643c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1224 microversion: 2.1 time: 0.158305 Oct 18 16:29:47.640046 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2980/5986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:47 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:47.891723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:47.899693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:47.929925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.930979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.931673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:47.937550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:47.941238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:47.941885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:48.163511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:48.178555 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35e8f876-91ec-4521-8dc2-29172ac60dc2 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.298472 Oct 18 16:29:48.183204 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3007/5987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:47 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:48.411181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:48.412459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] [instance: b6920a22-1395-405c-928f-356cb618384f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:48.438962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:48.439900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:48.440593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:48.441851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:48.442595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:48.450038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:48.485939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] HTTP exception thrown: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Request method failure captured: Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f HTTP/1.1 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtRa9aAuk1hkOzX7xEEvf9RTiwPamPQQf8FEAzMfWTW51z9wXIrtOahb7JTOLRUTaMWCCizEWTVKp0aT45WAYTiDusfEyUyY9San99ymWfHitBfSDPh_LUOb0-kGosHTjakyCAIhrb13Pl8FvX3dq5isKP5FXkc_tDzxpHqqPIkSctM Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ff3a0d95dfba48baa0c42c2189bbf5a5 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesNegativeTest-2031820047 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff3a0d95dfba48baa0c42c2189bbf5a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff3a0d95dfba48baa0c42c2189bbf5a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff3a0d95dfba48baa0c42c2189bbf5a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff3a0d95dfba48baa0c42c2189bbf5a5"}]}] Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesNegativeTest-2031820047 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ff3a0d95dfba48baa0c42c2189bbf5a5 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesNegativeTest-2031820047 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesNegativeTest-2031820047-project Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 1e19905859b1410abd0103590d7e1745 Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesNegativeTest-2031820047-project Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b6920a22-1395-405c-928f-356cb618384f'} Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:48.488297 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. Oct 18 16:29:48.495120 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:48.497787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] Returning 404 to user: Instance b6920a22-1395-405c-928f-356cb618384f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:48.503156 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5e57801-0912-4e6d-b576-9a860c95ebea tempest-VolumesNegativeTest-2031820047 tempest-VolumesNegativeTest-2031820047-project] 10.222.0.78 "GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f" status: 404 len: 111 microversion: 2.1 time: 0.096021 Oct 18 16:29:48.505547 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2981/5988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:48 2022] GET /compute/v2.1/servers/b6920a22-1395-405c-928f-356cb618384f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:29:48.663854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:48.665052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:48.679041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:48.681420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:48.682594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:48.683871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:48.685105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:48.690097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:48.858780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:48.909331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32167614-97b6-44cb-9c81-f84013ea246c tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1220 microversion: 2.1 time: 0.238323 Oct 18 16:29:48.910029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3008/5989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:48 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1220 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:49.205637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:49.206515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:49.257037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:49.266982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.274514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.280492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.281642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.286271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.290230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.692360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.695607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:49.697063 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7998b3e-a654-44ce-87cf-d9c5099b51b8 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.494767 Oct 18 16:29:49.707594 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2982/5990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:49 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:49.734112 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04971fbc-ce89-4495-98a1-6e8de6591b72 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.151470 Oct 18 16:29:49.741685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3009/5991] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:29:49 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:49.880405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:49.880923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:49.910221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.914788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.915848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.922349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:49.922982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:49.923674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:49.960795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:49.963527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:50.007548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.014210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.014803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.019621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.020355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.020711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.120122 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d6aed051-abad-448b-995d-6b599fa219e0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251" status: 200 len: 194 microversion: 2.1 time: 0.225826 Oct 18 16:29:50.124277 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2983/5992] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Oct 18 16:29:49 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251 => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:50.147314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:50.152424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:50.166678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.167067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.167488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.168272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.168914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.173165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.275882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:50.285819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a4ff388-7608-4dcc-bd8d-1729a48eb996 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1294 microversion: 2.1 time: 0.330948 Oct 18 16:29:50.301898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3010/5993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:49 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1294 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:50.407331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lazy-loading 'services' on Instance uuid a544916e-da85-4e7b-9c3a-69c6e9ddb106 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:29:50.578631 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff222a8d-049d-48bc-a7ed-be9f19a7813e tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251" status: 202 len: 0 microversion: 2.1 time: 0.439363 Oct 18 16:29:50.590157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2984/5994] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:29:50 2022] DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/8eb087ed-0d47-4d92-8795-ca9715aae251 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:29:50.720809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:50.721516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:50.733042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.736206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.736973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.742443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:50.743189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:50.743965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:50.927516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:50.946879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acb44551-09e6-4b6c-82a5-3b975d65b2be tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.230312 Oct 18 16:29:50.963888 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3011/5995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:50 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:51.322241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:51.323401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:51.337635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:51.338233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:51.338728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:51.339505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:51.348674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:51.349960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:51.562580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:51.581252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf0c6b05-0f3b-4146-8943-dd01b0e395df tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1282 microversion: 2.1 time: 0.265038 Oct 18 16:29:51.587054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2985/5996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:51 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:51.970467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:51.971274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:51.986100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:51.986607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:51.987195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:51.987762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:51.988228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:51.988669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:52.136306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:52.151782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9173ee39-c776-4546-a972-c62f257811a7 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.185069 Oct 18 16:29:52.164351 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3012/5997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:51 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:52.613632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:52.614407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:52.628783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:52.650044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:52.650711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:52.651686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:52.652184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:52.652629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:53.111727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:53.120922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4a22d6ac-55bb-44e6-9701-78e85e471533 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.514122 Oct 18 16:29:53.125980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2986/5998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:52 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:53.175190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:53.175927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:53.183430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:53.186686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:53.187414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:53.191898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:53.194704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:53.195330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:53.312078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:53.321928 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3155ee28-5427-4e37-ac0a-a0d4d7fa0223 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.150677 Oct 18 16:29:53.323480 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3013/5999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:53 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:53.806197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336f8570-c026-4b0d-a4d6-a6536e0431fa", "tag": "540e2f8c-b086-4aba-8b5d-9f17dc74ee4c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:53.827937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:53.830277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:53.831796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:53.876309 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] Creating event network-changed:540e2f8c-b086-4aba-8b5d-9f17dc74ee4c for instance 336f8570-c026-4b0d-a4d6-a6536e0431fa on n-h2-858383-14 Oct 18 16:29:53.891881 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8675f25b-e097-4e50-8027-3ddafbc59b8c req-3a01f2d8-1e11-4fbf-8c08-abb20b96247a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087002 Oct 18 16:29:53.893055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2987/6000] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:54.151646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:54.152267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:54.164433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:54.164931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:54.165408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:54.166653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:54.167122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:54.167552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:54.345922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:54.346643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:54.362339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:54.362844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:54.363285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:54.369972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:54.377075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:54.378183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:54.387691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:54.403406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67c2ab27-588f-4e43-bd2f-d1e6d18f1db7 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.256174 Oct 18 16:29:54.414654 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3014/6001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:54 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:54.513908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:54.522726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14c4e3ca-638a-40ee-b489-e83f887db85b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.181321 Oct 18 16:29:54.524868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2988/6002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:54 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:55.432325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:55.433475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:55.477016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:55.484516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:55.486224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:55.488963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:55.489529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:55.489983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:55.550441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:55.551813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:55.559095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:55.592953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:55.593526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:55.593974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:55.594703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:55.595186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:55.610533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:55.754411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5527f094f5ee4ada9aaae9885c272d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:55.766546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ccde168-1c5a-461a-8306-5adc7fbf8b46 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 200 len: 1253 microversion: 2.1 time: 0.222895 Oct 18 16:29:55.768302 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2989/6003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:55 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 1253 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:56.057748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:56.069623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6bec5269-c269-45f9-83d0-854179b38032 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.644509 Oct 18 16:29:56.079455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3015/6004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:55 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:56.795254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:56.796499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] [instance: ac08dc22-4c3d-4bbc-b63b-df6addda91ee] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:56.806948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:56.817813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:56.818278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:56.819037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:56.819506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:56.820011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:56.844125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] HTTP exception thrown: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Request method failure captured: Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee HTTP/1.1 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtPwtBVDktVAa1Xt1hkSM6xKfwtX9sn8tAHPxEN6yyMrj2BCK5V0OrO1NfzRkjAce6wbCOf3oHDmNK5O-7VUiVkoXsitiMAcMg6t0tMavGeEDI1tUqwmv8c-88l5En8FENHR-fa5s_gZ-ETa02jTQBdZ6sWgcdn52SFedQshqxjXf6w Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9c6af1f8b7c04cbb9ac28658f20a36e2 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestBootFromVolume-442255563 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c6af1f8b7c04cbb9ac28658f20a36e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c6af1f8b7c04cbb9ac28658f20a36e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c6af1f8b7c04cbb9ac28658f20a36e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c6af1f8b7c04cbb9ac28658f20a36e2"}]}] Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestBootFromVolume-442255563 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9c6af1f8b7c04cbb9ac28658f20a36e2 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestBootFromVolume-442255563 Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestBootFromVolume-442255563-project Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 5527f094f5ee4ada9aaae9885c272d7a Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestBootFromVolume-442255563-project Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ac08dc22-4c3d-4bbc-b63b-df6addda91ee'} Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:56.854074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Returning 404 to user: Instance ac08dc22-4c3d-4bbc-b63b-df6addda91ee could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:56.858317 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66875f57-96e0-4737-b1c3-8aace427dd88 tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee" status: 404 len: 111 microversion: 2.1 time: 0.064916 Oct 18 16:29:56.865353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2990/6005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:56 2022] GET /compute/v2.1/servers/ac08dc22-4c3d-4bbc-b63b-df6addda91ee => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:56.865920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f71b4c85-7325-4979-8a1e-06652ee0be3b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] Calling method '.version_select at 0x7f5fd15704c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:56.908233 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f71b4c85-7325-4979-8a1e-06652ee0be3b tempest-ServersTestBootFromVolume-442255563 tempest-ServersTestBootFromVolume-442255563-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140384837" status: 202 len: 0 microversion: 2.1 time: 0.046867 Oct 18 16:29:56.909777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3016/6006] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140384837 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:29:57.097973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:57.098617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:57.115850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:57.116654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:57.117406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:57.118568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:57.120051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:57.132231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:57.633781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:57.685758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:57.702905 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-59deab10-eda4-4423-8d6b-ac26272ccbe1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.608759 Oct 18 16:29:57.706094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2991/6007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:57 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:58.731820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:58.732524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:58.734720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:58.739425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:58.767562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:58.767983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:58.770538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:58.774377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:58.774899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:58.777291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:59.108944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:59.118524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-124a42d3-8871-4bd4-8538-81e921376807 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.394357 Oct 18 16:29:59.122010 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3017/6008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:58 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:00.108974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:00.111343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:00.139076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:00.141867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:00.149156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:00.151112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:00.160429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:00.165598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:00.171984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:00.172812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:00.176417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:00.189191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:00.198883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:00.201714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:00.207366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:00.209263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:00.288145 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-def9aa1a-dc59-4d6d-9f41-4ce72af9af44 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/ips" status: 200 len: 151 microversion: 2.1 time: 0.191735 Oct 18 16:30:00.290441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2992/6009] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:30:00 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/ips => generated 151 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:00.763722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:00.783647 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe22ae8c-4cb7-4b18-9e7a-2bb2c1f45f18 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.639659 Oct 18 16:30:00.802901 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3018/6010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:00 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:30:01.822834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:01.826437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:01.886656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:01.888088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:01.894013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:01.901621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:01.905126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:01.906636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:02.739304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:02.755943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c090a95f-f116-4286-9f03-f2f80e4be1e1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.943658 Oct 18 16:30:02.757303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2993/6011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:01 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:02.903617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f8570-c026-4b0d-a4d6-a6536e0431fa", "name": "network-vif-plugged", "status": "completed", "tag": "540e2f8c-b086-4aba-8b5d-9f17dc74ee4c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:02.946373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:02.947033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:02.960080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:02.973547 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] Creating event network-vif-plugged:540e2f8c-b086-4aba-8b5d-9f17dc74ee4c for instance 336f8570-c026-4b0d-a4d6-a6536e0431fa on n-h2-858383-14 Oct 18 16:30:02.987729 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-388d743b-2773-435b-81b8-67ea0b30dfc7 req-75a6caaf-4fe6-4840-90d7-70e5a2f75585 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088999 Oct 18 16:30:02.988944 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3019/6012] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:03.677838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:03.678359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:03.682658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:03.704044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.705383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.706972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:03.707921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.721819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.722803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:03.789097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:03.799039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:03.814546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46a9c59a-ff27-4c00-b4f0-ee3d67b1de51 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/f06195b6-cecf-42e5-8176-aa3ae7026159" status: 200 len: 194 microversion: 2.1 time: 0.142434 Oct 18 16:30:03.825400 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2994/6013] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Oct 18 16:30:03 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/f06195b6-cecf-42e5-8176-aa3ae7026159 => generated 194 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:03.831062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:03.832625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.833676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.834466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:03.835724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.845859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.846949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:03.847706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:03.861466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.881114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.886645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:03.888946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:03.896611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:03.897269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:04.255350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lazy-loading 'services' on Instance uuid a544916e-da85-4e7b-9c3a-69c6e9ddb106 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:30:04.259463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:04.352314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:04.365961 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f4adaa1-c272-4cac-844a-43dd41f17dda tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1324 microversion: 2.1 time: 0.586270 Oct 18 16:30:04.370923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3020/6014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:03 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:04.376549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6c5aaed-fd34-499f-ab50-4e3bb600beb6"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:04.386502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:04.421325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:04.423872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:04.424558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:04.425758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:04.427313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:04.428907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:04.557782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c6cf170-5631-48db-9081-2f940fabe661 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/f06195b6-cecf-42e5-8176-aa3ae7026159" status: 202 len: 0 microversion: 2.1 time: 0.730691 Oct 18 16:30:04.562754 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2995/6015] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:30:03 2022] DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments/f06195b6-cecf-42e5-8176-aa3ae7026159 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:30:05.225603 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96354de5-e539-4b2e-9710-7ae2421fab3b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "POST /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852951 Oct 18 16:30:05.240239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3021/6016] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:30:04 2022] POST /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:05.405905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:05.407105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:05.482754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:05.483850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:05.484797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:05.487002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:05.488227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:05.489308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:06.459137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:06.476594 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-988ed45c-686a-4634-9d64-d0c27a6cbfd1 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1522 microversion: 2.1 time: 1.081442 Oct 18 16:30:06.477648 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2996/6017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:05 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1522 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:06.507162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:06.518350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:06.532622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:06.549870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:06.550722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:06.552532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:06.553332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:06.554020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:06.692727 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] HTTP exception thrown: Instance is not a member of specified network Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Request method failure captured: Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa/ips/invalid HTTP/1.1 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtR5XDsCwU2MZE_kXu0wObN647v5wX5y4H9DvxGwIR_n22spK6zIhtr1EsohDddIGountVBlR4hSkdYFn7bXDgbp4-mBr8JDA36UHy0vX8Ki-DpFH9CoSDI65sMKVSz26GM3shi9Y7VTu09cglUfUwLV0z5FZIjqH9fTgyMqNac4syw Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}] Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 23622288141c4af2b2dfb82941f3b2e0 Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance is not a member of specified network Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '336f8570-c026-4b0d-a4d6-a6536e0431fa', 'id': 'invalid'} Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 18 16:30:06.714048 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.716862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:06.717539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea0ef798-7839-4a57-9d9e-ec9f81a8a864 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.214847 Oct 18 16:30:06.719130 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3022/6018] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 16:30:06 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa/ips/invalid => generated 91 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:30:06.730945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:06.731260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Failed to fetch instance by id 999 {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 16:30:06.731961 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] HTTP exception thrown: Instance 999 could not be found. Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Request method failure captured: Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtR5XDsCwU2MZE_kXu0wObN647v5wX5y4H9DvxGwIR_n22spK6zIhtr1EsohDddIGountVBlR4hSkdYFn7bXDgbp4-mBr8JDA36UHy0vX8Ki-DpFH9CoSDI65sMKVSz26GM3shi9Y7VTu09cglUfUwLV0z5FZIjqH9fTgyMqNac4syw Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}] Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 23622288141c4af2b2dfb82941f3b2e0 Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 999 could not be found. Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '999'} Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 16:30:06.733960 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:06.742823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:06.752665 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd672191-c2d7-4f47-99b0-80aee49c701d tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023126 Oct 18 16:30:06.761562 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2997/6019] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:30:06 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:30:06.770061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:06.771870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:06.799966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:06.804953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:06.805460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:06.806760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:06.807352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:06.811602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:06.993193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:30:07.432163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f77d514-1e8d-4837-86f9-1d2c4589c1b8 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 204 len: 0 microversion: 2.1 time: 0.664005 Oct 18 16:30:07.433998 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3023/6020] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:30:06 2022] DELETE /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:30:07.450323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:07.451195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:07.480091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:07.481582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:07.483177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:07.485376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:07.487240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:07.490490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:08.257454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:08.273045 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93dfc49b-2e22-439e-96c0-125c0055a8ba tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1528 microversion: 2.1 time: 0.833923 Oct 18 16:30:08.275910 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2998/6021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:07 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1528 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:09.312167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:09.317192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:09.346016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:09.349769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:09.356777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:09.362911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:09.366706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:09.367693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:09.846178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:09.873963 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-558347ec-fa8c-4b30-a2b9-88a61a5d5434 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1528 microversion: 2.1 time: 0.574534 Oct 18 16:30:09.877266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3024/6022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:09 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1528 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:10.902169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:10.902750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:10.951046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:10.952463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:10.953854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:10.956443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:10.957660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:10.958115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:12.193324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:12.210416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8873857f-a0ec-4a86-9467-38244e772d27 tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1528 microversion: 2.1 time: 1.312520 Oct 18 16:30:12.220628 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 2999/6023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:10 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1528 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:12.969860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336f8570-c026-4b0d-a4d6-a6536e0431fa", "name": "network-vif-deleted", "tag": "540e2f8c-b086-4aba-8b5d-9f17dc74ee4c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:13.020870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:13.074145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:13.079168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:13.087628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:13.155678 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] Creating event network-vif-deleted:540e2f8c-b086-4aba-8b5d-9f17dc74ee4c for instance 336f8570-c026-4b0d-a4d6-a6536e0431fa on n-h2-858383-14 Oct 18 16:30:13.178856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-775ed1fd-51e1-4a26-9a00-341ed25a4768 req-d23e7910-4314-4cbd-9dbe-ca2e250eaa66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212657 Oct 18 16:30:13.183778 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3025/6024] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:13.240136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:13.241539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:13.258406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:13.262379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:13.264378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:13.269223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:13.272683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:13.275133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:13.390019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:13.390966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:13.391611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:13.408480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lazy-loading 'fault' on Instance uuid 336f8570-c026-4b0d-a4d6-a6536e0431fa {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:30:13.648891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23622288141c4af2b2dfb82941f3b2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9fcede8164144ba3c05683a2bc44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:13.660389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e827465f-06d5-4ecb-a8e7-bca6b736af8b tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 200 len: 1314 microversion: 2.1 time: 0.426186 Oct 18 16:30:13.666247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3000/6025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:13 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:14.693562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:14.694763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] [instance: 336f8570-c026-4b0d-a4d6-a6536e0431fa] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:14.720150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:14.720396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:14.726455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:14.731788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:14.735777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:14.736411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:14.797946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] HTTP exception thrown: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Request method failure captured: Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa HTTP/1.1 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtR5XDsCwU2MZE_kXu0wObN647v5wX5y4H9DvxGwIR_n22spK6zIhtr1EsohDddIGountVBlR4hSkdYFn7bXDgbp4-mBr8JDA36UHy0vX8Ki-DpFH9CoSDI65sMKVSz26GM3shi9Y7VTu09cglUfUwLV0z5FZIjqH9fTgyMqNac4syw Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95e9fcede8164144ba3c05683a2bc44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95e9fcede8164144ba3c05683a2bc44c"}]}] Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 95e9fcede8164144ba3c05683a2bc44c Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-377939567 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 23622288141c4af2b2dfb82941f3b2e0 Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-377939567-project Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '336f8570-c026-4b0d-a4d6-a6536e0431fa'} Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:14.799972 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. Oct 18 16:30:14.803549 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:14.808049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] Returning 404 to user: Instance 336f8570-c026-4b0d-a4d6-a6536e0431fa could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:14.809158 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04692bc5-9f68-478b-b6a6-d08e099d4abe tempest-ServerAddressesNegativeTestJSON-377939567 tempest-ServerAddressesNegativeTestJSON-377939567-project] 10.222.0.78 "GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa" status: 404 len: 111 microversion: 2.1 time: 0.123869 Oct 18 16:30:14.825225 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3026/6026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:14 2022] GET /compute/v2.1/servers/336f8570-c026-4b0d-a4d6-a6536e0431fa => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:30:17.838090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:17.841197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:17.848775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:17.849617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:17.850242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:17.851141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:17.851780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:17.853464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:17.950323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f1cc47b-ad74-44b9-b433-a7fff970da2d tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.116961 Oct 18 16:30:17.962364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:17.964849 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3001/6027] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 18 16:30:17 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:17.965854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.007142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.008983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.009718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.010724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.012793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.014169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.141124 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5e2ca95-ab85-4fed-9de5-c9faa3a8f497 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182671 Oct 18 16:30:18.142595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3027/6028] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:17 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:30:18.148379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:18.148379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.159250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.160616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.162155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.164484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.169973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.173674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.249481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:30:18.351709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:18.355052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.363801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.364500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.365262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.367309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.368971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.370843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.454231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8430f79-43a8-4cdb-af51-3f3a3384eda0 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106864 Oct 18 16:30:18.459224 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3028/6029] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:18 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:30:18.495664 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47e876fa-b540-4c69-b1c0-c3b4b170d755 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 204 len: 0 microversion: 2.20 time: 0.352818 Oct 18 16:30:18.500314 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3002/6030] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:30:18 2022] DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:30:18.509049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:18.509878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.518458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.525845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.526518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.530013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.530684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.531272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.600890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:18.601819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.609334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.610662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.611360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.612269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.612922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.613608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.646154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:30:18.820068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5122abbf-108b-438c-8db4-98ca28724f16 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 204 len: 0 microversion: 2.1 time: 0.222893 Oct 18 16:30:18.825402 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3003/6031] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:30:18 2022] DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:30:18.834096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:18.835682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:18.844464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.846365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.847017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:18.847907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:18.848515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:18.849603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:19.059630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:19.080246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:19.100604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:19.108418 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29a1c8f9-9444-4917-9a00-a7c8386a7403 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.602011 Oct 18 16:30:19.115581 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3029/6032] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:18 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:19.378602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:19.389061 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-240e5eae-b71a-4f3a-a892-6a02dde79f3b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1674 microversion: 2.1 time: 0.561557 Oct 18 16:30:19.403715 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3004/6033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:18 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1674 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:20.146514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:20.147332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:20.173875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.188830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.192375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.199857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.200791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.205810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.417278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:20.418489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:20.427547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.428055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.428554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.436156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.440509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.441193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.965755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:20.975835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:20.977776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:20.979238 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-166809a8-9f34-4416-8340-e9e7955d86ac tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.842461 Oct 18 16:30:20.981410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3030/6034] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:20 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:21.576896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:21.601923 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cce05e23-4867-4be8-84cb-2ca801761769 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1674 microversion: 2.1 time: 1.189799 Oct 18 16:30:21.611566 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3005/6035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:20 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1674 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:22.031807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:22.034826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:22.061809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.067894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.075408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.082257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.086228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.092116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.640066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:22.640747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:22.653398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.660680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.661468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.662609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.663363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.664070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.750963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:22.761503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:22.775643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:22.777212 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0952c31d-3e80-4a77-9ed0-cb319399a9d7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1722 microversion: 2.20 time: 0.773084 Oct 18 16:30:22.777954 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3031/6036] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:22 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1722 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:23.176860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:23.185643 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a807c8be-5e80-4bae-a9ba-be4d24fe5c01 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1674 microversion: 2.1 time: 0.550641 Oct 18 16:30:23.192146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3006/6037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:22 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1674 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:30:23.807845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:23.808475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:23.820933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:23.825839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:23.829824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:23.830812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:23.831537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:23.832163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:23.874482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:24.032388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:24.052427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:24.054192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:24.055620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34e8bcc1-6414-4bd1-b83c-1a5c5912de70 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1654 microversion: 2.20 time: 0.253099 Oct 18 16:30:24.063814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3032/6038] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:23 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1654 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:30:24.219594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:24.222518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:24.238786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:24.243073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:24.243963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:24.244847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:24.248290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:24.253643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:24.488239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:24.503262 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9b7efd65-2690-4962-a4a3-41be32918a5d tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1606 microversion: 2.1 time: 0.284143 Oct 18 16:30:24.504153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3007/6039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:24 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1606 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:24.581232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d384d91-083f-42f1-a09d-b7168f119c29", "name": "network-vif-deleted", "tag": "f0c1da47-c8a1-4791-b12b-0a799bb423cf"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:24.598850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:24.599937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:24.600522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:24.621277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] Creating event network-vif-deleted:f0c1da47-c8a1-4791-b12b-0a799bb423cf for instance 2d384d91-083f-42f1-a09d-b7168f119c29 on n-h2-858383-14 Oct 18 16:30:24.628755 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-773af01e-797f-4bf8-8920-cabae4b38a77 req-e8b7bc0b-3b30-4292-9956-e8b6214f08f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051209 Oct 18 16:30:24.630294 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3033/6040] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:25.092229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:25.093328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:25.107812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.108566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.109324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.110950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.111635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.112279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.185274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.189717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.190516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.191208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lazy-loading 'fault' on Instance uuid 2d384d91-083f-42f1-a09d-b7168f119c29 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:30:25.374766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:25.395008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:25.398401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d2663d26c42412c8acb3ded09320213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31333817b5a74a6c9bb6cfcfb4ec940a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:25.400306 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4e4815b-f61f-479e-95f2-fab9f4602551 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 200 len: 1371 microversion: 2.20 time: 0.312068 Oct 18 16:30:25.401587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3008/6041] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:25 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:25.532575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:25.533327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:25.550687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.551192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.551639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.552368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.552832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.553323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.807693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a544916e-da85-4e7b-9c3a-69c6e9ddb106", "name": "network-vif-deleted", "tag": "a5c423c8-2fb1-4a0f-94db-39493cb478cc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:25.823010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0514cd6004596969d5d5caf689179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c6a4d6aa046c6becaba98873f63fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:25.833326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.834773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.841677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.848011 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6679866c-94ac-4d15-8e43-62d2ddac1c43 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 200 len: 1606 microversion: 2.1 time: 0.319710 Oct 18 16:30:25.850489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3034/6042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:25 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 1606 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:25.851207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:25.891478 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] Creating event network-vif-deleted:a5c423c8-2fb1-4a0f-94db-39493cb478cc for instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 on n-h1-858383-14 Oct 18 16:30:25.898250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-610bdaa2-30b0-486d-b2d2-c136124f778c req-101d975c-5d39-4a53-9c06-94d5d0e9b933 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095418 Oct 18 16:30:25.901245 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3009/6043] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:26.447063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:26.447772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:26.490407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:26.492471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:26.497990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:26.512762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:26.518366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:26.519973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:26.570547 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 HTTP/1.1 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2d384d91-083f-42f1-a09d-b7168f119c29'} Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.582554 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:26.587747 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.589127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:26.592781 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0523f93c-59be-41d3-94b4-cc61a33ee063 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 404 len: 111 microversion: 2.20 time: 0.165867 Oct 18 16:30:26.594690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3035/6044] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:26 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:30:26.615950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-599ee02b-edf0-49c8-882e-a89c1076d233 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '.version_select at 0x7f5fd1857c10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:26.715003 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-599ee02b-edf0-49c8-882e-a89c1076d233 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816311255" status: 204 len: 0 microversion: 2.20 time: 0.114048 Oct 18 16:30:26.720306 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3010/6045] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 18 16:30:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816311255 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:30:26.873158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:26.874215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:26.916928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:26.917850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:26.918533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:26.919545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:26.920225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:26.920901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:26.972109 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 HTTP/1.1 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a544916e-da85-4e7b-9c3a-69c6e9ddb106'} Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:26.978983 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:30:26.982630 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:26.986225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:26.987365 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-30b2f43d-d59e-437f-aa1b-61cdc2267976 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 404 len: 111 microversion: 2.1 time: 0.119144 Oct 18 16:30:26.988661 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3036/6046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:26 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:30:26.997640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6566e2e9-cd57-46ec-a32e-0fe01ace5323 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '.version_select at 0x7f5fd63d9550>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:27.041969 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6566e2e9-cd57-46ec-a32e-0fe01ace5323 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495176481" status: 202 len: 0 microversion: 2.1 time: 0.047970 Oct 18 16:30:27.047834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3011/6047] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:30:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495176481 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:30:36.644157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-68237794", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": "none"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:36.755697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:36.761513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:36.762346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:36.762916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:36.763818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:36.811993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:36.815390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:36.816049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:36.817025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:36.821671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:36.822679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:36.943377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Getting quotas for project 7f29daf24c5246769f01a77605400704. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:36.972296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Getting quotas for user 542988ec50ec4409b03d1620b5d9d23f and project 7f29daf24c5246769f01a77605400704. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:37.055534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:30:37.094413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:30:37.423636 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc4948ac-d932-4ec4-9cac-edda8b11d23a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.350995 Oct 18 16:30:37.436903 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3037/6048] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 18 16:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:30:37.447914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:37.455559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:37.462548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:37.654703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:37.655347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:37.680779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.681312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.692260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.696519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.696930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.697567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.755961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:37.776168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:37.785763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:37.790107 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.792693 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c18d28f-5a5a-41d9-9627-4d17677a8eeb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1276 microversion: 2.54 time: 0.348353 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 HTTP/1.1 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2d384d91-083f-42f1-a09d-b7168f119c29'} Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:37.811939 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.816316 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.816980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3012/6049] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:37 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:37.822961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:37.828280 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e6f15054-bfa8-45ef-8a42-efc9eba16131 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 404 len: 111 microversion: 2.20 time: 0.175340 Oct 18 16:30:37.838252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3038/6050] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:30:37 2022] DELETE /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:30:37.848763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:37.849438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: 2d384d91-083f-42f1-a09d-b7168f119c29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:37.863989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.864494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.864943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.876409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.889858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.902623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.940352 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 HTTP/1.1 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '2d384d91-083f-42f1-a09d-b7168f119c29'} Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.953473 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance 2d384d91-083f-42f1-a09d-b7168f119c29 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:37.959802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6045c6d5-6c52-454c-a5a1-183a372d5090 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29" status: 404 len: 111 microversion: 2.20 time: 0.117868 Oct 18 16:30:37.962468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3013/6051] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:37 2022] GET /compute/v2.1/servers/2d384d91-083f-42f1-a09d-b7168f119c29 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:30:38.043526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:38.044331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:38.052889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:38.064164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:38.068836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:38.079053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:38.079630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:38.094383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:38.582063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lazy-loading 'services' on Instance uuid b68fde45-4b28-42e5-a0cc-1ab3dd27d429 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:30:38.830086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:38.830715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:38.854905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4401f710-8d55-4e94-9086-2a3e718a941f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments/b6c5aaed-fd34-499f-ab50-4e3bb600beb6" status: 202 len: 0 microversion: 2.1 time: 0.826431 Oct 18 16:30:38.868584 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3039/6052] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:30:38 2022] DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments/b6c5aaed-fd34-499f-ab50-4e3bb600beb6 => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:30:38.896468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:38.898921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:38.971156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:38.971661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:38.972112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:38.989525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:38.990093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:38.990563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:39.134467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:39.143645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:39.166896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:39.177861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ac96d43-e127-4634-94b4-596f6345c359 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1276 microversion: 2.54 time: 0.346751 Oct 18 16:30:39.200211 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b86375c5-852c-4c6c-b1cf-d7e1d9d62351 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.312880 Oct 18 16:30:39.202117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3014/6053] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:38 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:39.204528 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3040/6054] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:38 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:40.225376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:40.227297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:40.230434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:40.233784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:40.245948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.247777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.249812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.250772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.251343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.251990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.252624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.255612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.256292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.257226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.260156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.260780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.374098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-47db5a61-cc31-404f-a1c4-9722ed497a67 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156028 Oct 18 16:30:40.375510 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3041/6055] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:40 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:40.851283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:40.897312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:40.899892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:40.901452 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e35d363a-5526-49d9-bf1b-68cb71098a8a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1328 microversion: 2.54 time: 0.688620 Oct 18 16:30:40.926092 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3015/6056] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:40 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1328 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:41.388198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:41.390652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:41.412642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.416346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.416864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.419975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.422753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.423201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.498113 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-447de534-4173-4544-b030-73bda72d40db tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114347 Oct 18 16:30:41.501823 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3042/6057] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:41 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:41.938295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:41.941900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:41.952958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.963447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.964074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.965505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.966142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.969197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.191441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.225798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.231053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.242418 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ecf1b3b8-f032-4033-82fe-e2f4da236782 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1334 microversion: 2.54 time: 0.306134 Oct 18 16:30:42.265021 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3016/6058] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:41 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:42.298304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04f7bae4-27c7-4088-af9b-781365c255a8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Action: 'create', calling method: .version_select at 0x7f5fd188b310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1950407456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94XEdTBHW5dERpH5uSYots1Md5GKoeZT8P4l+IqfU4qYu3Ltjh87Jiyk71gcUXJogUp9HTPqRhJVctJ/OUL5m9Kbw6GmGjnBnPOgIr9lp5GcamIMv3D6jClfM2tIzhTA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:42.335209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-04f7bae4-27c7-4088-af9b-781365c255a8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Getting quotas for project 42d3c0e8672c4488b8762c9e522d7245. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:42.348201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-04f7bae4-27c7-4088-af9b-781365c255a8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Getting quotas for user 0674cdb0faa64406a58794e68d5e94a3 and project 42d3c0e8672c4488b8762c9e522d7245. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:42.396950 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04f7bae4-27c7-4088-af9b-781365c255a8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.102420 Oct 18 16:30:42.399001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3043/6059] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:30:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:42.513511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:42.524536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:42.537149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.541961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.542925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.543916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.557841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.558650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.616191 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f3f6f93-222d-4762-8c58-d5d87ac5c092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108140 Oct 18 16:30:42.617739 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3017/6060] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:42 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:43.285328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:43.286503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:43.297709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.298941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.300800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.303371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.304009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.306829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.593364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:43.602092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:43.603561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:43.604728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-897e9541-ef1e-4af1-bd83-b8080813320a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1334 microversion: 2.54 time: 0.323664 Oct 18 16:30:43.607413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3044/6061] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:43 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1334 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:43.634660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:43.636898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:43.650634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.651135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.651581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.652302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.652767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.653237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.768764 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9cc96d1-b823-49f7-b0c0-e3f02d5012a6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138675 Oct 18 16:30:43.773373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3018/6062] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:43 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:44.637762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:44.638403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:44.660536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.675747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.679253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.684905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.690806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.692523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.785844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:44.788632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:44.817851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.818592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.819363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.820936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.822429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.828736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.921302 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3779bfc-8cc1-4184-bc04-e3db8761ec38 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132129 Oct 18 16:30:44.922598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3019/6063] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:44 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:45.801619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:45.816186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:45.817692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:45.831844 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ec6a1813-5a34-4b1d-865b-43ea08216306 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1334 microversion: 2.54 time: 1.199168 Oct 18 16:30:45.838240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3045/6064] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:44 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1334 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:45.941688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:45.943864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:45.973438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.974338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.974982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:45.977607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.981927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.982613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:46.063033 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5d38e550-c47e-4c22-a883-9a6030f97507 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131800 Oct 18 16:30:46.066765 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3020/6065] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:45 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:46.870780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:46.871421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:46.888461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:46.889898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:46.894308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:46.897099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:46.904068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:46.914585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:46.915468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:46.916101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.080095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:47.084079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:47.133053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.135882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.136360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.142796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.153734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.154718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.231001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:47.260081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:47.261757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:47.267905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-681c5ac5-af4e-447f-ad82-9ade59bad37d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1355 microversion: 2.54 time: 0.396627 Oct 18 16:30:47.270456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3046/6066] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:46 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1355 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:47.303608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-004aeedd-3757-4148-87df-363afb4c2a68 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Action: 'create', calling method: .version_select at 0x7f5fd6522550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1294423722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcrrhzTWfKHaE+sDsCmlCEExjOTkdDHHLkD7n+SjhiaRbvLdcF7TaJ5kQYZHF9Hpf/ZYxlds4I9GzbLsJ2Pgll4KH+b5VL45PCVv8K/I/jAlyVAkRD47KUWuT8ufw4ctA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:47.322727 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0aaf318c-327c-4020-98d0-a2e1552de590 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247766 Oct 18 16:30:47.331296 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3021/6067] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:47 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:47.372148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-004aeedd-3757-4148-87df-363afb4c2a68 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Getting quotas for project 7f29daf24c5246769f01a77605400704. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:47.388459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-004aeedd-3757-4148-87df-363afb4c2a68 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Getting quotas for user 542988ec50ec4409b03d1620b5d9d23f and project 7f29daf24c5246769f01a77605400704. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:47.505615 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-004aeedd-3757-4148-87df-363afb4c2a68 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.205891 Oct 18 16:30:47.509354 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3047/6068] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:30:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:30:47.523105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1294423722", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:47.542070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:47.574828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.575640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.585990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.591510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.592777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.594718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.336771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:48.339005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:48.345139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:48.345684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:48.349936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:48.350506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:48.352165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:48.369037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.369559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.370012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.370739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.371200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.371632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.550238 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2161aba-7a51-459d-acd4-0e66deb06a66 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213921 Oct 18 16:30:48.550907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3048/6069] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:48 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:48.587731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-196673909", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66b66383-f8b5-4d5a-b69c-770914536fa6", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1950407456", "security_groups": [{"name": "tempest-secgroup-smoke-765601439"}], "networks": [{"uuid": "19acb0f3-8d9d-4cb7-89a1-6ed39c57cba2"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:48.692911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:48.723967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.725916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.727642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.730201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.732293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.736895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.870604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acb3b1d9-569b-42a2-9f4a-f43036b339db tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "POST /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac/action" status: 202 len: 1138 microversion: 2.54 time: 1.356139 Oct 18 16:30:48.885817 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3022/6070] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Oct 18 16:30:47 2022] POST /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac/action => generated 1138 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 16:30:48.915659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:48.922267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:48.975839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.979981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.984697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.988915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.991035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.994797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:49.142546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:49.174286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] validate_networks() for [('19acb0f3-8d9d-4cb7-89a1-6ed39c57cba2', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:30:49.421482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:49.455832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:49.465621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:49.467487 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23afc83c-410f-4173-8e50-75ffd8ef63fb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.570187 Oct 18 16:30:49.468348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3023/6071] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:48 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:49.489046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-940757265", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "3a1af4be-1921-4d6f-9abe-11bafa4aa8ed"}, {"uuid": "ead56470-d900-479e-b3f6-6d9c03c54026"}, {"uuid": "3a1af4be-1921-4d6f-9abe-11bafa4aa8ed"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:49.775831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] validate_networks() for [('3a1af4be-1921-4d6f-9abe-11bafa4aa8ed', None, None, None, None, None), ('ead56470-d900-479e-b3f6-6d9c03c54026', None, None, None, None, None), ('3a1af4be-1921-4d6f-9abe-11bafa4aa8ed', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:30:50.730634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:50.731269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:50.737125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:50.737561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:50.737988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:50.777693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:50.778119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:50.785344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:50.786829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:50.787771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:50.788452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:50.878594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Getting quotas for project 42d3c0e8672c4488b8762c9e522d7245. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:50.900393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Getting quotas for user 0674cdb0faa64406a58794e68d5e94a3 and project 42d3c0e8672c4488b8762c9e522d7245. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:51.102799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:30:51.108128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66b66383-f8b5-4d5a-b69c-770914536fa6',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:30:51.542045 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fbd6772-a64a-4884-9357-0f24e5194eb9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.959568 Oct 18 16:30:51.572690 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3049/6072] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:30:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:30:51.593235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:51.602942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:51.619475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.625254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.627048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:51.628072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.628975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.629768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:51.724375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa2b77b5-b16e-423c-96b6-615e6a14192b tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149591 Oct 18 16:30:51.726363 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3050/6073] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:51 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:51.755462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:51.756883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:51.808573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.810459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.813076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:51.817962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.821483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.823795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.197326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:52.230256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:52.232014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:52.244832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-74b5c3ba-d3fd-4d45-b00c-1d115b490a47 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.509666 Oct 18 16:30:52.253778 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3051/6074] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:51 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:52.277133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:52.280620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:52.328460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.333973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.334537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.340395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.343674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.348710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.441635 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea HTTP/1.1 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e268bc7b-0f4b-4eba-b006-0eb28c380aea'} Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:52.445706 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.452542 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.457953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:52.462098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5376f74a-447f-4fc4-ba11-84b5ec513907 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 404 len: 111 microversion: 2.20 time: 0.204699 Oct 18 16:30:52.463983 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3052/6075] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:30:52 2022] DELETE /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:30:52.473412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f35fcf74-f675-42c8-ae2e-d012cb18b1bb tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:52.474313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f35fcf74-f675-42c8-ae2e-d012cb18b1bb tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:52.602569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f35fcf74-f675-42c8-ae2e-d012cb18b1bb tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:52.624228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f35fcf74-f675-42c8-ae2e-d012cb18b1bb tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1098 microversion: 2.1 time: 0.155897 Oct 18 16:30:52.629435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3053/6076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:52 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1098 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:52.638752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:52.653844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] [instance: e268bc7b-0f4b-4eba-b006-0eb28c380aea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:52.687838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.688478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.696938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.698085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.701023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.703242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.754295 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] HTTP exception thrown: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Request method failure captured: Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea HTTP/1.1 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtIvGiCtwmJh4NwE8atI5bPLD1l0I-IW7qhGKeQtlvmTuqBy_AZfKI8zTCtPI-sTuHb9zQ09NydNFeWW02k-6bZKJewnCQS5i2GfG8uNzibltK5PaQzAMJxI9W8SBEkDzVz7AEN-Cmup6PbnfHGHWdannCW7-mNT_Ho_BS3R9XIkFE4 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31333817b5a74a6c9bb6cfcfb4ec940a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31333817b5a74a6c9bb6cfcfb4ec940a"}]}] Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 31333817b5a74a6c9bb6cfcfb4ec940a Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136495738 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 9d2663d26c42412c8acb3ded09320213 Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136495738-project Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e268bc7b-0f4b-4eba-b006-0eb28c380aea'} Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.757619 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. Oct 18 16:30:52.763719 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:30:52.766073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] Returning 404 to user: Instance e268bc7b-0f4b-4eba-b006-0eb28c380aea could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:52.767567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55ebe40f-635c-4675-af5a-aa684827d4e7 tempest-AttachVolumeShelveTestJSON-1136495738 tempest-AttachVolumeShelveTestJSON-1136495738-project] 10.222.0.78 "GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea" status: 404 len: 111 microversion: 2.20 time: 0.136430 Oct 18 16:30:52.768884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3054/6077] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:52 2022] GET /compute/v2.1/servers/e268bc7b-0f4b-4eba-b006-0eb28c380aea => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:30:52.778342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:52.790866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:52.810597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.812520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.815399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.816863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.819131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.821918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.909669 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ce717130-4b9c-468a-aabd-eeb9ab3fb102 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134901 Oct 18 16:30:52.911910 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3055/6078] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:52 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:53.286252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:53.286976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:53.314387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.314558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.316629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.317478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.317920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.318925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.510820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:53.521650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:53.531184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:53.547535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:53.558748 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fbff7115-0084-4d68-b937-c5c8eb0afa39 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.272574 Oct 18 16:30:53.574455 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3056/6079] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:53 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:53.670366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:53.671397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:53.696305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.698501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.701806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.702873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.704842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.708121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.826903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:53.845111 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbef8282-96e8-4a05-add7-ee0112756421 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1196 microversion: 2.1 time: 0.187161 Oct 18 16:30:53.862341 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3057/6080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:53 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1196 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:30:53.930491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:53.933422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:53.951631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.952437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.955057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.956442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.958331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.958964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.053879 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0576d780-7892-464e-9886-41694a3447d6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128350 Oct 18 16:30:54.076562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3058/6081] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:53 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:54.178132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:54.178973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:54.180327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:54.182740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:54.183846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:54.230275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.233477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.235438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.237922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.241478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.243221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.341757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Getting quotas for project 4329dc19129c4c4783c5934ff48b045a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:54.370218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Getting quotas for user ed5f927857d54bba9371256669c262f1 and project 4329dc19129c4c4783c5934ff48b045a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:54.426379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:30:54.430966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:30:54.531040 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-53ad842a-cc95-4aba-9e45-80e171f73cc0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.058554 Oct 18 16:30:54.535653 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3024/6082] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:30:54.555750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6307c94e-23a9-430a-8c93-e71412e63839 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:54.560006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6307c94e-23a9-430a-8c93-e71412e63839 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:54.597564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:54.598403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:54.612277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.613919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.617494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.621264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.621951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.622584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.843960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6307c94e-23a9-430a-8c93-e71412e63839 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:54.852889 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6307c94e-23a9-430a-8c93-e71412e63839 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1212 microversion: 2.1 time: 0.301232 Oct 18 16:30:54.874171 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3059/6083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:54 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1212 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:54.889847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:54.891412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:54.903040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.906971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.907689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.909866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.910688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.914053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:55.104176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:55.134017 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-298241e9-897e-4d2f-986d-a56d3feb4ce4 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1214 microversion: 2.1 time: 0.258017 Oct 18 16:30:55.148395 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3060/6084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:54 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:55.158590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:55.167671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:55.203083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:55.208421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:55.210834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:55.211852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:55.213621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:55.216734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:55.341254 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81045c21-e142-4be4-af59-ac4db3c062f6 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191408 Oct 18 16:30:55.342138 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3061/6085] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:55 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:55.632887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:55.649633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:55.658318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:55.669945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf9cf16c-f75a-4790-85d1-aec21649fecb tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 1.076136 Oct 18 16:30:55.675105 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3025/6086] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:54 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:30:55.923027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:55.924357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:55.945111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:55.949921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:55.954723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:55.957592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:55.961460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:55.962268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.154699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:56.171537 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8258a3b7-7452-40d5-ac0a-3b2a06a9c88f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1208 microversion: 2.1 time: 0.254755 Oct 18 16:30:56.173126 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3062/6087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:55 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1208 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:56.192065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:56.193164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:56.217829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.222668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.225464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.231639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.237749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.238692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.358185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:56.368561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:56.392650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.400494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.401450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.403001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.404762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.408909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.496021 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f15ab9e-f1d2-4b13-9b61-603fe593fe28 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144431 Oct 18 16:30:56.525160 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3063/6088] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:56 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:56.706952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:56.707814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:56.718519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.732397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.736135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.738264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.744364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.747216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.856413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:56.878175 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-676c5b15-dc98-4235-be49-3bb081669b6c tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1214 microversion: 2.1 time: 0.691569 Oct 18 16:30:56.903826 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3026/6089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:56 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1214 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:56.990035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:57.020762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:57.026652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:57.028244 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eda676b2-3ab4-4000-902d-1dfd50d1992e tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.326393 Oct 18 16:30:57.034019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3064/6090] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:56 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:30:57.208266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:57.209323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:57.249154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.250010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.250769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.256973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.265714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.266462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.528855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:57.532339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:57.553182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.556108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.556858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.558192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.558955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.559672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.589195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:57.600172 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f172469-8230-4e04-b03d-ea0ab6a8e171 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1282 microversion: 2.1 time: 0.395848 Oct 18 16:30:57.609539 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3027/6091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:57 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1282 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:57.641912 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b46025de-22b4-4aa3-b389-2f6a233f8c88 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117852 Oct 18 16:30:57.644454 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3065/6092] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:30:57 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:30:57.794820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:57.795621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:57.811107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.811613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.812002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.812740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:57.820610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:57.821134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:57.884965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:30:57.964612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4b83615-2a68-4090-a082-1d8453828375 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Action: 'create', calling method: .version_select at 0x7f5fd64998b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-689368010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaFg3juCWqlidAUFsM1RwMbT64Xv0IXP1lw+J0NrYTB4xeT8wVY68D49cc4Rav6OvU3im0uP2V3y0bAK7AKSlfOKLA6eveDkpVZdUbD+fXliJvpdVoOwhBcYYT61fo64g=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:58.024093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f4b83615-2a68-4090-a082-1d8453828375 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for project 9d36e2aefcbe4a37a390a41917a828d4. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:58.057666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f4b83615-2a68-4090-a082-1d8453828375 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for user 85ef590207844cc5b5ecb86cc00fc862 and project 9d36e2aefcbe4a37a390a41917a828d4. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:58.069427 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a51aed54-a026-433a-ad6b-62dae40dfa5d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 204 len: 0 microversion: 2.1 time: 0.281858 Oct 18 16:30:58.074313 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3066/6093] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:30:57 2022] DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:30:58.087368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:58.089489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:58.107455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.108062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.108571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.109363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.110080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.110511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.164709 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f4b83615-2a68-4090-a082-1d8453828375 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.486479 Oct 18 16:30:58.167174 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3028/6094] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:30:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:58.193696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:58.196346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:58.233664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.239858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.248379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.258166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.264513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.264982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.735160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:58.749438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:58.754461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:58.757957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-89a8e6be-89ea-4283-9436-bcca7f86d3be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.587645 Oct 18 16:30:58.760003 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3029/6095] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:58 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:30:58.777094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:58.778162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:58.791048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.804701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.805821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.806937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:58.808514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:58.809268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:58.864542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:58.981507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:58.992375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75230ff4-7dc7-4c2b-9937-a6e8dfb97ce5 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1214 microversion: 2.1 time: 0.913783 Oct 18 16:30:59.005895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3067/6096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:58 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1214 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:59.019071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:59.019669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:59.029628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:59.030426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:59.031027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:59.032004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:59.032614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:59.033250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:59.323692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:59.346161 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fac6a4b-8d1f-4696-b943-894793a0f177 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1682 microversion: 2.1 time: 0.577566 Oct 18 16:30:59.366701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3030/6097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:58 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1682 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:59.810976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:59.811735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:59.820982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:59.825507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:59.826172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:59.827100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:59.832400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:59.834457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:59.988162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:59.999186 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1148fe32-a664-40a0-a62d-97d7fd2f7fdb tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1312 microversion: 2.1 time: 0.991931 Oct 18 16:31:00.000140 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3068/6098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:59 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1312 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:00.032158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:00.033255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:00.042087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:00.043219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:00.044158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:00.045177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:00.050079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:00.050870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:00.164150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:00.174830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:00.185437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:00.190404 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f5e3f79-e08d-422b-b157-4bbfd96acbfa tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.382705 Oct 18 16:31:00.192183 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3031/6099] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:30:59 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:00.372838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:00.373921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:00.390337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:00.390854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:00.394032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:00.396255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:00.396255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:00.396697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:00.853745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:00.965352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:00.982746 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63ffa073-5345-455e-ac3e-9e76fc04fc1b tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1281 microversion: 2.1 time: 0.960515 Oct 18 16:31:00.989678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3069/6100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:00 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1281 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:01.028066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:01.028944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:01.056824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:01.057498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:01.058063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:01.058918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:01.059696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:01.060245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:02.045534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:02.059913 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f7921f4-5517-4940-b1c9-315385fb4f6d tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1682 microversion: 2.1 time: 1.691827 Oct 18 16:31:02.060429 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3032/6101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:00 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1682 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:02.075280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:02.075926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:02.100148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:02.102214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:02.103612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:02.104587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:02.105251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:02.106179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:02.267429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:02.284276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b76b5d7f-838d-4fdd-bb10-1049750d1488 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1312 microversion: 2.1 time: 1.256921 Oct 18 16:31:02.298860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3070/6102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:01 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1312 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:02.322207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:02.324770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:02.344440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:02.346901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:02.353505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:02.367599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:02.368759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:02.369286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:02.372150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:02.380175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:02.382930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:02.384127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b9b0f61-f140-4cad-b68b-e3476b940cd0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.322746 Oct 18 16:31:02.394487 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3033/6103] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:02 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:03.089566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:03.090926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:03.105857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.129766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.136132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:03.137868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.139777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.140237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:03.358316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:03.369404 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-568cfda8-94b8-4258-8584-ea51888d3a31 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1281 microversion: 2.1 time: 1.069277 Oct 18 16:31:03.374415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3071/6104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:02 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1281 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:03.388985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:03.389909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:03.403218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.405439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.406859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:03.413056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.414354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.415371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:03.857929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:03.867322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:03.874668 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8f0e225-2a06-44c5-8f4c-3ad4a0f7db87 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1333 microversion: 2.1 time: 0.498258 Oct 18 16:31:03.875278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3072/6105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:03 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1333 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:03.904292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:03.904906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:03.931744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.932220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.933079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:03.933987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:03.934612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:03.935210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.100399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51c470236904eb0a85bfee1703d3c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:04.106402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:04.115102 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb01a662-da19-4935-a7e0-6435001df90a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 200 len: 1682 microversion: 2.1 time: 1.031005 Oct 18 16:31:04.118387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:04.118971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3034/6106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:03 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 1682 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:04.135108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:04.136777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c181779b-67af-4ff9-95b0-93e8bd4a5155 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.236502 Oct 18 16:31:04.137702 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3073/6107] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:03 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:04.297463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:04.298290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:04.300353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:04.317289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.321102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.321721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.324712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.327685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.328285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.355909 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 HTTP/1.1 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a544916e-da85-4e7b-9c3a-69c6e9ddb106'} Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:04.358095 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.362172 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.366879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:04.368356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46991293-2fb5-4346-b731-45cafe8ad3c9 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 404 len: 111 microversion: 2.1 time: 0.074947 Oct 18 16:31:04.369582 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3035/6108] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:04 2022] DELETE /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:04.377968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:04.379345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: a544916e-da85-4e7b-9c3a-69c6e9ddb106] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:04.391185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.394088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.394816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.403630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:04.404849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:04.405576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.413615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.414873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.436682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.440402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.442478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.447501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.451018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.460396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.486090 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 HTTP/1.1 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a544916e-da85-4e7b-9c3a-69c6e9ddb106'} Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:04.489881 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance a544916e-da85-4e7b-9c3a-69c6e9ddb106 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81f0dbec-0375-4a5f-877b-ca5271ceb14a tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106" status: 404 len: 111 microversion: 2.1 time: 0.118912 Oct 18 16:31:04.494865 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3074/6109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:04 2022] GET /compute/v2.1/servers/a544916e-da85-4e7b-9c3a-69c6e9ddb106 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:04.906940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:04.907489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:04.917410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=24 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:04.922387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.922893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.924838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:04.926135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:04.927620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:04.951845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:05.493469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:05.511921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df6d56f5-8148-4caa-a6e1-50364d75e9d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1333 microversion: 2.1 time: 0.609272 Oct 18 16:31:05.515278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3075/6110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:04 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1333 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:05.532345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68fde45-4b28-42e5-a0cc-1ab3dd27d429", "name": "network-vif-deleted", "tag": "8afbb950-63a8-490c-ad79-ab53f216f869"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:05.587013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:05.588176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:05.589616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:05.623727 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] Creating event network-vif-deleted:8afbb950-63a8-490c-ad79-ab53f216f869 for instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 on n-h1-858383-14 Oct 18 16:31:05.635504 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-24378b31-f7cc-42b7-bbb9-61e8dbcd833b req-9b24a256-e847-4088-8760-31b23f22a870 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117965 Oct 18 16:31:05.639316 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3076/6111] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:05.653478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:05.655726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:05.673669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:05.674279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:05.674722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:05.675448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:05.675903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:05.676333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:05.755835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 HTTP/1.1 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b68fde45-4b28-42e5-a0cc-1ab3dd27d429'} Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:05.764391 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:05.768870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:05.771687 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2df5a07-78db-4f03-bbf3-261c4a164222 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 404 len: 111 microversion: 2.1 time: 0.129912 Oct 18 16:31:05.782046 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3077/6112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:05 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:05.796421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:05.806299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:05.811751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:05.827375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:05.828149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:05.828597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:05.829410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:05.829873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:05.832689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:06.136844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:06.153960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:06.164033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:06.168320 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-982711fa-67d4-48ea-817f-36b343579728 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.382980 Oct 18 16:31:06.182313 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3078/6113] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:05 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:06.200548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa3040a4-35ae-4e51-83c2-def6459dca50 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '.version_select at 0x7f5fd215daf0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:06.257334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa3040a4-35ae-4e51-83c2-def6459dca50 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-493069750" status: 202 len: 0 microversion: 2.1 time: 0.071252 Oct 18 16:31:06.263915 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3079/6114] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-493069750 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:31:06.543757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:06.544363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:06.565707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:06.566206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:06.566728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:06.567442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:06.569559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:06.577234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:06.983228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:07.004110 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-862c4c2f-c272-460e-9f12-8d6d17b879bd tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1281 microversion: 2.1 time: 2.606805 Oct 18 16:31:07.008567 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3036/6115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:04 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1281 bytes in 2612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:07.201702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:07.203682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:07.227174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:07.227951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:07.229866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:07.232072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:07.233205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:07.236169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:07.274494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:07.290278 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-513d9026-78a4-41cc-ab73-35ea823e73a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.751597 Oct 18 16:31:07.311619 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3080/6116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:06 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:07.621888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:07.653829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:07.658063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:07.668888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3337a7fd-e3ec-45a3-b7f1-f6273bbd92f2 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.471592 Oct 18 16:31:07.670967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3037/6117] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:07 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:31:07.703086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:07.719738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:07.720213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:07.720649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:07.755287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] Creating event network-changed:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:31:07.770909 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b4eafe4e-5481-42a6-92de-50d5fc9c5cfd req-01585261-65c6-4fb0-bf44-4506bfd5a6eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074309 Oct 18 16:31:07.771825 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3081/6118] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:08.040161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:08.042262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:08.044447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:08.063115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:08.064303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:08.065786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:08.070042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:08.071988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:08.072730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:08.134890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:08.321484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:08.322374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:08.336184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:08.336728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:08.343728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:08.344619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:08.345133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:08.345578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:09.354763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:09.364433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11a3bac5-7d13-41b0-a7ca-e924da751e52 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 1.048628 Oct 18 16:31:09.370099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3082/6119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:08 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:09.398443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:09.399174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:09.420889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:09.421577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:09.422044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:09.426958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:09.427739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:09.433367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:09.531661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:09.542265 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-89b1d00e-6851-40f3-85ea-3387e1134f8a tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1281 microversion: 2.1 time: 1.507305 Oct 18 16:31:09.548936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3038/6120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:08 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1281 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:09.781462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:09.797325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:09.799390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:09.802888 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa2bab40-1824-492e-8ad0-d6607c5753c9 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.429930 Oct 18 16:31:09.818682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3083/6121] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:09 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:10.233404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1403995096", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-689368010", "security_groups": [{"name": "tempest-secgroup-smoke-2122988616"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "6cce995e-429b-4fe4-8017-5b5cfcd0970d"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:10.398917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:10.406682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:10.430123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:10.432756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:10.433405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:10.434294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:10.435948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:10.438784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:10.833545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] validate_networks() for [('6cce995e-429b-4fe4-8017-5b5cfcd0970d', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:31:10.938263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:10.953612 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d58c12c-1aab-425f-bddf-b6b18b51febd tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.560595 Oct 18 16:31:10.969230 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3084/6122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:10 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:10.969230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:10.969230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:10.988647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:10.989205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:10.989690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:10.990380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:10.991153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:10.991761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:11.264141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:11.281130 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f3abcf6-7e1f-4d20-b320-e32c09588caa tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1281 microversion: 2.1 time: 0.318734 Oct 18 16:31:11.286736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3085/6123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:10 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:11.305128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:11.306537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:11.330369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:11.331229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:11.333443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:11.337064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:11.337919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:11.343102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:11.492699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:11.518209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:11.528600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:11.533538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ae46155-5a28-452b-8340-69c7f1ef522b tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.244527 Oct 18 16:31:11.535613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3086/6124] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:11 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:11.549698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "tag": "6f9f9ac2-7249-4861-b653-1604be73770a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:11.581813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:11.582320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:11.585109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:11.608128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] Creating event network-changed:6f9f9ac2-7249-4861-b653-1604be73770a for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:11.615075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-40f4ed32-6219-4532-8440-16b54d6c923e req-48b163a7-1922-48d3-a075-0e332bf62633 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077858 Oct 18 16:31:11.615769 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3087/6125] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:11.982062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:11.982780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:11.995702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:11.996207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:11.996651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:11.997618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:11.998239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:11.998829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.277560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:12.289379 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d0751a8-a6a2-4128-885b-6fe383cffcc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.309667 Oct 18 16:31:12.290974 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3088/6126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:11 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:12.310639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:12.311965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:12.325447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.327608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.328361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.329936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.332216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.333906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.582139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:12.599331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e37260b2-d55d-44a2-9892-45b5982e1a3f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 0.293094 Oct 18 16:31:12.610034 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3089/6127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:12 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:12.622580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:12.623202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:12.630111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.630899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.631713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.632313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.632869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.633446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.725224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:12.737965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:12.739625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:12.741724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee721d3a-815b-457a-b26b-8010c7e66758 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.130379 Oct 18 16:31:12.742650 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3090/6128] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:12 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:12.747349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:12.747843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:12.754684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.755164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.755590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.756291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.756777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.757298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.773768 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 HTTP/1.1 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '69e5c2d1-8e68-4a2a-9937-274a2ba7db84'} Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:12.775938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.779477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.781840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:12.783147 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33136b6b-a5c1-4374-8c21-68796f27cec6 tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 404 len: 111 microversion: 2.1 time: 0.039472 Oct 18 16:31:12.784445 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3091/6129] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:12 2022] DELETE /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:12.793656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:12.794579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] [instance: 69e5c2d1-8e68-4a2a-9937-274a2ba7db84] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:12.802890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.804085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.804845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.805775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:12.807236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:12.808325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:12.845918 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] HTTP exception thrown: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Request method failure captured: Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 HTTP/1.1 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtKiPWaHm2L2nknPWMmE5b1RJXb_br8f8zgApzQQLUGAweEkQtr73TEsN8xi6ancDkThV6v4yd9RJ1IRjQKfQSFR8tk6lpgrlfmkcRJxSJxVZvelYZBZg3Dv-L-EhUySALU2QcOAYflWA9UR5nUyfB2GDbS3jh34TwJg2JigfeSoIco Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_238c6a4d6aa046c6becaba98873f63fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/238c6a4d6aa046c6becaba98873f63fc"}]}] Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 238c6a4d6aa046c6becaba98873f63fc Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813096367 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 08b0514cd6004596969d5d5caf689179 Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeTestJSON-1813096367-project Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '69e5c2d1-8e68-4a2a-9937-274a2ba7db84'} Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:12.847909 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. Oct 18 16:31:12.852346 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:12.855363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] Returning 404 to user: Instance 69e5c2d1-8e68-4a2a-9937-274a2ba7db84 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:12.856473 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d378255-b7af-4f30-8e91-445d8b8f145b tempest-AttachVolumeTestJSON-1813096367 tempest-AttachVolumeTestJSON-1813096367-project] 10.222.0.78 "GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84" status: 404 len: 111 microversion: 2.1 time: 0.067432 Oct 18 16:31:12.857598 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3092/6130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:12 2022] GET /compute/v2.1/servers/69e5c2d1-8e68-4a2a-9937-274a2ba7db84 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:31:12.886067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for project 9d36e2aefcbe4a37a390a41917a828d4. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:31:12.901600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for user 85ef590207844cc5b5ecb86cc00fc862 and project 9d36e2aefcbe4a37a390a41917a828d4. Resources: dict_keys(['metadata_items']) {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:31:12.972490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:31:12.972914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:31:12.973426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:31:12.973843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:31:12.974272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:31:13.017442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.018019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.018571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.019311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.019775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.020203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.069978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for project 9d36e2aefcbe4a37a390a41917a828d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:31:13.083644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Getting quotas for user 85ef590207844cc5b5ecb86cc00fc862 and project 9d36e2aefcbe4a37a390a41917a828d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:31:13.122847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:31:13.127467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:31:13.229527 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6f9e5cc-38a3-40b2-98c6-65df1232b69a tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.000161 Oct 18 16:31:13.236371 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3039/6131] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:31:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 3008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:31:13.247113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c75d372-84e3-4f0b-b263-d2a486b7d209 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:13.247855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c75d372-84e3-4f0b-b263-d2a486b7d209 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:13.319989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:13.320944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:13.372267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.372857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.373719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.375008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.388621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.390854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.706892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c75d372-84e3-4f0b-b263-d2a486b7d209 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:13.725481 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c75d372-84e3-4f0b-b263-d2a486b7d209 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1302 microversion: 2.1 time: 0.482175 Oct 18 16:31:13.726856 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3093/6132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:13 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1302 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:13.751018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:13.752260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:13.788572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.789220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.789934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.791094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.791590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.792010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.887100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:13.902194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fcbfa969-f7f3-4a11-9925-7108e1d35e12 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.588565 Oct 18 16:31:13.950760 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3040/6133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:13 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:13.966589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:13.968150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:13.986103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.986971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.989328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:13.994027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:13.994700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:13.995320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:14.267176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:14.289846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:14.295753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:14.305275 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f5a4b3fe-ad5f-4452-b485-bca382fcc07a tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.351787 Oct 18 16:31:14.307848 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3041/6134] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:13 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:14.368968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:14.401439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2bd1bfe0-3534-4ce9-9a21-e0b2feb21356 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 0.673261 Oct 18 16:31:14.406467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3094/6135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:13 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:14.627828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "tag": "2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:14.687977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:14.688467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:14.691305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:14.715044 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] Creating event network-changed:2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:14.738844 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d9b1a990-345a-4dac-9e3b-faa8d3ae2100 req-fbd84861-d8ec-49b9-8dca-0ab1dba27dd4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127863 Oct 18 16:31:14.740094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3042/6136] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:14.753955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:14.754944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:14.768292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:14.769480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:14.771284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:14.772495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:14.785922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:14.786675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:14.870474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7fb602f7-fcbb-4b6a-8812-2e9654c85f7c tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Action: 'create', calling method: .version_select at 0x7f5fd1855af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1035076221", "metadata": {"Type": "work"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:14.978555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:15.009634 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00390bda-81f4-4559-94e3-a2085220d594 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1354 microversion: 2.1 time: 0.256939 Oct 18 16:31:15.029032 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3043/6137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:14 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:15.040393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:15.041224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:15.054175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.054737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.055706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.058497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.060307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.061899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.489905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7fb602f7-fcbb-4b6a-8812-2e9654c85f7c tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.872976 Oct 18 16:31:15.500749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3095/6138] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 885 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 16:31:15.507385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:15.508068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:15.518088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.518582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.519088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.520524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.521288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.521727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.677341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:15.682344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:15.697738 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0c6a42b-cb5b-414e-b1a7-db8802d0da98 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.663891 Oct 18 16:31:15.706802 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3044/6139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:15 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:15.708767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:15.718448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:15.722959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:15.724393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1eb97c3f-dfe9-459a-809e-7cf5988f03a0 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1407 microversion: 2.54 time: 0.222215 Oct 18 16:31:15.727183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:15.749023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3096/6140] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:15 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:15.749239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.749239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.749239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.749522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0012654e-5e41-4b46-85b5-1cf908892850 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd1799dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:15.749611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:15.749611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:15.749611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:15.854461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0012654e-5e41-4b46-85b5-1cf908892850 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 353 microversion: 2.1 time: 0.118225 Oct 18 16:31:15.867743 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3097/6141] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:15 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:16.041988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:16.042595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:16.055526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.056376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.056971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:16.057861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.058448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.059007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:16.066220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:16.239033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:16.251619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:16.260281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5abb89a0-613c-40e4-99c7-3f077d0458b3 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1360 microversion: 2.1 time: 0.222748 Oct 18 16:31:16.260867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3098/6142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:16 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:16.285985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4092b546-8e88-4ab4-add4-94486f5c7ade tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 0.577768 Oct 18 16:31:16.294229 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3045/6143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:15 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:16.724164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:16.724788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:16.743049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.743657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.746032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:16.747422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.751579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.753344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:16.768419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:16.769179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:16.793575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.797257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.800541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:16.818364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:16.820493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:16.822142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.110105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:17.128559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:17.136506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:17.138138 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff5d21f9-acfb-4cb4-ac99-52b9bb521fd4 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1413 microversion: 2.54 time: 0.375228 Oct 18 16:31:17.139206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3046/6144] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:16 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1413 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:17.151871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "tag": "ceb85b8c-89bb-4eff-aefb-c11c7197e2ca"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:17.191898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.192373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.198735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.218957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] Creating event network-changed:ceb85b8c-89bb-4eff-aefb-c11c7197e2ca for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:17.224592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-827f1d04-6025-40d1-829c-0c3401678be2 req-6be7d808-e47b-4ea0-8211-fd4fbe9fc616 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083992 Oct 18 16:31:17.225590 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3047/6145] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:17.234502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99b9bf7d-d111-49d7-bd6b-1ab391ad2b98 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd64f8040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:17.351244 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99b9bf7d-d111-49d7-bd6b-1ab391ad2b98 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 354 microversion: 2.1 time: 0.124133 Oct 18 16:31:17.351821 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3048/6146] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:17 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:17.365840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:17.366643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:17.392371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.393281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.393974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.394965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.395680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.396281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.413318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 HTTP/1.1 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b68fde45-4b28-42e5-a0cc-1ab3dd27d429'} Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:17.415191 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:17.419350 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:17.420964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:17.422251 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdd384d3-995c-46d0-b6ad-90781f252273 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 404 len: 111 microversion: 2.1 time: 0.060558 Oct 18 16:31:17.423225 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3049/6147] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:17 2022] DELETE /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:17.429960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:17.430990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:17.438027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.438801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.439418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.440370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.441179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.441802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.547684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:17.563042 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d04ee140-741d-43b3-b43d-5e80a33ebc10 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1360 microversion: 2.1 time: 0.136042 Oct 18 16:31:17.563982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3050/6148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:17 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:17.578411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:17.581616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:17.598362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.601130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.603621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.605932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:17.606593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:17.607428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:17.667381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:18.021174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.032331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d789f827-9801-4f4a-8fa5-5661eab947c3 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 1.313518 Oct 18 16:31:18.033561 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3099/6149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:16 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:18.036922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.039488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c405127-9ec9-49fe-9343-aea296a96641 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd215db80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.052584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c566291-8afa-4e42-b71e-db0e98cc6b3e tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 0.487033 Oct 18 16:31:18.054524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3051/6150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:17 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:18.073361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.074759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: b68fde45-4b28-42e5-a0cc-1ab3dd27d429] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:18.092918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.093947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.094985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.096016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.096902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.097578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.121791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 HTTP/1.1 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b68fde45-4b28-42e5-a0cc-1ab3dd27d429'} Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:18.142082 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance b68fde45-4b28-42e5-a0cc-1ab3dd27d429 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:18.145932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7704f9e-19f2-498e-b1f0-b4123de30db3 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429" status: 404 len: 111 microversion: 2.1 time: 0.088274 Oct 18 16:31:18.150456 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3052/6151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:18 2022] GET /compute/v2.1/servers/b68fde45-4b28-42e5-a0cc-1ab3dd27d429 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:18.167155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.167678 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c405127-9ec9-49fe-9343-aea296a96641 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 354 microversion: 2.1 time: 0.132756 Oct 18 16:31:18.168252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3100/6152] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:18 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:18.178189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:18.184065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.185388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.187375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.190294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.191057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.194563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f852ef10-5975-47b0-a351-8f2a6af40edf tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd21119d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.195178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.354438 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f852ef10-5975-47b0-a351-8f2a6af40edf tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 202 len: 0 microversion: 2.1 time: 0.174110 Oct 18 16:31:18.355489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3101/6153] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:31:18 2022] DELETE /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:31:18.364607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b6b8343-53bd-412b-852f-294b50a6daed tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd223ac10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.507174 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b6b8343-53bd-412b-852f-294b50a6daed tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 353 microversion: 2.1 time: 0.145912 Oct 18 16:31:18.508630 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3102/6154] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:18 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:18.530108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.554907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.571597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.577857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e842ca3b-1329-4158-a3de-ae09fccb94b8 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1413 microversion: 2.54 time: 0.415918 Oct 18 16:31:18.597170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:18.598201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:18.607019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3053/6155] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:18 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1413 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:18.612022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.626698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.630807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.632354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:18.634554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:18.648551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:18.977965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:18.990433 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24b4a495-640d-4939-afc8-ef14e6e46796 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1360 microversion: 2.1 time: 0.397778 Oct 18 16:31:18.995345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3103/6156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:18 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1360 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:19.060833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:19.061492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:19.078137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:19.079831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:19.080310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:19.081598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "name": "network-vif-plugged", "status": "completed", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:19.084034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:19.084618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:19.087269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:19.099836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:19.101663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:19.105877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:19.139244 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] Creating event network-vif-plugged:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:31:19.163512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3d8994cc-a1ea-4f7c-8552-6fb3c6ebbb87 req-c8178294-41a7-4040-af19-be2e06098a49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087973 Oct 18 16:31:19.164686 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3104/6157] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:19.187349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:19.188616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:19.214248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:19.218404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:19.219151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:19.222492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:19.223657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:19.226699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:19.868157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:19.892052 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35194a16-c2b3-4967-adc6-9846396c168f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 0.724632 Oct 18 16:31:19.893321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3105/6158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:19 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:19.900481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99927c4f-8618-488f-ad0d-afb34bdb9645 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd6494ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:20.019522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99927c4f-8618-488f-ad0d-afb34bdb9645 tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 353 microversion: 2.1 time: 0.124134 Oct 18 16:31:20.020375 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3106/6159] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:19 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:20.029521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:20.032783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:20.043776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.053595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.054346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:20.055314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.055986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.056608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:20.242494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:20.262612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:20.264339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:20.265779 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c2d2a8c-f9d5-44b0-a2b6-1a8728507027 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1413 microversion: 2.54 time: 0.244048 Oct 18 16:31:20.266923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3107/6160] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:20 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1413 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:20.276183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:20.282715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:20.283729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:20.284616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e91302b7-fdd5-4a0e-99bd-2d6d1f798b71 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 1.227734 Oct 18 16:31:20.293358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.293658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3054/6161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:19 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:20.308778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.309493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:20.310273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.310760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.311199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:20.775852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:20.789084 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f8300df-1de4-4595-82cf-bfc69baf76c2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.517914 Oct 18 16:31:20.789798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3108/6162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:20 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:20.919241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:20.919859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:20.942576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.943022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.943469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:20.944739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:20.949958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:20.950463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:21.037086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e056363-bddd-4850-967b-b98d9e0d701e tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd6522ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:21.148623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e056363-bddd-4850-967b-b98d9e0d701e tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 200 len: 353 microversion: 2.1 time: 0.117112 Oct 18 16:31:21.149768 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3109/6163] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:21 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:21.295813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:21.296445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:21.311084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:21.311600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:21.312043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:21.318025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:21.320178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:21.322483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:21.533773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:21.547181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:21.549805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:21.551145 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f92976a-ee0d-424b-a1ba-1abc6e7531be tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1398 microversion: 2.54 time: 0.259297 Oct 18 16:31:21.568692 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3110/6164] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:21 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1398 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:31:21.582746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:21.590391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:21.611762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:21.613604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:21.614222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:21.615110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:21.617384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:21.620438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:21.910339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:21.926521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fb60903-5763-474f-b9ff-a9b1e91fea89 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1269 microversion: 2.1 time: 1.007233 Oct 18 16:31:21.927226 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3055/6165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:20 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1269 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:21.955916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd8db4-7bd1-40cf-85a8-1be980374788", "tag": "75e6c11a-3466-4a53-8a7b-fdc0235229d2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:21.986016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:21.987724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:21.988447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.019885 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] Creating event network-changed:75e6c11a-3466-4a53-8a7b-fdc0235229d2 for instance 24bd8db4-7bd1-40cf-85a8-1be980374788 on n-h1-858383-14 Oct 18 16:31:22.032781 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-584b5fff-246b-4495-8fc4-9ca311128fed req-c710a76d-c1d4-4820-b068-8c4eded74433 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097672 Oct 18 16:31:22.034492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3056/6166] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:22.049493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52445252-c99f-400c-944c-c1061b615ac5 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '.version_select at 0x7f5fd6380280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.092056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52445252-c99f-400c-944c-c1061b615ac5 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1294423722" status: 204 len: 0 microversion: 2.54 time: 0.050076 Oct 18 16:31:22.093619 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3057/6167] 10.222.0.78 () {60 vars in 1319 bytes} [Tue Oct 18 16:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1294423722 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:31:22.113508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.114818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:22.132081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.132987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.134528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.136162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.137421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.138436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.294271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:22.314601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-feef0705-5026-4783-ba51-d95b95fd2097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.738676 Oct 18 16:31:22.315511 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3111/6168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:21 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:22.325900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.329175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:22.341655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.342917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.344506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.347741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.348590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.349377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.398634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:31:22.553484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:22.567295 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b4a7da0-fe6b-4819-8ed1-3a8e9a72a6b2 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.472205 Oct 18 16:31:22.583306 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3058/6169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:22 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:22.595732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea0c2765-88cf-421e-b279-a1d6b4f0285f tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Calling method '.version_select at 0x7f5fd6384b80>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.634370 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65554e7d-ef44-45e4-ba5c-41d1fea9822d tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 204 len: 0 microversion: 2.54 time: 0.311094 Oct 18 16:31:22.637818 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3112/6170] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:31:22 2022] DELETE /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:31:22.676537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.679635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:22.693432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.694553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.695015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.695768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.696236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.696671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.715957 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ea0c2765-88cf-421e-b279-a1d6b4f0285f tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] HTTP exception thrown: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea0c2765-88cf-421e-b279-a1d6b4f0285f tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Request method failure captured: Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 HTTP/1.1 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtTSC0_U3NIqF28pTMbl8jAjZXexlvUbaubIJn4qrO-RBVPhFlD0tLxPCkTuaGkP7OJRJ3l0Zba-yo4oyKMkf7bVvYJ4QpMV0iwh0xA3zFoD8XtgUz1ChkF4uDRSpeKTzdewuJrNh8XWWwHuqEHnptOMG5GSISLVy2Zdg8scbrTNl88 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 3e44d05280ce4c5bb9c5d734fb2f4608 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesGetTestJSON-162715756 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3e44d05280ce4c5bb9c5d734fb2f4608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e44d05280ce4c5bb9c5d734fb2f4608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3e44d05280ce4c5bb9c5d734fb2f4608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e44d05280ce4c5bb9c5d734fb2f4608"}]}] Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesGetTestJSON-162715756 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 3e44d05280ce4c5bb9c5d734fb2f4608 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesGetTestJSON-162715756 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesGetTestJSON-162715756-project Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: fd456fe2229b49c081abdacf76249918 Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesGetTestJSON-162715756-project Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6e52b57e-bdc6-4463-bd49-3f279f3878b8'} Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. (HTTP 404) (Request-ID: req-10ac60fc-a1dd-489d-a2f5-8cbf3ba2ca99) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:31:22.718388 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. Oct 18 16:31:22.721955 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:22.726791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea0c2765-88cf-421e-b279-a1d6b4f0285f tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] Returning 404 to user: Volume 6e52b57e-bdc6-4463-bd49-3f279f3878b8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:22.727954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea0c2765-88cf-421e-b279-a1d6b4f0285f tempest-VolumesGetTestJSON-162715756 tempest-VolumesGetTestJSON-162715756-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8" status: 404 len: 109 microversion: 2.1 time: 0.143545 Oct 18 16:31:22.728743 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3059/6171] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:22 2022] GET /compute/v2.1/os-volumes/6e52b57e-bdc6-4463-bd49-3f279f3878b8 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:22.857067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:22.877726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:22.879664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:22.886723 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93ffc896-62e8-49fe-9275-d667f821b3dd tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1404 microversion: 2.54 time: 0.244175 Oct 18 16:31:22.888036 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3113/6172] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:22 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:22.952206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:22.953511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:22.969162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.969919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.970549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:22.971651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:22.973050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:22.985810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.055928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:23.104192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:23.342664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:23.343885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:23.353050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.356183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.356810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.362110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.362970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.363572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.649690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:23.667058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21116c21-861f-4fb1-99d1-9f9de4ba6977 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1458 microversion: 2.1 time: 0.715404 Oct 18 16:31:23.667907 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3060/6173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:22 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1458 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:23.706088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:23.706733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:23.720504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.721019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.724476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:23.728312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.730257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.730754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.731196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.866855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:23.876114 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-936b6d75-d868-4bac-b263-9c016c780ef0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.537411 Oct 18 16:31:23.897457 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3114/6174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:23 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:23.907724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:23.908361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:23.936020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.936020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.936342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:23.937061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:23.937690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:23.938321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:24.114548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:24.129789 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4710bfa-0ef4-4188-973e-b6a00ae02f55 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.439929 Oct 18 16:31:24.142377 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3061/6175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:23 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:24.154153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:24.155248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:24.163718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:24.164559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:24.165253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:24.166169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:24.166850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:24.167585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:24.261497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:24.296966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:24.302467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:24.305019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34f8bb64-7e22-49ee-832a-eaf7a32b4827 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1404 microversion: 2.54 time: 0.161192 Oct 18 16:31:24.309901 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3062/6176] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:24 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:24.408044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:24.419114 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-265ec096-8ce9-4506-9df7-bb993b2c7310 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1458 microversion: 2.1 time: 0.520410 Oct 18 16:31:24.419839 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3115/6177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:23 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1458 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:24.901750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:24.908521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:24.917534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:24.925330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:24.925887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:24.926719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:24.927429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:24.928631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.073400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.074160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.100379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.103923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.110099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.111319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.112203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.113777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.168332 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc HTTP/1.1 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'cdaf24c8-95cb-4100-af12-870c50388edc'} Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:25.174152 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.181144 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.185220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:25.190654 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eb474cd5-3395-44ad-ac00-791b03524e7a tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 404 len: 111 microversion: 2.1 time: 0.124340 Oct 18 16:31:25.191939 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3116/6178] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:25 2022] DELETE /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:25.193924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:25.202966 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b33b562b-749b-49c8-8104-65f0ecb1e27c tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.306289 Oct 18 16:31:25.203998 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3063/6179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:24 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:25.206217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.210536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.221164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.222140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.222484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.222833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.223556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: cdaf24c8-95cb-4100-af12-870c50388edc] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.223873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.224533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.225799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.239899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.240907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.241953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.242922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.243617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.244303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.262542 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc HTTP/1.1 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'cdaf24c8-95cb-4100-af12-870c50388edc'} Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.264363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. Oct 18 16:31:25.268556 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.270359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance cdaf24c8-95cb-4100-af12-870c50388edc could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:25.271380 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14aaaadc-2cda-4018-815d-6680fe957092 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc" status: 404 len: 111 microversion: 2.1 time: 0.066345 Oct 18 16:31:25.273551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3064/6180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:25 2022] GET /compute/v2.1/servers/cdaf24c8-95cb-4100-af12-870c50388edc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:25.281552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.283518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.294301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.295019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.295609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.296493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.297128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.297704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.315156 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac HTTP/1.1 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '644119af-a262-46f4-955f-dd2c671bf9ac'} Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:25.317882 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d2ca224a-09db-4c87-b407-2cb9d6717b24 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 404 len: 111 microversion: 2.1 time: 0.043416 Oct 18 16:31:25.324428 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3065/6181] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:25 2022] DELETE /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:31:25.333600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.337870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 644119af-a262-46f4-955f-dd2c671bf9ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.346793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.347783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.348377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.349296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.349974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.351078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.367263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac HTTP/1.1 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '644119af-a262-46f4-955f-dd2c671bf9ac'} Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:25.369820 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. Oct 18 16:31:25.374057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:25.375338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 644119af-a262-46f4-955f-dd2c671bf9ac could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:25.377009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02bc824c-21aa-48e0-917f-d1878ffee4d8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac" status: 404 len: 111 microversion: 2.1 time: 0.049319 Oct 18 16:31:25.378234 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3066/6182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:25 2022] GET /compute/v2.1/servers/644119af-a262-46f4-955f-dd2c671bf9ac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:25.383923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:25.384853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:25.392683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.393495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.394249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.395916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:25.397178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:25.397948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:25.499759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:25.516368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:25.518730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:25.520483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-644c9e9a-593d-4f64-bce7-9d512d5e1f72 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1404 microversion: 2.54 time: 0.140969 Oct 18 16:31:25.521361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3067/6183] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:25 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:26.228639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:26.229771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:26.255551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:26.257166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:26.257975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:26.270127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:26.271036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:26.271993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:26.857735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:26.877187 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a130c4ce-b996-4b2a-bd09-59f97ca7ed48 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.648709 Oct 18 16:31:26.877711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:26.882623 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3068/6184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:26 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:26.893847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:26.900665 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-59a42264-441c-435b-967d-c1ee156a4795 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 1.705423 Oct 18 16:31:26.904202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:26.920275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3117/6185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:25 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:26.939100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:26.940004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:26.940619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:26.945180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:26.945886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:26.947016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:27.193235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:27.235612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:27.245106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542988ec50ec4409b03d1620b5d9d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f29daf24c5246769f01a77605400704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:27.252194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-48c1f9cf-d92d-42e9-9819-9eb1b9c5faa7 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 200 len: 1404 microversion: 2.54 time: 0.367938 Oct 18 16:31:27.292098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3069/6186] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:26 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 1404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:31:27.904071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:27.904865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:27.920191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:27.920687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:27.921163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:27.927414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:27.937191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:27.938085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:27.942882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:27.948155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:27.959210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:27.963040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:27.966242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:27.968964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:27.972772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:27.976375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:28.601843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:28.616263 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9fcda10d-d045-44fe-9a96-231e795f6779 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.687055 Oct 18 16:31:28.637401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3070/6187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:27 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:28.653423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:28.653988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] [instance: 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:28.668516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:28.670255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:28.672282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:28.679090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:28.680121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:28.680725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:28.703088 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] HTTP exception thrown: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Request method failure captured: Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac HTTP/1.1 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSrKeWcwTFnPnSznKG9g4DOz8PrPIgzqlp-c3iVO3oBweXO2DdQRNGPBPIKNzg1_mh5dGEwTD8L2qMmmi_oph5uruOlsCkbjiGBGeseXsnv0Ev0CdgKvOtFVTYZ780P5HOvW-aWqH9bDpWgQV46q3hOXizriySIc-clbqCMi_jvr6I Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.54 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7f29daf24c5246769f01a77605400704 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerShowV254Test-104517092 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7f29daf24c5246769f01a77605400704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f29daf24c5246769f01a77605400704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7f29daf24c5246769f01a77605400704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f29daf24c5246769f01a77605400704"}]}] Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerShowV254Test-104517092 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7f29daf24c5246769f01a77605400704 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerShowV254Test-104517092 Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerShowV254Test-104517092-project Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 542988ec50ec4409b03d1620b5d9d23f Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerShowV254Test-104517092-project Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '96bdcc7c-c6c5-4b0c-be12-0fdc347129ac'} Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:28.705456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. Oct 18 16:31:28.714857 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:28.717485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] Returning 404 to user: Instance 96bdcc7c-c6c5-4b0c-be12-0fdc347129ac could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:28.719348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0c3fa038-8859-4e80-8315-8c7037992480 tempest-ServerShowV254Test-104517092 tempest-ServerShowV254Test-104517092-project] 10.222.0.78 "GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac" status: 404 len: 111 microversion: 2.54 time: 0.080171 Oct 18 16:31:28.720247 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3071/6188] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:31:28 2022] GET /compute/v2.1/servers/96bdcc7c-c6c5-4b0c-be12-0fdc347129ac => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:31:29.054534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:29.068140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e01b5475-d40f-450e-9a8d-fcc7c1bc89d1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 1.168123 Oct 18 16:31:29.080488 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3118/6189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:27 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:29.648586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:29.649409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:29.656761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.665764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.668037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.668956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.680585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.681197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.774019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd8db4-7bd1-40cf-85a8-1be980374788", "name": "network-vif-plugged", "status": "completed", "tag": "75e6c11a-3466-4a53-8a7b-fdc0235229d2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:29.805281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.805745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.806491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.841133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] Creating event network-vif-plugged:75e6c11a-3466-4a53-8a7b-fdc0235229d2 for instance 24bd8db4-7bd1-40cf-85a8-1be980374788 on n-h1-858383-14 Oct 18 16:31:29.877742 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5db390d2-d13a-415d-b814-4b77ec41ae86 req-e7113931-fe0d-4fd7-9fe3-45e0c2883bbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096777 Oct 18 16:31:29.879326 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3119/6190] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:30.113357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:30.114880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:30.127977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:30.132964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:30.133674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:30.134563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:30.135795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:30.137645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:30.154000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:30.242729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:30.257717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6ed7b6c-22cb-48b9-883b-ace6cd36d180 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.616817 Oct 18 16:31:30.269561 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3072/6191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:29 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:30.784348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:30.793976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6063f6cc-f5c3-4f31-8ec9-a7f3cfa4c3f9 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.686953 Oct 18 16:31:30.797129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3120/6192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:30 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:31.296660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:31.297643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:31.315481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.315990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.316508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:31.317251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.320517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.320930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:31.876254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:31.895460 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f81c5e69-0919-4bd6-9a53-a0e027a7c005 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1428 microversion: 2.1 time: 0.601672 Oct 18 16:31:31.900609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3121/6193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:31 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1428 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:31.921849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:31.925493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:31.966184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.969696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.971599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:31.973703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.977622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.978496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.150150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:32.179957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.180838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.182320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.211053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] Creating event network-changed:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:31:32.230158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-29593424-ed52-4b98-8f84-2f95946233ac req-4778a332-d242-489d-9fba-d1bafd7d40bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.993857 Oct 18 16:31:32.232616 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3073/6194] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:32.404481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:32.405569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:32.433376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.435366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.436114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.440031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.441109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.445808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.499066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd HTTP/1.1 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5a91d7db-776b-4e39-8ce9-ab78b91a89bd'} Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:32.511735 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.516896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.520420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:32.522521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-59d11e97-b2b1-4da0-afdb-5cc8a967dc3f tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 404 len: 111 microversion: 2.1 time: 0.125299 Oct 18 16:31:32.523705 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3074/6195] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:32 2022] DELETE /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:31:32.531916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:32.534537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] [instance: 5a91d7db-776b-4e39-8ce9-ab78b91a89bd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:32.552691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.553346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.554011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.558359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.558963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.559455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.593053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] HTTP exception thrown: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Request method failure captured: Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd HTTP/1.1 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtJSf2lg2YNGnHoTvmEyl2b3-hZlT0QL0Eg48q52WoYcU0xjcqQKJrz3lODfPOuO6JKhCEg9uZS0spopsA-HLjkIt1Cig1LqwYuCVkEoGKFArUl8oYB8Lj9s7pNvwptWe7KGyNDKYa__DiK30tABrNK6lnopfBrJplynymd3eKHC-yQ Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f7edbad9c1fb4c1a823575d5b5c6cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f7edbad9c1fb4c1a823575d5b5c6cd08"}]}] Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f7edbad9c1fb4c1a823575d5b5c6cd08 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1347511862 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a51c470236904eb0a85bfee1703d3c71 Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-AttachVolumeNegativeTest-1347511862-project Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5a91d7db-776b-4e39-8ce9-ab78b91a89bd'} Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:32.600555 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. Oct 18 16:31:32.604435 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:32.606403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] Returning 404 to user: Instance 5a91d7db-776b-4e39-8ce9-ab78b91a89bd could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:32.607553 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc1f11d4-c155-4d78-bdba-2095715dbdc8 tempest-AttachVolumeNegativeTest-1347511862 tempest-AttachVolumeNegativeTest-1347511862-project] 10.222.0.78 "GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd" status: 404 len: 111 microversion: 2.1 time: 0.079839 Oct 18 16:31:32.608615 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3075/6196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:32 2022] GET /compute/v2.1/servers/5a91d7db-776b-4e39-8ce9-ab78b91a89bd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:31:32.831595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:32.862852 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4eec7f92-8cd6-4861-8db7-6d37a8cbbe91 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.955367 Oct 18 16:31:32.871327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3122/6197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:31 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:32.927466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:32.928506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:32.940538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.941138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.941818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.943171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.945071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.946091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.962094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:33.669413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:33.691529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c18e1054-e855-414a-b3ae-b8b78b1197c4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1608 microversion: 2.1 time: 0.766475 Oct 18 16:31:33.692160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3076/6198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:32 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1608 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:33.719529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:33.720567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:33.735159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.740874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.744813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:33.745705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.746203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.746643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:33.891938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:33.892570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:33.906972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:33.909129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.915212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.919648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:33.921875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.925164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.935279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:34.231419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:34.245838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.357731 Oct 18 16:31:34.250730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3077/6199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:33 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:34.467855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:34.469184 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001808 Oct 18 16:31:34.469891 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3078/6200] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 18 16:31:34 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 16:31:34.478859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:34.479941 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002264 Oct 18 16:31:34.480669 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3079/6201] 10.222.0.78 () {54 vars in 1035 bytes} [Tue Oct 18 16:31:34 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 18 16:31:34.489088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:34.492479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003746 Oct 18 16:31:34.493223 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3080/6202] 10.222.0.78 () {54 vars in 1041 bytes} [Tue Oct 18 16:31:34 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:34.508948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:34.510770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17f0b0d6-6b79-4135-b030-971ba41ed0b8 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001981 Oct 18 16:31:34.518217 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3081/6203] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 18 16:31:34 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 16:31:34.786883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-plugged", "status": "completed", "tag": "ceb85b8c-89bb-4eff-aefb-c11c7197e2ca"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:34.808955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:34.813349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:34.814028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:34.846141 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] Creating event network-vif-plugged:ceb85b8c-89bb-4eff-aefb-c11c7197e2ca for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:34.860539 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c66b931b-8152-4815-94fd-619c65748348 req-981becc7-ba95-4fb5-bb73-be9ecbda3696 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077315 Oct 18 16:31:34.863013 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3082/6204] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:35.279400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:35.281256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:35.292489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:35.293962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:35.295366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:35.296926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:35.298237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:35.302224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:35.330614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:35.372402 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e38aadb4-95cd-4575-8fb0-6908883a7f00 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1608 microversion: 2.1 time: 1.654730 Oct 18 16:31:35.399040 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3123/6205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:33 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1608 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:35.411429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:35.413167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:35.427382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:35.430275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:35.431141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:35.433541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:35.434276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:35.436734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:35.890561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:35.891526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:35.900625 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6d89b49-40e8-4dba-9aeb-3db958a73b6e tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1608 microversion: 2.1 time: 0.497826 Oct 18 16:31:35.903039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3124/6206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:35 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1608 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:35.916081 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b28c01ee-a285-4ad6-80cf-4739e680ff42 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.640366 Oct 18 16:31:35.924565 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3083/6207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:35 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:36.597405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:36.614473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:36.627127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:36.627846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:36.630095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:36.686954 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] Creating event network-changed:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:31:36.697026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-29a3c091-9a29-44ac-89bc-abe21c78d184 req-9a649447-e683-4c15-9963-601e1d26815c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106225 Oct 18 16:31:36.698005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3125/6208] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:36.942109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:36.942748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:36.957375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:36.961707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:36.962390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:36.963325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:36.963955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:36.964535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:37.052100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-plugged", "status": "completed", "tag": "2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f"}, {"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-plugged", "status": "completed", "tag": "6f9f9ac2-7249-4861-b653-1604be73770a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:37.073598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:37.074407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:37.076229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:37.100791 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Creating event network-vif-plugged:2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:37.105039 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] Creating event network-vif-plugged:6f9f9ac2-7249-4861-b653-1604be73770a for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:37.116950 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fb1ba5a7-6303-47ad-b01d-05e8f3cc4732 req-22eb02cd-ccc4-47d1-9bc4-5dd25794427e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070923 Oct 18 16:31:37.120079 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3126/6209] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:37.521517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:37.534848 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3357d45f-a76b-48bb-a69e-7e9341ddba73 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.596693 Oct 18 16:31:37.535731 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3084/6210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:36 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:38.568688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:38.571255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:38.585828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:38.587080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:38.587751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:38.588866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:38.589662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:38.590751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:38.916126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:38.955674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:38.956478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:38.957097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:38.990935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] Creating event network-changed:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:31:38.998818 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ca06a594-0db5-401e-ac56-abacb7285e58 req-1984fe20-ee00-48fa-8574-67d5247b5b45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087299 Oct 18 16:31:39.000336 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3085/6211] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:39.418379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:39.469467 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65274f1a-5a19-440c-bb2c-a4aec9b6bd16 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1354 microversion: 2.1 time: 0.908584 Oct 18 16:31:39.493162 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3127/6212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:38 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1354 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:40.519308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:40.520145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:40.541934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:40.542746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:40.544655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:40.545665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:40.549444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:40.550585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.288514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:41.308210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68e38d42-ffb5-4bed-b07b-bc6a37630bc4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1805 microversion: 2.1 time: 0.793350 Oct 18 16:31:41.308818 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3086/6213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:40 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1805 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:41.338403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:41.340130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:41.365222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.372387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.377070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.380067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.384629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.385583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.524530 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-861dfb68-b177-4c83-bd8e-39fa1ad18685 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81/ips" status: 200 len: 219 microversion: 2.1 time: 0.192195 Oct 18 16:31:41.538606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3128/6214] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:31:41 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81/ips => generated 219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:41.546076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:41.546663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:41.566096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.570091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.570878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.572114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.572925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.585358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.672006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e695cba5-a746-4ab9-b6a4-6e81abb53ea7 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd25ca550>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:41.738050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:31:41.840875 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e695cba5-a746-4ab9-b6a4-6e81abb53ea7 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/e2fa9c9f-1949-496a-b71f-5e663607686c" status: 200 len: 351 microversion: 2.1 time: 0.178250 Oct 18 16:31:41.842730 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3129/6215] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:41 2022] GET /compute/v2.1/os-volumes/e2fa9c9f-1949-496a-b71f-5e663607686c => generated 351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:42.014952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e1017a51-6dde-4ec5-9de0-c913b4df4b53 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "DELETE /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 204 len: 0 microversion: 2.1 time: 0.469278 Oct 18 16:31:42.016545 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3087/6216] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:41 2022] DELETE /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:31:42.029737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:42.030590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:42.041066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:42.044459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:42.046528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:42.047481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:42.049240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:42.050670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:42.778625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:42.793731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d431c86-ff3f-476c-83bf-c69ef5f5888b tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1811 microversion: 2.1 time: 0.770608 Oct 18 16:31:42.797021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3130/6217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:42 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1811 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:43.826364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:43.827147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:43.852656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:43.857884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:43.859004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:43.866127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:43.867393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:43.872829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:44.394691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd8db4-7bd1-40cf-85a8-1be980374788", "tag": "75e6c11a-3466-4a53-8a7b-fdc0235229d2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:44.434137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:44.440327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:44.441645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:44.475421 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] Creating event network-changed:75e6c11a-3466-4a53-8a7b-fdc0235229d2 for instance 24bd8db4-7bd1-40cf-85a8-1be980374788 on n-h1-858383-14 Oct 18 16:31:44.488910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:44.504303 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-70d21854-c15d-43b7-9a48-44be0ba6fb54 req-6acb6474-bc3c-442b-866a-15ec827a620d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.983790 Oct 18 16:31:44.518265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3088/6218] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:44.518454 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-128fafb3-e465-4f84-8dad-056b371d17a6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1811 microversion: 2.1 time: 0.687160 Oct 18 16:31:44.526244 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3131/6219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:43 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1811 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:44.948147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8936021-b277-41a0-9767-6846c31134ec tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd64f8790>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:45.076577 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8936021-b277-41a0-9767-6846c31134ec tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/48f37bf2-e643-4e6d-8d33-d913f3100c83" status: 200 len: 351 microversion: 2.1 time: 0.143267 Oct 18 16:31:45.078008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3089/6220] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:44 2022] GET /compute/v2.1/os-volumes/48f37bf2-e643-4e6d-8d33-d913f3100c83 => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:45.553028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:45.555789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:45.581509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:45.588951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:45.591000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:45.591768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:45.592248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:45.592677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:46.188668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:46.222468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63b36875-c9bd-446a-bf19-453b904c49e5 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1790 microversion: 2.1 time: 0.652242 Oct 18 16:31:46.224355 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3132/6221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:45 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1790 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:46.805752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-deleted", "tag": "ceb85b8c-89bb-4eff-aefb-c11c7197e2ca"}, {"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-deleted", "tag": "6f9f9ac2-7249-4861-b653-1604be73770a"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:46.854415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:46.858121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:46.858664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:46.901674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Creating event network-vif-deleted:ceb85b8c-89bb-4eff-aefb-c11c7197e2ca for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:46.902545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] Creating event network-vif-deleted:6f9f9ac2-7249-4861-b653-1604be73770a for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:46.918355 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f7107ee8-8023-4894-9672-09a8b0c1b4b8 req-ea6dfca0-9302-4f3f-944a-16d952992d1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.139137 Oct 18 16:31:46.922085 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3090/6222] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:47.250970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:47.252137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:47.271426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:47.277782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:47.278652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:47.279825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:47.280519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:47.284208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:47.734232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:47.761760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b75b9389-e4f6-43a3-a090-e314b37f16d7 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 200 len: 1454 microversion: 2.1 time: 0.514900 Oct 18 16:31:47.763552 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3133/6223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:47 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 1454 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:48.815076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:48.815838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:48.827277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.828078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.828766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.829991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.831351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.832166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.863094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 HTTP/1.1 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '455e902d-2349-418e-ba25-9f4d7e44ae81'} Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:48.866344 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9935ca0b-e98d-4c21-b431-a2183ecb2722 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 404 len: 111 microversion: 2.1 time: 0.062945 Oct 18 16:31:48.869794 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3091/6224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:48 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:48.976547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455e902d-2349-418e-ba25-9f4d7e44ae81", "name": "network-vif-deleted", "tag": "2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:49.001463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:49.002838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:49.004180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:49.053178 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] Creating event network-vif-deleted:2dd05284-a920-4fc6-b2ca-ac5e9e0cf46f for instance 455e902d-2349-418e-ba25-9f4d7e44ae81 on n-h2-858383-14 Oct 18 16:31:49.078548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0b71370c-12fc-4823-84c8-d0e8aa88b8b0 req-e4c0f837-53e0-4553-b782-0d3d8b5bc23f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109439 Oct 18 16:31:49.087114 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3134/6225] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:49.231291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5588906-1595-440d-bc91-47f6ccdfa7b1 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd64f8ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:49.331453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5588906-1595-440d-bc91-47f6ccdfa7b1 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/241e6fc3-e497-4e3c-a79a-a0bd16b7fc66" status: 200 len: 350 microversion: 2.1 time: 0.105319 Oct 18 16:31:49.333672 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3092/6226] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:49 2022] GET /compute/v2.1/os-volumes/241e6fc3-e497-4e3c-a79a-a0bd16b7fc66 => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:49.358709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2786634-2217-4ca0-ac5b-3a5c458c32d0 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd2196c10>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:49.569069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2786634-2217-4ca0-ac5b-3a5c458c32d0 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.225103 Oct 18 16:31:49.569959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3135/6227] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:31:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:49.590175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01380bb4-9c8e-4b23-bbde-9440c9dd57ed tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd201c280>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:49.918605 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01380bb4-9c8e-4b23-bbde-9440c9dd57ed tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.336670 Oct 18 16:31:49.933094 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3093/6228] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:31:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:49.937086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4583fed2-c209-4786-aa7b-e947dea056d2 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd215d160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.102741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4583fed2-c209-4786-aa7b-e947dea056d2 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169623 Oct 18 16:31:50.103988 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3136/6229] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:31:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:50.119685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7bfd71b8-4f52-460c-a885-37f7687859a5 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd1fb4430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.402722 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7bfd71b8-4f52-460c-a885-37f7687859a5 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.287883 Oct 18 16:31:50.403880 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3094/6230] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:50.422053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cbfe29f-b0aa-4c42-8d20-0dc7b28364ce tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd24d19d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.651854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cbfe29f-b0aa-4c42-8d20-0dc7b28364ce tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.236145 Oct 18 16:31:50.652408 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3137/6231] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:50.673020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e6dd3a35-caee-4776-9b55-3e8f5851a444 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd64f89d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.832561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e6dd3a35-caee-4776-9b55-3e8f5851a444 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.164911 Oct 18 16:31:50.835405 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3095/6232] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:50.848811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b399b1c2-ff95-46ab-9fe2-0fa69e1dc516 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd19d14c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.956287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b399b1c2-ff95-46ab-9fe2-0fa69e1dc516 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.111002 Oct 18 16:31:50.971963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3138/6233] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:50.973238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2385be67-e336-4b8a-badb-d515bf668c86 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] Calling method '.version_select at 0x7f5fd65223a0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:51.097657 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2385be67-e336-4b8a-badb-d515bf668c86 tempest-VolumesTestJSON-969633123 tempest-VolumesTestJSON-969633123-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.129062 Oct 18 16:31:51.098529 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3096/6234] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:54.031242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd2e3c9f-533a-41a5-a673-2fc4e831ec2c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Action: 'create', calling method: .version_select at 0x7f5fd20a1160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649768591", "metadata": {"Type": "work"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd2e3c9f-533a-41a5-a673-2fc4e831ec2c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 122 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649768591", "metadata": {"Type": "work"}}} Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1649768591', 'metadata': {'Type': 'work'}}}} Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi '#$%' Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:31:54.056425 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 16:31:54.064093 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.068767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd2e3c9f-533a-41a5-a673-2fc4e831ec2c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.070322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd2e3c9f-533a-41a5-a673-2fc4e831ec2c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.810364 Oct 18 16:31:54.075664 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3139/6235] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 816 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:31:54.090919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd6d0f86-5db6-4ded-a390-ae596fe2afb2 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Action: 'create', calling method: .version_select at 0x7f5fd652e670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-415322652", "metadata": {"Type": "work"}}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd6d0f86-5db6-4ded-a390-ae596fe2afb2 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 119 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-415322652", "metadata": {"Type": "work"}}} Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-415322652', 'metadata': {'Type': 'work'}}}} Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '0' Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:31:54.097693 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 16:31:54.101999 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.108157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd6d0f86-5db6-4ded-a390-ae596fe2afb2 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.111066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd6d0f86-5db6-4ded-a390-ae596fe2afb2 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029169 Oct 18 16:31:54.113899 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3097/6236] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:31:54.123851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e5c9cf5-8d7a-4907-b967-c8f7ef92bd22 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Action: 'create', calling method: .version_select at 0x7f5fd18ce820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2076631334", "metadata": {"Type": "work"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e5c9cf5-8d7a-4907-b967-c8f7ef92bd22 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 119 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2076631334", "metadata": {"Type": "work"}}} Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2076631334', 'metadata': {'Type': 'work'}}}} Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi '' Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:31:54.127867 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e5c9cf5-8d7a-4907-b967-c8f7ef92bd22 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e5c9cf5-8d7a-4907-b967-c8f7ef92bd22 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009331 Oct 18 16:31:54.134269 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3140/6237] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:31:54.158653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d582d12-e7e8-4d21-b687-ded783721c7a tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Calling method '.version_select at 0x7f5fd20e09d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:54.258986 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-7d582d12-e7e8-4d21-b687-ded783721c7a tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] HTTP exception thrown: Volume tempest-invalid-1523501507 could not be found. Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d582d12-e7e8-4d21-b687-ded783721c7a tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1523501507 HTTP/1.1 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume tempest-invalid-1523501507 could not be found. Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'tempest-invalid-1523501507'} Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1523501507 could not be found. (HTTP 404) (Request-ID: req-a6464767-532b-4a84-8006-9613d8ee5b99) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:31:54.265662 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1523501507 could not be found. Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1523501507 could not be found. Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1523501507 could not be found. Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7d582d12-e7e8-4d21-b687-ded783721c7a tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 404 to user: Volume tempest-invalid-1523501507 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.271911 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7d582d12-e7e8-4d21-b687-ded783721c7a tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1523501507" status: 404 len: 99 microversion: 2.1 time: 0.127722 Oct 18 16:31:54.284866 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3098/6238] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:31:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1523501507 => generated 99 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 16:31:54.299410 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ffc69602-9c8e-48f0-b85b-4601b6a9cec6 tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006630 Oct 18 16:31:54.300253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3141/6239] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:31:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 16:31:54.355956 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ca2c65e-b996-4c95-94bc-236232e54c6c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.027926 Oct 18 16:31:54.357979 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3099/6240] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:31:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 16:31:54.451070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04a01785-74cc-4b75-a16c-a6e2a877a97e tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Calling method '.version_select at 0x7f5fd1865160>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:54.604245 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-04a01785-74cc-4b75-a16c-a6e2a877a97e tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] HTTP exception thrown: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04a01785-74cc-4b75-a16c-a6e2a877a97e tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/os-volumes/6f89b47a-aee5-43a5-af22-0f1918414f54 HTTP/1.1 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: method: Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: exception: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6f89b47a-aee5-43a5-af22-0f1918414f54'} Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. (HTTP 404) (Request-ID: req-a8236067-272d-44b0-9d6b-618be25d5ae8) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:31:54.622098 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. Oct 18 16:31:54.627066 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.640027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-04a01785-74cc-4b75-a16c-a6e2a877a97e tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 404 to user: Volume 6f89b47a-aee5-43a5-af22-0f1918414f54 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.640027 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-04a01785-74cc-4b75-a16c-a6e2a877a97e tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6f89b47a-aee5-43a5-af22-0f1918414f54" status: 404 len: 109 microversion: 2.1 time: 0.268461 Oct 18 16:31:54.641895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3142/6241] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:31:54 2022] DELETE /compute/v2.1/os-volumes/6f89b47a-aee5-43a5-af22-0f1918414f54 => generated 109 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:54.658713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8664604f-4e35-4708-9aff-5a4daffd664c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Calling method '.version_select at 0x7f5fd652ef70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:54.729333 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8664604f-4e35-4708-9aff-5a4daffd664c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] HTTP exception thrown: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8664604f-4e35-4708-9aff-5a4daffd664c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Request method failure captured: Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/os-volumes/dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe HTTP/1.1 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtT5yyT9JtuVfnn671ElkQCmwULfwjTDXbrH4189Ppp9YYng5OWYttBrHS0k8GT1Eg-PUbDr4C6ANHJvnenWn6lQQW7iroDYdfRdw700IOR1xVo3mVTQH5oq1SGeFwKCm0nGWky5o8ZlNkX3Zgp6BDtmnrh5gvuS8B28kA9ZekjHTAs Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "tempest-type-1569548720", "name": "tempest-service-74728347", "endpoints": [{"region": "tempest-region-1959540100", "publicURL": "https://url-1739503762.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "tempest-type-1727046573", "name": "tempest-service-432443701", "endpoints": [{"region": "tempest-region-181340201", "internalURL": "https://url-715979488.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9524ceb4490746e8ba976b45e79db945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9524ceb4490746e8ba976b45e79db945"}]}] Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9524ceb4490746e8ba976b45e79db945 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesNegativeTest-404410588 Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: bf177ca69f8144ef9ee819b92559445e Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesNegativeTest-404410588-project Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: method: Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: exception: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe'} Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. (HTTP 404) (Request-ID: req-4de7d4b9-83b7-4bad-9208-754d7c56d19e) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 16:31:54.732363 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. Oct 18 16:31:54.736048 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:31:54.741193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8664604f-4e35-4708-9aff-5a4daffd664c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] Returning 404 to user: Volume dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:54.742382 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8664604f-4e35-4708-9aff-5a4daffd664c tempest-VolumesNegativeTest-404410588 tempest-VolumesNegativeTest-404410588-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe" status: 404 len: 109 microversion: 2.1 time: 0.091727 Oct 18 16:31:54.743198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3100/6242] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:31:54 2022] GET /compute/v2.1/os-volumes/dfa4d7f5-dbc6-4548-a9ff-2bb880dcbabe => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:56.861575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-461660860", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "4f362b20-786c-43a7-91b2-223696d8fd5f"}, {"uuid": "c4c213b6-9cf3-4666-80a3-5eee85e88ab5"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:57.155664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] validate_networks() for [('4f362b20-786c-43a7-91b2-223696d8fd5f', None, None, None, None, None), ('c4c213b6-9cf3-4666-80a3-5eee85e88ab5', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:31:59.019116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=69 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.387461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:32:00.389415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:32:00.390168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:32:00.390802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:32:00.391419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:32:00.408124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:00.409583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:00.415384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:00.417193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:00.417923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:00.418655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:00.474155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Getting quotas for project 4329dc19129c4c4783c5934ff48b045a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:32:00.489396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Getting quotas for user ed5f927857d54bba9371256669c262f1 and project 4329dc19129c4c4783c5934ff48b045a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:32:00.527341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:32:00.537803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:32:00.624234 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-575ce8af-263c-462b-b427-3cb88fd22097 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.767772 Oct 18 16:32:00.640037 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3143/6243] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:31:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:32:00.641867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.643079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.652404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf23f02b-aa91-4b18-90cd-99c6f8f626e0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:00.674135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf23f02b-aa91-4b18-90cd-99c6f8f626e0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:00.856124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf23f02b-aa91-4b18-90cd-99c6f8f626e0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:00.882252 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf23f02b-aa91-4b18-90cd-99c6f8f626e0 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1212 microversion: 2.1 time: 0.242893 Oct 18 16:32:00.883593 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3101/6244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:00 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:01.911318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01880eda-4ee8-486c-8ece-dd468e2cf624 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:01.912267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01880eda-4ee8-486c-8ece-dd468e2cf624 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:02.063449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01880eda-4ee8-486c-8ece-dd468e2cf624 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:02.078103 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01880eda-4ee8-486c-8ece-dd468e2cf624 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1212 microversion: 2.1 time: 0.171709 Oct 18 16:32:02.079857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3144/6245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:01 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1212 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:03.108697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:03.109634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:03.157844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:03.158349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:03.158793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:03.159520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:03.159981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:03.160414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:04.105373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:04.114622 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-265f5cfb-4b3d-4932-862a-5fe9e7d3de45 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1264 microversion: 2.1 time: 1.011133 Oct 18 16:32:04.126524 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3102/6246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:03 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1264 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:05.161525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:05.162641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:05.188663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.189400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.193770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.194992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.197272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.199220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.414195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:05.443581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-009967dc-8646-4dfa-a331-b6c496e9ad31 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1270 microversion: 2.1 time: 0.287309 Oct 18 16:32:05.448961 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3145/6247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:05 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:05.918892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:05.924078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:05.940362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.941645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:05.942611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.950147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.952605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.953289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.953886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.006272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.008279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.009465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.061282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:32:06.064213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] Creating event network-changed:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:32:06.084823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-bf3fb57e-14e0-424c-8998-80269cfd27ce req-6c28fc93-fb6e-4206-9dbe-e3724b328925 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148725 Oct 18 16:32:06.092771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3146/6248] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:32:06.361579 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c835d48b-46c4-4227-8403-84483b4e69c9 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "DELETE /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 204 len: 0 microversion: 2.1 time: 0.450863 Oct 18 16:32:06.362500 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3103/6249] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:05 2022] DELETE /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:32:06.376447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:06.386111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:06.452782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.467227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.469486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.475204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.480830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.481914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:06.483416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:06.493091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.514219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.514913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.515742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.516733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.517562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.518151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:07.211846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:07.247749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24d026e2-8207-47a2-aa46-1176d1550e52 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1582 microversion: 2.1 time: 0.874711 Oct 18 16:32:07.250605 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3147/6250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:06 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1582 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:08.021473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:08.056668 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b59437f-0bb2-4e91-ad20-5e47eafc3c1d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1312 microversion: 2.1 time: 1.577644 Oct 18 16:32:08.062884 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3104/6251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:06 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1312 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:08.318725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:08.318725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:08.328117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:08.357781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:08.359117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:08.364167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:08.365889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:08.369398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:08.374204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:09.102004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:09.103288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:09.118393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:09.119595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:09.121725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:09.124163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:09.137985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:09.141710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:09.763390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:09.795256 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08f85484-b6c2-48d3-9244-c3077917a844 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1582 microversion: 2.1 time: 1.468779 Oct 18 16:32:09.813019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3148/6252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:08 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1582 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:10.176301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:10.193233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c69859c-a010-4a93-b770-7b8e07b7b1cf tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 1.097530 Oct 18 16:32:10.209134 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3105/6253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:09 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:10.581247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89134954-66b7-40e6-8157-47334aa8b28e", "name": "network-vif-deleted", "tag": "215c11c5-2173-4f5e-835b-39d7c8d20e0a"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:10.603271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:10.646247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:10.648711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:10.650600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:10.694086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] Creating event network-vif-deleted:215c11c5-2173-4f5e-835b-39d7c8d20e0a for instance 89134954-66b7-40e6-8157-47334aa8b28e on n-h1-858383-14 Oct 18 16:32:10.734456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ac68f955-d131-46eb-b74b-712a37d15a89 req-d2a72cbe-139b-48d8-b983-97dd75f35dce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159761 Oct 18 16:32:10.748123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3149/6254] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:10.837277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:10.838094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:10.860634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:10.864779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:10.866061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:10.866672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:10.868648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:10.870074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:10.884028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:11.256412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:11.273420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:11.279402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:11.347515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6c3e02df-3ffa-47cd-9163-a0417623ee5f tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.520563 Oct 18 16:32:11.366987 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3106/6255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:10 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:11.379955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:11.381238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:11.385577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:11.386923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:11.387607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:11.388265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:12.077333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:12.230796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:12.285191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-967f4eb1-cdb0-499d-ad34-05eb23c4327d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 1.052072 Oct 18 16:32:12.294922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3150/6256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:11 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:12.374622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:12.375258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:12.398325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:12.398846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:12.399297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:12.400022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:12.417018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:12.418151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:12.944182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "tag": "ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:12.979103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:12.980649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:12.983203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:13.017412 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] Creating event network-changed:ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:13.056583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-75f43e46-b176-415a-9d35-e71e56fdb74b req-1b1ab6f5-6cae-4af5-af99-d7501df4571a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116532 Oct 18 16:32:13.059155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:13.067203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3151/6257] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:13.069217 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b4cfed2-146b-4f71-82e8-e213990da4f2 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.696997 Oct 18 16:32:13.069917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3107/6258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:12 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:13.324362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:13.326442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:13.351964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:13.358568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:13.362030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:13.370400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:13.371392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:13.372064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:14.109013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:14.110061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:14.125310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:14.127778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:14.128271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:14.129575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:14.133799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:14.134656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:14.500256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:14.512111 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-792495a5-5491-4a6e-a400-c265e8adf9d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.407816 Oct 18 16:32:14.517982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3108/6259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:14 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:14.674066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:14.712822 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ea1a765-bf18-4df9-ad38-a323eff3edf6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 1.392776 Oct 18 16:32:14.734282 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3152/6260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:13 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:15.559455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:15.564345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:15.594901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:15.595410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:15.595851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:15.596644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:15.597203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:15.598143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:15.750387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:15.752483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:15.780057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:15.782978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:15.784030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:15.788356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:15.789452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:15.791076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:15.881691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:15.896505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-95811b6b-c498-4e9e-bceb-eaeb95b463ff tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.346473 Oct 18 16:32:15.901743 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3109/6261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:15 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:16.217994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:16.257244 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e4efa59-03b0-4faf-91c3-3760931d1d07 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.511000 Oct 18 16:32:16.279047 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3153/6262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:15 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:16.391156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "tag": "93f2feb3-66d4-45fa-af5a-9824b09cd385"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:16.410791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:16.411591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:16.413593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:16.442532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] Creating event network-changed:93f2feb3-66d4-45fa-af5a-9824b09cd385 for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:16.466343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-10624bcd-eeab-41a0-aaa0-e2167c1cc986 req-62a883ac-f5d4-42fc-96fe-4e2eed2dafe8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079104 Oct 18 16:32:16.467689 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3110/6263] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:16.954880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:16.956287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:16.974218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:16.975371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:16.980686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:16.982099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:16.983318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:16.984319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:17.211074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:17.267126 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4503553-85c1-46dc-9ef8-7397e9b25b25 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.318699 Oct 18 16:32:17.273696 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3154/6264] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:16 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:17.296714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:17.306514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:17.356932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:17.358221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:17.367449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:17.371753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:17.376193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:17.377400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:17.991939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:18.007669 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f78e3a8-b706-41bf-af69-603d2c809018 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.726928 Oct 18 16:32:18.014391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3111/6265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:17 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:18.316003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:18.319130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:18.349200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:18.351392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:18.353166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:18.359536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:18.361658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:18.363416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:18.551513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:18.563806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-70b16079-d9f1-4942-b6ab-14d4874586d8 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.268760 Oct 18 16:32:18.565920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3155/6266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:18 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:19.049576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:19.050454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:19.089484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:19.092558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:19.093148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:19.093811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:19.102264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:19.102898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:19.476276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:19.486635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f78afe0f-40b6-401c-87c1-11d3a2974671 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.449782 Oct 18 16:32:19.487246 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3112/6267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:19 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:19.602913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:19.603544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:19.617638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:19.620462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:19.622427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:19.624009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:19.625334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:19.626396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:19.846731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:19.862200 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b8e7afd-a5b3-4ee1-a3d0-72f83671fc47 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.257950 Oct 18 16:32:19.862887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3156/6268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:19 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:20.528044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:20.528895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:20.540160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:20.546210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:20.546975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:20.547880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:20.548503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:20.549122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:20.889067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:20.889706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:20.911037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:20.911860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:20.913332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:20.914628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:20.918065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:20.921372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:21.041258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:21.064709 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b18f461e-151d-49be-a50a-549bdd9cd455 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.537498 Oct 18 16:32:21.066608 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3113/6269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:20 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:21.105720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0674cdb0faa64406a58794e68d5e94a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d3c0e8672c4488b8762c9e522d7245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:21.123154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-225602a1-a985-4e44-8a2c-873baed71769 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 200 len: 1229 microversion: 2.1 time: 0.238225 Oct 18 16:32:21.130677 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3157/6270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:20 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 1229 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:22.102052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:22.103167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:22.137758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:22.139822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:22.142962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:22.144034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:22.146516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:22.147501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:22.165391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:22.166383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] [instance: 89134954-66b7-40e6-8157-47334aa8b28e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:22.176754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:22.178633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:22.179391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:22.180380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:22.180969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:22.181628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:22.261633 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] HTTP exception thrown: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Request method failure captured: Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e HTTP/1.1 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtOg7xhWYbDc9KhfLl-maaqgmGYq4JvsfGUO37YVQiWxbpjONNUJ9gEWnJdzMIPoc4RKmNDKHgpf8znRion_xGVSzyBAmDDWMN2bLBBxA-Jo8E__evH7-BCm_ZE6DT6sElUSY3s8U-Um91zqV_o7q5vt8l_a1FqMxOfqmE0SjihfbLs Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 42d3c0e8672c4488b8762c9e522d7245 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBackupRestore-115981143 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/42d3c0e8672c4488b8762c9e522d7245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/42d3c0e8672c4488b8762c9e522d7245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_42d3c0e8672c4488b8762c9e522d7245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/42d3c0e8672c4488b8762c9e522d7245"}]}] Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBackupRestore-115981143 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 42d3c0e8672c4488b8762c9e522d7245 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBackupRestore-115981143 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBackupRestore-115981143-project Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 0674cdb0faa64406a58794e68d5e94a3 Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBackupRestore-115981143-project Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '89134954-66b7-40e6-8157-47334aa8b28e'} Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:22.267343 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. Oct 18 16:32:22.272477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:22.273959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Returning 404 to user: Instance 89134954-66b7-40e6-8157-47334aa8b28e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:22.274849 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-54956678-8504-4d83-930c-54b34b73a0a0 tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e" status: 404 len: 111 microversion: 2.1 time: 0.125250 Oct 18 16:32:22.275845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3158/6271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:22 2022] GET /compute/v2.1/servers/89134954-66b7-40e6-8157-47334aa8b28e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:22.606369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:22.656517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8b71bf2-2b6f-46ee-b50a-a121c8a5f6d6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.559880 Oct 18 16:32:22.658079 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3114/6272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:22 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:22.723972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-559b628a-a5b2-418d-b851-8e1547acc87d tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] Calling method '.version_select at 0x7f5fd20a1280>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:22.783276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-559b628a-a5b2-418d-b851-8e1547acc87d tempest-TestVolumeBackupRestore-115981143 tempest-TestVolumeBackupRestore-115981143-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1950407456" status: 202 len: 0 microversion: 2.1 time: 0.070059 Oct 18 16:32:22.789044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3159/6273] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1950407456 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:32:23.697930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:23.701192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:23.729284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:23.734563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:23.739473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:23.743334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:23.749393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:23.750575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:24.085221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:24.098389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5cc1c353-0246-41e6-ba3d-c8a22ad04c95 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.404505 Oct 18 16:32:24.099540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3115/6274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:23 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:25.125667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:25.126297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:25.146792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:25.157952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:25.158430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:25.159224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:25.159692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:25.160811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:25.494090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:25.518394 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5717ec83-171f-4012-a0fd-cb1190b00365 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.396205 Oct 18 16:32:25.520083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3160/6275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:25 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:26.547467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:26.550174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:26.562118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:26.562738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:26.563968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:26.565508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:26.566674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:26.572196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:26.873647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:26.881962 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0da5dba-af3d-441f-aab6-027b52384921 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.339525 Oct 18 16:32:26.882555 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3116/6276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:26 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:27.412270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "name": "network-vif-plugged", "status": "completed", "tag": "93f2feb3-66d4-45fa-af5a-9824b09cd385"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:27.443407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:27.443978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:27.444323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:27.485086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] Creating event network-vif-plugged:93f2feb3-66d4-45fa-af5a-9824b09cd385 for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:27.498751 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-36da666e-5803-4e49-b45b-6140957f900f req-9b9bcc74-e4d7-4107-84fd-27c8c671458b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094535 Oct 18 16:32:27.499863 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3161/6277] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:27.910434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:27.911015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:27.924656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:27.925186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:27.925653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:27.926373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:27.938078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:27.938078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:27.977638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:28.311867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:28.336167 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed4bb230-0e7d-4988-a69f-0a9497847090 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.425602 Oct 18 16:32:28.338818 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3117/6278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:27 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:29.374919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:29.376862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:29.398989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:29.404432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:29.406984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:29.407900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:29.408376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:29.408812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:29.420940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=79 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:29.522276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "name": "network-vif-plugged", "status": "completed", "tag": "ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:29.568039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:29.570565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:29.571922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:29.628918 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] Creating event network-vif-plugged:ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:29.650367 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4600c162-e4d3-43c5-b0cb-717735352da5 req-7759e5e0-33f5-4f1c-891d-864a925a1b00 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119255 Oct 18 16:32:29.652406 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3118/6279] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:32:29.804731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:29.815475 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b07c2b1d-2403-4949-b405-f7151d41a8b6 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.450263 Oct 18 16:32:29.824532 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3162/6280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:29 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:30.854271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:30.855344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:30.868844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:30.872722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:30.874520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:30.876631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:30.881204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:30.882811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:30.885257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:31.730420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:31.741305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-403f6b7b-ad62-42f1-9253-4d2d5ebce166 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1333 microversion: 2.1 time: 0.892615 Oct 18 16:32:31.742704 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3119/6281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:30 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1333 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:32.768080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:32.768760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:32.795182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:32.795817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:32.796280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:32.799970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:32.803378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:32.804083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.141189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:33.152370 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8985183e-71fe-4416-970a-0e473f0b4eac tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1669 microversion: 2.1 time: 0.387384 Oct 18 16:32:33.154435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3163/6282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:32 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:33.182847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:33.183971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:33.191942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.192446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.193018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.194000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.194674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.195414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.232079 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84f03cec-7aa6-47c7-952e-8139ee7bc210 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803/ips" status: 200 len: 180 microversion: 2.1 time: 0.054266 Oct 18 16:32:33.240015 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3120/6283] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:33 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803/ips => generated 180 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:33.246254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:33.246885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:33.255169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.255732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.256103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.256820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.257311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.257949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.315341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:32:33.479713 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-859823c7-3ad0-4f3c-ad13-38c1a6ee7186 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 204 len: 0 microversion: 2.1 time: 0.235999 Oct 18 16:32:33.482172 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3164/6284] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:33 2022] DELETE /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:32:33.493504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:33.494131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:33.515031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.515543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.516129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.516856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:33.517500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:33.517942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:33.804329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:33.817802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee4f5a5e-306a-4302-91be-1ede6a0d6733 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1675 microversion: 2.1 time: 0.326566 Oct 18 16:32:33.819669 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3121/6285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:33 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:34.849448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:34.851361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:34.869620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:34.870819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:34.871512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:34.872457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:34.873054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:34.875754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:35.308096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:35.320203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99f9e822-4b9f-4b97-bdf3-269d8ebdd277 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1675 microversion: 2.1 time: 0.476065 Oct 18 16:32:35.323549 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3165/6286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:34 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1675 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:36.346600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:36.358846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:36.372761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:36.373529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:36.374187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:36.377077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:36.380213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:36.382529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:36.801313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "name": "network-vif-deleted", "tag": "ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:36.828518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:36.829259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:36.837463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:36.851733 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] Creating event network-vif-deleted:ad4e3348-b2ac-4c33-a5b6-6db1f10d1c9b for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:36.857144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-26ddb166-65e3-444b-94e7-2a027d31257d req-05366173-c469-4975-bc37-b2262ed4500a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060297 Oct 18 16:32:36.857992 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3166/6287] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:37.015803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:37.025897 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4ba4a12-92c2-4ca8-93b6-00164c999116 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1654 microversion: 2.1 time: 0.685927 Oct 18 16:32:37.031898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3122/6288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:36 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1654 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:38.061611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:38.070493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:38.073041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:38.074820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:38.075720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:38.076585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:38.077185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:38.077584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:38.153335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:38.153335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:38.153335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:38.153335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lazy-loading 'fault' on Instance uuid 2a86e204-df1a-40f3-97c2-e25c5d187803 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:32:38.220653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5f927857d54bba9371256669c262f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4329dc19129c4c4783c5934ff48b045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:38.231525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e8cf505-2c24-4dce-bd4e-3881c61b5600 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 200 len: 1302 microversion: 2.1 time: 0.175888 Oct 18 16:32:38.233347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3167/6289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:38 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:38.905856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a86e204-df1a-40f3-97c2-e25c5d187803", "name": "network-vif-deleted", "tag": "93f2feb3-66d4-45fa-af5a-9824b09cd385"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:38.916493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:38.917835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:38.918784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:38.933223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] Creating event network-vif-deleted:93f2feb3-66d4-45fa-af5a-9824b09cd385 for instance 2a86e204-df1a-40f3-97c2-e25c5d187803 on n-h2-858383-14 Oct 18 16:32:38.941546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1c15703e-0cb9-4f77-b62b-0fd4a3eddf9b req-11ad7088-7f2e-4504-903e-f4e148b1f3c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041131 Oct 18 16:32:38.949352 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3123/6290] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:39.260543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:39.263103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:39.269911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.275316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.276162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.276764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:39.277645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.278112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.278706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:39.305760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 HTTP/1.1 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2a86e204-df1a-40f3-97c2-e25c5d187803'} Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:39.307868 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:39.312784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15a0e9da-25ca-4228-8d32-10616681223f tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 404 len: 111 microversion: 2.1 time: 0.055534 Oct 18 16:32:39.313580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3168/6291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:39 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:43.059473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:43.060760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:43.095278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.095921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.096681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.099392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.100173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.101427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.141826 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 HTTP/1.1 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '2a86e204-df1a-40f3-97c2-e25c5d187803'} Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:43.146057 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.152113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:43.154378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de62b7fb-7854-4e66-a588-031de9a4a03d tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 404 len: 111 microversion: 2.1 time: 0.101222 Oct 18 16:32:43.156099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3124/6292] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:43 2022] DELETE /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:43.165328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:43.166040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 2a86e204-df1a-40f3-97c2-e25c5d187803] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:43.182433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.182768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.184373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.185501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.186227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.188292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.222083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 HTTP/1.1 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '2a86e204-df1a-40f3-97c2-e25c5d187803'} Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.227127 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 2a86e204-df1a-40f3-97c2-e25c5d187803 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d325a5d6-2102-4fa6-bbd0-2dde51b8d630 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803" status: 404 len: 111 microversion: 2.1 time: 0.069561 Oct 18 16:32:43.235435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3169/6293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:43 2022] GET /compute/v2.1/servers/2a86e204-df1a-40f3-97c2-e25c5d187803 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:43.242260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:43.242868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:43.251240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.254703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.255548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.257943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.262236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.262814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.285801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 HTTP/1.1 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '455e902d-2349-418e-ba25-9f4d7e44ae81'} Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:43.287450 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.291808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:43.293399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-893622e1-8969-4c50-9585-696c853e64b1 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "DELETE /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 404 len: 111 microversion: 2.1 time: 0.055583 Oct 18 16:32:43.294144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3125/6294] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:43 2022] DELETE /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:43.302364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:43.303263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] [instance: 455e902d-2349-418e-ba25-9f4d7e44ae81] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:43.310841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.311510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.312104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.312977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.313643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.314236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.333724 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] HTTP exception thrown: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Request method failure captured: Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 HTTP/1.1 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtSuAwT3126Glj3p7YK4oka8D8-VRUMQ2xptfNx5lwx4FwRJPY1EW0rzZMfTtIyIhjRHv5N7rJdXovJpvHBdDo1dIuk-qXCgudfWEitlMRUW9nB9uHnSNno_DccXJPsNIRP7-yNcP6ylWjXiTP0Oq-TztI-vzgK-Rk-xGUWqj8bZvCE Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4329dc19129c4c4783c5934ff48b045a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4329dc19129c4c4783c5934ff48b045a"}]}] Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 4329dc19129c4c4783c5934ff48b045a Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersTestMultiNic-967040684 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: ed5f927857d54bba9371256669c262f1 Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersTestMultiNic-967040684-project Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '455e902d-2349-418e-ba25-9f4d7e44ae81'} Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:32:43.335738 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. Oct 18 16:32:43.340065 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:32:43.342097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] Returning 404 to user: Instance 455e902d-2349-418e-ba25-9f4d7e44ae81 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:32:43.343018 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-603c7d0b-6f79-4977-a2aa-0a0800a086f4 tempest-ServersTestMultiNic-967040684 tempest-ServersTestMultiNic-967040684-project] 10.222.0.78 "GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81" status: 404 len: 111 microversion: 2.1 time: 0.044674 Oct 18 16:32:43.343952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3170/6295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:43 2022] GET /compute/v2.1/servers/455e902d-2349-418e-ba25-9f4d7e44ae81 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:46.213864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:46.218090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:46.239310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:46.244091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:46.245409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:46.251022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:46.256898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:46.258458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:46.396014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b935adca-f98e-4975-a92a-9b9f6bc697fb tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.186525 Oct 18 16:32:46.407719 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3126/6296] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:32:46 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788/os-server-password => generated 116 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:00.766040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:00.769525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:00.775703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-485e504f-563c-495b-83fc-c758bed85c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Action: 'create', calling method: .version_select at 0x7f5fd21965e0>, body: {"keypair": {"name": "tempest-keypair-1316054348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPG+r9g//+Vl/s/OGlTSJm0neRQewxH54LR5i4NBqu2+E66hX7y4ZT/rUhZfFJtlKWgo/0JaKMiDPl3mckKPuNghiY193drV9fgl0k+Wr8cxEfpOifYvb22rTYEHXDW8GA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:00.826528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-485e504f-563c-495b-83fc-c758bed85c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Getting quotas for project ba79606e524741829336d54b9d93ea63. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:34:00.840168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-485e504f-563c-495b-83fc-c758bed85c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Getting quotas for user 4064b8b6e24149d48f3ab0699e61c175 and project ba79606e524741829336d54b9d93ea63. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:34:00.911010 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-485e504f-563c-495b-83fc-c758bed85c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.139125 Oct 18 16:34:00.912387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3171/6297] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 18 16:34:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 16:34:05.748427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=15 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:05.749589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:05.751026 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:34:05.751185 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 18 16:34:05.752550 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:34:05.752706 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 18 16:34:05.759368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-299970355", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5c811aab-7102-4d55-9077-8248b6af1cc1"}, {"port": "be8a18ac-d17f-4ac7-8c53-a9022a908166", "tag": "port-1"}, {"port": "fdc3a467-8744-41ca-b7da-e5ab4fd3b181", "tag": "port-2"}, {"uuid": "6728759e-1d97-440e-a340-94021d906216", "tag": "net-1"}, {"uuid": "6728759e-1d97-440e-a340-94021d906216"}, {"uuid": "7dd3b558-f63e-4b08-9bcb-89ecdb7bcaf1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7dd3b558-f63e-4b08-9bcb-89ecdb7bcaf1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4635ae03-0a60-4445-b9d2-c5d0a962e7fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f6c07206-aa22-40bc-8d2b-a83cb5820ef2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "984deb75-fd42-4466-9958-eef1d7d1e85f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--423874198"}], "key_name": "tempest-keypair-1316054348", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:06.362172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] validate_networks() for [('5c811aab-7102-4d55-9077-8248b6af1cc1', None, None, None, None, None), (None, None, 'be8a18ac-d17f-4ac7-8c53-a9022a908166', None, None, None), (None, None, 'fdc3a467-8744-41ca-b7da-e5ab4fd3b181', None, None, None), ('6728759e-1d97-440e-a340-94021d906216', None, None, None, None, None), ('6728759e-1d97-440e-a340-94021d906216', None, None, None, None, None), ('7dd3b558-f63e-4b08-9bcb-89ecdb7bcaf1', '10.2.2.100', None, None, None, None), ('7dd3b558-f63e-4b08-9bcb-89ecdb7bcaf1', '10.2.2.200', None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:34:14.398225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:34:14.398853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:34:14.399117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:34:14.399532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:34:14.400034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:34:14.427172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:14.427691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:14.429322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:14.430137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:14.430559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:14.431005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:14.517316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Getting quotas for project ba79606e524741829336d54b9d93ea63. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:34:14.536281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Getting quotas for user 4064b8b6e24149d48f3ab0699e61c175 and project ba79606e524741829336d54b9d93ea63. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:34:14.886174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:34:14.891646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4635ae03-0a60-4445-b9d2-c5d0a962e7fd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f6c07206-aa22-40bc-8d2b-a83cb5820ef2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='984deb75-fd42-4466-9958-eef1d7d1e85f',volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:34:15.627445 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c66f2c8a-1df3-4863-b634-824c522272b3 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.880929 Oct 18 16:34:15.637147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3127/6298] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Oct 18 16:34:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 9892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 16:34:15.638205 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:34:15.639498 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:34:15.644618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:15.645270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:15.657166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:15.661415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:15.871447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:15.882698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:15.887472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:15.892738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-57dfeaf0-98d8-4029-8ff3-ef6e5ae318bc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1285 microversion: 2.32 time: 0.255591 Oct 18 16:34:15.896580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3172/6299] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:15 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:34:16.938091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:16.942878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:17.460231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:17.478908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:17.486119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:17.493592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d73922ed-dde1-4129-9586-6fd69670dfc9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1285 microversion: 2.32 time: 0.565971 Oct 18 16:34:17.499916 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3128/6300] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:16 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1285 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:18.528615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:18.530421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:18.550832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:18.551172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:18.557048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:18.558607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:18.559484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:18.560462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:18.616930 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57326. Oct 18 16:34:18.632515 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57324. Oct 18 16:34:19.050874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:19.072321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:19.075438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:19.079562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97e44f00-cf34-44d0-88e6-d859f38f5634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1519 microversion: 2.32 time: 0.555931 Oct 18 16:34:19.082277 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3173/6301] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:18 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:20.116921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:20.118630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:20.174063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:20.175137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:20.175893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:20.184461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:20.190983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:20.191836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:20.460700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:20.477850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:20.483446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:20.485348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5418c1e4-fb82-4162-be67-65ed4eda7231 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1593 microversion: 2.32 time: 0.376915 Oct 18 16:34:20.488541 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3129/6302] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:20 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1593 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:21.518294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:21.518918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:21.532034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:21.538571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:21.539437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:21.540506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:21.554812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:21.556087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:22.045455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:22.064598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:22.070928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:22.072401 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-977e5f27-29b9-435b-ae92-c822063c6e22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1660 microversion: 2.32 time: 0.559580 Oct 18 16:34:22.074189 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3174/6303] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:21 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1660 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:23.102055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:23.103672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:23.119490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:23.120801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:23.123040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:23.124668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:23.126768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:23.128685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:24.480782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:24.624979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:24.649276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:24.651195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:24.659407 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0bd87fa8-7aed-47a6-9a55-d7ad840c01cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1660 microversion: 2.32 time: 1.561262 Oct 18 16:34:24.661334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3130/6304] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:23 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1660 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:25.693652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:25.694281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:25.704051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:25.704457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:25.704906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:25.721587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:25.722050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:25.722500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:25.880945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:26.142538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:26.161500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:26.167454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:26.168669 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ea2324bb-c8c6-4a69-9ef1-9adad6fe0a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1706 microversion: 2.32 time: 0.480687 Oct 18 16:34:26.169261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3175/6305] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:25 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1706 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:27.200876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:27.201636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:27.215775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:27.216274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:27.216719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:27.224408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:27.224912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:27.229504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:27.465996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:28.078326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:28.098134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:28.105640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:28.106913 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13eebf0e-882a-44eb-889b-b8f2387c9513 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1706 microversion: 2.32 time: 0.913508 Oct 18 16:34:28.114560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3131/6306] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:27 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1706 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:29.146254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:29.146946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:29.160360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:29.161017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:29.161493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:29.165257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:29.175649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:29.176406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:30.265233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:30.281516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:30.283512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:30.295886 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a455cc19-a185-4fb4-b7fb-41787259ebca tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1752 microversion: 2.32 time: 1.153136 Oct 18 16:34:30.313613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3176/6307] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:29 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1752 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:31.336139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:31.336773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:31.359205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:31.362264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:31.362726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:31.363481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:31.372802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:31.373473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:31.952016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:31.968678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:31.971722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:31.979612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1e2983a-985e-4eaa-8378-32475704aa4d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1752 microversion: 2.32 time: 0.647666 Oct 18 16:34:31.984166 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3132/6308] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:31 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1752 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:33.011235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:33.011997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:33.024301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:33.036334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:33.038203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:33.041697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:33.048844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:33.050524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:33.826975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:33.850889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:33.855526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:33.864471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-463c2503-d00d-420c-99b2-fb2d82807adb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1798 microversion: 2.32 time: 0.854380 Oct 18 16:34:33.868208 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3177/6309] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:33 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1798 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:34.899250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:34.900698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:34.918499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:34.919009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:34.919459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:34.920711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:34.927921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:34.930767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:36.186909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:36.193489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=31 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:36.197405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:36.198925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:36.200107 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c86bc86-f0d8-4eff-bddb-ae5f6c0908b9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1798 microversion: 2.32 time: 1.304868 Oct 18 16:34:36.200686 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3133/6310] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:34 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1798 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:37.235700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:37.236954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:37.260107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:37.260779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:37.261417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:37.262299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:37.262931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:37.263515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:39.399987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:39.413057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:39.414626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:39.422890 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-beba593b-9625-4a58-a378-f2ad71403a6b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1844 microversion: 2.32 time: 2.190980 Oct 18 16:34:39.426662 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3178/6311] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:37 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1844 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:40.336376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "1e4d2380-1931-4aae-b124-703d9146b003"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:40.369951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:40.373159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:40.374662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:40.376514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:40.392246 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] Creating event network-changed:1e4d2380-1931-4aae-b124-703d9146b003 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:40.398758 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-430fc41f-6dca-442c-a76d-1ea24319c730 req-3112b052-81f5-4b8c-ac16-944c6d9bcea1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065971 Oct 18 16:34:40.399894 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3134/6312] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:40.469509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:40.473390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:40.512007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:40.514908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:40.517967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:40.519457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:40.522363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:40.523085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:41.326005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:41.339048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:41.343099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:41.352708 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f94ccd52-fbb5-42ce-9165-5b8dce1ac256 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1844 microversion: 2.32 time: 0.901523 Oct 18 16:34:41.354121 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3179/6313] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:40 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1844 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:42.384682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:42.385440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:42.397723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.399136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.399136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.399494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.399996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.400388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.942431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:42.970563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:42.978494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:42.985608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4ad41fc2-b66e-4bf2-8fea-e343c82abbfb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1865 microversion: 2.32 time: 0.605026 Oct 18 16:34:42.986773 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3135/6314] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:42 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1865 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:43.075768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "be8a18ac-d17f-4ac7-8c53-a9022a908166"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:43.126786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:43.129382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:43.131333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:43.162076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] Creating event network-changed:be8a18ac-d17f-4ac7-8c53-a9022a908166 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:43.170252 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9c97fce2-4b78-4ebe-b39b-bd133679ebd3 req-7c73ee0d-0f67-44fc-adc7-a3fcf334ef54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100508 Oct 18 16:34:43.173136 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3180/6315] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:44.018937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:44.019941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:44.073277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:44.074054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:44.074749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:44.093335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:44.094253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:44.094955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:45.249170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:45.259515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:45.269175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:45.270912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e5a3922-d4b5-4325-9626-8abfeeaa2da7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1865 microversion: 2.32 time: 1.258954 Oct 18 16:34:45.286604 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3136/6316] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:44 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1865 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:46.305247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:46.306114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:46.319630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=21 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:46.345769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:46.349494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:46.350228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:46.353323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:46.355861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:46.356517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:46.437166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=45 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:47.658674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "fdc3a467-8744-41ca-b7da-e5ab4fd3b181"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:47.690062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:47.690764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:47.695080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:47.733259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] Creating event network-changed:fdc3a467-8744-41ca-b7da-e5ab4fd3b181 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:47.750046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-50ae9361-3ba6-48e4-9097-9d53d6ebdfae req-a53662c5-3a5b-4ea0-8f13-9165b9f52b73 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095974 Oct 18 16:34:47.761399 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3137/6317] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:47.842157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:47.882290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:47.884003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:47.885299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e23a150a-7b26-48c9-b430-81dcb563020c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1886 microversion: 2.32 time: 1.587665 Oct 18 16:34:47.910291 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3181/6318] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:46 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1886 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:48.955160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:48.955837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:48.971030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:48.971535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:48.972256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:48.972987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:48.973509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:48.973943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:50.237867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:50.273216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:50.277735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:50.280411 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b9715f0d-8489-4ce4-ba7a-26d5f2aad40e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1886 microversion: 2.32 time: 1.356828 Oct 18 16:34:50.308265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3138/6319] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:48 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1886 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:51.317928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:51.325792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:51.360265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:51.361124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:51.361867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:51.363071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:51.363853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:51.385530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:52.272458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:52.310021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:52.311880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:52.313135 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50af73c6-3b53-43d8-908b-9e63013b91a6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1886 microversion: 2.32 time: 1.003121 Oct 18 16:34:52.342005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3182/6320] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:51 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1886 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:53.218021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "8c25692c-948c-423f-b129-98197b0992af"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:53.237957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:53.238447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:53.239165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:53.274161 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] Creating event network-changed:8c25692c-948c-423f-b129-98197b0992af for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:53.291875 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ab5372c2-99b8-4d86-9b65-7dde8229f341 req-f4ef438a-5cb1-45ab-8fbd-990ab3b9b87f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070722 Oct 18 16:34:53.293521 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3139/6321] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:53.358862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:53.359784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:53.383506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:53.384091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:53.384549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:53.387339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:53.388091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:53.388659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:54.204208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:54.238665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:54.240132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:54.241353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc5c469e-2da2-4e8f-8f03-dfe6c88ad0b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1886 microversion: 2.32 time: 0.888014 Oct 18 16:34:54.257275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3183/6322] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:53 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1886 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:55.283696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:55.284437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:55.292206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:55.293276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:55.293991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:55.305383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:55.308393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:55.308908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:56.113766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:56.149090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:56.152425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:56.165374 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-736585cb-c07a-4a9c-aacc-f39e20bb9137 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.875467 Oct 18 16:34:56.170690 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3140/6323] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:55 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:56.293351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "f6c5052f-e953-46d0-b4f3-025bc429f948"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:56.314691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:56.315636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:56.316694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:56.337792 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] Creating event network-changed:f6c5052f-e953-46d0-b4f3-025bc429f948 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:56.347361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4dfa6b0d-b636-4b6b-8caf-c330a3f4ed84 req-2d7b8cfe-43a6-44b0-a10f-ad139dc45579 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061313 Oct 18 16:34:56.348845 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3184/6324] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:57.210996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:57.215222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:57.235812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:57.236330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:57.236781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:57.238011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:57.238485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:57.238920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:57.928277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:57.948605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:57.958487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:57.961249 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ca1faf9-1942-4e3d-a5a3-200da928c40a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.763820 Oct 18 16:34:57.978339 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3141/6325] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:57 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:58.995317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:58.996682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:59.004953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:59.009738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:59.010224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:59.010992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:59.014939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:59.017119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:59.311414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:59.335998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:59.343438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:59.346904 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7243b2d-f0f0-4618-b535-7fbbc107f0f8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.355913 Oct 18 16:34:59.355511 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3185/6326] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:34:58 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:34:59.379543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "b2d79cb6-1507-43e2-87c8-837dcedb4c0c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:59.398660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:59.398660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:59.399203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:59.415735 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] Creating event network-changed:b2d79cb6-1507-43e2-87c8-837dcedb4c0c for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:34:59.422937 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9a128436-c70b-4752-b9cf-df63f6ebc0cf req-23c1108c-8b90-4c96-93b5-00d5293e94cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048393 Oct 18 16:34:59.424249 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3142/6327] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:00.382586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:00.384007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:00.421847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:00.422615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:00.423262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:00.424197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:00.425939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:00.437430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:00.891219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:00.924900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:00.926568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:00.932652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-78db5b4a-e324-481c-aef7-e283949e1711 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.557191 Oct 18 16:35:00.945526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3186/6328] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:00 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:01.965060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:01.965767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:01.983314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:01.983842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:01.984560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:01.985333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:01.989898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:01.990664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:02.322268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "94028fa1-3091-41da-89d8-65553aa4e2fb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:02.338652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:02.339473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:02.340664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:02.359954 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] Creating event network-changed:94028fa1-3091-41da-89d8-65553aa4e2fb for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:02.367641 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-806cc895-9f38-46e5-bd2c-01dc76a32559 req-7ddf1f1a-8260-41af-a8d0-7d7e30b03301 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049742 Oct 18 16:35:02.369075 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3187/6329] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:35:02.709083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:02.752492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:02.771191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:02.782384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-093a7c41-e4f6-4e46-b72e-12ab4a9747e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.817509 Oct 18 16:35:02.791702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3143/6330] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:01 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:03.819382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:03.820497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:03.833680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Calling method '.version_select at 0x7f5fd2020040>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:03.836984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.837540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.837920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.838538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.839011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.840288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.848476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.849414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.851182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.874512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.874827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.878958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.910440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.911276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.911932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.927572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d63ed5ad-484b-4640-ab88-7cea04ae95b8 tempest-PortsAdminExtendedAttrsTestJSON-122449015 tempest-PortsAdminExtendedAttrsTestJSON-122449015-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.775400 Oct 18 16:35:03.937971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3188/6331] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:35:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:04.662948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:04.692300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:04.697156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:04.698615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eafcc365-1f9f-4d85-b56c-4e7766a16950 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.883808 Oct 18 16:35:04.709042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3144/6332] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:03 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:35:05.747618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:05.749195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:05.759938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:05.760941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:05.762509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:05.764768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:05.765560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:05.767566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:06.395399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:06.406391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:06.414483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:06.419945 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a64c21e1-57e7-4f26-8be0-449af79c2f2b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.675692 Oct 18 16:35:06.421116 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3189/6333] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:05 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:07.451958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:07.453383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:07.477680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:07.485721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:07.486319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:07.487265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:07.487835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:07.488475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:08.616637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:08.629872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:08.631514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:08.633276 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd70c37a-6202-45bb-8097-961ede43fbfe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.189123 Oct 18 16:35:08.634378 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3145/6334] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:07 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:09.667260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:09.668487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:09.691130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:09.692511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:09.695129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:09.697749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:09.698815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:09.699772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:10.278728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:10.310247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:10.312587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:10.316652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d7fef91-fd49-4ec1-8031-37bd5130781e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.655994 Oct 18 16:35:10.321124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3190/6335] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:09 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:11.352169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:11.353479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:11.357292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=24 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:11.376353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:11.376949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:11.377352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:11.378093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:11.378555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:11.378982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:11.393231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=58 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:12.505488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:12.527157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:12.534174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:12.537165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b53592b1-b3c9-4b30-8a5b-69a6f7359225 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.187713 Oct 18 16:35:12.538940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3146/6336] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:11 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:13.568724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:13.569351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:13.596807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:13.597351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:13.597793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:13.601865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:13.602158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:13.602628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:14.507017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:14.527310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:14.547437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:14.549142 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3754a6f7-1bf6-40a1-ac22-52a0bbc7d2cc tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.984284 Oct 18 16:35:14.558651 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3191/6337] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:13 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:15.579739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:15.581054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:15.606033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:15.607992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:15.611580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:15.613281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:15.614041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:15.616060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:16.535682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:16.558646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:16.563959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:16.589057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e74d6bf-7851-4637-816f-0f5b17023722 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.012098 Oct 18 16:35:16.598047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3147/6338] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:15 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:17.628287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:17.629299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:17.648975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=24 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:17.655593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.663224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.664356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.665750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.666685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.667569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.688170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=58 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:18.735513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:18.751467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:18.754702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:18.757488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9c93314b-2dc3-47cf-abec-b219f15b01b6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.136419 Oct 18 16:35:18.759814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3192/6339] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:17 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:19.783811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:19.784435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:19.796275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:19.796768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:19.797276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:19.817448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:19.818076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:19.818533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:20.419177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:20.429796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:20.431298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:20.433324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe1a5ab6-b665-421e-8f05-b6b1e813afc5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.653347 Oct 18 16:35:20.434915 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3148/6340] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:19 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:21.468401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:21.469873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:21.483269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:21.485349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:21.486401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:21.488626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:21.489516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:21.490298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:22.498168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:22.509780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:22.511216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:22.513076 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-38d008bc-ae49-4293-9320-0053c424881b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.052562 Oct 18 16:35:22.514253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3193/6341] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:21 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:35:23.538727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:23.539342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:23.554374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:23.554870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:23.555304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:23.555996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:23.556456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:23.556874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:24.215985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:24.236722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:24.241318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:24.247943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10a9cbfc-e288-41fd-a016-0484231a0d73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.710704 Oct 18 16:35:24.251483 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3149/6342] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:23 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:25.278582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:25.279930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:25.291002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:25.291746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:25.292519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:25.294752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:25.296381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:25.299110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:25.919432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:25.958714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:25.970462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:25.978006 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bdfe2006-7d0b-4110-b2b3-7e4c78c90a3c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.704716 Oct 18 16:35:25.980062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3194/6343] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:25 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:27.013634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:27.014274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:27.030823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:27.037265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:27.038428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:27.041814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:27.043032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:27.044414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:28.134192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:28.154323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:28.159904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:28.166050 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02b057e3-82b6-4704-8c1d-fd07b4e1dcf5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.161674 Oct 18 16:35:28.171010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3150/6344] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:27 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:29.203522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:29.204816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:29.220323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:29.221064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:29.229319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:29.229798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:29.230291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:29.231345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:30.019411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:30.041759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:30.046955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:30.048653 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd7f2b21-bfe6-4e79-9d1d-63bea0163d68 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.851643 Oct 18 16:35:30.053090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3195/6345] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:29 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:31.080480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:31.081256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:31.101113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:31.101734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:31.102264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:31.103093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:31.109698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:31.110511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:31.697522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:31.717075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:31.725227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:31.726632 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83bd3260-3572-4ec2-9b0e-d6f2cea68281 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.652161 Oct 18 16:35:31.728126 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3151/6346] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:31 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:32.753342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:32.753974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:32.765825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:32.767314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:32.768955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:32.771059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:32.774265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:32.774726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:33.805606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:33.838832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:33.841172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:33.842416 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa2156dc-3504-472d-af86-1e26b4406501 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.094212 Oct 18 16:35:33.847467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3196/6347] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:32 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:34.880915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:34.881649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:34.895930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:34.896504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:34.896852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:34.897595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:34.898061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:34.898492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:36.038245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:36.060144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:36.063233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:36.065088 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ed42c6b-3b19-44ac-9a41-7c124b1a6f5c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.188612 Oct 18 16:35:36.066514 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3152/6348] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:34 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:37.091488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:37.092117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:37.120931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:37.122517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:37.123617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:37.133245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:37.134459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:37.135280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:37.588282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:37.613819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:37.620016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:37.627160 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0af22c54-206c-415c-8d6b-7d7bcec89eda tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.537101 Oct 18 16:35:37.629675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3197/6349] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:37 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:38.656641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.658236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.676981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.680345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.681488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.695035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.697628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.698428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:39.070816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:39.082045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:39.084072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:39.085449 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-702e05cc-15de-403e-adad-8bbac1db1548 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.434011 Oct 18 16:35:39.087004 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3153/6350] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:38 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:35:40.117132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:40.118462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:40.141244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:40.142273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:40.143338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:40.145345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:40.149997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:40.150814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:40.804083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:40.827994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:40.833328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:40.835439 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-42b1b93e-e6de-4c68-840b-35558495d5ae tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.722095 Oct 18 16:35:40.840122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3198/6351] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:40 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:41.797167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "fdc3a467-8744-41ca-b7da-e5ab4fd3b181"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:41.805541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=16 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:41.828911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.828911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.828911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.859075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=48 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:41.869411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:41.870238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:41.883363 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] Creating event network-vif-plugged:fdc3a467-8744-41ca-b7da-e5ab4fd3b181 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:41.889139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.892214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.896184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.898206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.906831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.907114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.912350 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-98e22698-2fcf-4a4c-ae14-3380978d0a78 req-b2a9749f-f2e0-4570-97fe-d100636114c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.722979 Oct 18 16:35:41.915970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3154/6352] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:43.373259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:43.401614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:43.406533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:43.412629 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ae0a63f-b34b-44f3-a638-a30fdff384d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.544632 Oct 18 16:35:43.425544 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3199/6353] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:41 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:44.460069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:44.460796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:44.480719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:44.481374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:44.481828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:44.482776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:44.483426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:44.484032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:44.893314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "be8a18ac-d17f-4ac7-8c53-a9022a908166"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:44.911826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:44.912429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:44.913814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:44.943356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] Creating event network-vif-plugged:be8a18ac-d17f-4ac7-8c53-a9022a908166 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:44.959314 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-03f1fbd3-d1db-448e-bb57-36d43261de3e req-29c61a34-43a1-4ad6-949e-d58f9f61c1ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084373 Oct 18 16:35:44.965021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3200/6354] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 16:35:45.901019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:45.935925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:45.938092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:45.939564 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87b05d43-a44b-4029-81d5-b0d8d4364615 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.484429 Oct 18 16:35:45.940587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3155/6355] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:44 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:46.972620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:46.973373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:46.989558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.990772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.991633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:46.992838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.993612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.994313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:47.055204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "8c25692c-948c-423f-b129-98197b0992af"}, {"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "b2d79cb6-1507-43e2-87c8-837dcedb4c0c"}, {"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "1e4d2380-1931-4aae-b124-703d9146b003"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:47.082021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:47.082516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:47.082955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:47.124343 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Creating event network-vif-plugged:8c25692c-948c-423f-b129-98197b0992af for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:47.124869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Creating event network-vif-plugged:b2d79cb6-1507-43e2-87c8-837dcedb4c0c for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:47.125634 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] Creating event network-vif-plugged:1e4d2380-1931-4aae-b124-703d9146b003 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:47.141540 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5e380330-636b-4921-b843-04e09f7a48ea req-e5b95910-69e8-4bec-b4bb-c95412493fff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090440 Oct 18 16:35:47.142639 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3156/6356] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:35:47.887274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:47.893027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=54 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:47.913129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:47.923006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:47.925750 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7dd48e4-eae8-43b9-a0bb-8feba20aac73 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.957808 Oct 18 16:35:47.928851 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3201/6357] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:46 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:48.959433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:48.960185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:48.968231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:48.968713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:48.969246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:48.970137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:48.970667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:48.971159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:49.256298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "f6c5052f-e953-46d0-b4f3-025bc429f948"}, {"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-plugged", "status": "completed", "tag": "94028fa1-3091-41da-89d8-65553aa4e2fb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:49.273929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=20 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:49.275859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:49.276342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:49.282437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:49.315811 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Creating event network-vif-plugged:f6c5052f-e953-46d0-b4f3-025bc429f948 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:49.316321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] Creating event network-vif-plugged:94028fa1-3091-41da-89d8-65553aa4e2fb for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:49.334821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e4d6db2a-0206-42a0-8bf0-403a9faab121 req-5efed7e8-7a26-4df7-a5b8-cae3f4d665bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080478 Oct 18 16:35:49.335928 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3202/6358] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:49.818070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:49.829325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:49.832455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:49.833985 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1685cc39-a8d8-4f74-8dbc-71a7d5920fa5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 0.880609 Oct 18 16:35:49.851200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3157/6359] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:48 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:50.869826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.870463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.911409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.918206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.920987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.929090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.930114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.931650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:51.884854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:51.899271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:51.915919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:51.921854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92578ac4-1fdf-4264-b8ef-f6fb32a28b06 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1874 microversion: 2.32 time: 1.057748 Oct 18 16:35:51.923305 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3203/6360] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:50 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1874 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:52.963257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:52.965133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:52.987395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:52.988036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:52.988369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:52.989864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:52.990614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:52.991219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:54.300780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:54.331135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:54.335070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:54.340254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08ca42bf-5e4c-48e1-ab19-6e80ea804ceb tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2826 microversion: 2.32 time: 1.384502 Oct 18 16:35:54.341930 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3158/6361] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:35:52 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2826 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:54.381227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:54.381855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:54.397102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:54.397889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:54.399322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:54.400339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:54.412384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:54.440130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:54.737073 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc0b5c38-3337-4ec3-becd-76308054e1fe tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.367556 Oct 18 16:35:54.737694 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3204/6362] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:35:54 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7/os-interface => generated 1829 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:35:57.411705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "tag": "1e4d2380-1931-4aae-b124-703d9146b003"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:57.443597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:57.444095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:57.445202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:57.491592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] Creating event network-changed:1e4d2380-1931-4aae-b124-703d9146b003 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:35:57.508629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5bef9d8c-8161-4793-95a9-c09dd469c111 req-ed1df172-d60a-4b24-8a8f-a3c5d9d16f99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098929 Oct 18 16:35:57.511763 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3159/6363] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:36:39.537680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=5 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:39.538965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=13 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:39.551991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:39.553355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:39.577439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:39.579517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:39.583564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:39.584615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:39.585537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:39.586171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:40.314650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:40.339364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:40.349042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:40.350930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6696509a-18c9-4aea-a131-54a14c9a58f7 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2944 microversion: 2.32 time: 0.815877 Oct 18 16:36:40.354532 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3205/6364] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:36:39 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2944 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:36:40.382270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:40.383522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:40.387704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=11 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:40.402723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=23 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:40.410464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:40.411315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:40.412021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:40.412972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:40.413842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:40.414509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:40.627511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-373e7964-1f0b-4702-891c-fc509a0312da tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.249479 Oct 18 16:36:40.630088 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3160/6365] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Oct 18 16:36:40 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7/os-interface => generated 1829 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:36:49.718720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:50.084701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:50.085511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:50.092835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:50.093730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:50.094433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:50.095393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:50.096088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:50.096735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:50.174443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:36:50.351372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-732438b9-b53d-4015-a7b4-f818a61c9b3b tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 204 len: 0 microversion: 2.1 time: 0.638793 Oct 18 16:36:50.353679 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3206/6366] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:36:49 2022] DELETE /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:36:50.412523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:50.413170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:50.423936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:50.452334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:50.452628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:50.453092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:50.454020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:50.454834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:50.455417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:50.927610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:50.936867 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d78812e2-1d8a-4c7c-85d8-f77d3cda89db tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1732 microversion: 2.1 time: 0.578744 Oct 18 16:36:50.943477 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3161/6367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:50 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1732 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:51.969063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:51.969922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:51.992258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:51.998418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:51.999254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:52.000558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:52.001076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:52.001506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:52.527316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:52.536055 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0014e300-2fa9-4c69-b7b9-46a5496ea9dc tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1732 microversion: 2.1 time: 0.572254 Oct 18 16:36:52.556497 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3207/6368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:51 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1732 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:53.565969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:53.566967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:53.585951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:53.590224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:53.590923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:53.592639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:53.595098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:53.595655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:53.826126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:53.838015 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97aefb82-453a-49ef-8b01-806f59e40b24 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1664 microversion: 2.1 time: 0.278587 Oct 18 16:36:53.853030 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3162/6369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:53 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1664 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:54.869620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:54.870964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:54.905488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:54.907493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:54.910217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:54.911145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:54.915297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:54.916171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:55.114370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd8db4-7bd1-40cf-85a8-1be980374788", "name": "network-vif-deleted", "tag": "75e6c11a-3466-4a53-8a7b-fdc0235229d2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:55.167424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:55.167916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:55.168356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:55.221561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] Creating event network-vif-deleted:75e6c11a-3466-4a53-8a7b-fdc0235229d2 for instance 24bd8db4-7bd1-40cf-85a8-1be980374788 on n-h1-858383-14 Oct 18 16:36:55.247376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7cca51cb-2508-4ee4-ac8e-e7b1af2612d6 req-aac61210-7206-4eee-98c3-338c7288fb8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376713 Oct 18 16:36:55.250494 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3163/6370] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:36:55.845460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85ef590207844cc5b5ecb86cc00fc862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e2aefcbe4a37a390a41917a828d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:55.858079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dd3bbd8-84b5-4e4c-add4-d9625ef7281f tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 200 len: 1383 microversion: 2.1 time: 0.992486 Oct 18 16:36:55.866887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3208/6371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:54 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 1383 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:56.897746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:56.900494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:56.919157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:56.919648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:56.924475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:56.926209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:56.929855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:56.931323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:56.979464 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] HTTP exception thrown: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Request method failure captured: Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 HTTP/1.1 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSub46-KD5OaH1_amwledKvwXMky6nOvw1P6IOWV__zvBn3AyDwsAwtATdnVoqEZfYZexbluVrU8ADvGdd1QStpe8JdNJPt-RsjVaEErbKvGvKgwFzzLjrMR_yb2LlXea4udLrCerc3LH8CdTvClNzWXgkqMvzDZnuAzjuaC8JC2iM Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}] Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 85ef590207844cc5b5ecb86cc00fc862 Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '24bd8db4-7bd1-40cf-85a8-1be980374788'} Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:56.994956 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:57.000545 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:57.002262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Returning 404 to user: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:57.003837 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01702fbf-474c-4772-9b4b-951ba3855ac0 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 404 len: 111 microversion: 2.1 time: 0.111711 Oct 18 16:36:57.008287 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3164/6372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:56 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:58.849834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:58.850450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:58.868717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:58.869079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:58.869356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:58.870087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:58.870553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:58.870991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:58.905277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] HTTP exception thrown: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Request method failure captured: Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 HTTP/1.1 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtSub46-KD5OaH1_amwledKvwXMky6nOvw1P6IOWV__zvBn3AyDwsAwtATdnVoqEZfYZexbluVrU8ADvGdd1QStpe8JdNJPt-RsjVaEErbKvGvKgwFzzLjrMR_yb2LlXea4udLrCerc3LH8CdTvClNzWXgkqMvzDZnuAzjuaC8JC2iM Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}] Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 85ef590207844cc5b5ecb86cc00fc862 Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '24bd8db4-7bd1-40cf-85a8-1be980374788'} Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:58.906993 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.911607 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.914101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Returning 404 to user: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:58.915762 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a436f47d-b869-473c-8846-9c2d9eeee7a4 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 404 len: 111 microversion: 2.1 time: 0.069970 Oct 18 16:36:58.920746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3209/6373] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:36:58 2022] DELETE /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:58.925171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:58.926561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [instance: 24bd8db4-7bd1-40cf-85a8-1be980374788] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:58.943314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:58.944256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:58.944962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:58.946071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:58.946814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:58.951362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:58.985337 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] HTTP exception thrown: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Request method failure captured: Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 HTTP/1.1 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtSub46-KD5OaH1_amwledKvwXMky6nOvw1P6IOWV__zvBn3AyDwsAwtATdnVoqEZfYZexbluVrU8ADvGdd1QStpe8JdNJPt-RsjVaEErbKvGvKgwFzzLjrMR_yb2LlXea4udLrCerc3LH8CdTvClNzWXgkqMvzDZnuAzjuaC8JC2iM Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9d36e2aefcbe4a37a390a41917a828d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d36e2aefcbe4a37a390a41917a828d4"}]}] Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9d36e2aefcbe4a37a390a41917a828d4 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestServerBasicOps-1248314188 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 85ef590207844cc5b5ecb86cc00fc862 Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestServerBasicOps-1248314188-project Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '24bd8db4-7bd1-40cf-85a8-1be980374788'} Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:58.986926 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. Oct 18 16:36:58.992791 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:36:58.994286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Returning 404 to user: Instance 24bd8db4-7bd1-40cf-85a8-1be980374788 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:58.995185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-263d1848-b9e7-41d2-b8fb-3645f2ed35a8 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788" status: 404 len: 111 microversion: 2.1 time: 0.074203 Oct 18 16:36:58.995780 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3165/6374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:58 2022] GET /compute/v2.1/servers/24bd8db4-7bd1-40cf-85a8-1be980374788 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:59.682067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1d4eba4-2f7c-48e6-99eb-daca44268130 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] Calling method '.version_select at 0x7f5fd19ab9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:59.691803 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1d4eba4-2f7c-48e6-99eb-daca44268130 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:37:00.703427 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1d4eba4-2f7c-48e6-99eb-daca44268130 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33512. Oct 18 16:37:00.747618 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1d4eba4-2f7c-48e6-99eb-daca44268130 tempest-TestServerBasicOps-1248314188 tempest-TestServerBasicOps-1248314188-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-689368010" status: 202 len: 0 microversion: 2.1 time: 1.070175 Oct 18 16:37:00.752174 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3210/6375] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-689368010 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:38:44.743279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:44.744557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=22 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:44.745693 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:38:44.746073 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 (ip 10.222.0.78) !!! Oct 18 16:38:44.748890 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:38:44.749176 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 (ip 10.222.0.78) !!! Oct 18 16:38:45.272353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:45.272866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:45.283465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:45.283965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:45.284445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:45.285181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:45.291168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:45.292505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:45.359755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:38:45.573476 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78d52e90-a22d-4e1f-8206-4a876bd2fb42 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 204 len: 0 microversion: 2.32 time: 0.836409 Oct 18 16:38:45.578298 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3166/6376] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:38:44 2022] DELETE /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:38:45.583623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:45.585136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:45.586571 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:38:45.587175 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 (ip 10.222.0.78) !!! Oct 18 16:38:45.597044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:45.598085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:45.617676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:45.618608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:45.619391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:45.620565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:45.621242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:45.621903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:46.299746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:46.310074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:46.312218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:46.313806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb816088-e3fb-4659-bc16-67290f13f66c tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2950 microversion: 2.32 time: 0.734129 Oct 18 16:38:46.324316 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3211/6377] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:45 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2950 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:47.350994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:47.352447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:47.371978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:47.372625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:47.374189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:47.375056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:47.377723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:47.378277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:47.841285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:47.895298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:47.908082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:47.911888 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12a85f83-8910-4299-8104-d85cf5fcbcad tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2950 microversion: 2.32 time: 0.567448 Oct 18 16:38:47.912874 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3167/6378] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:47 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2950 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:48.943161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:48.950543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:48.979913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:48.980784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:48.981668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:48.982852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:48.984014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:48.984712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:49.538428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:49.555313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:49.567465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:49.568807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83be0953-771b-482d-9987-a304dbe681d6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2950 microversion: 2.32 time: 0.630633 Oct 18 16:38:49.580054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3212/6379] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:48 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2950 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:50.612700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:50.614454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:50.628318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.630671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.632240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:50.635113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.636365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.637639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:51.234086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:51.266545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:51.271047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:51.273937 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43d1b59a-b4e7-4b1c-b276-4e6d34344fd6 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2929 microversion: 2.32 time: 0.666688 Oct 18 16:38:51.279032 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3168/6380] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:50 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2929 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:52.309287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:52.310741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:52.332227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:52.335538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:52.336035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:52.340559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:52.342886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:52.343359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:53.035162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:53.047623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:53.059673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:53.061408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01fc6a5d-3b76-446d-a63d-39eb56487d22 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2908 microversion: 2.32 time: 0.756843 Oct 18 16:38:53.066699 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3213/6381] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:52 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2908 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:54.104676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:54.105423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:54.130930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:54.138232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:54.142234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:54.147012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:54.147012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:54.147012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:54.856270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "1e4d2380-1931-4aae-b124-703d9146b003"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:54.901375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:54.901867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:54.917572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:54.965488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] Creating event network-vif-unplugged:1e4d2380-1931-4aae-b124-703d9146b003 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:38:54.986048 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b50ecfe6-72b4-40b2-b704-b3bafad350bf req-f5185a50-ebed-47c7-83c0-cb99797aed8b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134555 Oct 18 16:38:54.987237 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3214/6382] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:38:55.649676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:55.667028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:55.668887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:55.670720 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c33088d-1e3c-464a-b24c-019af6dc8c30 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2862 microversion: 2.32 time: 1.573477 Oct 18 16:38:55.671776 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3169/6383] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:54 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2862 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:56.125221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-deleted", "tag": "8c25692c-948c-423f-b129-98197b0992af"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:56.169182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:56.172663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:56.174600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:56.234000 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] Creating event network-vif-deleted:8c25692c-948c-423f-b129-98197b0992af for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:38:56.247321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ac214550-363d-4668-b1a9-5f4ed3aac3fd req-f326e99f-353e-4501-b1a1-eb385453d4e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.720507 Oct 18 16:38:56.248824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3215/6384] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:56.706193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:56.707561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:56.727040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:56.728465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:56.731358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:56.732314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:56.736436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:56.737441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:57.384299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c5052f-e953-46d0-b4f3-025bc429f948"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:57.404721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:57.405449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:57.407592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:57.432119 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] Creating event network-vif-unplugged:f6c5052f-e953-46d0-b4f3-025bc429f948 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:38:57.452338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a3c862c6-698b-45a7-bb1f-b1f435ba35c1 req-c0989a2a-9d23-4630-9636-a22caaa4ceec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071760 Oct 18 16:38:57.456953 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3216/6385] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:38:57.928139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:57.948403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:57.950800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:57.953326 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9b69f16-1cd7-475c-86c2-35335cb5f5b5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2749 microversion: 2.32 time: 1.250951 Oct 18 16:38:57.954464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3170/6386] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:56 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2749 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:38:58.931056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-deleted", "tag": "1e4d2380-1931-4aae-b124-703d9146b003"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:58.960102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:58.973906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:58.974734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:58.999240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:59.003779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:59.058427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.059132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.059593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.060347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.073499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.074034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.079279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] Creating event network-vif-deleted:1e4d2380-1931-4aae-b124-703d9146b003 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:38:59.096161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-fe7ab2de-95a2-47e3-84ad-30a12e9675cd req-785c3c52-856a-4630-91d8-31da6d67114a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170675 Oct 18 16:38:59.096776 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3217/6387] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:59.591464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "b2d79cb6-1507-43e2-87c8-837dcedb4c0c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:59.611430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.620968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.621455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.654104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] Creating event network-vif-unplugged:b2d79cb6-1507-43e2-87c8-837dcedb4c0c for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:38:59.673894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0c6708cc-e730-4735-a644-92fb145e4eb6 req-eac49ca6-bb99-4c27-ace5-b9b3c8f460f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083578 Oct 18 16:38:59.675229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3218/6388] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:39:00.443344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:00.484131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:00.493706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:00.495100 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-330a09a1-ccf8-4605-8636-1364067c014e tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2703 microversion: 2.32 time: 1.515171 Oct 18 16:39:00.497680 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3171/6389] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:38:58 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2703 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:01.537172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:01.542207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:01.567415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.567930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.568379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.569198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.579996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.580449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.956853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-deleted", "tag": "f6c5052f-e953-46d0-b4f3-025bc429f948"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:01.997882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.998634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.999231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:02.040279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] Creating event network-vif-deleted:f6c5052f-e953-46d0-b4f3-025bc429f948 for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:39:02.067132 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2fd3ce65-0580-4a9a-960c-c10a32b97d5b req-c674f3e4-ac69-4128-8fc3-8eabb5ed3da7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110391 Oct 18 16:39:02.069879 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3172/6390] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:39:02.076114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "94028fa1-3091-41da-89d8-65553aa4e2fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:02.110970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:02.111723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:02.112317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:02.153597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] Creating event network-vif-unplugged:94028fa1-3091-41da-89d8-65553aa4e2fb for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:39:02.162883 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2ee29445-997a-4c97-91d9-b331f75fb06f req-447a076e-34a4-44ef-b24c-7902c7760921 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089437 Oct 18 16:39:02.163759 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3173/6391] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:39:02.219696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:02.236958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:02.238946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:02.244857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5038de2d-9117-40fb-b730-691a103fd6b2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2371 microversion: 2.32 time: 0.718271 Oct 18 16:39:02.245739 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3219/6392] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:01 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2371 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:03.280011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:03.280731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:03.311035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:03.314913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:03.319160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:03.326767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:03.327519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:03.328136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:04.192533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:04.202654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:04.228375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:04.229971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-491cc71c-c061-4194-bd1b-bb927ff31a37 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2258 microversion: 2.32 time: 0.955593 Oct 18 16:39:04.253659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3174/6393] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:03 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2258 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:04.334906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-deleted", "tag": "b2d79cb6-1507-43e2-87c8-837dcedb4c0c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:04.354949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:04.355433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:04.355870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:04.411579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] Creating event network-vif-deleted:b2d79cb6-1507-43e2-87c8-837dcedb4c0c for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:39:04.432049 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-eb0d1934-7e5f-4c6c-a5ab-a920bc9c8c4e req-0dadfbeb-70f8-49c5-ad43-e86d8ea0315d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097866 Oct 18 16:39:04.432923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3220/6394] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:39:05.274409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:05.275079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:05.288518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:05.292981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:05.293541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:05.294429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:05.297120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:05.299172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:06.280130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:06.309507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:06.317125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:06.319934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3c915d7-c960-4b84-9e84-3462c563c10b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 2098 microversion: 2.32 time: 1.054580 Oct 18 16:39:06.324829 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3175/6395] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:05 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 2098 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:06.461581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7", "name": "network-vif-deleted", "tag": "94028fa1-3091-41da-89d8-65553aa4e2fb"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:06.494214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:06.495089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:06.496936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:06.547524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] Creating event network-vif-deleted:94028fa1-3091-41da-89d8-65553aa4e2fb for instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 on n-h2-858383-14 Oct 18 16:39:06.567400 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e2da8b0c-0475-4e85-97d0-2c361412fc1d req-2af92d70-82de-47e8-ba6a-5723243baaeb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111460 Oct 18 16:39:06.568321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3221/6396] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:39:07.354120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:07.354736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:07.365719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:07.366218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:07.366653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:07.373666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:07.374240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:07.374691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:07.565945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:07.589190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:07.596409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:07.606178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c62f23f4-a51a-4360-b37d-fdc9ca2e75d5 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.255453 Oct 18 16:39:07.610948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3176/6397] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:07 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:08.642078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:08.643041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:08.658615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:08.659543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:08.662857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:08.665196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:08.665805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:08.668046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:08.800482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:08.813600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:08.818481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:08.821605 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d06a358-54ed-4566-81a6-9f5c1d4ff1e1 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.185403 Oct 18 16:39:08.822946 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3222/6398] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:08 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:09.851198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:09.851993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:09.868975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:09.870559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:09.873804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:09.874708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:09.875301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:09.875857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:10.013255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:10.027064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:10.037284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:10.038922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22e48921-1fe0-46fa-9f19-85efebf689d4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.193535 Oct 18 16:39:10.044337 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3177/6399] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:09 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:11.075931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:11.076986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:11.107948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:11.110353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:11.112196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:11.114447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:11.116261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:11.123412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:11.758206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:11.778474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:11.783577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:11.787050 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34989b40-1647-49b0-8d1d-d1ee404c7d54 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.715826 Oct 18 16:39:11.789141 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3223/6400] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:11 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:12.818644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:12.819284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:12.845047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:12.852724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:12.853449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:12.855944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:12.861794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:12.867900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:13.376653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:13.408797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:13.412181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:13.429207 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c3a6172-b4f8-4ab3-afeb-72e988f4e383 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.615808 Oct 18 16:39:13.431117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3178/6401] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:12 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:14.473363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:14.474101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:14.492339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:14.492770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:14.498286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:14.501407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:14.501800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:14.502275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:15.241565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:15.267357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:15.288454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:15.297563 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d8b8e74d-5d0f-4208-bc16-11e3b8dc215b tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.831507 Oct 18 16:39:15.325246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3224/6402] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:14 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:16.332750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:16.335789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:16.346611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:16.350352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:16.352921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:16.353597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:16.362108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:16.369812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:16.370542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:16.475117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:17.009245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:17.019657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:17.033508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:17.044158 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9dcaf444-3c16-4eae-a548-a1c1128ab537 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.717861 Oct 18 16:39:17.078287 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3179/6403] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:16 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:18.078817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:18.079701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:18.091169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:18.092744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:18.109471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:18.110042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:18.110821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:18.111305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:18.112278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:18.141113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=57 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:18.495471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:18.522783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:18.526208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:18.536837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35153102-be3c-4a48-bb8b-437fa16a4c17 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.460990 Oct 18 16:39:18.549091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3225/6404] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:18 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:19.564101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:19.565354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:19.583826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:19.584336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:19.584788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:19.585549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:19.586017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:19.586456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:19.943263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:19.957803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:19.962323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:19.963793 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9ac1bdca-5be0-49f1-98d9-1692916f6558 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.403891 Oct 18 16:39:19.988376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3180/6405] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:19 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:20.996686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:20.998322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:21.020392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:21.039693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:21.041649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:21.063244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:21.063973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:21.066728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:21.292984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:21.310979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:21.314388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:21.320511 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-586c4a4a-c511-4509-a5f5-7ce096541c56 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.329013 Oct 18 16:39:21.323146 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3226/6406] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:20 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:22.351860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:22.352583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:22.368121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:22.368761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:22.369340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:22.370184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:22.378786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:22.379376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:22.582286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:22.619532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:22.626487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:22.647900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9ff66a6-5341-434e-a1ab-8f051bb989b8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.301179 Oct 18 16:39:22.654116 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3181/6407] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:22 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:39:23.710391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:23.715467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:23.742221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:23.745350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:23.746772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:23.747661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:23.748587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:23.749216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:24.156982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:24.179397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:24.180855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:24.199373 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb65e775-106c-4432-95dd-64873221c52a tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.505502 Oct 18 16:39:24.199980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3227/6408] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:23 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:25.232882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:25.234537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:25.275670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:25.277096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:25.278082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:25.286490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:25.289767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:25.290627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:25.716658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:25.789575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:25.798147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:25.804052 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61336f10-fe56-49bc-9e61-1a81e0216d07 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.575589 Oct 18 16:39:25.811820 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3182/6409] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:25 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:26.848286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:26.849589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:26.871606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:26.875618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:26.876126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:26.876874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:26.877410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:26.877960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:27.109501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:27.142289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:27.144812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:27.147463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cfafcd63-8fed-4d61-8267-0e8119c9f900 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.303408 Oct 18 16:39:27.148217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3228/6410] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:26 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 16:39:28.184631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:28.194005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:28.241343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:28.246281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:28.248956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:28.252479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:28.255467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:28.259040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:28.600749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:28.624889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:28.629932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:28.633952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d24dccd1-d6b3-48e5-a0d2-dcf8d5731f53 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.452497 Oct 18 16:39:28.637348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3183/6411] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:28 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:29.666247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:29.669113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:29.699639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:29.706602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:29.710079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:29.711429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:29.713788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:29.717016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:30.066458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:30.108762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:30.120939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:30.128348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b2d4d85-4319-4e50-811f-7f8ac023dd9d tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.461409 Oct 18 16:39:30.130546 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3229/6412] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:29 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:31.159136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:31.160739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:31.177534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:31.178839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:31.180288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:31.185216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:31.186112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:31.186705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:31.834257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:31.864979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:31.870770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:31.877173 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-680461b0-26e1-4be0-8f68-53d3922011e9 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.723114 Oct 18 16:39:31.881495 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3184/6413] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:31 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:32.910368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:32.911591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:32.931052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:32.943571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:32.946623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:32.947571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:32.948056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:32.948498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:33.141422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:33.157548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:33.162432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:33.163934 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2d599514-dd03-4177-a565-6bdcbc176bd8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.257569 Oct 18 16:39:33.183041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3230/6414] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:32 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:34.190919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:34.191711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:34.208957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:34.209680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:34.210307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:34.211123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:34.211830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:34.213122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:34.439695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:34.457781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:34.462164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:34.463545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63765748-f1f7-4139-9722-cc595c78db93 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.277143 Oct 18 16:39:34.468314 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3185/6415] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:34 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:35.499687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:35.500512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:35.525776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:35.526278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:35.526718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:35.527433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:35.527889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:35.528311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:35.916291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:35.933279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:35.937553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:35.943993 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-693171ce-8701-4959-84c8-b47390424634 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.447912 Oct 18 16:39:35.965223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3231/6416] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:35 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:36.979963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:36.982898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:37.002257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:37.008920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:37.010090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:37.011418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:37.013801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:37.014603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:37.229324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:37.251516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:37.263007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:37.274259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-629953cf-7ebb-4f5a-b4d8-8ea212808e64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.300556 Oct 18 16:39:37.278810 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3186/6417] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:36 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:38.321419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:38.322306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:38.342073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:38.351776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:38.359566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:38.360555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:38.361832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:38.362619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:38.732382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:38.765099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:38.777278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:38.778761 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a9f4f06-2eff-49e4-9387-8b6bf6b48fc2 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.465452 Oct 18 16:39:38.784803 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3232/6418] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:38 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:39.807502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:39.808245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:39.826881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:39.827696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:39.828164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:39.828926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:39.829423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:39.838187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:40.000064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:40.021427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:40.022942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:40.024172 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13d3cdef-db18-4478-bd13-be0d25c55647 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.220990 Oct 18 16:39:40.029229 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3187/6419] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:39 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:41.061245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:41.062587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:41.091454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:41.092195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:41.094332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:41.095707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:41.100446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:41.103955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:41.357161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:41.371331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:41.373232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4064b8b6e24149d48f3ab0699e61c175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba79606e524741829336d54b9d93ea63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:41.374489 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-19596ea3-b08a-47ac-9636-13abf7e47a72 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 200 len: 1604 microversion: 2.32 time: 0.323017 Oct 18 16:39:41.378975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3233/6420] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:41 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 16:39:42.416081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:42.417292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:42.444712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:42.446681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:42.447348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:42.448874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:42.452811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:42.455616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:42.506139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] HTTP exception thrown: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Request method failure captured: Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 HTTP/1.1 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtU9coPFLk3ZUr8e-PyHonp7wJPpJe5upRdlQstcKhsPM6HKuj-FWQy4gPuJES9Q36jkzrzyhse9OkPVt4nvIVS80aOEtKug-Co0RMNVX2m5x5_o-tRbJoeWWUo0U7QY522ex4hZXH5wwTG-t17T0zyV9CwcMXcsizhlHo_MZYuA8a4 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba79606e524741829336d54b9d93ea63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba79606e524741829336d54b9d93ea63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}] Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4064b8b6e24149d48f3ab0699e61c175 Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7'} Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:42.507908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:42.511517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Returning 404 to user: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:39:42.521563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d78840c-440f-45ce-9b72-d3fdbde4cfe4 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 404 len: 111 microversion: 2.32 time: 0.102105 Oct 18 16:39:42.526025 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3188/6421] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:42 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:39:42.532873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ffc21f48-ea1f-4944-abd8-e66d38361b64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '.version_select at 0x7f5fd15bf3a0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:42.598390 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ffc21f48-ea1f-4944-abd8-e66d38361b64 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316054348" status: 204 len: 0 microversion: 2.32 time: 0.068005 Oct 18 16:39:42.601948 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3234/6422] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 18 16:39:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316054348 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 16:39:54.049645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=19 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:54.051608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=55 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:54.056798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:54.057624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:54.082450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.084102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.086173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.088565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.090203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.091764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.143988 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] HTTP exception thrown: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Request method failure captured: Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 HTTP/1.1 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtU9coPFLk3ZUr8e-PyHonp7wJPpJe5upRdlQstcKhsPM6HKuj-FWQy4gPuJES9Q36jkzrzyhse9OkPVt4nvIVS80aOEtKug-Co0RMNVX2m5x5_o-tRbJoeWWUo0U7QY522ex4hZXH5wwTG-t17T0zyV9CwcMXcsizhlHo_MZYuA8a4 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba79606e524741829336d54b9d93ea63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba79606e524741829336d54b9d93ea63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}] Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 4064b8b6e24149d48f3ab0699e61c175 Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7'} Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:39:54.146567 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.150249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Returning 404 to user: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:39:54.152333 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99485c73-cd13-459f-a28e-ba057f330a67 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 404 len: 111 microversion: 2.32 time: 0.103191 Oct 18 16:39:54.156088 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3189/6423] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 18 16:39:54 2022] DELETE /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:39:54.163916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=53 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:54.165420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:54.173521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:54.178084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] [instance: 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:54.197823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.198673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.199373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.201574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.202302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.202669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.224962 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] HTTP exception thrown: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Request method failure captured: Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 HTTP/1.1 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtU9coPFLk3ZUr8e-PyHonp7wJPpJe5upRdlQstcKhsPM6HKuj-FWQy4gPuJES9Q36jkzrzyhse9OkPVt4nvIVS80aOEtKug-Co0RMNVX2m5x5_o-tRbJoeWWUo0U7QY522ex4hZXH5wwTG-t17T0zyV9CwcMXcsizhlHo_MZYuA8a4 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba79606e524741829336d54b9d93ea63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba79606e524741829336d54b9d93ea63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba79606e524741829336d54b9d93ea63"}]}] Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: ba79606e524741829336d54b9d93ea63 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TaggedBootDevicesTest-623957542 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 4064b8b6e24149d48f3ab0699e61c175 Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TaggedBootDevicesTest-623957542-project Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7'} Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:54.226699 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] Returning 404 to user: Instance 3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a96289c9-b789-4011-88bd-3f6487e739c8 tempest-TaggedBootDevicesTest-623957542 tempest-TaggedBootDevicesTest-623957542-project] 10.222.0.78 "GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7" status: 404 len: 111 microversion: 2.32 time: 0.066282 Oct 18 16:39:54.234310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3235/6424] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 18 16:39:54 2022] GET /compute/v2.1/servers/3f3115c8-f4ca-4bd0-8336-ae34c4aec2e7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:40:37.145914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-854157977", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "f24f60ec-1e5a-45da-80a5-5234aeaaf44b"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:37.155011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:37.156645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:37.249980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] validate_networks() for [('f24f60ec-1e5a-45da-80a5-5234aeaaf44b', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:40:38.313098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:40:38.313834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:40:38.314130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:40:38.314762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:40:38.315005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:40:38.330162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:38.331348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:38.332119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:38.333243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:38.333869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:38.334486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:38.362334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Getting quotas for project dd133cec4ca14729a6dd03a36ba5a7af. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:40:38.376673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Getting quotas for user e4dd2c3b9b684160aa8511d85b5ec446 and project dd133cec4ca14729a6dd03a36ba5a7af. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:40:38.397121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:40:38.400786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:40:38.518101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fa1649c-fcf7-440a-b473-7e6befbf3a6e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378328 Oct 18 16:40:38.519360 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3190/6425] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:40:38.529250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:38.530040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:38.544937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1ffe2ef-7fa0-4081-bd8a-f40f85fc61e3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:38.547917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1ffe2ef-7fa0-4081-bd8a-f40f85fc61e3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:38.655857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e1ffe2ef-7fa0-4081-bd8a-f40f85fc61e3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:38.665642 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1ffe2ef-7fa0-4081-bd8a-f40f85fc61e3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1213 microversion: 2.1 time: 0.137545 Oct 18 16:40:38.677539 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3236/6426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:38 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:39.705320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5b1a738-0106-4deb-af75-2ac817587c7a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:39.706453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5b1a738-0106-4deb-af75-2ac817587c7a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:39.946755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5b1a738-0106-4deb-af75-2ac817587c7a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:39.995649 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5b1a738-0106-4deb-af75-2ac817587c7a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1213 microversion: 2.1 time: 0.307000 Oct 18 16:40:39.997143 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3191/6427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:39 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1213 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:40:41.023488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db9a8cea-2dc5-48c5-a5ca-e75b04ead0d3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:41.024801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db9a8cea-2dc5-48c5-a5ca-e75b04ead0d3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:41.321147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-db9a8cea-2dc5-48c5-a5ca-e75b04ead0d3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:41.343900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db9a8cea-2dc5-48c5-a5ca-e75b04ead0d3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1213 microversion: 2.1 time: 0.321486 Oct 18 16:40:41.347476 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3237/6428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:41 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1213 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:40:42.371759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-006506b4-eb67-4089-86ee-71b835b86e57 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:42.372475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-006506b4-eb67-4089-86ee-71b835b86e57 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:42.810724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-006506b4-eb67-4089-86ee-71b835b86e57 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:42.835039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-006506b4-eb67-4089-86ee-71b835b86e57 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1213 microversion: 2.1 time: 0.467896 Oct 18 16:40:42.843050 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3192/6429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:42 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1213 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:43.864224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:43.865621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:43.894150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:43.895048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:43.895679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:43.896637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:43.898515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:43.898963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:44.032816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:44.044803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8b08d3b-4427-4bcf-8aa4-7d509e730d8f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1217 microversion: 2.1 time: 0.187249 Oct 18 16:40:44.061626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3238/6430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:43 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:45.079584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:45.080899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:45.095650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:45.096494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:45.097924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:45.100916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:45.106958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:45.107921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:45.547595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:45.571447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5eab7d63-396a-420b-9c5f-393c8a637a95 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1265 microversion: 2.1 time: 0.501306 Oct 18 16:40:45.594271 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3193/6431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:45 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1265 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:46.607020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:46.607833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:46.629541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:46.630064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:46.634789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:46.636067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:46.636667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:46.639247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:46.945595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:46.964197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5777e678-1b75-44f4-aaf0-a2e311b7f896 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1271 microversion: 2.1 time: 0.364849 Oct 18 16:40:46.964837 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3239/6432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:46 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:47.990179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:47.993124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:48.009740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:48.010244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:48.010699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:48.022884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:48.025181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:48.030978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:48.349263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:48.974785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:49.019845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f64ab1f8-af07-43fe-be86-d30a7182f205 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 1.034178 Oct 18 16:40:49.021325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3194/6433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:47 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:50.055029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:50.056314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:50.067227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:50.071063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:50.071661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:50.073323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:50.075390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:50.076650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:50.309051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4949a39-71a8-4ac1-b67a-3b75fd4b517f", "tag": "52b5ad46-2948-4379-a837-df63b4ff233d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:50.370342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:50.371643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:50.375395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:50.446092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] Creating event network-changed:52b5ad46-2948-4379-a837-df63b4ff233d for instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f on n-h1-858383-14 Oct 18 16:40:50.459763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-56301cb1-fb66-4742-b6a2-25a725c9dfee req-69e2f7d2-3b0f-413e-baa1-0bed30af1540 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154336 Oct 18 16:40:50.462939 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3195/6434] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:40:51.124542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1386792109", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "474aa6c2-ffff-4f98-a8b4-fbd27f605c5d"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:51.328663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:51.395915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:51.411261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-da6cbe68-3aab-4bb8-aad4-32fede2f9c71 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 1.355333 Oct 18 16:40:51.422458 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3240/6435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:50 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:51.944833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] validate_networks() for [('474aa6c2-ffff-4f98-a8b4-fbd27f605c5d', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:40:52.437813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:52.439017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:52.449980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:52.452585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:52.453925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:52.456265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:52.457983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:52.458435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:52.828627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:52.870860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:52.878554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:40:52.879690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:40:52.880389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:40:52.881050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:40:52.881598 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac519365-a1ed-4388-ad3b-6613b87a82b5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.447741 Oct 18 16:40:52.881797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:40:52.882099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3241/6436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:52 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:40:52.906912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:52.908172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:52.914758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:52.918889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:52.919857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:52.920585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:53.017267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Getting quotas for project 31f27aec34714d7bba536906c9d9aa2c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:40:53.036144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Getting quotas for user 661a7db853734f9fa204a0a74959e4bc and project 31f27aec34714d7bba536906c9d9aa2c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:40:53.104418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:40:53.113370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:40:53.407541 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.413399 Oct 18 16:40:53.415376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3196/6437] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:40:53.437901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09aa8190-275c-47d0-968e-3109b4ed7897 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:53.439894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09aa8190-275c-47d0-968e-3109b4ed7897 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:53.583695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-09aa8190-275c-47d0-968e-3109b4ed7897 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:53.601311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09aa8190-275c-47d0-968e-3109b4ed7897 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1217 microversion: 2.1 time: 0.172777 Oct 18 16:40:53.602014 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3242/6438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:53 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:53.908348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:53.909443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:53.938408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:53.938911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:53.949993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:53.957463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:53.958226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:53.958678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:54.318598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:54.331008 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d5c1d6da-aace-4d78-98f2-edc142bbec86 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.427252 Oct 18 16:40:54.334041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3197/6439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:53 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:54.625153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:54.626162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:54.649026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:54.658545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:54.659389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:54.660976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:54.663141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:54.665998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:54.872970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:54.884773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81d5d636-e2cd-43e9-8e3d-6f39d12eb19f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1213 microversion: 2.1 time: 0.264206 Oct 18 16:40:54.885394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3243/6440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:54 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1213 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:55.356725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:55.358590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:55.385070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:55.389197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:55.390340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:55.392665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:55.396434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:55.397090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:55.911626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:55.912459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:55.922416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:55.923234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:55.923951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:55.924838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:55.925658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:55.926249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:56.083141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:56.096232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b0adec1-2261-4d98-9777-f6076228dee9 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1275 microversion: 2.1 time: 0.189195 Oct 18 16:40:56.109579 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3244/6441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:55 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:56.146696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:56.159721 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2a8136f-90fe-42ae-b790-a488a4108ea2 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.808085 Oct 18 16:40:56.160302 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3198/6442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:55 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:57.124285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:57.126681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:57.171441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:57.186747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:57.189426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:57.197493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:57.209845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:57.215195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:57.220561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:57.229751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:57.233864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:57.234770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:57.238525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:57.256976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:57.260538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:57.262113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:57.739166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:57.753371 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a94b88a-411c-4096-8eb5-3c98febae1be tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.633900 Oct 18 16:40:57.757204 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3245/6443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:57 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:57.796746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:57.811580 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3fecf1fe-43ca-479e-8869-f60e5bfecc76 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.628522 Oct 18 16:40:57.815584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3199/6444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:57 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:58.376867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4949a39-71a8-4ac1-b67a-3b75fd4b517f", "name": "network-vif-plugged", "status": "completed", "tag": "52b5ad46-2948-4379-a837-df63b4ff233d"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:58.418899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:58.419426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:58.419873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:58.464181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] Creating event network-vif-plugged:52b5ad46-2948-4379-a837-df63b4ff233d for instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f on n-h1-858383-14 Oct 18 16:40:58.477513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-08755e83-e106-42ab-a5fb-744c8ef948f3 req-cc33467a-da70-4dca-b456-f81ba035e5bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386406 Oct 18 16:40:58.478124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3246/6445] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:40:58.790774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:58.806887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:58.828411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:58.828920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:58.834984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:58.836045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:58.848925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:58.849453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:58.850030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:58.850616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:58.851077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:58.851502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:58.852602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:58.853405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:58.853884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:58.854319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:59.166767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:59.186757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcfa58ad-3c1f-4c51-939e-5d6f22a21cb3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.390452 Oct 18 16:40:59.193834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3200/6446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:58 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:40:59.200919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:59.218035 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b24070b2-0825-4b03-8dac-2d60109e0a4e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.386608 Oct 18 16:40:59.225975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3247/6447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:58 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:40:59.568918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693f45f3-5eff-45d8-b344-c76751ea9ee9", "tag": "c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:59.589697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:59.590270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:59.590763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:59.618395 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] Creating event network-changed:c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc for instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 on n-h2-858383-14 Oct 18 16:40:59.633654 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2f112cc5-5f7a-4602-8ee7-faceb4303c1e req-19a68b64-a3d2-44f5-a4d5-6bd6aa588d42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068923 Oct 18 16:40:59.634273 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3201/6448] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:00.210417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:00.211047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:00.237421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:00.245749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:00.247304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:00.252784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:00.254411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:00.257217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:00.262412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:00.263164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:00.271198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:00.271704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:00.272154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:00.272977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:00.280478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:00.281441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:00.692467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:00.706313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9411c19e-4f92-4d66-a134-e20bf82bf8ce tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.498008 Oct 18 16:41:00.721028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3248/6449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:00 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:00.739861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:00.761877 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d1047fca-2f0d-4feb-bd91-7fe0c3db8a7b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1313 microversion: 2.1 time: 0.512638 Oct 18 16:41:00.765855 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3202/6450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:00 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:01.739644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:01.740808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:01.751205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:01.752023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:01.752681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:01.753676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:01.754650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:01.755221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:01.792897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:01.793876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:01.812557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:01.813102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:01.817850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:01.818671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:01.819171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:01.819624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:02.063764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:02.076264 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fa3aa8c-643b-4fbf-9d23-96a07dd8a9cc tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.340113 Oct 18 16:41:02.078139 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3249/6451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:01 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:02.103807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:02.114363 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f7d3489-d66e-48b3-9e93-bca4a20ee96a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1498 microversion: 2.1 time: 0.325827 Oct 18 16:41:02.115798 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3203/6452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:01 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:02.762474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:02.763009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:02.784058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:02.784568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:02.788275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:02.789116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:02.789637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:02.790077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:02.840121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:41:03.111457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c212f206-77b0-448a-9250-226f52d7e0c3 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 204 len: 0 microversion: 2.1 time: 0.353332 Oct 18 16:41:03.111840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:03.112433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3250/6453] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:41:02 2022] DELETE /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:41:03.115940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:03.121989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:03.127431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:03.133334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:03.137666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:03.155284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:03.155780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:03.156502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:03.157176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:03.159273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:03.159565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:03.160173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:03.161075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:03.161785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:03.161901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:03.162330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:03.167704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:03.461386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:03.475324 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c82e013-adb1-4a8f-a846-10a14b2bf0ad tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1504 microversion: 2.1 time: 0.355282 Oct 18 16:41:03.476348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3251/6454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:03 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:03.598597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:03.936339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:03.943678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b7eeb17-df36-4278-baef-aa8e7df72938 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: .version_select at 0x7f5fd175a3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1880413216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdvVCxwX+Z9lmTGfMEVC9lfOV9CmVLhu1zbt/TO1KIhd1oVnooiEcdI8TGJIWLmlBJ8ASR7JkpXlpPo7FjgsVvGvxSxtJsSBmC24ZYA1as+YZ6u1HM4NvryiUr0PHxtog=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:03.948830 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-599cd8c7-7dfd-4e1d-a70c-a68a61d1fddd tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.851998 Oct 18 16:41:03.949933 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3204/6455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:03 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:03.982598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9b7eeb17-df36-4278-baef-aa8e7df72938 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:41:03.992748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9b7eeb17-df36-4278-baef-aa8e7df72938 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:41:04.044842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b7eeb17-df36-4278-baef-aa8e7df72938 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.482271 Oct 18 16:41:04.045554 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3252/6456] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:41:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:04.502989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:04.504307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:04.511894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:04.512729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:04.513426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:04.514915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:04.515610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:04.516252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:04.809799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:04.821631 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e54f2ce-51c6-4ede-980a-e9012cdf2562 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1504 microversion: 2.1 time: 0.322325 Oct 18 16:41:04.824553 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3205/6457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:04 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:04.976934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:04.977725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:04.996236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:05.000000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:05.001975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:05.003274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:05.004083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:05.004843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:05.423317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:05.441538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c41ab67d-da29-4e4c-83d3-39505d5d9d99 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.471637 Oct 18 16:41:05.442439 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3253/6458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:04 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:05.785215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4949a39-71a8-4ac1-b67a-3b75fd4b517f", "name": "network-vif-deleted", "tag": "52b5ad46-2948-4379-a837-df63b4ff233d"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:05.827607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:05.828973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:05.831189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:05.849268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:05.851810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:05.870332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:05.873468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:05.876452 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] Creating event network-vif-deleted:52b5ad46-2948-4379-a837-df63b4ff233d for instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f on n-h1-858383-14 Oct 18 16:41:05.878033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:05.879559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:05.881359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:05.884463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:05.900207 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8c404d08-965c-4290-9ea8-7631aa9140c5 req-7ba80e18-5521-4669-9f79-33f30b2542cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119441 Oct 18 16:41:05.906320 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3206/6459] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:06.088639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:06.100438 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6f60228b-72d8-4f2f-aeca-3d7ae4d5621c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 200 len: 1298 microversion: 2.1 time: 0.255456 Oct 18 16:41:06.101794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3254/6460] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:05 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 1298 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:06.130198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f45f3-5eff-45d8-b344-c76751ea9ee9", "name": "network-vif-plugged", "status": "completed", "tag": "c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:06.152907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:06.153592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:06.154246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:06.179527 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] Creating event network-vif-plugged:c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc for instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 on n-h2-858383-14 Oct 18 16:41:06.197858 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-84132aac-3374-4c1e-8a6b-26e697435bc0 req-8732d0ab-335e-4283-845e-28e49a005ad0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073088 Oct 18 16:41:06.199133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3207/6461] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:06.474381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:06.475259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:06.486566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:06.489609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:06.490227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:06.491131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:06.493545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:06.494152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:06.533479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:06.820416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:06.850107 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0437efc-2e0c-4169-ad48-c2920dc90180 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1317 microversion: 2.1 time: 0.379516 Oct 18 16:41:06.879962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3255/6462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:06 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:07.137375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:07.139518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: c4949a39-71a8-4ac1-b67a-3b75fd4b517f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:07.147804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:07.148634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:07.149379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:07.150954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:07.151663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:07.152411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:07.173950 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] HTTP exception thrown: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Request method failure captured: Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f HTTP/1.1 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtcBep2o-AuGiNtm1oQEQcIecmFjM_6aa3mK3ApbCjXnPdZoiDX_tFI6sl1JYvcT7CeCkV4x2bNmVN-EAly9Pbpyd_dnJN7J_Q2ZYX-HJZIt3zBRD_HolOONlS6TvUjK_8t-HSvil54EmhiEGsJ2hNo-O8-n8VOcwVaN7kNfmxmtLTI Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: dd133cec4ca14729a6dd03a36ba5a7af Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd133cec4ca14729a6dd03a36ba5a7af"}]}] Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: dd133cec4ca14729a6dd03a36ba5a7af Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesActionsTest-1755806082-project Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e4dd2c3b9b684160aa8511d85b5ec446 Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesActionsTest-1755806082-project Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c4949a39-71a8-4ac1-b67a-3b75fd4b517f'} Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:07.176266 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. Oct 18 16:41:07.180102 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:07.185642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Returning 404 to user: Instance c4949a39-71a8-4ac1-b67a-3b75fd4b517f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:07.187201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67913243-5b87-45ab-99ed-86757eaf9a60 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f" status: 404 len: 111 microversion: 2.1 time: 0.061247 Oct 18 16:41:07.188587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3208/6463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:07 2022] GET /compute/v2.1/servers/c4949a39-71a8-4ac1-b67a-3b75fd4b517f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:41:07.530553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-470795154", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "f24f60ec-1e5a-45da-80a5-5234aeaaf44b"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:07.663530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] validate_networks() for [('f24f60ec-1e5a-45da-80a5-5234aeaaf44b', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:41:07.906558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:07.911650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:07.918200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:07.953655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:07.955665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:07.957509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:07.958975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:07.959501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:07.959946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:07.966694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=75 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:08.238747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:08.258084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e215cf43-ebcf-4e53-9c20-2a8a93351e78 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1506 microversion: 2.1 time: 0.361819 Oct 18 16:41:08.260446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3209/6464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:07 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:08.288456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:08.289259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:08.329265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.329816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.330412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:08.331647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.332367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.333082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:08.427031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:08.431712 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f98532e9-3355-4f94-862b-6f392b3a8819 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/os-instance-actions/req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c" status: 200 len: 313 microversion: 2.1 time: 0.150035 Oct 18 16:41:08.432338 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3210/6465] 10.222.0.78 () {58 vars in 1419 bytes} [Tue Oct 18 16:41:08 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/os-instance-actions/req-bf44a8f8-e9a2-4f44-a2af-2e4e7317b72c => generated 313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:08.465060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:08.469230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:08.505664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.507245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.507933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:08.509076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.509781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.510455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:08.644842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a41d1caa-e14d-4856-8770-b7c61fbc5f64 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "POST /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/action" status: 202 len: 0 microversion: 2.1 time: 0.195595 Oct 18 16:41:08.646799 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3211/6466] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:41:08 2022] POST /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:41:08.679185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:08.686482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:08.698393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.702392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.704242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:08.705016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:08.705576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:08.708189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:09.158045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:09.176481 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdd8aaca-0d10-4dd1-959e-b37f231e3214 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1508 microversion: 2.1 time: 0.514063 Oct 18 16:41:09.177325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3212/6467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:08 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:10.205283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:10.210396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:10.236389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:10.236884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:10.237376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:10.238109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:10.258607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:10.269040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:10.288014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:41:10.288591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:41:10.288974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:41:10.289414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:41:10.289825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:41:10.292038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:10.317969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:10.318302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:10.318737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:10.324670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:10.326700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:10.327377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:10.387313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Getting quotas for project dd133cec4ca14729a6dd03a36ba5a7af. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:41:10.400940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Getting quotas for user e4dd2c3b9b684160aa8511d85b5ec446 and project dd133cec4ca14729a6dd03a36ba5a7af. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:41:10.432905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:41:10.438459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:41:10.554539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6368fd8b-96cb-40ed-9293-653f87eb3169 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.028086 Oct 18 16:41:10.557379 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3256/6468] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:41:10.566709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9a7d527d-5b42-4ad4-befa-d2a5bbc2c021 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:10.567343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9a7d527d-5b42-4ad4-befa-d2a5bbc2c021 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:10.706534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:10.722702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67925ecc-6305-4c64-a058-4de04a5ffb0a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1508 microversion: 2.1 time: 0.522865 Oct 18 16:41:10.723303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3213/6469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:10 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:10.814390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9a7d527d-5b42-4ad4-befa-d2a5bbc2c021 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:10.822894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9a7d527d-5b42-4ad4-befa-d2a5bbc2c021 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1213 microversion: 2.1 time: 0.260196 Oct 18 16:41:10.828570 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3257/6470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:10 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:11.752557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:11.760429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:11.786266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:11.792897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:11.802901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:11.806342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:11.806523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:11.813862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:11.854267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:11.860836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:11.881210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:11.902743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:11.905946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:11.909814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:11.910667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:11.911392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.173261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:12.183392 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdee6118-1dc0-47c5-87d3-340e3797234a tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1506 microversion: 2.1 time: 0.435876 Oct 18 16:41:12.188216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3214/6471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:11 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:12.222962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '.version_select at 0x7f5fd17970d0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:12.223689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:12.238563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:12.240379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.241170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.241921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.242979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.247377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.248208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.253554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-caf0413b-f9f9-4848-a3d5-8d4ef29a0c80 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1217 microversion: 2.1 time: 0.403067 Oct 18 16:41:12.254293 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3258/6472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:11 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1217 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:12.372740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b88654cc-7638-48e6-a9ea-afa06e81a35f tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.158709 Oct 18 16:41:12.378710 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3215/6473] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:41:12 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9/os-instance-actions => generated 611 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:12.388072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:12.389249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:12.425144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.431184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.432426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.461809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.470568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.471327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.613116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:41:12.864061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9513ebd4-b97c-463e-b79d-35ee91d21559 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "DELETE /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 204 len: 0 microversion: 2.1 time: 0.479536 Oct 18 16:41:12.871973 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3259/6474] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:41:12 2022] DELETE /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:41:12.877610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:12.878514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:12.895812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.907060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.907776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:12.925735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:12.927655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:12.928470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:13.285831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:13.286953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:13.310678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:13.317407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:13.339716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:13.340498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:13.340977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:13.342195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:13.381550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:13.392034 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a6d4abc-365f-4174-b594-a47c6e4d8aab tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1512 microversion: 2.1 time: 0.519023 Oct 18 16:41:13.395602 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3216/6475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:12 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:13.527386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:13.561227 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1222be73-9667-4098-9bd6-f9712827468a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1273 microversion: 2.1 time: 0.280328 Oct 18 16:41:13.564121 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3260/6476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:13 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:14.420612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:14.422387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:14.445329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:14.447023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:14.447787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:14.448758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:14.449476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:14.450143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:14.613439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:14.614054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:14.642787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:14.643237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:14.646285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:14.652844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:14.653586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:14.654817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:15.029825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:15.054906 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ae4eae50-3689-4f74-8971-5c6825747fc7 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1512 microversion: 2.1 time: 0.639178 Oct 18 16:41:15.058736 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3217/6477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:14 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1512 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:15.175101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:15.211713 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a1ef3e6e-cbdd-40c9-9b07-1bad3b9191f5 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1271 microversion: 2.1 time: 0.606776 Oct 18 16:41:15.222058 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3261/6478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:14 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1271 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:16.099661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:16.104807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:16.141723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:16.153744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:16.154932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:16.155744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:16.156224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:16.156644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:16.256601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:16.263490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:16.351753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:16.352341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:16.388922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:16.389978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:16.390475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:16.390916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:16.528147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:16.547952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f2189dd-6477-4837-9c14-4e4bd9a5dd43 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1470 microversion: 2.1 time: 0.446604 Oct 18 16:41:16.561298 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3218/6479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:16 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:16.659394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f45f3-5eff-45d8-b344-c76751ea9ee9", "name": "network-vif-deleted", "tag": "c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:16.700152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:16.701198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:16.709036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:16.767747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] Creating event network-vif-deleted:c5ebe8a3-6899-47a7-8c76-eb3f139f4cbc for instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 on n-h2-858383-14 Oct 18 16:41:16.791394 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d5041dae-d6ff-4ee0-a1cd-e2819c586474 req-f732e85d-6370-4b4d-92d6-e17997942843 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136790 Oct 18 16:41:16.792302 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3219/6480] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:17.528197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:17.542783 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7dba37d2-e278-4c62-8859-fc6cfce7936f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 1.294306 Oct 18 16:41:17.563846 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3262/6481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:16 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:17.587657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:17.588510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:17.625679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:17.626190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:17.626646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:17.628142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:17.628628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:17.629098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:17.786160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:17.794017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:17.797833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:17.798435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lazy-loading 'fault' on Instance uuid 693f45f3-5eff-45d8-b344-c76751ea9ee9 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:41:17.942741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a7db853734f9fa204a0a74959e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f27aec34714d7bba536906c9d9aa2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:17.951528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-336c1baf-580c-450c-a63a-a841b9773cd3 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 200 len: 1307 microversion: 2.1 time: 0.368803 Oct 18 16:41:17.952369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3220/6482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:17 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:18.571788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:18.572325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:18.590100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:18.593904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:18.594990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:18.595914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:18.597867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:18.598683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:18.975285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:18.976715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] [instance: 693f45f3-5eff-45d8-b344-c76751ea9ee9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:18.989584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:18.991256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:18.992001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:18.997218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:18.998455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:18.999142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:19.042787 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] HTTP exception thrown: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Request method failure captured: Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 HTTP/1.1 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtcSOXNMj0BsHVTmmlVrG_4VLOJsi42i_QuBl47_pP8U06-k2kKwX1dloa7httpC10vCkfsWpXoysM_IdqxxMIWifvkfVO0roj_fjLML2VxlZLUW82qRZU0eYNxdFTXTEYK-NKEbLLmZed1yhoYOLUnaD3fs67778q5yHNuwejcUTig Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 31f27aec34714d7bba536906c9d9aa2c Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-InstanceActionsTestJSON-989192674 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31f27aec34714d7bba536906c9d9aa2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31f27aec34714d7bba536906c9d9aa2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31f27aec34714d7bba536906c9d9aa2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31f27aec34714d7bba536906c9d9aa2c"}]}] Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-InstanceActionsTestJSON-989192674 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 31f27aec34714d7bba536906c9d9aa2c Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-InstanceActionsTestJSON-989192674 Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-InstanceActionsTestJSON-989192674-project Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 661a7db853734f9fa204a0a74959e4bc Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-InstanceActionsTestJSON-989192674-project Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '693f45f3-5eff-45d8-b344-c76751ea9ee9'} Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:19.049539 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. Oct 18 16:41:19.054330 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:19.056403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] Returning 404 to user: Instance 693f45f3-5eff-45d8-b344-c76751ea9ee9 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:19.059609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4a4e6da-ac86-48a5-81a1-fc5388799948 tempest-InstanceActionsTestJSON-989192674 tempest-InstanceActionsTestJSON-989192674-project] 10.222.0.78 "GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9" status: 404 len: 111 microversion: 2.1 time: 0.087504 Oct 18 16:41:19.064874 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3221/6483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:18 2022] GET /compute/v2.1/servers/693f45f3-5eff-45d8-b344-c76751ea9ee9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:41:19.982455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:19.991415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6916c7ec-d6d7-42f8-bf49-8c3b8aef8681 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 1.423852 Oct 18 16:41:19.998210 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3263/6484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:18 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:20.823957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1445770f-bc56-40c7-81f2-a08b000e4305", "tag": "5dba540d-0ba0-4063-a8ba-b0835cbe1586"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:20.843537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:20.847153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:20.847657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:20.874700 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] Creating event network-changed:5dba540d-0ba0-4063-a8ba-b0835cbe1586 for instance 1445770f-bc56-40c7-81f2-a08b000e4305 on n-h1-858383-14 Oct 18 16:41:20.880376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f26189b0-c49f-4a1e-b7a4-01f16f7c6bc0 req-0d0599dc-6c86-4188-94fa-396682f7593a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062196 Oct 18 16:41:20.885827 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3222/6485] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:21.021395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:21.022017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:21.024086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:21.029687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:21.059682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:21.063175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:21.063735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:21.064660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:21.065293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:21.066051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:21.939247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:21.948734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3da30dd7-9a1a-4ea5-a436-2f54e4353c70 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.932081 Oct 18 16:41:21.952013 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3264/6486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:21 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:22.978566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:22.979869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:22.987698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:22.988462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:22.989355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:22.990227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:22.990856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:22.991441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:23.373972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:23.384010 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a203f0f8-257f-4c64-bcaf-1805cfd5ba65 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.411207 Oct 18 16:41:23.384526 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3223/6487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:22 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:23.825317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-619359087", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "278b2085-a7f9-4a72-a2cd-f58d7a9b265e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1880413216", "security_groups": [{"name": "tempest-secgroup-smoke-1150149602"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:24.188701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] validate_networks() for [('278b2085-a7f9-4a72-a2cd-f58d7a9b265e', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:41:24.429070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:24.431712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:24.444457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:24.447018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:24.447750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:24.450977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:24.453158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:24.454176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:24.750053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:24.759834 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c5284e7-1201-4011-aadb-69399a6e9a7c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.338628 Oct 18 16:41:24.770153 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3224/6488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:24 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:25.794666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:25.795810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:25.807974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:25.808475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:25.808911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:25.809721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:25.810903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:25.811475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:26.111447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:41:26.112638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:41:26.113588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:41:26.114669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:41:26.115736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:41:26.145047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:26.146405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:26.153556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:26.154910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:26.155632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:26.156302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:26.226373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:41:26.245635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:41:26.283980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:41:26.302526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:41:26.439819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:26.440393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7737955e-00c1-4a4f-b5a7-f9767b5a08e8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.606719 Oct 18 16:41:26.444477 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3265/6489] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:41:26.448067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b259eaf-81e5-4b3b-b185-2c839b4c503b tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.658515 Oct 18 16:41:26.457895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-728f107d-1e87-4e1c-84e2-18b79373496d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:26.469716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-728f107d-1e87-4e1c-84e2-18b79373496d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:26.472826 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3225/6490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:25 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:26.678501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-728f107d-1e87-4e1c-84e2-18b79373496d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:26.698478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-728f107d-1e87-4e1c-84e2-18b79373496d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1266 microversion: 2.1 time: 0.245605 Oct 18 16:41:26.703237 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3266/6491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:26 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:27.476783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:27.478704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:27.514272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:27.514835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:27.515378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:27.516001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:27.516540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:27.516863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:27.644529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:27.730243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbf36e9c-dfbb-4d3f-b379-cab27d3aa30e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:27.730941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbf36e9c-dfbb-4d3f-b379-cab27d3aa30e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:27.947117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbf36e9c-dfbb-4d3f-b379-cab27d3aa30e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:27.963062 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbf36e9c-dfbb-4d3f-b379-cab27d3aa30e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1266 microversion: 2.1 time: 0.235569 Oct 18 16:41:27.969063 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3267/6492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:27 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:28.484499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:28.500018 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03626a17-9a3d-4e93-ba5b-c4d64ca4ce3f tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 1.027901 Oct 18 16:41:28.500662 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3226/6493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:27 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:28.998660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:29.000017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:29.012316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:29.017391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:29.018067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:29.018713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:29.019363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:29.020094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:29.244305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:29.255423 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f7974a0-c138-4fb2-ac58-85a3e3e9a30a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1318 microversion: 2.1 time: 0.260916 Oct 18 16:41:29.269757 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3268/6494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:28 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:29.529234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:29.530052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:29.548891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:29.555354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:29.556566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:29.561207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:29.562450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:29.563722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:30.280784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:30.284375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:30.297847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:30.307979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:30.308622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:30.314176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:30.314827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:30.315281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:30.542288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:30.558716 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-abd30566-b555-49f4-9f01-dfd48f920963 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 1.035474 Oct 18 16:41:30.564967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3227/6495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:29 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:30.595972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:30.610457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15c55897-a959-4b83-aa81-fb7c10537dcd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1324 microversion: 2.1 time: 0.334377 Oct 18 16:41:30.612607 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3269/6496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:30 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:31.589399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:31.590031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:31.608380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:31.608888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:31.616599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:31.631389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:31.632073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:31.632533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:31.634218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:31.635407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:31.649637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:31.666428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:31.667419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:31.668427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:31.669626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:31.670073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:31.983957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:32.004243 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f108360-2ebb-49f6-8808-c8fd0285a328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1324 microversion: 2.1 time: 0.374159 Oct 18 16:41:32.023287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3270/6497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:31 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:32.383061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445770f-bc56-40c7-81f2-a08b000e4305", "name": "network-vif-plugged", "status": "completed", "tag": "5dba540d-0ba0-4063-a8ba-b0835cbe1586"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:32.406657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:32.407229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:32.407556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:32.429369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:32.438779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-79747503-ac3f-4eb6-b225-b51882d1e350 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.853236 Oct 18 16:41:32.447130 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] Creating event network-vif-plugged:5dba540d-0ba0-4063-a8ba-b0835cbe1586 for instance 1445770f-bc56-40c7-81f2-a08b000e4305 on n-h1-858383-14 Oct 18 16:41:32.462809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3228/6498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:31 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:32.468740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b1d50cf0-0d29-4a56-81e8-ce4309e9a0a5 req-7929bbe7-0ccd-42b9-a148-7a328ea11a22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090469 Oct 18 16:41:32.469397 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3271/6499] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:33.029635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:33.029635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:33.041158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:33.054491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:33.057260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:33.066293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:33.068109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:33.069593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:33.254266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-645427617", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "4637ac00-3514-4648-a695-b4e13a9bed54"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:33.383318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] validate_networks() for [('4637ac00-3514-4648-a695-b4e13a9bed54', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:41:34.156386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:34.178916 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19abd80a-dc99-4e7f-8b5b-b439a0bab707 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 1.154814 Oct 18 16:41:34.180124 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3229/6500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:33 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:34.185297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:34.186942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:34.201795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:34.206348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:34.206966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:34.207890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:34.208507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:34.209119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:34.345108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:41:34.346127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:41:34.346765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:41:34.347335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:41:34.348136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:41:34.370977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:34.372384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:34.373385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:34.376806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:34.377743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:34.379043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:34.428049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Getting quotas for project ebe6b545c1f44199a313289eb21fe0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:41:34.440145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Getting quotas for user 93b7f4b9ee5e4b85a95f3989557222ee and project ebe6b545c1f44199a313289eb21fe0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:41:34.486544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:41:34.502430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:41:34.596181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6da241cf-bcc9-429f-91fe-cf0c60473418 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352535 Oct 18 16:41:34.599053 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3272/6501] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:41:34.614199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e8866982-5ad0-4dcf-89ed-b14cdc68b364 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:34.615183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e8866982-5ad0-4dcf-89ed-b14cdc68b364 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:34.727828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e8866982-5ad0-4dcf-89ed-b14cdc68b364 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:34.740704 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e8866982-5ad0-4dcf-89ed-b14cdc68b364 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1218 microversion: 2.1 time: 0.133006 Oct 18 16:41:34.741930 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3273/6502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:34 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:34.824540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:34.837212 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-de7bd75b-c5e3-45db-b0c1-fe3890748a2c tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1313 microversion: 2.1 time: 0.655737 Oct 18 16:41:34.838141 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3230/6503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:34 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:35.209783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:35.210807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:35.223375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.224197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.224929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.226363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.227574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.228739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.537730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:35.556854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97c1cf5a-af00-4975-9e64-0b79c39d57e3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 0.352632 Oct 18 16:41:35.559910 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3274/6504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:35 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:35.776466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:35.779670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:35.796738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.800337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.802294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.803227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.804212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.805825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.826244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:35.843559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.844320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.844915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.872272 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] Creating event network-changed:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h2-858383-14 Oct 18 16:41:35.894858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3e8e4764-1e1d-40fe-8560-54765cc614a8 req-0ce8406d-96f3-47f0-859c-8945d5b28e71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085233 Oct 18 16:41:35.898310 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3275/6505] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 16:41:35.909569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:35.910729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:35.931168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.931909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.932506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.933403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:35.934018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:35.935346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:35.960204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:35.973771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0453242b-f563-4a0a-925e-4e6092ac1bad tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1214 microversion: 2.1 time: 0.203345 Oct 18 16:41:35.979810 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3231/6506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:35 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:36.189325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c826a4c8-e582-4221-837c-99f427bd4e71 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-861019595", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:36.193159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c826a4c8-e582-4221-837c-99f427bd4e71 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] HTTP exception thrown: min_count must be <= max_count Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c826a4c8-e582-4221-837c-99f427bd4e71 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Request method failure captured: Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 183 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtc_6TyS6p7Z5cf6kADy_KS7JiVvEglJHcaACFkGTLKMj8dLa9bhiITV2ycOX925pX3VCDj-B-7biLWDXpEtyZT1tSJ-YzEC7tKH1fgRVLMXQc0W_WD67YdNYzpJujQmWJXWCE24F8X6Vl6MlmEj8ugflxYcRRyJQJKD7wzYlD_Zw_I Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}] Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3b2a5118e0334c86b8c4cf7d3daec8c5 Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-861019595", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: exception: min_count must be <= max_count Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-861019595', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 18 16:41:36.195463 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.202603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c826a4c8-e582-4221-837c-99f427bd4e71 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Returning 400 to user: min_count must be <= max_count {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:36.203626 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c826a4c8-e582-4221-837c-99f427bd4e71 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.222566 Oct 18 16:41:36.204528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3232/6507] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:35 2022] POST /compute/v2.1/servers => generated 74 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:36.273547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-436250aa-c9d5-4c8f-8ea5-1ec66e47b3b4 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1863669708", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "max_count": 0}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-436250aa-c9d5-4c8f-8ea5-1ec66e47b3b4 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Request method failure captured: Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 168 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtc_6TyS6p7Z5cf6kADy_KS7JiVvEglJHcaACFkGTLKMj8dLa9bhiITV2ycOX925pX3VCDj-B-7biLWDXpEtyZT1tSJ-YzEC7tKH1fgRVLMXQc0W_WD67YdNYzpJujQmWJXWCE24F8X6Vl6MlmEj8ugflxYcRRyJQJKD7wzYlD_Zw_I Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}] Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3b2a5118e0334c86b8c4cf7d3daec8c5 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1863669708", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "max_count": 0}} Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1863669708', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'max_count': 0}}} Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 0 Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:41:36.280948 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:36.285586 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.286648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-436250aa-c9d5-4c8f-8ea5-1ec66e47b3b4 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:36.287602 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-436250aa-c9d5-4c8f-8ea5-1ec66e47b3b4 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019028 Oct 18 16:41:36.300425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3233/6508] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:41:36.303904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:36.315236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f242c5a-3d52-4f18-8a6f-372f67ce20fc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1497 microversion: 2.1 time: 0.415378 Oct 18 16:41:36.316065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3276/6509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:35 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1497 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:36.588651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:36.589553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:36.596222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:36.596827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:36.597334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:36.598374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:36.598904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:36.599401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:36.810913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8be7a16c-ec84-4798-ae2a-8c4eb0ffb0a6 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1154840231", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "max_count": 2.5}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8be7a16c-ec84-4798-ae2a-8c4eb0ffb0a6 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Request method failure captured: Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 170 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtc_6TyS6p7Z5cf6kADy_KS7JiVvEglJHcaACFkGTLKMj8dLa9bhiITV2ycOX925pX3VCDj-B-7biLWDXpEtyZT1tSJ-YzEC7tKH1fgRVLMXQc0W_WD67YdNYzpJujQmWJXWCE24F8X6Vl6MlmEj8ugflxYcRRyJQJKD7wzYlD_Zw_I Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}] Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3b2a5118e0334c86b8c4cf7d3daec8c5 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1154840231", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "max_count": 2.5}} Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1154840231', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'max_count': 2.5}}} Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:41:36.816818 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8be7a16c-ec84-4798-ae2a-8c4eb0ffb0a6 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:36.821455 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8be7a16c-ec84-4798-ae2a-8c4eb0ffb0a6 tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020050 Oct 18 16:41:36.832273 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3277/6510] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:41:36.903649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:36.915181 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3774aea-0d6e-4383-afea-0f998389e3f2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 0.332539 Oct 18 16:41:36.931034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3234/6511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:36 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:37.003511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:37.004160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:37.021638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.023981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.025055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.027891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.028554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.030387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.077374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:37.131247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c74afbe-46c5-4b04-99d4-2ffd9fc668da tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1245905012", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 0}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c74afbe-46c5-4b04-99d4-2ffd9fc668da tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Request method failure captured: Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 168 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtc_6TyS6p7Z5cf6kADy_KS7JiVvEglJHcaACFkGTLKMj8dLa9bhiITV2ycOX925pX3VCDj-B-7biLWDXpEtyZT1tSJ-YzEC7tKH1fgRVLMXQc0W_WD67YdNYzpJujQmWJXWCE24F8X6Vl6MlmEj8ugflxYcRRyJQJKD7wzYlD_Zw_I Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}] Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 3b2a5118e0334c86b8c4cf7d3daec8c5 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1245905012", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 0}} Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1245905012', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'min_count': 0}}} Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi 0 Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:41:37.136080 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 16:41:37.140010 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.144920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c74afbe-46c5-4b04-99d4-2ffd9fc668da tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:37.146124 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c74afbe-46c5-4b04-99d4-2ffd9fc668da tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019687 Oct 18 16:41:37.149009 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3235/6512] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:41:37.171133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:37.171679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:37.181923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.182407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.187703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.188806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.189803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:37.190466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.191519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.205464 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c3088d7-000a-4b73-aa24-81c46ae860dc tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1276 microversion: 2.1 time: 0.203705 Oct 18 16:41:37.216586 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3278/6513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:36 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:37.247162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:41:37.300804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-552077a5-8d4b-46fa-b840-2115b79236bb tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861417892", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 2.5}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-552077a5-8d4b-46fa-b840-2115b79236bb tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Request method failure captured: Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 170 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtc_6TyS6p7Z5cf6kADy_KS7JiVvEglJHcaACFkGTLKMj8dLa9bhiITV2ycOX925pX3VCDj-B-7biLWDXpEtyZT1tSJ-YzEC7tKH1fgRVLMXQc0W_WD67YdNYzpJujQmWJXWCE24F8X6Vl6MlmEj8ugflxYcRRyJQJKD7wzYlD_Zw_I Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ad8f804fd884b80b1bb36b1228e350c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ad8f804fd884b80b1bb36b1228e350c"}]}] Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 7ad8f804fd884b80b1bb36b1228e350c Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1442622295 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 3b2a5118e0334c86b8c4cf7d3daec8c5 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1442622295-project Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861417892", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "min_count": 2.5}} Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1861417892', 'imageRef': '716a8cb0-5725-40db-af07-5a18594590ce', 'flavorRef': '452', 'min_count': 2.5}}} Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:41:37.304792 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-552077a5-8d4b-46fa-b840-2115b79236bb tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:37.308665 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-552077a5-8d4b-46fa-b840-2115b79236bb tempest-MultipleCreateNegativeTestJSON-1442622295 tempest-MultipleCreateNegativeTestJSON-1442622295-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011680 Oct 18 16:41:37.317405 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3279/6514] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:41:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 16:41:37.454108 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f1c46ed-034f-4785-a0a9-068c5d4ddb79 tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 204 len: 0 microversion: 2.1 time: 0.288681 Oct 18 16:41:37.454790 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3236/6515] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:41:37 2022] DELETE /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:41:37.464619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:37.465968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:37.474367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:37.504854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.506547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.507492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.513780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.514290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.515535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.887945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:37.898347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-33a999e4-2bbe-42b0-8c54-cc7341469b2e tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1503 microversion: 2.1 time: 0.438644 Oct 18 16:41:37.900284 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3280/6516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:37 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1503 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:37.942446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:37.943322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:37.954983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.956125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.957210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:37.958211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:37.958916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:37.959647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:38.163468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:38.174976 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0780b620-a7a9-4a07-8f3d-408c5803306d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 0.239972 Oct 18 16:41:38.175767 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3237/6517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:37 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:38.232852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:38.236003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:38.244372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:38.245485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:38.246324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:38.248808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:38.250046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:38.250955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:38.451766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:38.460010 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-474e25ba-0ed9-4186-8203-524d77ef030c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.233429 Oct 18 16:41:38.460868 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3281/6518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:38 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:38.957456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:38.958081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:38.969467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:38.975431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:38.975816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:38.976440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:38.977374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:38.978161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:38.978748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:39.197968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:39.201891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:39.212016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:39.212915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:39.214078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:39.215078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:39.215967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:39.216691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:39.316960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:39.333204 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7307c1e0-32ed-4f2a-ae0d-0107cde5695a tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1503 microversion: 2.1 time: 0.403028 Oct 18 16:41:39.339220 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3238/6519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:38 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:39.485084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:39.485974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:39.492251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:39.493133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:39.493820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:39.494550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:39.495001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:39.495430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:39.735088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:39.745280 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.265012 Oct 18 16:41:39.747835 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3239/6520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:39 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:40.170959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:40.172033 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7219bd1-044f-4dbd-a1be-25ada6478c8e tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001371 Oct 18 16:41:40.172384 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3240/6521] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 18 16:41:40 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 18 16:41:40.194023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:40.207650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a221aae-d219-43e2-9df1-d1096627259b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 1.013227 Oct 18 16:41:40.223598 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3282/6522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:39 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:40.357053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:40.357692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:40.372526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:40.378547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:40.379465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:40.381926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:40.382642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:40.385749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:40.586423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4dd2c3b9b684160aa8511d85b5ec446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd133cec4ca14729a6dd03a36ba5a7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:40.606801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-286703f8-838f-49d6-98b5-7756221a0ebf tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 200 len: 1461 microversion: 2.1 time: 0.251478 Oct 18 16:41:40.610879 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3241/6523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:40 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 1461 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:40.745230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445770f-bc56-40c7-81f2-a08b000e4305", "name": "network-vif-deleted", "tag": "5dba540d-0ba0-4063-a8ba-b0835cbe1586"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:40.773837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:40.774702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:40.788872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:40.791403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:40.792329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:40.793099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:40.795570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:40.796100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:40.809828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:40.813759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:40.815623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:40.874298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] Creating event network-vif-deleted:5dba540d-0ba0-4063-a8ba-b0835cbe1586 for instance 1445770f-bc56-40c7-81f2-a08b000e4305 on n-h1-858383-14 Oct 18 16:41:40.902285 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1716fa9f-4b18-4a74-8741-71b64f8deac5 req-681daf83-76ed-4c27-adf7-5bbe31903dd7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164232 Oct 18 16:41:40.917459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3283/6524] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:41.203257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:41.219935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3bf5328-0926-4bc7-834e-7d21807636e1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.452001 Oct 18 16:41:41.220347 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3242/6525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:40 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:41.239316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:41.240604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:41.247131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:41.247887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:41.248907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:41.250146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:41.251121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:41.251713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:41.602123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:41.619336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed64e333-d102-4ace-8d94-4277437b2e6d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 0.382767 Oct 18 16:41:41.645021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3284/6526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:41 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:41.645497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:41.645497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] [instance: 1445770f-bc56-40c7-81f2-a08b000e4305] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:41.674182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:41.674746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:41.675681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:41.676656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:41.677326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:41.677920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:41.718372 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] HTTP exception thrown: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Request method failure captured: Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 HTTP/1.1 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtcBep2o-AuGiNtm1oQEQcIecmFjM_6aa3mK3ApbCjXnPdZoiDX_tFI6sl1JYvcT7CeCkV4x2bNmVN-EAly9Pbpyd_dnJN7J_Q2ZYX-HJZIt3zBRD_HolOONlS6TvUjK_8t-HSvil54EmhiEGsJ2hNo-O8-n8VOcwVaN7kNfmxmtLTI Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: dd133cec4ca14729a6dd03a36ba5a7af Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd133cec4ca14729a6dd03a36ba5a7af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd133cec4ca14729a6dd03a36ba5a7af"}]}] Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: dd133cec4ca14729a6dd03a36ba5a7af Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesActionsTest-1755806082 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesActionsTest-1755806082-project Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: e4dd2c3b9b684160aa8511d85b5ec446 Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesActionsTest-1755806082-project Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '1445770f-bc56-40c7-81f2-a08b000e4305'} Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:41:41.721146 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. Oct 18 16:41:41.725790 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:41:41.727571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] Returning 404 to user: Instance 1445770f-bc56-40c7-81f2-a08b000e4305 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:41:41.728646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49c6a61b-0592-4c42-a8ca-eb3d5aca6ffc tempest-VolumesActionsTest-1755806082 tempest-VolumesActionsTest-1755806082-project] 10.222.0.78 "GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305" status: 404 len: 111 microversion: 2.1 time: 0.095534 Oct 18 16:41:41.729765 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3243/6527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:41 2022] GET /compute/v2.1/servers/1445770f-bc56-40c7-81f2-a08b000e4305 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:41:42.209677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "name": "network-vif-plugged", "status": "completed", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:42.223618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.224563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.225773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.246166 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] Creating event network-vif-plugged:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h2-858383-14 Oct 18 16:41:42.247903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:42.250271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:42.253148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9025d276-ef6a-4cee-b492-2c2a497b7b1d req-da529c62-adc5-4e29-bfee-ccf2de55fa6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047140 Oct 18 16:41:42.254073 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3285/6528] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:42.264143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.270638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.271736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.274143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.274833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.275663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.626815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:42.637765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd4ad14f-2708-4985-a350-78e9fa5c14ef tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.395215 Oct 18 16:41:42.638999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3244/6529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:42 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:41:42.661852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:42.662680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:42.674387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.675212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.676096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.677039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.677760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.678874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.867979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:42.891424 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0e30205-1f02-4afc-a46a-3313e8afa5fe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1392 microversion: 2.1 time: 0.233792 Oct 18 16:41:42.907599 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3286/6530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:42 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:42.949662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e644ea-81aa-4eeb-9da7-0194e246c659", "tag": "257ce36c-cf86-477a-b7fb-49e40e3c61e3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:42.966414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:42.966911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:42.967351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:42.985159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] Creating event network-changed:257ce36c-cf86-477a-b7fb-49e40e3c61e3 for instance 41e644ea-81aa-4eeb-9da7-0194e246c659 on n-h1-858383-14 Oct 18 16:41:42.990407 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7056ef82-2f16-4ff2-8b40-9d61558277b6 req-e8eede9d-8392-412a-a536-b468d6fbc877 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044374 Oct 18 16:41:42.991750 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3245/6531] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:43.188298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09b4926e-727f-4f92-8537-8ccdbe82d30c tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Calling method '.version_select at 0x7f5fd158d940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.299170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09b4926e-727f-4f92-8537-8ccdbe82d30c tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.323029 Oct 18 16:41:43.299855 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3287/6532] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:41:42 2022] GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5/defaults => generated 371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:43.318350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-38b19b9f-565e-43b1-88b7-9b89b743d4c8 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Calling method '.version_select at 0x7f5fd15bb430>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.423753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-38b19b9f-565e-43b1-88b7-9b89b743d4c8 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5" status: 200 len: 371 microversion: 2.1 time: 0.112027 Oct 18 16:41:43.425129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3246/6533] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:43.440055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-595145a2-954c-468c-8f61-a39c514e3a0e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Calling method '.version_select at 0x7f5fd1421ee0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.556739 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-595145a2-954c-468c-8f61-a39c514e3a0e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.120900 Oct 18 16:41:43.557663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3288/6534] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5/defaults => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:43.572773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4e6c867-5111-4b0c-a4ae-8dfa38a31a67 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Calling method '.version_select at 0x7f5fd64b8e50>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.662842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.663371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:43.672531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:43.673246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:43.673819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:43.674786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:43.675377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:43.676291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:43.701559 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4e6c867-5111-4b0c-a4ae-8dfa38a31a67 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5" status: 200 len: 371 microversion: 2.1 time: 0.130838 Oct 18 16:41:43.712025 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3247/6535] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:41:43.719363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a61b1027-3aa9-4d8d-8478-2ab727f8eda4 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Calling method '.version_select at 0x7f5fd6522ca0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.881053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:43.891888 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa0a9287-3ee9-493b-8367-e605b18c3208 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.232551 Oct 18 16:41:43.893083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3289/6536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:43.921771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:43.927052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:43.951687 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a61b1027-3aa9-4d8d-8478-2ab727f8eda4 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5?user_id=a4c81d21eabf414e8d4c1583b0eaba2b" status: 200 len: 371 microversion: 2.1 time: 0.236875 Oct 18 16:41:43.952448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:43.953593 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3248/6537] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/os-quota-sets/d609d9c28b1e41dbb1397732022376b5?user_id=a4c81d21eabf414e8d4c1583b0eaba2b => generated 371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:43.954306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:43.954946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:43.955993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:43.956629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:43.957256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:44.384137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:44.404576 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc23e4fc-5479-47da-8187-980d84d9d77b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1565 microversion: 2.1 time: 0.490790 Oct 18 16:41:44.406752 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3290/6538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:43 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1565 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:44.439303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:44.440696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:44.452686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:44.453642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:44.454340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:44.455351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:44.456045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:44.456739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:44.738757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:44.743347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:44.757625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5776e1de-da66-4f89-8c50-9ccde645fe6e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1565 microversion: 2.1 time: 0.318557 Oct 18 16:41:44.758591 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3249/6539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:44 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1565 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:44.916257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:44.916905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:44.920216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:44.920931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=18 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:44.952239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:44.952783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:44.962053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:44.962962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:44.964383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:44.967718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:45.411907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:45.428351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d083b7b-cbb9-47a1-9db6-dc1e5d547cd5 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.513834 Oct 18 16:41:45.429223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3291/6540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:44 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:46.463190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:46.463928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:46.501820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:46.502364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:46.504287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:46.505158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:46.505648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:46.506094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:46.915838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:46.954459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f808aaaa-2a25-4f87-99ca-84211b699523 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.503009 Oct 18 16:41:46.962362 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3250/6541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:46 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:47.997594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:47.999273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:48.030748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:48.033446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:48.034921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:48.038338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:48.041570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:48.046999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:48.469195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e644ea-81aa-4eeb-9da7-0194e246c659", "name": "network-vif-plugged", "status": "completed", "tag": "257ce36c-cf86-477a-b7fb-49e40e3c61e3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:48.498549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:48.499782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:48.502165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:48.527596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:48.544723 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75fa0630-5710-41be-a6f7-5a23a6b1d4d7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.561818 Oct 18 16:41:48.552001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3292/6542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:47 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:48.560955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] Creating event network-vif-plugged:257ce36c-cf86-477a-b7fb-49e40e3c61e3 for instance 41e644ea-81aa-4eeb-9da7-0194e246c659 on n-h1-858383-14 Oct 18 16:41:48.570676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ddff5344-0158-40b2-a31e-841c581fa2fa req-500782b1-3c77-4a65-8c53-8105ab148b38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107745 Oct 18 16:41:48.571790 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3251/6543] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:49.382150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:49.383308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:49.392370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:41:49.407907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:49.410391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:49.412763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:49.413715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:49.414617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:49.416705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:49.417240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:49.417675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:49.425540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:49.484968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] Creating event network-changed:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h2-858383-14 Oct 18 16:41:49.518106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5c653d5e-f3a2-4db1-a489-dac0803d38c2 req-01945036-6ee4-4c02-889e-f6b2acabaacf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130720 Oct 18 16:41:49.526242 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3252/6544] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:41:49.575799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:49.576532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:49.596340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:49.597259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:49.604595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:49.608699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:49.618236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:49.619251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:49.876262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:49.891752 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fddfe018-a562-455e-893d-a72aa68626cc tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1565 microversion: 2.1 time: 0.513882 Oct 18 16:41:49.904179 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3293/6545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:49 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1565 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:50.380832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:50.393738 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8db541c-07ba-4f19-b054-9ddc7b78afba tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1318 microversion: 2.1 time: 0.825667 Oct 18 16:41:50.409977 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3253/6546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:49 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:41:51.420332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:41:51.421195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:41:51.437136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:51.437671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:51.438126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:51.438903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:41:51.439385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:41:51.439818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:41:52.025604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:41:52.035510 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f37b12f-acd4-4d84-b2af-49792f028460 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1506 microversion: 2.1 time: 0.619163 Oct 18 16:41:52.042233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3294/6547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:41:51 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:00.296455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=8 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:00.302103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=37 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:00.392869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=17 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:00.514851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-609648800", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e3e390b5-c9bb-4944-8536-dc7768af008e"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:10.527071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:12.608886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] validate_networks() for [('e3e390b5-c9bb-4944-8536-dc7768af008e', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:42:13.524797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:42:13.527546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:42:13.529034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:42:13.530297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:42:13.531806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:42:13.550666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:13.551857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:13.552583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:13.553760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:13.554570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:13.555355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:13.585348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Getting quotas for project aec13f6a69f6473ba45dcd9790e2520d. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:42:13.593915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Getting quotas for user 563a2112837048d693979d948c066894 and project aec13f6a69f6473ba45dcd9790e2520d. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:42:13.614241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:42:13.619827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:42:13.705757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-76d6c9d5-2c38-4676-b499-237899d1353d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.415381 Oct 18 16:42:13.706925 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3254/6548] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:42:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 13418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:42:13.716583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:13.717754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=75 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:13.724169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05516f66-9adf-498e-b020-6b5da554de17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:13.725379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05516f66-9adf-498e-b020-6b5da554de17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:13.982542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05516f66-9adf-498e-b020-6b5da554de17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:14.015863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05516f66-9adf-498e-b020-6b5da554de17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1213 microversion: 2.1 time: 0.300596 Oct 18 16:42:14.016345 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3295/6549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:13 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:42:15.046774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:15.047772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:15.065757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:15.076287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:15.082302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:15.083731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:15.085596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:15.086211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:15.270470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:15.279528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c30ae404-efa0-41cb-b64b-ff729085ae17 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1217 microversion: 2.1 time: 0.238128 Oct 18 16:42:15.280134 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3255/6550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:15 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:16.308930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:16.310313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:16.320188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:16.333794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:16.334566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:16.335548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:16.336219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:16.336889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:16.533431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:16.550161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab160fd2-29e6-474e-bef6-cb56649bdfe1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1283 microversion: 2.1 time: 0.245464 Oct 18 16:42:16.551176 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3296/6551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:16 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:17.578263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:17.580742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:17.595093 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:42:17.596661 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 (ip 10.222.0.78) !!! Oct 18 16:42:17.601586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:17.612598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:17.614656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:17.623824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:17.624800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:17.626791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:18.792986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:18.804458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99ab78e5-1cd4-40d3-bd6d-351bb9e4d66f tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 1.230849 Oct 18 16:42:18.805051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3256/6552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:17 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:19.830249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:19.831018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:19.871357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:19.883543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:19.886149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:19.889894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:19.891302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:19.894561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:19.895402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51eeaa91-b894-4905-95be-6e0a70f83720", "tag": "429d68b2-6735-4fbe-a4a7-ce262531c766"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:19.935315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:19.936573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:19.938517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:19.965338 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] Creating event network-changed:429d68b2-6735-4fbe-a4a7-ce262531c766 for instance 51eeaa91-b894-4905-95be-6e0a70f83720 on n-h1-858383-14 Oct 18 16:42:19.975334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-35f9badd-356b-45a7-8fc7-2a20595b7113 req-d24ad6da-1dee-46f6-a63e-87636c85edf2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409932 Oct 18 16:42:19.979099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3297/6553] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:42:20.183708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:20.195593 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f95e0ab4-49ff-4201-a620-ffa7f3982fa1 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.370883 Oct 18 16:42:20.211059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3257/6554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:19 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:21.230381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:21.231349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:21.246962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:21.248117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:21.248680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:21.249505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:21.250038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:21.250537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:21.273223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:21.280346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:21.301108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:21.302120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:21.302795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:21.303756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:21.304325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:21.304841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:21.383461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdff3580-658c-492f-b5ab-679b3e30ea42 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action" status: 200 len: 24571 microversion: 2.1 time: 0.115923 Oct 18 16:42:21.384168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3258/6555] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:42:21 2022] POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action => generated 24571 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:42:21.533782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:21.546868 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b48c818-9e71-4ee5-a9ee-472a431e85ea tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.327281 Oct 18 16:42:21.562836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3298/6556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:21 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:22.575846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:22.577284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:22.586604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:22.587327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:22.588026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:22.589621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:22.591226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:22.591931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:23.003948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:23.014206 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c7be4ac2-1640-4f6c-b71a-eaf4562f4264 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.445189 Oct 18 16:42:23.021164 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3259/6557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:22 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:24.045324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.051692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:24.052675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:24.063563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.064295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.065242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.066167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.066841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.067495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.347632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:24.361627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b03410d1-30c5-4a76-93ff-ab3a61122850 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.319981 Oct 18 16:42:24.375131 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3299/6558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:24 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:24.421252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e70381-41de-4c63-b8b6-7eb20194bda5", "device": "/dev/sdb"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:24.424297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:24.444748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.452651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.455949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.457587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.459555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.460448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.462817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.463517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.997080 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-44851188-c05e-4e8a-aa4d-00d9bad7da1c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "POST /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.579058 Oct 18 16:42:24.999650 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3260/6559] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:42:24 2022] POST /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:42:25.389207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:25.389867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:25.405155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:25.407069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:25.410176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:25.411686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:25.412369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:25.414198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:26.257380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:26.279002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2d36eda-7793-4f13-a20b-29bd8bf092dc tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.894012 Oct 18 16:42:26.286368 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3300/6560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:25 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:27.320801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:27.321824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:27.354462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:27.359555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:27.360429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:27.365057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:27.365760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:27.366357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:27.720949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:27.731078 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1e25dc6-1087-4ccc-a0e0-64066035bb96 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.425758 Oct 18 16:42:27.745254 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3261/6561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:27 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:28.756559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:28.757696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:28.780880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:28.788173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:28.788654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:28.789516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:28.790012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:28.790433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:28.985848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eeaa91-b894-4905-95be-6e0a70f83720", "name": "network-vif-plugged", "status": "completed", "tag": "429d68b2-6735-4fbe-a4a7-ce262531c766"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:29.002844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:29.003595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:29.004500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:29.032579 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] Creating event network-vif-plugged:429d68b2-6735-4fbe-a4a7-ce262531c766 for instance 51eeaa91-b894-4905-95be-6e0a70f83720 on n-h1-858383-14 Oct 18 16:42:29.042740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-63926434-7c74-4a08-95ed-0aa5240636f1 req-b13b1d84-e74f-46fc-8fc7-d43be02a167e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061171 Oct 18 16:42:29.043650 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3262/6562] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:42:29.529536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:29.537932 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4869ddf-34f1-43ff-82b7-b9676d8411e8 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.785199 Oct 18 16:42:29.538508 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3301/6563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:28 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:30.566059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:30.566775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:30.586249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:30.586746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:30.587190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:30.587931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:30.588965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:30.589910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:30.962510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:30.976320 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a800ee9-280e-49a2-8103-5e267af8d245 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1313 microversion: 2.1 time: 0.416628 Oct 18 16:42:30.979758 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3263/6564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:30 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:32.020050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:32.020574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:32.029724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:32.030530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:32.031137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:32.032013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:32.032663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:32.033333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:32.245353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:32.259658 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-173f6a14-0885-472b-8f9e-c6e056c9561a tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1498 microversion: 2.1 time: 0.243561 Oct 18 16:42:32.264127 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3302/6565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:32 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:35.653262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:35.654387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:35.664608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:35.665427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:35.666609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:35.667637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:35.668280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:35.668905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:35.706393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:42:35.814635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-856411f4-9b87-4b60-a4b6-9cc86e4da1e3 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "DELETE /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 204 len: 0 microversion: 2.1 time: 0.165840 Oct 18 16:42:35.815624 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3264/6566] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:42:35 2022] DELETE /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:42:35.825101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:35.826409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:35.834465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:35.835305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:35.835949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:35.836871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:35.837540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:35.838383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:36.132465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:36.146266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-331f85df-49b6-4720-853c-358f36ad1999 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1504 microversion: 2.1 time: 0.325833 Oct 18 16:42:36.147739 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3303/6567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:35 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:37.172927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:37.176309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:37.184003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:37.184791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:37.185285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:37.186688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:37.187336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:37.187336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:37.508868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:37.519016 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd4869be-a3dd-4b6f-a775-1622bf6a46a6 tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1504 microversion: 2.1 time: 0.350243 Oct 18 16:42:37.520128 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3265/6568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:37 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:38.215370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eeaa91-b894-4905-95be-6e0a70f83720", "name": "network-vif-deleted", "tag": "429d68b2-6735-4fbe-a4a7-ce262531c766"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:38.226155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:38.227143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:38.227860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:38.252461 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] Creating event network-vif-deleted:429d68b2-6735-4fbe-a4a7-ce262531c766 for instance 51eeaa91-b894-4905-95be-6e0a70f83720 on n-h1-858383-14 Oct 18 16:42:38.265652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-536206bc-c5bc-416c-9081-0b0dddffe029 req-bc915a94-7ba2-4a6c-95b6-3d64b43e22d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059433 Oct 18 16:42:38.267555 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3304/6569] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:42:38.563665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:38.569563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:38.603191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:38.610427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:38.611139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:38.614118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:38.615083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:38.616678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:38.699335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:38.699704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:38.701466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:38.702270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lazy-loading 'fault' on Instance uuid 51eeaa91-b894-4905-95be-6e0a70f83720 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:42:38.762021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563a2112837048d693979d948c066894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec13f6a69f6473ba45dcd9790e2520d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:38.770116 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2fe75abb-a2f1-4b37-b75f-d5cd657c367d tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 200 len: 1303 microversion: 2.1 time: 0.230386 Oct 18 16:42:38.770702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3266/6570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:38 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:39.804083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:39.805401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] [instance: 51eeaa91-b894-4905-95be-6e0a70f83720] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:39.820314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:39.822071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:39.822071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:39.822071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:39.823613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:39.824318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:39.847476 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] HTTP exception thrown: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Request method failure captured: Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 HTTP/1.1 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtdVFUiMTH-VovApT9NIpySS--xduG3IfOBUZRgEYD2aRyzIEWpmlwcXpHhuWOOUiuKE1Rb3Mcqtbxfj9s6rc4sl8cdox2k2XdMIdj7hXjZ6pdsxbLdcmLzaxWIoMZvoZodYuvzwIVjIftP73S-4DtzSbixIjIQI6Hs0xF0ZKsnayb8 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: aec13f6a69f6473ba45dcd9790e2520d Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-VolumesActionsTest-193335329 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aec13f6a69f6473ba45dcd9790e2520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aec13f6a69f6473ba45dcd9790e2520d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aec13f6a69f6473ba45dcd9790e2520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aec13f6a69f6473ba45dcd9790e2520d"}]}] Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-VolumesActionsTest-193335329 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: aec13f6a69f6473ba45dcd9790e2520d Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-VolumesActionsTest-193335329 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-VolumesActionsTest-193335329-project Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 563a2112837048d693979d948c066894 Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-VolumesActionsTest-193335329-project Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '51eeaa91-b894-4905-95be-6e0a70f83720'} Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:42:39.856588 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] Returning 404 to user: Instance 51eeaa91-b894-4905-95be-6e0a70f83720 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90f0e9e5-acdc-4440-9159-d0a44845970e tempest-VolumesActionsTest-193335329 tempest-VolumesActionsTest-193335329-project] 10.222.0.78 "GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720" status: 404 len: 111 microversion: 2.1 time: 0.062697 Oct 18 16:42:39.862019 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3305/6571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:39 2022] GET /compute/v2.1/servers/51eeaa91-b894-4905-95be-6e0a70f83720 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:43:00.197675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:00.199339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:00.204266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:00.206148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:00.228919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:00.230298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:00.231323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:00.233208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:00.234208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:00.235104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:00.373149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lazy-loading 'services' on Instance uuid 41e644ea-81aa-4eeb-9da7-0194e246c659 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:43:00.458071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:00.460104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:00.471364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=24 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:00.472739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=48 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:00.475373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:00.476214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:00.477286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:00.479324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:00.480454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:00.481624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:00.528519 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4c0f332-77f8-48be-98db-9aec463eec1d tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659/os-volume_attachments/c8e70381-41de-4c63-b8b6-7eb20194bda5" status: 202 len: 0 microversion: 2.1 time: 0.332413 Oct 18 16:43:00.533745 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3267/6572] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:43:00 2022] DELETE /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659/os-volume_attachments/c8e70381-41de-4c63-b8b6-7eb20194bda5 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:43:01.109723 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-858dc5fc-5fd0-4148-b88c-846cf25454ee tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1837 microversion: 2.1 time: 0.657436 Oct 18 16:43:01.117787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3306/6573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:00 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1837 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:01.140720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:01.141481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:01.152505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.158283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.159371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.160740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.173899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.175545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.406466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:01.416067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40bae458-564d-4340-8ec6-98bdad032f1a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1684 microversion: 2.1 time: 0.282358 Oct 18 16:43:01.418086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3268/6574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:01 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1684 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:01.584328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:01.587775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:01.600022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.600894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.601610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.603263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.603948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.604607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.679599 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1aa626f7-a1c3-40c1-bec5-6f230cd2b223 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action" status: 200 len: 32644 microversion: 2.1 time: 0.100573 Oct 18 16:43:01.692325 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3307/6575] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:43:01 2022] POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action => generated 32644 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:43:01.828318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:01.828985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:01.848981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.849742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.850398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.851218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:01.851796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:01.852482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:01.938509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ffde37ad3364246b878de50a1fbef50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0715cffedd40429f9755053f748669f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:01.939280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] flavor_id is None. Assuming migration. {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 16:43:01.941747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:43:02.575977 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5cc06e5c-44ea-4f68-aea1-97c09f6c5761 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action" status: 202 len: 0 microversion: 2.1 time: 0.751564 Oct 18 16:43:02.577165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3269/6576] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:43:01 2022] POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:43:02.589999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:02.591623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:02.616641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:02.621627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:02.624622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:02.628592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:02.629849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:02.630650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:02.978422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:02.988063 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73775cfb-6275-45ac-9341-b3f5e98af61a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1693 microversion: 2.1 time: 0.406592 Oct 18 16:43:03.011939 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3308/6577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:02 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1693 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:04.021044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:04.021665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:04.032715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:04.033278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:04.033721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:04.034427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:04.040385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:04.040903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:04.301859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:04.313460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-428f7df2-d0b6-4a27-95e0-836ac35ad719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1693 microversion: 2.1 time: 0.297127 Oct 18 16:43:04.317744 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3270/6578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:04 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1693 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:05.343032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:05.344366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:05.359127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:05.363312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:05.367386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:05.369124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:05.372946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:05.374444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:05.781951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:05.796957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0697ff83-dfbd-4691-a452-7153cf872c05 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1693 microversion: 2.1 time: 0.457750 Oct 18 16:43:05.799027 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3309/6579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:05 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1693 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:06.826535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:06.827593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:06.853833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:06.855795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:06.857152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:06.860049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:06.860968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:06.863064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:07.104695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:07.116147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e48750f4-b448-46f2-8179-a56b4828a35b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.296723 Oct 18 16:43:07.117231 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3271/6580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:06 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:08.143735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:08.149134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:08.165057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.168134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.169778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:08.171813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.172515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.174285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:08.483233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:08.496943 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef26b58a-ca3b-4443-82d9-960a9b2ae97c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.358531 Oct 18 16:43:08.498488 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3310/6581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:08 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:08.598097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:08.598759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:08.608581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.609358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.609965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:08.610862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.611322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.611950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:08.640844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:43:08.750068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14039a6a-4a77-4d3d-b59c-3d9ff68cacc0 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 204 len: 0 microversion: 2.1 time: 0.156217 Oct 18 16:43:08.753053 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3272/6582] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:43:08 2022] DELETE /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:43:08.765022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:08.766058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:08.773829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.774957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.775615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:08.776645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:08.777635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:08.778468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:09.481753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:09.492456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-290a9050-2d1e-4379-9823-6bd3defb202f tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1512 microversion: 2.1 time: 0.735165 Oct 18 16:43:09.494540 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3311/6583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:08 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:09.523308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:09.524237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:09.536163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:09.537292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:09.537942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:09.539767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:09.540815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:09.542451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:10.078009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:10.088869 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-023f3cc8-791a-4d17-824c-a64afa3cc55c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.570045 Oct 18 16:43:10.113929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3273/6584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:09 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:10.533234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:10.534892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:10.574030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:10.574908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:10.575608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:10.576821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:10.577538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:10.578212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:11.133046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:11.135215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:11.150432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:11.151603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:11.158552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:11.159887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:11.160868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:11.162085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:11.188074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:11.209282 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4f6b230f-b99a-4ebc-9a70-199dce8ea4e6 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1512 microversion: 2.1 time: 0.690087 Oct 18 16:43:11.210379 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3312/6585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:10 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:11.635824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:11.655954 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2534ae34-7ade-4eb4-add1-4cb5edee2f25 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.527925 Oct 18 16:43:11.699144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e644ea-81aa-4eeb-9da7-0194e246c659", "name": "network-vif-deleted", "tag": "257ce36c-cf86-477a-b7fb-49e40e3c61e3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:11.707514 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3274/6586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:11 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:11.715957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:11.717342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:11.718338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:11.753456 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] Creating event network-vif-deleted:257ce36c-cf86-477a-b7fb-49e40e3c61e3 for instance 41e644ea-81aa-4eeb-9da7-0194e246c659 on n-h1-858383-14 Oct 18 16:43:11.764298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1d84090b-685e-4919-94ee-ad2e86dc0da3 req-2b5edf6b-5b60-4537-a7d9-dd08a82efe73 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070311 Oct 18 16:43:11.765642 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3313/6587] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:12.236815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:12.237477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:12.251444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:12.251943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:12.254681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:12.256694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:12.257221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:12.257670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:12.350574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:12.351464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:12.352099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:12.353396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lazy-loading 'fault' on Instance uuid 41e644ea-81aa-4eeb-9da7-0194e246c659 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:43:12.432082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:12.457704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94a49855-5ed9-4880-9476-a6a1cfe75ef7 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 200 len: 1308 microversion: 2.1 time: 0.225937 Oct 18 16:43:12.458764 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3275/6588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:12 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:12.711301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:12.714391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:12.735535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:12.737208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:12.739380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:12.743985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:12.744632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:12.745210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:13.250595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:13.266034 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-395c5b27-d7d7-41a8-9c47-be0d8a4140e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.562279 Oct 18 16:43:13.267228 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3314/6589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:12 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:13.484307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:13.488957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 41e644ea-81aa-4eeb-9da7-0194e246c659] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:13.502641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:13.505955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:13.506593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:13.509735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:13.510752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:13.516141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:13.540362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] HTTP exception thrown: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Request method failure captured: Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 HTTP/1.1 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtbOCzTmQ6Wo_ncYram231Xy-lJNJ6Evu-qgQISx0vuPC8jRWFJ-N3C8fOpPfmyRBPWTfgdYbfg_mq20nalPnPYA3LUHqJ5h38FpspKmckFLt6ndFs92oMOM85bRcnJgIm2W7njhHkwOkIlxFJNdtq8jlw4OX6kqccq7H7lPobQ49lo Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ebe6b545c1f44199a313289eb21fe0b2 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebe6b545c1f44199a313289eb21fe0b2"}]}] Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ebe6b545c1f44199a313289eb21fe0b2 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesSnapshotTestJSON-236265184-project Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 93b7f4b9ee5e4b85a95f3989557222ee Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesSnapshotTestJSON-236265184-project Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '41e644ea-81aa-4eeb-9da7-0194e246c659'} Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:43:13.545600 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. Oct 18 16:43:13.550625 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:43:13.552833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Returning 404 to user: Instance 41e644ea-81aa-4eeb-9da7-0194e246c659 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:43:13.554060 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-73d7b535-069f-4041-a607-26f2aa64b461 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659" status: 404 len: 111 microversion: 2.1 time: 0.074005 Oct 18 16:43:13.555935 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3276/6590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:13 2022] GET /compute/v2.1/servers/41e644ea-81aa-4eeb-9da7-0194e246c659 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:43:14.296624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:14.298020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:14.312946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:14.318203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:14.318949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:14.328821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:14.330411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:14.333623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:14.660433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:14.669863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c540b5d-e236-4955-a30c-9e4c5c43b2a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.377691 Oct 18 16:43:14.686365 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3315/6591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:14 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:43:15.704796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:15.705785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:15.718290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:15.719124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:15.719741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:15.720670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:15.721442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:15.722038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:16.099188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:16.119848 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6e0b9f7-5a2a-4d42-9428-323db0a194d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.418457 Oct 18 16:43:16.136226 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3277/6592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:15 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:17.165426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:17.166055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:17.196468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:17.196914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:17.197389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:17.198151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:17.198720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:17.199162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:17.567350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:17.578413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-937840be-0ed5-489d-85b9-7b2faefbdab7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.418514 Oct 18 16:43:17.593897 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3316/6593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:17 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:18.604150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:18.604932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:18.614563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:18.615224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:18.615758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:18.616745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:18.618155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:18.618935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:18.816199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:18.835129 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1311668-238a-41f5-addb-d5f19dd3b044 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.235656 Oct 18 16:43:18.857488 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3278/6594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:18 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:19.879937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:19.880566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:19.899629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:19.900432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:19.901114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:19.902048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:19.902752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:19.903236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:20.186721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:20.194898 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-812f9795-8e46-4cbf-ad58-eede18797a83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.319156 Oct 18 16:43:20.195572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3317/6595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:19 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:21.219313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:21.219933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:21.238216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:21.238709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:21.239142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:21.239844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:21.240296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:21.240716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:21.565059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:21.578336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:21.590046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ae8431c-a95a-4824-a5a1-8f2f9104fe3a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.374412 Oct 18 16:43:21.615024 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3279/6596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:21 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:22.620579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:22.621292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:22.636517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:22.637514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:22.638545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:22.639668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:22.653890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:22.657114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:22.941322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:22.965620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ef7e380-df25-497f-9c8a-89bcb751e5cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1698 microversion: 2.1 time: 0.349505 Oct 18 16:43:22.973680 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3318/6597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:22 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1698 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:24.007442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:24.008484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:24.043866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:24.045676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:24.046862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:24.051841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:24.052479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:24.055735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:24.169979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1556196502", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "4637ac00-3514-4648-a695-b4e13a9bed54"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:24.238496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] validate_networks() for [('4637ac00-3514-4648-a695-b4e13a9bed54', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:43:24.354861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:24.369303 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bcd1bd9a-9547-47da-b2ae-7f900e594314 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1697 microversion: 2.1 time: 0.364475 Oct 18 16:43:24.370635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3280/6598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:24 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1697 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:25.238333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "name": "network-vif-unplugged", "status": "completed", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:25.256618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:25.258248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:25.258936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:25.282925 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Creating event network-vif-unplugged:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h1-858383-14 Oct 18 16:43:25.295701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:43:25.312759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f8f0ea69-4b77-4832-8b1d-a04b946a4fec req-da4bc120-976c-4ea5-9942-273bff89c242 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077147 Oct 18 16:43:25.312928 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3281/6599] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:43:25.421844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:25.423926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:25.434283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:25.434951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:25.435582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:25.436274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:25.436730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:25.437183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:25.688764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:25.700903 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3a580f8-5184-46b5-9672-c9bafc90abef tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1697 microversion: 2.1 time: 0.310052 Oct 18 16:43:25.703289 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3282/6600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:25 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:43:26.284694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:43:26.285345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:43:26.286290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:43:26.287018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:43:26.287726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:43:26.305881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:26.307618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:26.308067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:26.308818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:26.309306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:26.309738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:26.330749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Getting quotas for project ebe6b545c1f44199a313289eb21fe0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:43:26.337148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Getting quotas for user 93b7f4b9ee5e4b85a95f3989557222ee and project ebe6b545c1f44199a313289eb21fe0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:43:26.353575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:43:26.356348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:43:26.442316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b3d3661-59ea-4482-a0e3-44de5b1b5e39 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281063 Oct 18 16:43:26.443782 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3319/6601] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:43:26.454857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-131c9884-9cb7-419a-be13-9ed0015a71bd tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:26.455471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-131c9884-9cb7-419a-be13-9ed0015a71bd tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:26.553226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-131c9884-9cb7-419a-be13-9ed0015a71bd tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:26.562073 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-131c9884-9cb7-419a-be13-9ed0015a71bd tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1219 microversion: 2.1 time: 0.110901 Oct 18 16:43:26.565752 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3283/6602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:26 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:26.728353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:26.729320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:26.740331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:26.745304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:26.745873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:26.748451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:26.750460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:26.752171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:27.098623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:27.119369 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-892251d5-2c4e-4377-8685-ea5d2feb115d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1697 microversion: 2.1 time: 0.395721 Oct 18 16:43:27.137610 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3320/6603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:26 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1697 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:27.369618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:27.396625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:27.397548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:27.398364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:27.413324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Creating event network-changed:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h1-858383-14 Oct 18 16:43:27.421995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:43:27.438761 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e2716f67-fef6-4766-8a63-0b1e1c7cf6c4 req-a3507715-d9c8-42ba-82f6-d6282ae07673 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076275 Oct 18 16:43:27.440093 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3284/6604] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:27.590602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:27.591280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:27.602645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:27.603498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:27.604287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:27.605312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:27.605973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:27.606552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:27.996246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:28.006741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e9f69c6-5a9b-4447-9bda-a14386f15bc4 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1271 microversion: 2.1 time: 0.421844 Oct 18 16:43:28.022085 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3321/6605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:27 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1271 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:28.145877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:28.147497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:28.161150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:28.168207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:28.169006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:28.170234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:28.170988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:28.171650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:28.483842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:28.494232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88913af5-da79-49b2-b871-3fb5cbc77c77 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1697 microversion: 2.1 time: 0.353636 Oct 18 16:43:28.497753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3285/6606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:28 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1697 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:29.032060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:29.033047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:29.043307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:29.044064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:29.045476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:29.046914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:29.047615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:29.048280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:29.180179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:29.193248 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd0ad27b-8fb6-494c-af88-3d6ec901cc58 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1277 microversion: 2.1 time: 0.161278 Oct 18 16:43:29.194204 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3322/6607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:29 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:29.527952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:29.528576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:29.537550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:29.543568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:29.544254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:29.545543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:29.546423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:29.547341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:29.754973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:29.765511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d76c241f-d9cf-4cab-9227-eac1307f005f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1695 microversion: 2.1 time: 0.243740 Oct 18 16:43:29.766846 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3286/6608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:29 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1695 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:30.218570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:30.220070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:30.232640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:30.233746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:30.234427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:30.235363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:30.236328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:30.237034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:30.410496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:30.421259 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0aa9211-9676-42da-8ae5-e4c256c76bb1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.208087 Oct 18 16:43:30.421853 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3323/6609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:30 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:30.791681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:30.792299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:30.802258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:30.804639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:30.805028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:30.805729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:30.806451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:30.806909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:30.807837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:31.162089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:31.185900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a25e71db-09d7-48c9-bb14-7f1e61aadbf4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1695 microversion: 2.1 time: 0.400859 Oct 18 16:43:31.186584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3287/6610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:30 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1695 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:31.446396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:31.446923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:31.449865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:31.467257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:31.468268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:31.469176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:31.470102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:31.470739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:31.471589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:31.478856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:32.156105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:32.168186 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-973b18bb-5054-4ecf-9256-a5c668c949eb tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.726010 Oct 18 16:43:32.169204 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3324/6611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:31 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:32.215634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:32.216970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:32.223726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.224550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.225281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:32.226382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.227756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.228436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:32.521890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:32.541625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-15512a40-fd6c-4965-b097-4a7e521d3de9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1692 microversion: 2.1 time: 0.329100 Oct 18 16:43:32.543967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3288/6612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:32 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1692 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:32.565791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:32.566398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:32.573785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.574101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.574728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:32.575933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.576544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.577312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:32.648930 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2132de78-51d2-41c4-906c-5950dc45702b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action" status: 204 len: 0 microversion: 2.1 time: 0.086691 Oct 18 16:43:32.650590 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3325/6613] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:43:32 2022] POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:43:32.674299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:32.675258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:32.683934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.684790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.685480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:32.686591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:32.687244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:32.688019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:33.102271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:33.115968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-909e4cd6-6ab7-458b-ae5a-bac2464b3d33 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1692 microversion: 2.1 time: 0.448959 Oct 18 16:43:33.117553 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3289/6614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:32 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1692 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:33.192148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:33.192856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:33.200596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:33.201389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:33.202022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:33.202886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:33.203486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:33.204067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:33.675064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:33.688231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-920c98bd-8617-47ac-b17f-3b8f91d8ea4b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.500193 Oct 18 16:43:33.690895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3326/6615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:33 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:34.142759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:34.144119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:34.152635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:34.153472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:34.154160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:34.155497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:34.156204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:34.156860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:34.325922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:34.335991 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e4b17fc-fb37-4fd3-8360-957d6dc7d1b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1692 microversion: 2.1 time: 0.196780 Oct 18 16:43:34.341718 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3290/6616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:34 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:34.530773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3548c590-ddf0-4793-8976-03fd642c8d8a", "tag": "848f2fba-4209-4afb-9b12-4da7a0e4fe1e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:34.551556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:34.552055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:34.552707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:34.567261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] Creating event network-changed:848f2fba-4209-4afb-9b12-4da7a0e4fe1e for instance 3548c590-ddf0-4793-8976-03fd642c8d8a on n-h1-858383-14 Oct 18 16:43:34.573900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9a14e318-6b49-4d35-9208-639465058a3b req-53a1d23a-1974-4b0a-8a5d-cdcdee4feff4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051038 Oct 18 16:43:34.574663 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3327/6617] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:34.715171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:34.715873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:34.727506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:34.728376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:34.728894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:34.729915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:34.731406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:34.732969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:35.027450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "name": "network-vif-plugged", "status": "completed", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:35.028059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:35.036583 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00e13437-f58b-4e26-89e7-d26edce62e42 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.326091 Oct 18 16:43:35.038385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3291/6618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:34 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:35.053041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:35.056042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:35.062119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:35.079010 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] Creating event network-vif-plugged:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h1-858383-14 Oct 18 16:43:35.085560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2fe968d7-d7f6-4d9e-9e2d-6fec7493f648 req-b26a7bf4-2bbc-4482-8bc7-b11d22ed8eb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065284 Oct 18 16:43:35.086757 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3328/6619] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:43:35.359899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:35.363425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:35.371978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:35.372974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:35.373795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:35.374794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:35.375536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:35.376117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:35.587854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:35.595946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-71518185-a9ec-4f48-ae7d-720dcf4a0914 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1684 microversion: 2.1 time: 0.240053 Oct 18 16:43:35.597161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3292/6620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:35 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:36.061654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:36.062674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:36.071740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:36.072240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:36.072682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:36.073445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:36.073905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:36.074331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:36.321310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:36.347158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:36.445679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:36.455539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aa373571-3a45-4bd7-9fd5-12fafb030e30 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.398614 Oct 18 16:43:36.471593 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3329/6621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:36 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:37.482681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:37.484627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:37.488024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:37.502187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:37.505449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:37.506306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:37.510082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:37.510798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:37.521290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:37.876077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:37.892534 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-572105a1-9c74-457e-8263-8f721bff41bf tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.415097 Oct 18 16:43:37.909103 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3293/6622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:37 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:38.930294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:38.931906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:38.954050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:38.957277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:38.958045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:38.962312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:38.964710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:38.965280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:39.468277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:39.479556 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e59f8467-d4ea-4f12-a9ed-096930cc96da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.555771 Oct 18 16:43:39.481354 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3330/6623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:38 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:40.513069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:40.514850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:40.535865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:40.536730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:40.537423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:40.540527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:40.541344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:40.542310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:40.883720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:40.906307 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e549bd3f-1984-4021-8608-2514d1d80458 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.400463 Oct 18 16:43:40.906934 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3294/6624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:40 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:41.323401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3548c590-ddf0-4793-8976-03fd642c8d8a", "name": "network-vif-plugged", "status": "completed", "tag": "848f2fba-4209-4afb-9b12-4da7a0e4fe1e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:41.352403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:41.352905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:41.356879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:41.399383 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] Creating event network-vif-plugged:848f2fba-4209-4afb-9b12-4da7a0e4fe1e for instance 3548c590-ddf0-4793-8976-03fd642c8d8a on n-h1-858383-14 Oct 18 16:43:41.411088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-890db162-f2d5-41c7-9f77-9b4f68e95756 req-12184265-9463-46d6-90e6-e7e19accdf4b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093503 Oct 18 16:43:41.419696 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3331/6625] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:41.842851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df44d32e-c722-4f7f-96ca-e0c3ff6063aa tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: .version_select at 0x7f5fd173c4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1981147012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3bwa024kh18Q4a+wiYFYC6cZoWShAqV3N4/koRQJ+0Vylgqf5kco2buodBnn2R0xzv6XlIwmSP5jZtHy58ScUJ+VuPD3Nd4TAbP/SWaB/W87RTg1201ygwLImVmZS+Ew=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:41.865661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-df44d32e-c722-4f7f-96ca-e0c3ff6063aa tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:43:41.874380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-df44d32e-c722-4f7f-96ca-e0c3ff6063aa tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:43:41.923098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df44d32e-c722-4f7f-96ca-e0c3ff6063aa tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.084551 Oct 18 16:43:41.924494 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3295/6626] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:43:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:41.943882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:41.948502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:41.965342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:41.966819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:41.967449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:41.968360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:41.969094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:41.969972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:42.247539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:42.258240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08a0bb87-1edf-4c26-8be8-e5032f16feb2 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1319 microversion: 2.1 time: 0.327943 Oct 18 16:43:42.272281 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3332/6627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:41 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:43.300324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:43.300945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:43.311098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:43.312946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:43.313659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:43.314878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:43.316379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:43.317170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:43.565657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:43.580139 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aa2f6951-7fdb-41d9-947e-6316a316e59b tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1507 microversion: 2.1 time: 0.280872 Oct 18 16:43:43.581314 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3296/6628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:43 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:43.603300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "200fab30-6f0e-406a-9881-a5a662afb112", "device": "/dev/sdb"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:43.606629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:43.614144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:43.615505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:43.616132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:43.618419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:43.619107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:43.619543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:43.825162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1020136698", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "d6ce88a1-8427-49ae-83da-76ef7b7e5ddb"}], "key_name": "tempest-TestNetworkBasicOps-1981147012", "security_groups": [{"name": "tempest-secgroup-smoke-406941611"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:44.064985 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ae34b9b-e4a5-41df-b2b7-39aaaf68f2da tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "POST /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465895 Oct 18 16:43:44.069028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3333/6629] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:43:43 2022] POST /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:44.555584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] validate_networks() for [('d6ce88a1-8427-49ae-83da-76ef7b7e5ddb', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:43:45.550248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:43:45.551049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:43:45.551804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:43:45.552607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:43:45.553221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:43:45.566132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:45.567649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:45.568424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:45.569399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:45.570591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:45.571425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:45.603903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:43:45.610507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:43:45.625257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:43:45.627959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:43:45.723756 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a9d420f4-ee03-46c3-8faf-95b8a9d8e6c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.892684 Oct 18 16:43:45.724898 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3297/6630] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:43:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:43:45.739109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e73da984-6e85-47e9-8566-40ecb714079f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:45.739967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e73da984-6e85-47e9-8566-40ecb714079f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:45.851758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e73da984-6e85-47e9-8566-40ecb714079f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:45.864888 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e73da984-6e85-47e9-8566-40ecb714079f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1249 microversion: 2.1 time: 0.131045 Oct 18 16:43:45.865535 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3334/6631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:45 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:46.896843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:46.897603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:46.904746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:46.905650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:46.905950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:46.906723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:46.907188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:46.907617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:47.052145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:47.061457 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e60d19d-b48f-4e34-92c3-f30809b80dc8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1301 microversion: 2.1 time: 0.169256 Oct 18 16:43:47.062388 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3298/6632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:46 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:48.091739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:48.092533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:48.103136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:48.104119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:48.104786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:48.105689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:48.106366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:48.107104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:48.185809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:48.197437 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6b4497d-ad29-4663-8796-680de1980bbf tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1307 microversion: 2.1 time: 0.110079 Oct 18 16:43:48.198672 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3335/6633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:48 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:49.222858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:49.223623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:49.231321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:49.232221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:49.233082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:49.234114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:49.234702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:49.235260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:49.500854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:49.508588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:49.513512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-627a5d47-9a93-44a8-a5dc-463ddfbcc3b7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.294069 Oct 18 16:43:49.529533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3299/6634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:49 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:49.974909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17c1279-71eb-440d-8238-7d92bc93a66f", "tag": "f996f67d-4797-4dda-b3fb-21ce91cbeaf5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:49.995581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:49.996419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:49.997193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:50.010846 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] Creating event network-changed:f996f67d-4797-4dda-b3fb-21ce91cbeaf5 for instance f17c1279-71eb-440d-8238-7d92bc93a66f on n-h2-858383-14 Oct 18 16:43:50.016667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-aff7eff4-df58-4480-9f0f-550ce99301d9 req-02ea0ddc-f1a4-4987-9919-7cf1c1605e5b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045878 Oct 18 16:43:50.017984 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3336/6635] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:50.537316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:50.539240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:50.555656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:50.556560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:50.557233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:50.558361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:50.560430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:50.561360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:50.758095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:50.778838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5d303b08-8ef9-47a4-a527-a256f07c60c4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.245603 Oct 18 16:43:50.792910 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3300/6636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:50 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:51.803749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:51.805131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:51.812962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:51.817081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:51.817081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:51.817081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:51.817081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:51.817081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:52.059593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:52.068549 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc7a6aa0-ecbb-445c-83f4-f9d85cafad21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.269847 Oct 18 16:43:52.070334 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3337/6637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:51 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:53.102046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:53.104425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:53.115861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:53.118550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:53.119348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:53.120348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:53.122266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:53.124797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:53.509217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:53.525868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-32c5ba62-bca6-4a57-ad2a-bb044c04fd33 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.431707 Oct 18 16:43:53.543431 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3301/6638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:53 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:54.549826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:54.550533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:54.558957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:54.560262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:54.560775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:54.562247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:54.562947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:54.565428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:54.811314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:54.821032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef556701-9bbf-4073-80eb-f0b47879e1e3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.275830 Oct 18 16:43:54.825721 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3338/6639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:54 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:55.248613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c1279-71eb-440d-8238-7d92bc93a66f", "name": "network-vif-plugged", "status": "completed", "tag": "f996f67d-4797-4dda-b3fb-21ce91cbeaf5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:43:55.276800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:55.277307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:55.279112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:55.311739 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] Creating event network-vif-plugged:f996f67d-4797-4dda-b3fb-21ce91cbeaf5 for instance f17c1279-71eb-440d-8238-7d92bc93a66f on n-h2-858383-14 Oct 18 16:43:55.327180 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4d883cf7-0752-452b-afac-a52b37b79d2e req-12440945-671b-4360-b566-c12109b29c13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081382 Oct 18 16:43:55.329635 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3302/6640] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:43:55.847388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:55.848314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:55.862277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:55.865599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:55.869547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:55.870173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:55.872024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:55.901246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:55.901908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:56.179919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:56.195090 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a522352c-b780-4920-927a-14ae43a68f62 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.350937 Oct 18 16:43:56.196283 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3339/6641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:55 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:43:57.225866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:57.227464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:57.236946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:57.238533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:57.248511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:57.251642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:57.252408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:57.253710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:57.254794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:57.255380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:57.716114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:57.727236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b65a494b-4cf8-45b8-8888-390d755cac6a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1374 microversion: 2.1 time: 0.510993 Oct 18 16:43:57.729410 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3303/6642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:57 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1374 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:58.753760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:58.755074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:58.766237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:58.766970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:58.767833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:58.769594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:58.770387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:58.771025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:58.941580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:58.952188 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d84fb376-961c-47cc-8551-3bfefcfaf304 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1547 microversion: 2.1 time: 0.202261 Oct 18 16:43:58.953106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3340/6643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:58 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1547 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:43:58.978211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:43:58.979297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:43:58.989839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:58.990352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:58.990836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:58.992471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:43:58.992979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:43:58.993428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:43:59.652755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:43:59.662614 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-476cc10e-240b-4c34-bc1b-326503de2408 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1547 microversion: 2.1 time: 0.690136 Oct 18 16:43:59.664570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3304/6644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:43:58 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1547 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:02.403343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17c1279-71eb-440d-8238-7d92bc93a66f", "tag": "f996f67d-4797-4dda-b3fb-21ce91cbeaf5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:02.412943 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:44:02.413248 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 16:44:02.422502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:02.444012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:02.446792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:02.447329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:02.459330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:02.484806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] Creating event network-changed:f996f67d-4797-4dda-b3fb-21ce91cbeaf5 for instance f17c1279-71eb-440d-8238-7d92bc93a66f on n-h2-858383-14 Oct 18 16:44:02.498154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5f3569f2-dc7e-4ce4-b66e-1bbfb2065665 req-2afad34b-8fd6-4639-acdf-ea13ced1eaa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096638 Oct 18 16:44:02.501880 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3341/6645] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:05.904303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:05.918922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:05.925801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:05.963831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:05.965241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:05.969370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:05.970306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:05.972228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:05.973227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:06.067753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10fca4a1-a139-4b29-9557-0a577f00c00b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action" status: 200 len: 24582 microversion: 2.1 time: 0.170062 Oct 18 16:44:06.078511 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3305/6646] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:44:05 2022] POST /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40/action => generated 24582 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:44:12.034561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:12.035940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:12.046479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.047347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.048270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.049267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.050052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.050757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.195135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lazy-loading 'services' on Instance uuid 3548c590-ddf0-4793-8976-03fd642c8d8a {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:44:12.299835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-610a814a-2fcd-466d-ae28-74f903932ed1 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a/os-volume_attachments/200fab30-6f0e-406a-9881-a5a662afb112" status: 202 len: 0 microversion: 2.1 time: 0.270474 Oct 18 16:44:12.302540 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3342/6647] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:44:12 2022] DELETE /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a/os-volume_attachments/200fab30-6f0e-406a-9881-a5a662afb112 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:44:17.640948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:17.642993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=30 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:17.966304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07c8dfd9-fc51-48cd-a03d-44f3cf73c2a2 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1392667754", "availability_zone": "foo_zone"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:17.971722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.aggregate [None req-07c8dfd9-fc51-48cd-a03d-44f3cf73c2a2 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Generated uuid efec126d-55cd-44fb-a27a-8532aa2bc709 for aggregate {{(pid=120570) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 16:44:18.014125 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07c8dfd9-fc51-48cd-a03d-44f3cf73c2a2 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.379227 Oct 18 16:44:18.017540 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3306/6648] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 18 16:44:17 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.036731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f784e65a-38f6-4c55-9e7c-05a0198e6554 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:18.134971 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f784e65a-38f6-4c55-9e7c-05a0198e6554 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.108231 Oct 18 16:44:18.142475 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3343/6649] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:44:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:44:18.148168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:18.152537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:18.155408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:18.156303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:18.157821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:18.158464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:18.160257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:18.223302 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-defb6185-2741-4e60-9d79-aa83a090a4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079794 Oct 18 16:44:18.224788 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3307/6650] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 18 16:44:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.237448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00c570e9-85d6-4de2-8628-c455e89dba0d tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:18.259782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00c570e9-85d6-4de2-8628-c455e89dba0d tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.026573 Oct 18 16:44:18.261215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3344/6651] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:44:18 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.274642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3ef28a25-ab79-4723-b30b-736c5e39c0d5 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-14"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:18.304318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ef28a25-ab79-4723-b30b-736c5e39c0d5 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:18.305713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ef28a25-ab79-4723-b30b-736c5e39c0d5 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:18.306445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3ef28a25-ab79-4723-b30b-736c5e39c0d5 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:18.533843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3ef28a25-ab79-4723-b30b-736c5e39c0d5 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.264554 Oct 18 16:44:18.535278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3308/6652] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:44:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.547244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77fee170-e432-4054-89a8-936fc1180062 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:18.556594 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77fee170-e432-4054-89a8-936fc1180062 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.012885 Oct 18 16:44:18.568689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1ec148b4-87e3-48bd-9eca-1405dd023c18 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1182571429", "availability_zone": "foo_zone"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:18.571348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3345/6653] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:44:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.654122 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1ec148b4-87e3-48bd-9eca-1405dd023c18 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.089026 Oct 18 16:44:18.655197 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3309/6654] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 18 16:44:18 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:44:18.667101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b3474c4-db6f-4aa2-bb2a-a0ac04c0f2f7 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:18.728103 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b3474c4-db6f-4aa2-bb2a-a0ac04c0f2f7 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.065417 Oct 18 16:44:18.742189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-057aca68-96ae-4f90-8c7d-aefad0bfd4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:18.742403 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3346/6655] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:44:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.754274 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-057aca68-96ae-4f90-8c7d-aefad0bfd4d3 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.017557 Oct 18 16:44:18.756033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3310/6656] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:44:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:18.769523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b3cd9298-c54e-4c18-a7ca-13b81816fb36 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-14"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:18.800324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3cd9298-c54e-4c18-a7ca-13b81816fb36 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:18.800883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3cd9298-c54e-4c18-a7ca-13b81816fb36 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:18.801394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3cd9298-c54e-4c18-a7ca-13b81816fb36 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:19.139026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b3cd9298-c54e-4c18-a7ca-13b81816fb36 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.374347 Oct 18 16:44:19.164288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4089f970-2d9e-4774-99e9-7696f2613738 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:19.171281 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3347/6657] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 18 16:44:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:19.223828 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4089f970-2d9e-4774-99e9-7696f2613738 tempest-TestAggregatesBasicOps-48350967 tempest-TestAggregatesBasicOps-48350967-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.062785 Oct 18 16:44:19.227682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3311/6658] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:44:19 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 16:44:20.402165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:20.403424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:20.409985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:20.411088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:20.411742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:20.412741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:20.414001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:20.414659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:20.453392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:44:20.627605 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3bb53629-c91a-4649-bf7e-1f5cfaa2884c tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 204 len: 0 microversion: 2.1 time: 0.232637 Oct 18 16:44:20.629445 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3348/6659] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:44:20 2022] DELETE /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:44:20.642588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:20.644045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:20.652167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:20.652882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:20.653505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:20.654640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:20.655468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:20.656215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:21.057454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:21.066353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d35ed54-3771-4bc3-a4c4-5f6151b72e3a tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1513 microversion: 2.1 time: 0.430984 Oct 18 16:44:21.089364 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3312/6660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:20 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:22.096783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:22.097730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:22.106468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:22.107426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:22.108039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:22.110003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:22.110662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:22.111359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:22.411943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:22.422790 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ac9e6f4-8d0c-4ffe-923e-fb69619b3bfa tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1513 microversion: 2.1 time: 0.330584 Oct 18 16:44:22.423580 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3349/6661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:22 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:23.448537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:23.449187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:23.464358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:23.473342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:23.474014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:23.474985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:23.475680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:23.476341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:23.959748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b7f4b9ee5e4b85a95f3989557222ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe6b545c1f44199a313289eb21fe0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:23.975561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b9ef26d4-925f-4ae4-b584-e09a75e44e09 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 200 len: 1513 microversion: 2.1 time: 0.531380 Oct 18 16:44:23.977937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3313/6662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:23 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:24.051562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3548c590-ddf0-4793-8976-03fd642c8d8a", "name": "network-vif-deleted", "tag": "848f2fba-4209-4afb-9b12-4da7a0e4fe1e"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:24.067183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:24.068014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:24.069100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:24.111608 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] Creating event network-vif-deleted:848f2fba-4209-4afb-9b12-4da7a0e4fe1e for instance 3548c590-ddf0-4793-8976-03fd642c8d8a on n-h1-858383-14 Oct 18 16:44:24.121012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9f55ee59-f747-4613-b46d-35d4a8f973aa req-29f98716-46b4-4347-81fb-91e4c5e10cae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073109 Oct 18 16:44:24.123532 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3350/6663] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:25.002396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:25.003433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] [instance: 3548c590-ddf0-4793-8976-03fd642c8d8a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:25.020434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:25.020949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:25.021425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:25.022129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:25.023828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:25.025284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:25.055790 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] HTTP exception thrown: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Request method failure captured: Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a HTTP/1.1 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtbOCzTmQ6Wo_ncYram231Xy-lJNJ6Evu-qgQISx0vuPC8jRWFJ-N3C8fOpPfmyRBPWTfgdYbfg_mq20nalPnPYA3LUHqJ5h38FpspKmckFLt6ndFs92oMOM85bRcnJgIm2W7njhHkwOkIlxFJNdtq8jlw4OX6kqccq7H7lPobQ49lo Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: ebe6b545c1f44199a313289eb21fe0b2 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ebe6b545c1f44199a313289eb21fe0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebe6b545c1f44199a313289eb21fe0b2"}]}] Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: ebe6b545c1f44199a313289eb21fe0b2 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-236265184 Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesSnapshotTestJSON-236265184-project Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 93b7f4b9ee5e4b85a95f3989557222ee Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesSnapshotTestJSON-236265184-project Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '3548c590-ddf0-4793-8976-03fd642c8d8a'} Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:25.060003 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. Oct 18 16:44:25.065557 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.067433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] Returning 404 to user: Instance 3548c590-ddf0-4793-8976-03fd642c8d8a could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:44:25.068914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94cf3170-485d-4f82-a8e3-6524cca91d64 tempest-VolumesSnapshotTestJSON-236265184 tempest-VolumesSnapshotTestJSON-236265184-project] 10.222.0.78 "GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a" status: 404 len: 111 microversion: 2.1 time: 0.070886 Oct 18 16:44:25.073792 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3314/6664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:24 2022] GET /compute/v2.1/servers/3548c590-ddf0-4793-8976-03fd642c8d8a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:44:29.105851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:29.106574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:29.124974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:29.125505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:29.126037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:29.127097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:29.127575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:29.128012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:29.380347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6732419a-73df-4149-835f-222ed255c788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1837 microversion: 2.1 time: 0.280051 Oct 18 16:44:29.381209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3351/6665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:29 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1837 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:30.635211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:30.635891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:30.650474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:30.666869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:30.684898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:30.689904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:30.694952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:30.695967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:30.698608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:30.699464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:30.700203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:30.700866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:30.703154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:30.737503 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] Creating event network-changed:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h1-858383-14 Oct 18 16:44:30.755938 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c30f17a4-2a2d-48df-8864-5d2ba439bbdb req-ba2951a5-b77d-4217-a10b-6ddea28f13b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111694 Oct 18 16:44:30.758467 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3352/6666] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:44:30.776169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:44:30.929731 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0324d017-d0a6-4e6f-b097-74670a5dea8c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 204 len: 0 microversion: 2.1 time: 0.297055 Oct 18 16:44:30.931629 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3315/6667] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:44:30 2022] DELETE /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:44:30.943424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:30.945815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:30.960704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:30.961801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:30.962222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:30.963140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:30.963665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:30.965179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:31.355759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:31.376505 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13f15550-83e4-4940-b990-b05f74e1cad1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1690 microversion: 2.1 time: 0.436937 Oct 18 16:44:31.377356 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3353/6668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:30 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1690 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:32.405773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:32.406433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:32.415617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:32.416412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:32.417098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:32.418058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:32.418689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:32.419287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:32.897063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:32.908512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c497d774-b429-43c6-8c1d-a5511f1cd6af tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1690 microversion: 2.1 time: 0.507655 Oct 18 16:44:32.927087 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3316/6669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:32 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1690 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:44:33.538698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc41abb-1478-481c-acd5-8fe57a0f7e40", "name": "network-vif-deleted", "tag": "74af05d6-100a-4f79-abac-5a43f0fc4020"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:33.556181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:33.561368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:33.562586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:33.563514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:33.584100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] Creating event network-vif-deleted:74af05d6-100a-4f79-abac-5a43f0fc4020 for instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 on n-h1-858383-14 Oct 18 16:44:33.591946 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b111bf86-1273-418e-8fde-a1c7d8078a46 req-61716b54-18e7-4f2b-a00b-80853108d016 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059063 Oct 18 16:44:33.593291 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3354/6670] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:33.952485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:33.953884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:33.969956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:33.970460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:33.970905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:33.971619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:33.972075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:33.972507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:34.050619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:34.051199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:34.051654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:34.052146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lazy-loading 'fault' on Instance uuid 3bc41abb-1478-481c-acd5-8fe57a0f7e40 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:44:34.147783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:34.156809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f472c24e-7aed-4598-87a4-313eb42b8afb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 200 len: 1356 microversion: 2.1 time: 0.212842 Oct 18 16:44:34.157789 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3317/6671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:33 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:35.189091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:35.190171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: 3bc41abb-1478-481c-acd5-8fe57a0f7e40] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:35.197846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:35.199048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:35.199507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:35.202833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:35.203309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:35.204254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:35.226457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] HTTP exception thrown: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Request method failure captured: Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 HTTP/1.1 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtceLIscCOAKhgHifrTrD-khzakT4oXOBQmfBQBAV175ynZt6XNPgWp0jzGNpPIQrr2sCyC78GvUrnacrkN22X5mWjAe0X0-0LXjLKiCnR9k-Xu5yZbhPwppk7xxOfHOQt8Ryc1NrzOO9qnfmtLWd6Hp9TjZnuhqW1fur2in7TSaND4 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}] Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c0d13a891f6445a2b12c8b30182df7e2 Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3bc41abb-1478-481c-acd5-8fe57a0f7e40'} Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:44:35.228512 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Returning 404 to user: Instance 3bc41abb-1478-481c-acd5-8fe57a0f7e40 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dec70933-5da8-4285-99b8-fbb90c5163e4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40" status: 404 len: 111 microversion: 2.1 time: 0.048805 Oct 18 16:44:35.237561 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3355/6672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:35 2022] GET /compute/v2.1/servers/3bc41abb-1478-481c-acd5-8fe57a0f7e40 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:44:35.400688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:35.404496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:35.413320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:35.414097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:35.414935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:35.416016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:35.416954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:35.417597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:35.519576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-84535435-c851-434c-8ce1-9dd8376d0c14 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f/action" status: 200 len: 24574 microversion: 2.1 time: 0.120266 Oct 18 16:44:35.525570 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3318/6673] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:44:35 2022] POST /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f/action => generated 24574 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:44:40.995557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-750b6b07-9030-44cb-ab1d-db3ea7fe6bfe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '.version_select at 0x7f5fd0d49af0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:41.040219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-750b6b07-9030-44cb-ab1d-db3ea7fe6bfe tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1880413216" status: 202 len: 0 microversion: 2.1 time: 0.049063 Oct 18 16:44:41.054967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3356/6674] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 16:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1880413216 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:44:41.097567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6785d1e-46dd-436f-9861-dfa30b6a6e68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: .version_select at 0x7f5fd104a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1186240977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+Q/0yu3kiYUoh94bM9g6K13d5TD7QyjJjUdy/5Tzc6b0GSte3gWsZZyNx0iU6y8ueVm1+Q7i3xuxMbwWoT5u2MD66A7RssdTMFlce1+0qGCo99H5oMI9Ld/eKrr0KsCQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:41.151986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6785d1e-46dd-436f-9861-dfa30b6a6e68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:44:41.159577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c6785d1e-46dd-436f-9861-dfa30b6a6e68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:44:41.207092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6785d1e-46dd-436f-9861-dfa30b6a6e68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.122933 Oct 18 16:44:41.208462 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3319/6675] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:44:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:51.848068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1982804269", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "a377be14-03fa-4774-a0e7-35df25719851"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1186240977", "security_groups": [{"name": "tempest-secgroup-smoke-1694321643"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:51.904819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:51.922087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:52.458244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] validate_networks() for [('a377be14-03fa-4774-a0e7-35df25719851', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:44:53.611758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:44:53.612433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:44:53.612641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:44:53.613079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:44:53.613494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:44:53.624304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:53.625068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:53.625678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:53.626600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:53.627240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:53.627861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:53.647095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:44:53.654196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:44:53.669117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:44:53.672164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:44:53.729526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a4b74bb-9e14-44e8-9831-bd50f98ec0d7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.885582 Oct 18 16:44:53.737541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3357/6676] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:44:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:44:53.742226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6252e607-ca5d-4dbf-a1e2-7f3059f6d1a0 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:53.743084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6252e607-ca5d-4dbf-a1e2-7f3059f6d1a0 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:53.755744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:53.761761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:53.764077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:53.869352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6252e607-ca5d-4dbf-a1e2-7f3059f6d1a0 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:53.878009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6252e607-ca5d-4dbf-a1e2-7f3059f6d1a0 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1267 microversion: 2.1 time: 0.139630 Oct 18 16:44:53.895430 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3320/6677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:53 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:54.902478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:54.903690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:54.912903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:54.913835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:54.914535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:54.915489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:54.916212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:54.917928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:55.058773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:55.068507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c25e81d-ab6d-4239-9459-cd866a73b5f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1263 microversion: 2.1 time: 0.170359 Oct 18 16:44:55.089624 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3358/6678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:54 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:56.100816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:56.101464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:56.110596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.113203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.115521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.121428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.122086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.122694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.358308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:56.380472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1d58023-ce8d-4176-9e7b-1dee19693c30 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1325 microversion: 2.1 time: 0.282670 Oct 18 16:44:56.383265 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3321/6679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:56 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:57.425465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:57.427500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:57.440299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:57.441369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:57.442003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:57.442882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:57.443495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:57.445656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:57.639565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:57.657150 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02cb718f-a5ec-4c13-b274-238e959cded3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1325 microversion: 2.1 time: 0.233227 Oct 18 16:44:57.677120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3359/6680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:57 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:58.684673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:58.692870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:58.717542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:58.718094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:58.718554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:58.719295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:58.726014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:58.730518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:59.374380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:59.394421 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50f7a464-1c46-4fc6-88b2-83b585170e44 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.711985 Oct 18 16:44:59.396906 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3322/6681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:58 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:44:59.989826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:00.021555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:00.023015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:00.025936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:00.054322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] Creating event network-changed:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:45:00.066880 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b6b0053b-9c38-4c51-aecc-eeaa288158f7 req-403805c1-e331-492d-a3fb-6dd9dd4e9007 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081121 Oct 18 16:45:00.067848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3360/6682] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:45:00.419990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:00.420620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:00.435263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:00.435982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:00.439384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:00.448640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:00.449706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:00.458391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:00.983508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:01.001258 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-262a6769-5edb-4079-909b-315d44c5563e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.579710 Oct 18 16:45:01.002223 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3323/6683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:00 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:02.028109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:02.029586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:02.040639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:02.041700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:02.042410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:02.043409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:02.044398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:02.045092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:02.325048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:02.346526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9a7b917-3606-4bfe-a203-a3644e3cb167 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.323350 Oct 18 16:45:02.348526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3361/6684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:02 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:03.374034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:03.375342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:03.385707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:03.386345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:03.386897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:03.387699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:03.388287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:03.388800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:03.649786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:03.663364 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-792c7125-c5d0-4f9e-9ced-691577e12fc2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.292403 Oct 18 16:45:03.667644 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3324/6685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:03 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:04.693101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:04.695346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:04.705114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:04.706886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:04.709435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:04.711971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:04.713612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:04.714789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:04.715977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:04.717682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:04.954068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:04.966265 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7f9c254-1311-492a-b8df-e5641c93e41b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.278158 Oct 18 16:45:04.968021 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3362/6686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:04 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:45:05.993315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:05.994855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:05.997184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:06.019620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:06.020301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:06.020874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:06.024554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:06.029288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:06.030047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:06.317695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:06.331823 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1fd4f495-0197-4260-b141-19c96b406135 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.342193 Oct 18 16:45:06.337530 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3325/6687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:05 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:07.365576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:07.366213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:07.382628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:07.383336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:07.383800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:07.384539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:07.385023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:07.395963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:07.985912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-plugged", "status": "completed", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:08.011361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:08.011817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:08.012275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:08.059565 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] Creating event network-vif-plugged:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:45:08.065798 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-237fe980-7f11-48c9-8965-06541c3a257f req-3d57dbeb-55e3-4635-8d9c-7c61ba0e5647 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084619 Oct 18 16:45:08.068505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3326/6688] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:08.391948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:08.403850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d3d5b87-6328-4f00-b3a9-12bc1d174719 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 1.043350 Oct 18 16:45:08.418751 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3363/6689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:07 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:09.432642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:09.433290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:09.448345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:09.449383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:09.452363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:09.453399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:09.454039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:09.454668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:09.650371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:09.659452 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39331557-4073-4823-a71c-c9295a7cea23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1393 microversion: 2.1 time: 0.232500 Oct 18 16:45:09.660753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3327/6690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:09 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1393 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:10.684079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:10.685603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:10.692943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:10.693675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:10.694684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:10.695736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:10.696360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:10.697020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:10.975095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:10.987699 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8045ee5c-632c-464e-b052-dd2a776eafec tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1565 microversion: 2.1 time: 0.305726 Oct 18 16:45:10.988588 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3364/6691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:10 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1565 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:11.015420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:11.016033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:11.024122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:11.024962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:11.030275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:11.031282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:11.031950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:11.032573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:11.275330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:11.313181 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-878a6669-836c-4d96-88ad-b5993bb1cb17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1565 microversion: 2.1 time: 0.292252 Oct 18 16:45:11.333203 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3328/6692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:11 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1565 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:13.625730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06f873f3-9f1f-4347-b275-001f6e226cc0 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: .version_select at 0x7f5fd0d49ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-709495939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCewv5cvgFXn+AzgjH+gbUUgGZ2xIMJdFT2FDRErLMpMIQut/hJ6r2drw0V0GZoyNrWY5sYlEWaXmizATopgvnnW9obVcpMBrcnqWTE08zTe8C3zj+lkTAmj169Tc9ZTvw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:13.680766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-06f873f3-9f1f-4347-b275-001f6e226cc0 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:45:13.698720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-06f873f3-9f1f-4347-b275-001f6e226cc0 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:45:13.787391 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06f873f3-9f1f-4347-b275-001f6e226cc0 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.168200 Oct 18 16:45:13.794566 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3365/6693] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:45:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:15.499819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:15.500442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:15.531218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:15.534323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:15.537630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:15.539807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:15.540729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:15.541215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:15.826501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:15.855024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:15.855866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:15.856664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:15.873563 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] Creating event network-changed:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:45:15.884299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6caa807b-82dd-4ac9-b742-ae813d8fbbcf req-40085d84-92b4-4156-835f-723a368063a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381053 Oct 18 16:45:15.885448 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3366/6694] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:45:15.920317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:15.941822 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47cecb28-da94-4131-b6cb-51166a636f1e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1565 microversion: 2.1 time: 0.445690 Oct 18 16:45:15.946395 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3329/6695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:15 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1565 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:16.415641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-260043989", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "cd5d9aaa-20f9-4d80-9cb2-04caa14be8e5"}], "key_name": "tempest-TestNetworkBasicOps-709495939", "security_groups": [{"name": "tempest-secgroup-smoke-2055329251"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:16.766913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] validate_networks() for [('cd5d9aaa-20f9-4d80-9cb2-04caa14be8e5', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:45:18.245347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:45:18.246424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:45:18.247269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:45:18.248023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:45:18.248624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:45:18.260553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:18.261445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:18.262061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:18.262968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:18.263455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:18.263992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:18.297209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:45:18.305443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:45:18.324467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:45:18.327213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:45:18.410484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb80185b-a02c-499f-a0ab-e3ab1fd08365 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.999483 Oct 18 16:45:18.419196 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3367/6696] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:45:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:45:18.425518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43c37b49-8547-45ce-982f-7249ae9375a3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:18.429212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43c37b49-8547-45ce-982f-7249ae9375a3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:18.565954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43c37b49-8547-45ce-982f-7249ae9375a3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:18.584374 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43c37b49-8547-45ce-982f-7249ae9375a3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1247 microversion: 2.1 time: 0.162491 Oct 18 16:45:18.586274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3330/6697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:18 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1247 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:19.618989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:19.619530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:19.629834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:19.630339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:19.635825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:19.637922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:19.638627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:19.639141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:19.778943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:19.790152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4308e404-b4df-4afe-b84e-85867ebc43fe tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1299 microversion: 2.1 time: 0.177878 Oct 18 16:45:19.790761 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3368/6698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:19 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:20.816833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:20.818200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:20.829716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:20.830751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:20.831350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:20.832816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:20.833613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:20.834204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:20.950079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:20.960707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d1a21d55-4d85-453b-a92c-a4eafa6234a4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1305 microversion: 2.1 time: 0.150864 Oct 18 16:45:20.965653 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3331/6699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:20 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1305 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:21.986532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:21.987158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:22.005284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:22.005793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:22.007609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:22.021728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:22.023102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:22.024228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:22.053821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=51 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:22.238870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:22.248837 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-568db87e-5179-4c8d-aeca-6540af9a0a7e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.266387 Oct 18 16:45:22.250091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3369/6700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:21 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:23.276876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:23.278996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:23.311766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:23.312339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:23.313056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:23.315098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:23.315736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:23.316645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:23.635910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:23.653151 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-48869c6b-b2bc-44ce-bf5d-6d284e6df9ca tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.383515 Oct 18 16:45:23.666006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3332/6701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:23 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:23.881983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9d04fc-46e1-4a62-913c-647e1b459e2e", "tag": "337a105b-0eba-49bc-ae89-5ee6c0eab758"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:23.890087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:23.919091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:23.919503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:23.919957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:23.935271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] Creating event network-changed:337a105b-0eba-49bc-ae89-5ee6c0eab758 for instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e on n-h2-858383-14 Oct 18 16:45:23.941972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4ffd1fd6-9a89-4a37-a272-55160c7ab6e1 req-798c4fc4-3f67-4e51-8cf9-777a043befd3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073525 Oct 18 16:45:23.942887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3370/6702] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:24.677753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:24.678791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:24.682439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=31 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:24.688761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:24.689737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:24.690275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:24.691170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:24.691728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:24.692256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:24.696461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=63 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:24.846941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:24.856502 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dca6a19c-71e6-4af2-8123-ba4c92d66d0f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.182578 Oct 18 16:45:24.857285 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3333/6703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:24 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:25.881236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:25.883717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:25.894230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:25.894874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:25.895333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:25.896674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:25.897467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:25.898104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:26.244558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:26.257274 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cec23f85-4c99-4410-900e-1c13e3a6b301 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.381019 Oct 18 16:45:26.260927 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3371/6704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:25 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:27.283663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:27.285133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:27.292732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:27.293351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:27.293918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:27.294589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:27.295144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:27.295525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:27.558454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:27.570434 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a18ea30-9e8e-4612-82b1-2c0171089bcc tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.290650 Oct 18 16:45:27.574855 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3334/6705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:27 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:28.595501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:28.596534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:28.603241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:28.604241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=10 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:28.609407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:28.609988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:28.610498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:28.611935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:28.623577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:28.624824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:28.934747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:28.948980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a7a6e59-2b4b-4040-8732-97b009a1e077 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.358491 Oct 18 16:45:28.949734 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3372/6706] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:28 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:29.614291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9d04fc-46e1-4a62-913c-647e1b459e2e", "name": "network-vif-plugged", "status": "completed", "tag": "337a105b-0eba-49bc-ae89-5ee6c0eab758"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:29.622705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:29.630764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.631671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.632280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.644385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] Creating event network-vif-plugged:337a105b-0eba-49bc-ae89-5ee6c0eab758 for instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e on n-h2-858383-14 Oct 18 16:45:29.650767 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0b1c001e-02bf-4f2f-8eff-e38a6d351137 req-b17d3996-0c6d-46a4-b45c-099253da4ddd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040838 Oct 18 16:45:29.651696 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3335/6707] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:29.972361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:29.972894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:29.980339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.981083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.981854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.982736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.983349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.983942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:30.162387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:30.171277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55d3e8e7-41e2-4b03-aa28-3aab66b3b1a6 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.203088 Oct 18 16:45:30.171957 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3373/6708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:29 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:31.201409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:31.202743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:31.211240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:31.212270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:31.213084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:31.214641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:31.215440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:31.230338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:31.443457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:31.458715 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6dc76a1-14a4-40ff-b0e1-9321c448a5e7 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1373 microversion: 2.1 time: 0.266715 Oct 18 16:45:31.460979 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3336/6709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:31 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:32.485981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:32.487188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:32.494929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.495527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.495967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:32.496721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.497416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.497992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:32.663233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:32.673674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81ada85c-fdba-4267-9f73-a2edf382f4e5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1546 microversion: 2.1 time: 0.193744 Oct 18 16:45:32.674922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3374/6710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:32 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1546 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:32.702028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:32.702650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:32.710125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.710853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.711296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:32.712213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.712880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.713509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:32.872683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:32.881618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8537c891-2a32-4e04-869b-08782dcd2946 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1546 microversion: 2.1 time: 0.183391 Oct 18 16:45:32.897727 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3337/6711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:32 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:44.710314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:44.712829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:44.716134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:44.716848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=31 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:44.727339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:44.727339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:44.727339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:44.727339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:44.727752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:44.728236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:44.798216 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f30854f9-972e-46e9-b006-5786ccc5496f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action" status: 200 len: 24565 microversion: 2.1 time: 0.092071 Oct 18 16:45:44.799843 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3375/6712] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:45:44 2022] POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action => generated 24565 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:46:09.947694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:09.948203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:09.961476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=9 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:09.962949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=25 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:09.964944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:09.966339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:09.967150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:09.968159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:09.968813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:09.969468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:10.000691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:46:10.124388 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a3d8dda-5779-4b53-a82d-fa224257cbf3 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 204 len: 0 microversion: 2.1 time: 0.181211 Oct 18 16:46:10.125672 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3338/6713] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:46:09 2022] DELETE /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:46:10.135999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:10.137962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:10.145766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:10.148003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:10.150501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:10.151262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:10.151779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:10.152882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:10.153630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:10.154259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:10.576127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:10.588481 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5cbb322a-a4a3-4ee7-85c4-5e61563d5177 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1552 microversion: 2.1 time: 0.458251 Oct 18 16:46:10.589916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3376/6714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:10 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1552 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:11.613145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:11.613865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:11.621572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:11.622069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:11.622739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:11.623518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:11.623983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:11.624423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:11.849109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:11.857841 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc5a0153-50cc-485c-a0fe-06720b829ee8 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1552 microversion: 2.1 time: 0.249296 Oct 18 16:46:11.858447 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3339/6715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:11 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:12.357019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9d04fc-46e1-4a62-913c-647e1b459e2e", "name": "network-vif-deleted", "tag": "337a105b-0eba-49bc-ae89-5ee6c0eab758"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:12.370410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:12.370943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:12.371451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:12.383915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] Creating event network-vif-deleted:337a105b-0eba-49bc-ae89-5ee6c0eab758 for instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e on n-h2-858383-14 Oct 18 16:46:12.389154 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-072d59cf-2c43-4d52-8681-3218d3248682 req-001a8fbb-c897-4a3b-bc42-1989aeff4cc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Oct 18 16:46:12.390125 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3377/6716] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:12.882466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:12.883517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:12.890854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:12.891860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:12.892454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:12.893671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:12.894340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:12.894963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:12.934882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:12.935610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:12.936252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:12.936898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lazy-loading 'fault' on Instance uuid 3c9d04fc-46e1-4a62-913c-647e1b459e2e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:46:12.989597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:12.998840 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-666274b8-e48c-42a4-9dda-5a5218498b6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 200 len: 1337 microversion: 2.1 time: 0.120752 Oct 18 16:46:12.999702 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3340/6717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:12 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 1337 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:14.024861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:14.025689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: 3c9d04fc-46e1-4a62-913c-647e1b459e2e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:14.032277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:14.032912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:14.033441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:14.034206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:14.034736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:14.035237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:14.052513 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] HTTP exception thrown: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Request method failure captured: Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e HTTP/1.1 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtex5WKMks6_gNLcC4T5_D9D0ANSAebc9jL-29T8HA3MvfiewpxUmYLfMSYxWYZcGCa6SvaLxAsk_scS7WfrZeqL-9oRk3tzVIulAcfcU6UWlCNRkuO32xzY5bAmH20K99FMstvM0W02EFr2mOPPnp9V1LNtgFlXWQftPjnT6PTCXrc Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}] Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 928b7b2e278d406eac6ecf01af7b91bf Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3c9d04fc-46e1-4a62-913c-647e1b459e2e'} Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:14.054751 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Returning 404 to user: Instance 3c9d04fc-46e1-4a62-913c-647e1b459e2e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b308b23-ea2c-4906-8a66-7fcc3220646f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e" status: 404 len: 111 microversion: 2.1 time: 0.037286 Oct 18 16:46:14.059717 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3378/6718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:14 2022] GET /compute/v2.1/servers/3c9d04fc-46e1-4a62-913c-647e1b459e2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:46:14.238805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1c8f234-875d-406b-b00c-f2c54cca7b29 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '.version_select at 0x7f5fd1009ee0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:14.263159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e1c8f234-875d-406b-b00c-f2c54cca7b29 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-709495939" status: 202 len: 0 microversion: 2.1 time: 0.028543 Oct 18 16:46:14.264392 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3341/6719] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-709495939 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:46:15.181918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:15.183841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:15.192890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.195412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.196977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.197746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.198204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.198632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.375457 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0238be1c-63d8-4475-a3e0-d37d8cfee51c tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1836 microversion: 2.1 time: 0.360245 Oct 18 16:46:15.376335 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3379/6720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:15 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1836 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:15.540691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:15.541520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:15.547741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.548439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.549085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.549974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.550601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.551019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.807150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:15.816358 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e034951f-0e75-4c17-9948-5cbb34bc7003 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1683 microversion: 2.1 time: 0.420022 Oct 18 16:46:15.817574 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3342/6721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:15 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:15.932361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:15.935133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:15.945460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.946080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.947201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.947732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.948289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.948822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.023700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8029b669-0b96-4140-8c5d-596ab61500b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action" status: 200 len: 32628 microversion: 2.1 time: 0.095582 Oct 18 16:46:16.024707 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3380/6722] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:46:15 2022] POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action => generated 32628 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:46:16.199621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:16.200274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:16.206493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.207188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.207691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.209119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.209752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.210327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.240836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ffde37ad3364246b878de50a1fbef50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0715cffedd40429f9755053f748669f2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:16.242256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] flavor_id is None. Assuming migration. {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 16:46:16.242842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 16:46:16.392526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:16.393148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:16.403488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-125c1b2c-07e6-4b5d-8e7e-1a20edcac9b9 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action" status: 202 len: 0 microversion: 2.1 time: 0.207560 Oct 18 16:46:16.405293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3343/6723] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:46:16 2022] POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:46:16.411738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17c1279-71eb-440d-8238-7d92bc93a66f", "tag": "f996f67d-4797-4dda-b3fb-21ce91cbeaf5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:16.411917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.412276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.414235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.415026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.415504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.415942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.428350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.429468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.430159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.444328 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] Creating event network-changed:f996f67d-4797-4dda-b3fb-21ce91cbeaf5 for instance f17c1279-71eb-440d-8238-7d92bc93a66f on n-h2-858383-14 Oct 18 16:46:16.451309 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-87965957-0066-4861-8ec1-26f76c253daa req-dc745d4c-df1f-4b3d-8c69-e0d0f1115290 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Oct 18 16:46:16.453293 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3344/6724] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:16.463109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:16.465263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:16.472749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.473599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.474544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.475674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.476542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.477619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.498260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:46:16.721889 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2b569dd6-3a3a-4e88-8d16-1ec9831f7bab tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 204 len: 0 microversion: 2.1 time: 0.333152 Oct 18 16:46:16.729022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3381/6725] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:46:16 2022] DELETE /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:46:16.750678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:16.752602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:16.768695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.769780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.772654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.773907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.774398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.776575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.935589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:16.952692 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db5907ce-29e1-40a0-8cde-06e08d8adc04 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1692 microversion: 2.1 time: 0.497310 Oct 18 16:46:16.954142 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3345/6726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:16 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1692 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:17.096877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:17.111459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92c74c89-951a-46d9-8d8f-6f78af6a2001 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1672 microversion: 2.1 time: 0.380438 Oct 18 16:46:17.112359 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3382/6727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:16 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1672 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:17.984628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:17.987155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:18.001331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.002009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.002642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.004325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.005169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.005596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.137120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:18.138164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:18.144822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.145564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.146321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.147050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.147612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.148039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.260571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:18.273178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1d064ca-9741-4496-bd0e-2fdaf8073080 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1692 microversion: 2.1 time: 0.294737 Oct 18 16:46:18.274354 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3346/6728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:17 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1692 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:18.369983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:18.378506 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-32a698e9-b3ce-4a9f-b5d2-dd00a096daef tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1672 microversion: 2.1 time: 0.245779 Oct 18 16:46:18.379244 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3383/6729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:18 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1672 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:19.298940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:19.300346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:19.315451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.316375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.317037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.318075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.319109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.319912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.403950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:19.404636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:19.412131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.413892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.414716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.415736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.416268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.416908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.580527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:19.608040 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a61f0190-f5cc-463b-881f-f27f5dbcf12c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1692 microversion: 2.1 time: 0.314121 Oct 18 16:46:19.610349 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3347/6730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:19 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1692 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:19.692034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:19.701703 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8798d6c3-62e6-4d15-abda-2af0b281cde1 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 200 len: 1553 microversion: 2.1 time: 0.301989 Oct 18 16:46:19.702286 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3384/6731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:19 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:19.791329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c1279-71eb-440d-8238-7d92bc93a66f", "name": "network-vif-deleted", "tag": "f996f67d-4797-4dda-b3fb-21ce91cbeaf5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:19.806385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.806869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.807298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.823901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] Creating event network-vif-deleted:f996f67d-4797-4dda-b3fb-21ce91cbeaf5 for instance f17c1279-71eb-440d-8238-7d92bc93a66f on n-h2-858383-14 Oct 18 16:46:19.830845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b1a01fed-b2f7-4ab5-8295-2aef58e96ed1 req-2af0a60c-b2c5-4a78-bf79-8bd98d0cb363 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045626 Oct 18 16:46:19.831375 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3348/6732] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:20.634841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:20.635563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:20.644493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.645515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.646046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.647608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.648221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.648735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.743452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:20.744295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: f17c1279-71eb-440d-8238-7d92bc93a66f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:20.752446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.753382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.753884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.754830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.755319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.755894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.778760 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] HTTP exception thrown: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Request method failure captured: Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f HTTP/1.1 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtex5WKMks6_gNLcC4T5_D9D0ANSAebc9jL-29T8HA3MvfiewpxUmYLfMSYxWYZcGCa6SvaLxAsk_scS7WfrZeqL-9oRk3tzVIulAcfcU6UWlCNRkuO32xzY5bAmH20K99FMstvM0W02EFr2mOPPnp9V1LNtgFlXWQftPjnT6PTCXrc Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}] Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 928b7b2e278d406eac6ecf01af7b91bf Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f17c1279-71eb-440d-8238-7d92bc93a66f'} Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:20.781180 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Returning 404 to user: Instance f17c1279-71eb-440d-8238-7d92bc93a66f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cabfedee-ab1c-4227-975d-a5683e9a5c21 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f" status: 404 len: 111 microversion: 2.1 time: 0.051549 Oct 18 16:46:20.785780 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3349/6733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:20 2022] GET /compute/v2.1/servers/f17c1279-71eb-440d-8238-7d92bc93a66f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:46:21.056755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28319287-1355-4589-880a-a0d1fa7d2e67 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '.version_select at 0x7f5fd0f9dd30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:21.111041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28319287-1355-4589-880a-a0d1fa7d2e67 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1981147012" status: 202 len: 0 microversion: 2.1 time: 0.058799 Oct 18 16:46:21.112492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3350/6734] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1981147012 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:46:21.151779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:21.161949 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8bbcebeb-e65b-447b-a15d-84f73f85ae76 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.531380 Oct 18 16:46:21.162942 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3385/6735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:20 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:21.861551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-765781343", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:21.917832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:46:22.192111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:22.192748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:22.200377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:22.200858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:22.201322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:22.202029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:22.202467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:22.202885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:22.336611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:46:22.337057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:46:22.337530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:46:22.338160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:46:22.338338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:46:22.348426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:22.348912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:22.349369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:22.350150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:22.350608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:22.351208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:22.354718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:22.364330 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56a5fbbc-89c1-4976-af83-e0a70a010f83 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.175982 Oct 18 16:46:22.365009 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3386/6736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:22 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:22.377175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Getting quotas for project 0b93599474964d94a2f675ec746dcce7. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:46:22.382374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Getting quotas for user 5e99b9cd9bfc4d9c9e5726ec86efc352 and project 0b93599474964d94a2f675ec746dcce7. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:46:22.395989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:46:22.398955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:46:22.447907 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb5bcf38-10df-46bf-ab14-62524e633999 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591041 Oct 18 16:46:22.454724 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3351/6737] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:46:22.461645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-924ac3e8-f447-45d2-b236-b043d9f065b5 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:22.462269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-924ac3e8-f447-45d2-b236-b043d9f065b5 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:22.519778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-924ac3e8-f447-45d2-b236-b043d9f065b5 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:22.529626 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-924ac3e8-f447-45d2-b236-b043d9f065b5 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1213 microversion: 2.1 time: 0.073405 Oct 18 16:46:22.531498 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3387/6738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:22 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:23.390077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:23.391429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:23.404200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:23.406490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:23.409344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:23.410109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:23.415300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:23.415881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:23.552885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:23.553782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:23.567176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:23.570231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:23.572540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:23.574753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:23.577996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:23.578558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:23.663934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:23.675512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c41e1be7-d8d2-4cb6-b53c-1ed970179a0e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1265 microversion: 2.1 time: 0.126929 Oct 18 16:46:23.676848 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3388/6739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:23 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:23.677833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:23.689270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65a1c7ed-4dd3-4630-be88-de0f6353c16b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.302938 Oct 18 16:46:23.695844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3352/6740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:23 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:24.701469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:24.702742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:24.718539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.719262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.719868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.720132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:24.720920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:24.721785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.722421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.723634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.734863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.735521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.736073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.740366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.741175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.741734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.851139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:24.871927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4bbc9bd1-5a61-4929-a478-5ddebf406390 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1271 microversion: 2.1 time: 0.174230 Oct 18 16:46:24.886840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3389/6741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:24 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:25.076049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:25.086221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8d9bfac7-d4ca-4031-9765-1e712e4ef75d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.370328 Oct 18 16:46:25.087625 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3353/6742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:24 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:25.899444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:25.900283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:25.908102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:25.908612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:25.909172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:25.909917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:25.910389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:25.910834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.111700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:26.114002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:26.123100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.123553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.124171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.125172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.125641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.126076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.390931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:26.400836 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93b322d2-bfd8-4ecd-b5ca-e0a2b4c7828e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.293027 Oct 18 16:46:26.401571 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3354/6743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:26 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:26.451380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:26.462783 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5d02ca7-ab87-420c-bf88-7dbe9cf7c3a6 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.567341 Oct 18 16:46:26.477807 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3390/6744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:25 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:26.656638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40bdfc9b-32ec-4370-80f4-ef94d1da362b", "tag": "753168f6-99f8-48fc-bb6f-bdeb135e365c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:26.668958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.669823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.670256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.683513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] Creating event network-changed:753168f6-99f8-48fc-bb6f-bdeb135e365c for instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b on n-h1-858383-14 Oct 18 16:46:26.689612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b49d7362-9558-413c-b0c6-7ef7c9c8049c req-89097681-16c1-4590-83d3-b4d4e220b219 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036580 Oct 18 16:46:26.690955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3355/6745] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:27.427415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:27.429233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:27.437368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.438194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.438844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.439796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.440452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.441244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.488372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:27.488984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:27.498325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.499116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.499728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.500666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.501319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.501905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.527012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:27.677676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:27.686106 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c6ab7242-d397-4966-aa58-d6508aea0860 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.202092 Oct 18 16:46:27.686699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3356/6746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:27 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:27.716096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:27.724492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25472e57-d4b9-4036-86cb-fd12e8f3fc40 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.301869 Oct 18 16:46:27.725682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3391/6747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:27 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:28.708196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:28.708830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:28.715984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:28.716466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:28.716896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:28.717609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:28.718253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:28.718674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:28.751316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:28.752947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:28.764336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:28.764929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:28.765488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:28.766277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:28.766802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:28.767311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:28.888741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:28.898269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4b91f57-56d4-4690-bbdc-9c159d258761 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.194341 Oct 18 16:46:28.899695 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3357/6748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:28 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:29.008381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:29.019416 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc75b96b-b141-4d67-b2bf-eaa9be864a18 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.273751 Oct 18 16:46:29.026826 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3392/6749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:28 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:29.922024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:29.922911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:29.930544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:29.931296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:29.931901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:29.932979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:29.933664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:29.934298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:30.044777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:30.046929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:30.079167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:30.079742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:30.080194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:30.083273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:30.083763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:30.085661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:30.104174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:30.112681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-954a26f8-b37f-4edf-92a8-ffd5ac25d67d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.194442 Oct 18 16:46:30.114765 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3358/6750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:29 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:30.120457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:30.924569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:30.942972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97c3a272-ef72-4ee5-9377-d57c5322fe36 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.900964 Oct 18 16:46:30.946000 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3393/6751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:30 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:31.140345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:31.140959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:31.151318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:31.152064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:31.152883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:31.153839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:31.154468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:31.155067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:31.347734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:31.362450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2688c23a-3299-467d-8062-b13c530543f3 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.226034 Oct 18 16:46:31.363693 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3359/6752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:31 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:31.967830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:31.968432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:31.975225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:31.975960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:31.976619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:31.977608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:31.978272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:31.979139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:32.043552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bdfc9b-32ec-4370-80f4-ef94d1da362b", "name": "network-vif-plugged", "status": "completed", "tag": "753168f6-99f8-48fc-bb6f-bdeb135e365c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:32.054645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:32.055494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:32.056094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:32.068409 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] Creating event network-vif-plugged:753168f6-99f8-48fc-bb6f-bdeb135e365c for instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b on n-h1-858383-14 Oct 18 16:46:32.074862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b8f479bc-0be2-4957-bc58-314547dc65bc req-ff0293ee-13df-4caf-ad01-a7b157d68ae6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246993 Oct 18 16:46:32.075478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3394/6753] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:32.182991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:32.192896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e2846cf-de71-4d29-af76-3b0d036a7d1f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1697 microversion: 2.1 time: 0.228955 Oct 18 16:46:32.199552 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3360/6754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:31 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1697 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:32.331107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5c7fbad0-2da1-4f0c-8d1f-fe6751f6ce97 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: .version_select at 0x7f5fd0d24310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2117675029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzqWL4stH2p89KNm9qUFJyS4qefioB8wXKUnMyC3KZEtNzdqeFJIP9/7p7Bmf54I52cd3B8ArB0BcmDCXsgbR+SuhVUlK4xe7T+04QMUwayHdOZyrC6iYxjNoBMovLlNw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:32.347779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c7fbad0-2da1-4f0c-8d1f-fe6751f6ce97 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:46:32.353448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5c7fbad0-2da1-4f0c-8d1f-fe6751f6ce97 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:46:32.379919 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5c7fbad0-2da1-4f0c-8d1f-fe6751f6ce97 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.053460 Oct 18 16:46:32.382916 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3395/6755] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:46:32 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:32.390681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:32.391435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:32.393611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:32.394389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:32.401718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:32.402358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:32.402899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:32.403708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:32.404295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:32.404831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:32.599322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:32.610832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f12d8265-b241-4c4e-bfa9-9ff492a369fd tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.226360 Oct 18 16:46:32.614436 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3361/6756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:32 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:33.219108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:33.219998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:33.231716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:33.236425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:33.237034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:33.242482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:33.243086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:33.243656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:33.463934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:33.473230 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41bc0e16-2df5-4b9c-b177-81a2cfd1bfd2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1696 microversion: 2.1 time: 0.258141 Oct 18 16:46:33.481108 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3396/6757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:33 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1696 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:33.640666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:33.642921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:33.659182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:33.659916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:33.660579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:33.661683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:33.663451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:33.664318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:33.786584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-unplugged", "status": "completed", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:33.815449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:33.816462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:33.817276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:33.835613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Creating event network-vif-unplugged:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h2-858383-14 Oct 18 16:46:33.852749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:46:33.875557 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-71c0276d-f2e9-43ed-8fad-959a588f511c req-3cf884a5-e1ef-4c12-acb9-862c6ff5c4de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093367 Oct 18 16:46:33.878300 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3397/6758] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:33.918654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1239439052", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "d8e76e40-e53e-4b38-b967-37c7880d026e"}], "key_name": "tempest-TestNetworkBasicOps-2117675029", "security_groups": [{"name": "tempest-secgroup-smoke-76786898"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:34.027902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:34.040705 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8dda15ee-8210-4dd2-b1ca-4e768575a12d tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1313 microversion: 2.1 time: 0.403902 Oct 18 16:46:34.041940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3362/6759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:33 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:34.075169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] validate_networks() for [('d8e76e40-e53e-4b38-b967-37c7880d026e', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:46:34.502369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:34.503258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:34.513924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:34.514750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:34.516557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:34.517348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:34.520417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:34.521382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:34.689423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:46:34.691021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:46:34.691654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:46:34.692202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:46:34.693207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:46:34.706006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:34.707393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:34.708188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:34.710075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:34.710805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:34.711495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:34.734186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:46:34.743592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Getting quotas for user 928b7b2e278d406eac6ecf01af7b91bf and project 65f1daaa3adc40258f909dc2ff87eba8. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:46:34.760524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:46:34.763042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:46:34.826016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:34.843306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbd0902e-a18b-40b1-b683-8315c46b2445 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.928844 Oct 18 16:46:34.844464 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3398/6760] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:46:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:46:34.857692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ba5ae1c-15cd-4ce8-be3f-54b4e73925d4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:34.857919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a082415-cac5-4470-9a41-910c5eb88852 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1696 microversion: 2.1 time: 0.359228 Oct 18 16:46:34.860725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ba5ae1c-15cd-4ce8-be3f-54b4e73925d4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:34.873549 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3363/6761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:34 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1696 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:34.943780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ba5ae1c-15cd-4ce8-be3f-54b4e73925d4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:34.952892 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ba5ae1c-15cd-4ce8-be3f-54b4e73925d4 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1249 microversion: 2.1 time: 0.100866 Oct 18 16:46:34.953547 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3399/6762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:34 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:35.067457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:35.068085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:35.083697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.084224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.085645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.086397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.086870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.087302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.349232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:35.359679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e202cd25-e9a4-4ba9-9edc-de8519374c45 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1463 microversion: 2.1 time: 0.295971 Oct 18 16:46:35.360546 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3364/6763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:35 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:35.384966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7e7391-38ef-455e-b61d-bb6c02830014", "device": "/dev/sdb"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:35.388211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:35.399750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.400280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.400715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.401471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.401916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.402663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.713653 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3fd6d1e2-2abd-4445-9fd4-207c9a8406ff tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "POST /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333507 Oct 18 16:46:35.714369 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3400/6764] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 16:46:35 2022] POST /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:35.886243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:35.887673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:35.899780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.900181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:35.900621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.901520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.902737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.903522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.904283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.910145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.910694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.911131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:35.924061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Creating event network-changed:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h2-858383-14 Oct 18 16:46:35.932913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:46:35.944567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ab3cce97-e888-4b99-be41-d1de8e993702 req-a20e17de-b849-4078-9825-a2b8aaa15f42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049654 Oct 18 16:46:35.945620 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3401/6765] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:35.982544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:35.986032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:35.998024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:35.998897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:35.999510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:36.000405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:36.001751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:36.002359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:36.081363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:36.091308 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ab5af48-8173-421f-9e84-3d81dd1e70c1 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1694 microversion: 2.1 time: 0.212103 Oct 18 16:46:36.092041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3365/6766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:35 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:36.100471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:36.123237 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5a59c7e-b365-4f64-a9d8-6c37e77b25c2 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1301 microversion: 2.1 time: 0.149716 Oct 18 16:46:36.124840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3402/6767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:35 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1301 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:37.117309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:37.117935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:37.124962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:37.125496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:37.125940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:37.126640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:37.127099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:37.127528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:37.149591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:37.150211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:37.157403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:37.157899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:37.158340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:37.159228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:37.159702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:37.160119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:37.228658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:37.239738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fbe6925-5b2c-4168-bccc-627b022c4b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1301 microversion: 2.1 time: 0.093840 Oct 18 16:46:37.249066 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3403/6768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:37 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:37.272363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:37.280528 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c327540e-f4ee-41e2-924d-c7f56b98d7ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1694 microversion: 2.1 time: 0.167954 Oct 18 16:46:37.281266 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3366/6769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:37 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:38.263609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:38.264224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:38.271244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:38.272529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:38.272836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:38.273615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:38.274106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:38.274541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:38.307763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:38.312596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:38.324391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:38.325181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:38.325727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:38.326539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:38.327252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:38.327770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:38.342176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:38.350026 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de7b0140-b543-4368-8def-e0cf6c7ff707 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1301 microversion: 2.1 time: 0.090330 Oct 18 16:46:38.350617 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3404/6770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:38 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:38.581417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:38.597884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3e179960-8eb9-46e2-a898-ebfab79f51c5 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1694 microversion: 2.1 time: 0.297386 Oct 18 16:46:38.601798 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3367/6771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:38 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:39.375155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:39.376884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:39.389275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.390125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.390977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.391935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.392939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.394166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.472491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:39.482550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-30780451-49d2-4dc4-82fd-ea7fcbdbc604 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1307 microversion: 2.1 time: 0.112384 Oct 18 16:46:39.483313 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3405/6772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:39 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:39.625695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:39.626440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:39.633505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.633999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.634476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.635146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.635605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.636033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.845413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:39.854795 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca38a46b-c4b8-4d37-a715-fa37494e42b8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1691 microversion: 2.1 time: 0.233155 Oct 18 16:46:39.855503 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3368/6773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:39 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:39.880015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:39.880780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:39.889359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.889968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.890517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.891699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:39.892287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:39.892844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:39.934326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:40.022315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af6911e4-6853-4f36-912b-6313a2f4734a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action" status: 202 len: 0 microversion: 2.1 time: 0.147159 Oct 18 16:46:40.023258 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3406/6774] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:46:39 2022] POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:46:40.031839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:40.034740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:40.044437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:40.058933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:40.059582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:40.060310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:40.061140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:40.061753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:40.062284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:40.319558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-plugged", "status": "completed", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:40.341479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:40.341978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:40.342730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:40.376851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Creating event network-vif-plugged:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h2-858383-14 Oct 18 16:46:40.390792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:46:40.423368 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5e824466-556c-4aa4-b87b-7d370d2be193 req-200667ad-835d-4db4-becf-a1f77db99dd6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102914 Oct 18 16:46:40.425388 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3407/6775] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:46:40.450161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:40.460865 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ceee60f4-2c6f-4845-baaf-d7a332c5fbf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.432010 Oct 18 16:46:40.462663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3369/6776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:40 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:40.508762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:40.509874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:40.518880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:40.519425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:40.519863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:40.520582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:40.521181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:40.522751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:40.683856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:40.696987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-84afcfba-9048-48c8-b7c1-01af5d082710 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.193794 Oct 18 16:46:40.697691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3408/6777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:40 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:41.484970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:41.485616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:41.493637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:41.494215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:41.494732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:41.495525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:41.496101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:41.496742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:41.608590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8f5e2-b259-47de-b30e-82a081bf7a6a", "tag": "272d7642-9f5a-4e53-b998-aae226204ea1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:41.620101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:41.620675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:41.621741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:41.633634 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] Creating event network-changed:272d7642-9f5a-4e53-b998-aae226204ea1 for instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a on n-h2-858383-14 Oct 18 16:46:41.638663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-aae1df4e-c542-44d5-bae2-5fe0907fd443 req-7a2f3228-9d96-45c4-9a70-20bec0f205b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033951 Oct 18 16:46:41.639315 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3409/6778] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:41.698181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:41.705883 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2510df1-1ba4-4525-9c0d-d401215991a2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.224816 Oct 18 16:46:41.706453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3370/6779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:41 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:41.721655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:41.722341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:41.729383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:41.729884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:41.730324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:41.731037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:41.731502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:41.731941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:41.872068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:41.879977 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a87a4bf-14bf-448c-968d-d0288ffe664e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.162918 Oct 18 16:46:41.880553 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3410/6780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:41 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:42.730436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:42.731292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:42.738845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:42.741191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:42.741191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:42.742240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:42.742770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:42.742770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:42.910375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:42.912108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:42.923528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:42.924553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:42.925368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:42.926475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:42.927109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:42.927737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:43.065596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:43.080863 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-673326a9-8f7f-4073-aca2-c37909472030 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.354156 Oct 18 16:46:43.082717 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3371/6781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:42 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:43.115010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:43.138684 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73e18199-8047-4d82-96c7-903512dd702a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.236217 Oct 18 16:46:43.140193 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3411/6782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:42 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:44.107178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:44.107874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:44.116388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.116897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.117435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.118142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.118594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.119015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.164920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:44.165573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:44.172926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.173447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.173890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.174593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.175045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.175469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.181085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:44.275838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:44.279942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=100 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:44.285466 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e114dcc-e7ac-40e6-b67a-4841cae654c2 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.182428 Oct 18 16:46:44.286048 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3372/6783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:44 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:44.546850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:44.555259 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e4ee755-0dda-48c4-9d2f-4f8172e4725e tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.395616 Oct 18 16:46:44.555852 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3412/6784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:44 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:46:44.646391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-unplugged", "status": "completed", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:44.656834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.657358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.657832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.673157 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Creating event network-vif-unplugged:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:46:44.680896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:46:44.694356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5195df79-7252-4d90-9a63-b91457b8d274 req-a5f7ade2-ddea-485f-bbe4-a8b9868a4420 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051535 Oct 18 16:46:44.695033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3373/6785] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:45.316184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:45.317856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:45.320348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:45.321748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=14 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:45.332930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.333811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.334295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:45.335214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.335901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.336561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:45.559850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:45.567905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71f18d16-eb65-4206-a745-eb40e95aa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.255921 Oct 18 16:46:45.568439 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3413/6786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:45 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:45.581148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:45.581852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:45.591139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.591711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.592217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:45.592925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.593405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.593831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:45.745130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:45.753259 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24b7e7ed-c1aa-4f1e-a5bb-0996cb23e87b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.177083 Oct 18 16:46:45.754171 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3374/6787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:45 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:46.592137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:46.593065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:46.600871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.601385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.601832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.602528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.603136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.603571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.739354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:46.752401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.752875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.753578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.758737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:46.768388 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Creating event network-changed:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:46:46.773089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9c931ae-fd55-4218-98b9-94abc7b0823c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.184616 Oct 18 16:46:46.774259 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3414/6788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:46 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:46.780473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:46.781493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:46.782704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 16:46:46.789474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.790488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.791168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.792171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.793510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.793510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.798121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1e97c5fe-024f-4f33-8ccd-0d833dc3aa72 req-5d87d1ec-5993-49cd-b76f-d3ae952e1748 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065187 Oct 18 16:46:46.802699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3375/6789] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:46.951483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:46.964544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c179d5c-f385-4169-8175-b5ee6eb31174 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.187543 Oct 18 16:46:46.966036 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3415/6790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:46 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:47.801100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:47.801817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:47.808640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:47.809150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:47.809599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:47.810301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:47.810755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:47.811175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:47.954859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:47.963421 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a0786a58-3023-4272-8c9a-f63b9a0fd9f3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1690 microversion: 2.1 time: 0.167481 Oct 18 16:46:47.964354 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3376/6791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:47 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:47.989240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:47.990073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:47.998310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:47.998715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:47.999154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:47.999847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:48.000305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:48.000733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:48.143835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:48.152389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4515c476-f392-40a5-b527-7122396f1b59 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.168263 Oct 18 16:46:48.153351 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3416/6792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:47 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:48.261804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8f5e2-b259-47de-b30e-82a081bf7a6a", "name": "network-vif-plugged", "status": "completed", "tag": "272d7642-9f5a-4e53-b998-aae226204ea1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:48.272389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:48.273139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:48.273570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:48.286154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] Creating event network-vif-plugged:272d7642-9f5a-4e53-b998-aae226204ea1 for instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a on n-h2-858383-14 Oct 18 16:46:48.291112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f26daa3a-8722-45a9-8d95-12c53de84b71 req-386e4cad-20ee-4eca-9194-e334742b192e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Oct 18 16:46:48.291711 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3377/6793] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:48.990176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:48.992978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:49.001429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.002219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.002869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.003794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.004441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.005068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.176394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:49.177122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:49.184958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.185472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.185915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.186616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.187144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.187575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.263692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:49.275378 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d583793-280b-4ffe-9fb7-64132e782a81 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1683 microversion: 2.1 time: 0.292207 Oct 18 16:46:49.284363 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3417/6794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:48 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1683 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:49.432093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:49.441703 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29fa5114-1772-4051-893b-c7f9ae8a8fbd tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1373 microversion: 2.1 time: 0.269562 Oct 18 16:46:49.442295 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3378/6795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:49 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1373 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:50.466731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:50.467350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:50.474648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.475420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.475864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.476560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.477037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.477461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.627613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:50.637395 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a93f3da9-4e41-4823-bf8c-a1c732817601 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1546 microversion: 2.1 time: 0.174564 Oct 18 16:46:50.637993 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3418/6796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:50 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:50.661289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:50.662054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:50.669690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.670264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.670758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.671512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.672032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.672514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.819303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:50.827946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dbfb80d0-f3b0-4c74-a0ed-caff9b488a6d tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1546 microversion: 2.1 time: 0.170470 Oct 18 16:46:50.828572 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3379/6797] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:50 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:51.675005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-plugged", "status": "completed", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:51.687445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:51.688072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:51.688518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:51.710181 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] Creating event network-vif-plugged:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:46:51.728857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-186ec547-ed58-458e-b668-852495c2d838 req-5c0d122c-5a60-43bd-acca-86ed1352ec46 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056162 Oct 18 16:46:51.729670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3419/6798] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:53.196369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8f5e2-b259-47de-b30e-82a081bf7a6a", "tag": "272d7642-9f5a-4e53-b998-aae226204ea1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:53.208952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:53.209737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:53.210474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:53.222337 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] Creating event network-changed:272d7642-9f5a-4e53-b998-aae226204ea1 for instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a on n-h2-858383-14 Oct 18 16:46:53.228838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-eba7b4a1-9d93-45c7-9d8c-3d9b2a394490 req-f0c6fb6d-2fc1-40a1-a626-9d1ad020bc61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036138 Oct 18 16:46:53.233621 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3380/6799] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:47:21.603636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=28 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:21.604390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=43 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:21.609482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:21.611896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:21.620886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:21.621703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:21.622194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:21.622919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:21.623384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:21.623849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:21.703252 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7886f29c-8891-4664-b93f-0775c22bc91b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action" status: 200 len: 63160 microversion: 2.1 time: 0.101422 Oct 18 16:47:21.704130 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3420/6800] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:47:21 2022] POST /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4/action => generated 63160 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 16:47:24.466174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=23 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:24.467002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:24.471819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:24.474101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:24.482012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:24.482502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:24.483008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:24.483627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:24.484083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:24.484525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:24.551170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b637e634-bdf6-49c6-9858-12965022bd6b tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a/action" status: 200 len: 24571 microversion: 2.1 time: 0.087005 Oct 18 16:47:24.552048 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3381/6801] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:47:24 2022] POST /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:47:37.933025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:37.934475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:37.939250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:37.939970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:37.949929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:37.950493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:37.951057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:37.951821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:37.952383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:37.953058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:38.094784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0e05be7-30c3-4f14-8da8-7d24cfa0c072 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1836 microversion: 2.1 time: 0.164967 Oct 18 16:47:38.095398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3421/6802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:37 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1836 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:38.994340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:38.994939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:38.999131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:39.000602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:39.004393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:39.012019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:39.012603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:39.013151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:39.018221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:39.018708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:39.019151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:39.019886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:39.024711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:39.025243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:39.025399 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] Creating event network-changed:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:47:39.030850 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-02e5da0d-d138-490b-a7da-48ee664c4b5d req-9f83b4c8-3715-46dd-8d36-de0ba2e3d8e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035421 Oct 18 16:47:39.032080 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3422/6803] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:47:39.062051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:47:39.154805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c81eea2e-ba6a-4075-958d-14793ceb518e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 204 len: 0 microversion: 2.1 time: 0.166164 Oct 18 16:47:39.155519 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3382/6804] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:47:38 2022] DELETE /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:47:39.164651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:39.165401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:39.174809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:39.176157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:39.176830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:39.178583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:39.179518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:39.181072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:39.360544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:39.373491 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb19bf29-e075-42b9-b13a-82449755924a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1689 microversion: 2.1 time: 0.213111 Oct 18 16:47:39.389047 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3423/6805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:39 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:40.400512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:40.401465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:40.417566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:40.418070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:40.418514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:40.419223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:40.419684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:40.420156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:40.625252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:40.635968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-661f2885-18ea-4660-be66-2ff1c746ab51 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1689 microversion: 2.1 time: 0.240596 Oct 18 16:47:40.636943 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3383/6806] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:40 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:41.438329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312450-91c8-4e60-9f07-5c08ba9f2aa4", "name": "network-vif-deleted", "tag": "43a19849-00ad-4142-93e6-79419375a40c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:41.451494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:41.452556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:41.453721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:41.469204 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] Creating event network-vif-deleted:43a19849-00ad-4142-93e6-79419375a40c for instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 on n-h1-858383-14 Oct 18 16:47:41.474218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3dc2a490-b8cd-4c94-a815-577809d1aa05 req-72f4f8fd-0569-46c4-9b84-0fc74f69172e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124066 Oct 18 16:47:41.474782 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3424/6807] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:47:41.662828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:41.664011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:41.673314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:41.673908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:41.674634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:41.675575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:41.676200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:41.676719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:41.714229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:41.715079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:41.715588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:41.716040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lazy-loading 'fault' on Instance uuid ec312450-91c8-4e60-9f07-5c08ba9f2aa4 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:47:41.766251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:41.776911 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47406662-d9e0-4603-b11a-499cb343f9e6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 200 len: 1357 microversion: 2.1 time: 0.118410 Oct 18 16:47:41.777778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3384/6808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:41 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 1357 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:42.666615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:42.668103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:42.674328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:42.674811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:42.675244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:42.675934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:42.676385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:42.676986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:42.758501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lazy-loading 'services' on Instance uuid 40bdfc9b-32ec-4370-80f4-ef94d1da362b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:47:42.801949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:42.802459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ec312450-91c8-4e60-9f07-5c08ba9f2aa4] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:42.810227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:42.810708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:42.811262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:42.812035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:42.812515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:42.812979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:42.830460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] HTTP exception thrown: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. Oct 18 16:47:42.831067 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-199ff315-83cd-48d7-a070-1cec217eb970 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b/os-volume_attachments/5b7e7391-38ef-455e-b61d-bb6c02830014" status: 202 len: 0 microversion: 2.1 time: 0.169588 Oct 18 16:47:42.831675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3425/6809] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 16:47:42 2022] DELETE /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b/os-volume_attachments/5b7e7391-38ef-455e-b61d-bb6c02830014 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Request method failure captured: Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 HTTP/1.1 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtceLIscCOAKhgHifrTrD-khzakT4oXOBQmfBQBAV175ynZt6XNPgWp0jzGNpPIQrr2sCyC78GvUrnacrkN22X5mWjAe0X0-0LXjLKiCnR9k-Xu5yZbhPwppk7xxOfHOQt8Ryc1NrzOO9qnfmtLWd6Hp9TjZnuhqW1fur2in7TSaND4 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}] Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c0d13a891f6445a2b12c8b30182df7e2 Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ec312450-91c8-4e60-9f07-5c08ba9f2aa4'} Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:42.832100 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Returning 404 to user: Instance ec312450-91c8-4e60-9f07-5c08ba9f2aa4 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adea3a67-f388-471a-a9a3-2617528ae450 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4" status: 404 len: 111 microversion: 2.1 time: 0.035536 Oct 18 16:47:42.837885 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3385/6810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:42 2022] GET /compute/v2.1/servers/ec312450-91c8-4e60-9f07-5c08ba9f2aa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:47:46.512468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d54333d-0d06-4bcc-a79d-fae18aa06a56 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '.version_select at 0x7f5fd108e430>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:46.537768 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d54333d-0d06-4bcc-a79d-fae18aa06a56 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1186240977" status: 202 len: 0 microversion: 2.1 time: 0.030363 Oct 18 16:47:46.538893 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3426/6811] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 16:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1186240977 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:47:46.575557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b8d0fc5-f8a0-42d9-ac38-d0040705dd19 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: .version_select at 0x7f5fd0f2a4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1480135149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhaK/aWb4z26vzt5lniQPBKnVPvjFYATuOrX6Yc37RG8qafGw0ziquTC0OK24R6EnrJed9kD43d6a7cvjMlDAnb6xwlNC8XAUiF15BYMgP42jFH3GoXkmva40L73ogtaQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:46.594028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8b8d0fc5-f8a0-42d9-ac38-d0040705dd19 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:47:46.600115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-8b8d0fc5-f8a0-42d9-ac38-d0040705dd19 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:47:46.625208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b8d0fc5-f8a0-42d9-ac38-d0040705dd19 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053514 Oct 18 16:47:46.625806 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3386/6812] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:47:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:47:48.321965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:48.322654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:48.331054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:48.331544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:48.331981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:48.332693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:48.333172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:48.333596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:48.361642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:47:48.453169 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f32448e9-86c4-4763-a62f-ad5ec9684718 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 204 len: 0 microversion: 2.1 time: 0.137043 Oct 18 16:47:48.454116 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3427/6813] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:47:48 2022] DELETE /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:47:48.464165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:48.465688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:48.473353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:48.473981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:48.474485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:48.475252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:48.475790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:48.476297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:48.621994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:48.629960 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c6aa529-ae58-4320-bd9b-15e240a9d94c tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1469 microversion: 2.1 time: 0.171445 Oct 18 16:47:48.630612 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3387/6814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:48 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:49.657858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:49.659328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:49.667561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:49.668346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:49.669082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:49.669988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:49.670612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:49.671212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:49.865415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:49.875380 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-186832c3-1e15-41cc-ae74-9f112ed72c5e tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1469 microversion: 2.1 time: 0.224373 Oct 18 16:47:49.876233 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3428/6815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:49 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:50.904235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:50.906235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:50.906478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bdfc9b-32ec-4370-80f4-ef94d1da362b", "name": "network-vif-deleted", "tag": "753168f6-99f8-48fc-bb6f-bdeb135e365c"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:50.915793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:50.917682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:50.918473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:50.919838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:50.921478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:50.922204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:50.941457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:50.942305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:50.943034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:50.972510 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] Creating event network-vif-deleted:753168f6-99f8-48fc-bb6f-bdeb135e365c for instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b on n-h1-858383-14 Oct 18 16:47:50.978810 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e9a3bff0-da35-47a4-9b05-320a052527fa req-1f80d76f-34bf-4047-a875-d3fa3334f6c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082569 Oct 18 16:47:50.980066 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3388/6816] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:47:51.046499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e99b9cd9bfc4d9c9e5726ec86efc352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b93599474964d94a2f675ec746dcce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:51.056519 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-367d484e-df34-4b17-aefb-7c4b51b7b592 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 200 len: 1298 microversion: 2.1 time: 0.160694 Oct 18 16:47:51.057546 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3429/6817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:50 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:47:52.083939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:52.085613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] [instance: 40bdfc9b-32ec-4370-80f4-ef94d1da362b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:52.097153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:52.097946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:52.098704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:52.099425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:52.099887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:52.100317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:52.120318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] HTTP exception thrown: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Request method failure captured: Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b HTTP/1.1 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTthcPAPxOGDia7zFU24YbWV5Wvg4qWiPmev3NeuKPCq-ziDy_KCjkLyZ6bqcfAc3YWGxIhMiN2F97c8JqI5IEtDLTej4SsbS3JpUS6UdNuQgoe0LQ_L5TUwT69MAGYLLn3M4Hv4O5kdQrjNHSmLkya4a3cawxmARgWrITNf-o5VJw-I Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 0b93599474964d94a2f675ec746dcce7 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-VolumesBackupsTest-1226371089 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0b93599474964d94a2f675ec746dcce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b93599474964d94a2f675ec746dcce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0b93599474964d94a2f675ec746dcce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b93599474964d94a2f675ec746dcce7"}]}] Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-VolumesBackupsTest-1226371089 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 0b93599474964d94a2f675ec746dcce7 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-VolumesBackupsTest-1226371089 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-VolumesBackupsTest-1226371089-project Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 5e99b9cd9bfc4d9c9e5726ec86efc352 Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-VolumesBackupsTest-1226371089-project Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '40bdfc9b-32ec-4370-80f4-ef94d1da362b'} Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:47:52.122074 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. Oct 18 16:47:52.127832 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:47:52.133561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] Returning 404 to user: Instance 40bdfc9b-32ec-4370-80f4-ef94d1da362b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:47:52.134812 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8da394f5-52e4-4467-bb69-715053583fb7 tempest-VolumesBackupsTest-1226371089 tempest-VolumesBackupsTest-1226371089-project] 10.222.0.78 "GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b" status: 404 len: 111 microversion: 2.1 time: 0.059435 Oct 18 16:47:52.139554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3389/6818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:52 2022] GET /compute/v2.1/servers/40bdfc9b-32ec-4370-80f4-ef94d1da362b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:47:53.404346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-147584797", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "10b3d134-8575-466a-a7c0-7570fa18c48b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1480135149", "security_groups": [{"name": "tempest-secgroup-smoke-1007492058"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:53.547634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] validate_networks() for [('10b3d134-8575-466a-a7c0-7570fa18c48b', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:47:53.980306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:47:53.980956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:47:53.981561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:47:53.982087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:47:53.982611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:47:53.995000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:53.995799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:53.996492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:53.997778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:53.998251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:53.998857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:54.020031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:47:54.026608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:47:54.040493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:47:54.042848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:47:54.094588 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a3d4419-2621-4961-818a-d23ab4f2d118 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694321 Oct 18 16:47:54.095246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3430/6819] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:47:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:47:54.106834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c79f43f2-437c-4aef-a99c-1454c22d81c3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:54.108178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c79f43f2-437c-4aef-a99c-1454c22d81c3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:54.185892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c79f43f2-437c-4aef-a99c-1454c22d81c3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:54.195521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c79f43f2-437c-4aef-a99c-1454c22d81c3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1266 microversion: 2.1 time: 0.092482 Oct 18 16:47:54.213454 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3390/6820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:54 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:55.221582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:55.222200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:55.229648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:55.230143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:55.230584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:55.231426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:55.231890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:55.232321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:55.300293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:55.310426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f1f654a6-3ee3-4488-91dd-f28bbb87d567 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1318 microversion: 2.1 time: 0.093689 Oct 18 16:47:55.311764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3431/6821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:55 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:56.335356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:56.336350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:56.350937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:56.351773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:56.352818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:56.355495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:56.356189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:56.357081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:56.712212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:56.723000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-41ca6c4e-1d57-43ac-941c-92471dbaa761 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.391431 Oct 18 16:47:56.727784 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3391/6822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:56 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:57.536870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:57.551605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:57.552104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:57.552516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:57.570020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] Creating event network-changed:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h1-858383-14 Oct 18 16:47:57.576832 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-60ba01ad-0218-4492-82c8-f08a5e5fb9e4 req-29bd34d0-bcd7-4937-a1cb-86de410a416d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045748 Oct 18 16:47:57.578051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3432/6823] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:47:57.751821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:57.752433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:57.760628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:57.761149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:57.762011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:57.763236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:57.763705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:57.764272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:57.909384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:57.918420 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a67d244-023d-42c2-90d6-80092a506704 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.170454 Oct 18 16:47:57.933844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3392/6824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:57 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:58.942843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:47:58.943665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:58.952411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:58.952901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:58.953372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:58.954304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:58.954774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:58.955199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:59.096852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:47:59.105546 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8bbd7a52-85e1-4d94-8d17-ee0c645b19ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.166999 Oct 18 16:47:59.106133 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3433/6825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:47:58 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:00.127670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:00.128738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:00.136825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.137348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.138565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.139470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.140121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.140815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.289412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:00.298225 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a75a7f3-eebd-4e36-9ff5-babc28e2603d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.174342 Oct 18 16:48:00.298816 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3393/6826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:00 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:01.322977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:01.324264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:01.331211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:01.331699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:01.332135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:01.332833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:01.333355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:01.333793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:01.481994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:01.490140 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1054153d-8614-4120-af0e-9f4dc19a56df tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.171372 Oct 18 16:48:01.490985 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3434/6827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:01 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:02.514172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:02.515043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:02.522446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:02.523301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:02.524553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:02.525467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:02.526327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:02.527183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:02.686132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:02.694456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c4262ec3-b0ac-4b4e-99ff-c4a3aeac0cb7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.184438 Oct 18 16:48:02.709019 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3394/6828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:02 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:03.359607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:03.362043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:03.370089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.370580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.371027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.371832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.372343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.372809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.445685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94b38066-4992-4108-a4ce-921aa23e2631 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "POST /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a/action" status: 200 len: 32641 microversion: 2.1 time: 0.089733 Oct 18 16:48:03.446836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3435/6829] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:03 2022] POST /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a/action => generated 32641 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:48:03.718638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:03.719255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:03.726196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.726865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.727400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.728191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.728650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.729348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.896435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:03.906055 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9add8087-b1d7-4e12-bbf6-87539040071f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.190976 Oct 18 16:48:03.907598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3395/6830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:03 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:04.062811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "name": "network-vif-plugged", "status": "completed", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:04.072415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:04.075973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:04.088014 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.089160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.089875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.107895 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] Creating event network-vif-plugged:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h1-858383-14 Oct 18 16:48:04.119897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a89237a2-98f7-422d-9191-9b278bf39157 req-a3734461-e8dd-4430-8e48-40a983c238ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063181 Oct 18 16:48:04.121466 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3436/6831] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:04.931344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:04.931898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:04.938773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:04.946845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.947429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.947947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.948806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.950176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.950698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.017791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:05.018383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:05.029559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.030263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.030483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.031537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.032046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.032560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.062985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:48:05.152080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:05.162219 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfef5d6c-e63f-4717-b5a2-7a1eaf891624 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1392 microversion: 2.1 time: 0.234691 Oct 18 16:48:05.163651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3396/6832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:04 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:05.165652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4ff1492-203b-4c23-8e26-d63e22522235 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 204 len: 0 microversion: 2.1 time: 0.152494 Oct 18 16:48:05.169850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3437/6833] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:48:05 2022] DELETE /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:48:05.170058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8f5e2-b259-47de-b30e-82a081bf7a6a", "tag": "272d7642-9f5a-4e53-b998-aae226204ea1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:05.175891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:05.176961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:05.182424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.182837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.183440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.186330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.187010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.187580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.188648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.189417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.190248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.195983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:05.203297 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] Creating event network-changed:272d7642-9f5a-4e53-b998-aae226204ea1 for instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a on n-h2-858383-14 Oct 18 16:48:05.214953 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1a3cf2fd-f52e-47ef-859e-4beebd3299b1 req-2510aa53-34d5-4716-95f8-f0efa8d10698 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049506 Oct 18 16:48:05.218756 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3397/6834] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:05.355913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:05.363962 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-638f1942-3e64-4ddb-a29c-fa5de17b1a9f tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1670 microversion: 2.1 time: 0.192516 Oct 18 16:48:05.364850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3438/6835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:05 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1670 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:06.190590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:06.191332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:06.198150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.198642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.199088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.199808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.200479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.200916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.388805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:06.389450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:06.396842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.397371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.397882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.399259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.399728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.400162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.405749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:06.414062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a6443869-6e65-44ed-871b-72d6cfcb1592 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1564 microversion: 2.1 time: 0.228587 Oct 18 16:48:06.432825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3398/6836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:06 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:06.437882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:06.438730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:06.444935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.446789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.447433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.448139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.448768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.449441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.568907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:06.581315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-240b7daf-e9ac-4075-8816-f5e0311713a5 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1670 microversion: 2.1 time: 0.196626 Oct 18 16:48:06.600886 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3439/6837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:06 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:06.653423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:06.676117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-29f0f6e1-fdbe-4d4c-8e71-8ed58050c4cd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1564 microversion: 2.1 time: 0.241821 Oct 18 16:48:06.676705 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3399/6838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:06 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:07.531773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8f5e2-b259-47de-b30e-82a081bf7a6a", "name": "network-vif-deleted", "tag": "272d7642-9f5a-4e53-b998-aae226204ea1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:07.553873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:07.555422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:07.556103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:07.568976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] Creating event network-vif-deleted:272d7642-9f5a-4e53-b998-aae226204ea1 for instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a on n-h2-858383-14 Oct 18 16:48:07.575197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5560bdb1-1922-41ed-80a0-b1e8de31cc6b req-4cf3073d-fc1c-41de-b057-86a3b92c73c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047297 Oct 18 16:48:07.576736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3440/6839] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:07.623715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:07.624374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:07.631421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:07.631810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:07.632460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:07.633942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:07.634583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:07.635189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:07.669556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:07.670326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:07.670938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:07.671562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lazy-loading 'fault' on Instance uuid a9e8f5e2-b259-47de-b30e-82a081bf7a6a {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:48:07.724503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928b7b2e278d406eac6ecf01af7b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f1daaa3adc40258f909dc2ff87eba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:07.730900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:07.740925 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e01de362-69e6-4c31-bc9a-a25375b11c73 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 200 len: 1339 microversion: 2.1 time: 0.121212 Oct 18 16:48:07.741888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3400/6840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:07 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:08.555564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:08.557192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:08.557339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:08.561807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:08.569285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.570043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.571499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.573991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.583273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.584986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.587800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.588444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.589248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.590128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] Creating event network-changed:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h1-858383-14 Oct 18 16:48:08.596930 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8d81be2a-53e4-44c4-9175-bd1ec0c2392b req-58ec1fbe-c66d-4ded-9a02-b9a57022f3a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043762 Oct 18 16:48:08.598315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3401/6841] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:08.768185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:08.770283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] [instance: a9e8f5e2-b259-47de-b30e-82a081bf7a6a] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:08.778500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.779382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.779813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.780511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.780966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.781406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.796748 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] HTTP exception thrown: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Request method failure captured: Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a HTTP/1.1 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtex5WKMks6_gNLcC4T5_D9D0ANSAebc9jL-29T8HA3MvfiewpxUmYLfMSYxWYZcGCa6SvaLxAsk_scS7WfrZeqL-9oRk3tzVIulAcfcU6UWlCNRkuO32xzY5bAmH20K99FMstvM0W02EFr2mOPPnp9V1LNtgFlXWQftPjnT6PTCXrc Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65f1daaa3adc40258f909dc2ff87eba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65f1daaa3adc40258f909dc2ff87eba8"}]}] Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestNetworkBasicOps-371066705 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 65f1daaa3adc40258f909dc2ff87eba8 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestNetworkBasicOps-371066705 Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 928b7b2e278d406eac6ecf01af7b91bf Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestNetworkBasicOps-371066705-project Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'a9e8f5e2-b259-47de-b30e-82a081bf7a6a'} Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:08.798812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. Oct 18 16:48:08.803749 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:08.807851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Returning 404 to user: Instance a9e8f5e2-b259-47de-b30e-82a081bf7a6a could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:48:08.807851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4046ccf3-0ee4-4584-a3aa-d3171efa787a tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a" status: 404 len: 111 microversion: 2.1 time: 0.044479 Oct 18 16:48:08.809138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3402/6842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:08 2022] GET /compute/v2.1/servers/a9e8f5e2-b259-47de-b30e-82a081bf7a6a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:48:08.899935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:08.925813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0978f7ee-3048-4ffa-863b-4cc48caff06c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1564 microversion: 2.1 time: 0.374902 Oct 18 16:48:08.926856 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3441/6843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:08 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1564 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:09.168375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c79d2619-f7e6-4f83-b34e-35501a2e6752 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] Calling method '.version_select at 0x7f5fd1797040>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:09.194785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:09.212280 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c79d2619-f7e6-4f83-b34e-35501a2e6752 tempest-TestNetworkBasicOps-371066705 tempest-TestNetworkBasicOps-371066705-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2117675029" status: 202 len: 0 microversion: 2.1 time: 0.047576 Oct 18 16:48:09.215969 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3403/6844] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2117675029 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:48:26.332495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:26.333711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=18 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:26.491615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:26.494235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:26.494940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:26.495357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:26.496266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:26.496721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:26.497175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:26.536720 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2523d4f3-cf31-41bf-bc76-614ef1ff597f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.209570 Oct 18 16:48:26.540495 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3442/6845] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 18 16:48:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:26.660801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:26.666602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-796467136", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-14", "networks": [{"uuid": "ec670b4d-e7a8-478a-bc83-776ac1ee6274"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:26.746219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] validate_networks() for [('ec670b4d-e7a8-478a-bc83-776ac1ee6274', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:48:27.459328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:48:27.459953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:48:27.460437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:48:27.461961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:48:27.462384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:48:27.472599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:27.473125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:27.473566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:27.474474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:27.474954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:27.475359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:27.498918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Getting quotas for project 9a110f605c9b42349631e73154b82e85. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:48:27.504378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Getting quotas for user 0ed827713408402cb9fb1c1e0a82760a and project 9a110f605c9b42349631e73154b82e85. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:48:27.520514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:48:27.523179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:48:27.579584 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-289ba4e6-123e-4fd3-b012-9148e658320a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920877 Oct 18 16:48:27.580239 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3404/6846] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:48:27.595623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b89bc7b6-4e08-4656-8c70-e968cc41b6c9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:27.598115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b89bc7b6-4e08-4656-8c70-e968cc41b6c9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:27.682679 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b89bc7b6-4e08-4656-8c70-e968cc41b6c9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1328 microversion: 2.1 time: 0.093609 Oct 18 16:48:27.683261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3443/6847] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:27 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:28.707416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:28.708035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:28.715420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:28.716166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:28.716608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:28.717548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:28.718012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:28.718448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:28.812089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0b43a8a1-e829-4db5-b4dc-4112b13ed579 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1417 microversion: 2.1 time: 0.109438 Oct 18 16:48:28.812983 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3405/6848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:28 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:29.836714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:29.837308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:29.844593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:29.845404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:29.846046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:29.846944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:29.847793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:29.848527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:30.111847 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9339f158-d30f-4aed-ae1c-7d08d19e4330 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.277679 Oct 18 16:48:30.125018 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3444/6849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:29 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:30.632286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bf35c4-56a9-4881-b186-93d9900f2db9", "tag": "d5467f38-3194-42b4-b9cd-a4b8a0ac64b1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:30.659273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:30.659754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:30.660180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:30.692112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] Creating event network-changed:d5467f38-3194-42b4-b9cd-a4b8a0ac64b1 for instance 54bf35c4-56a9-4881-b186-93d9900f2db9 on n-h1-858383-14 Oct 18 16:48:30.706351 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a4bd9a68-9777-4446-b94a-e04d6ce6dd2b req-e30ebab5-b4ae-4a89-953c-890efe58adca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077535 Oct 18 16:48:30.707534 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3406/6850] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:31.140779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:31.142099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:31.156449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:31.157350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:31.159690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:31.160549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:31.176210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:31.181236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:31.358061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9187d67-3b0b-437e-91db-1f24f34893d3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.223443 Oct 18 16:48:31.358670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3445/6851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:31 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:32.383527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:32.384173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:32.390429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:32.390912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:32.391347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:32.392052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:32.392504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:32.392977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:32.544770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-487b76ce-dfa2-4591-a785-741215775e05 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.166525 Oct 18 16:48:32.545665 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3407/6852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:32 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:33.572266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:33.573653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:33.584083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:33.584616 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:33.585108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:33.586136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:33.586613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:33.587215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:33.826726 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-356bd5d1-e2d7-4eb8-b022-b3abfb63de4b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.260650 Oct 18 16:48:33.827613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3446/6853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:33 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:34.849827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:34.850449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:34.857793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:34.858291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:34.858710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:34.859406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:34.859857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:34.860313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:34.997317 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c61c00c-0dd9-46f0-acca-2a80f3eab397 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.151105 Oct 18 16:48:34.997956 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3408/6854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:34 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:36.025381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:36.026646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:36.034435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:36.034923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:36.035356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:36.036145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:36.036513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:36.037112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:36.211189 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d78486f-97ea-48e1-88cb-d5013ca7ccc9 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.190931 Oct 18 16:48:36.227606 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3447/6855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:36 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:37.239096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:37.240093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:37.249482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:37.249996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:37.250430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:37.251123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:37.251636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:37.252171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:37.385476 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7878b767-ab03-421c-80f0-0cc33ad62d00 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.153443 Oct 18 16:48:37.386210 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3409/6856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:37 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:38.180755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bf35c4-56a9-4881-b186-93d9900f2db9", "name": "network-vif-plugged", "status": "completed", "tag": "d5467f38-3194-42b4-b9cd-a4b8a0ac64b1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:38.188338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:38.189564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:38.194989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:38.196435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:38.197207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:38.210333 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] Creating event network-vif-plugged:d5467f38-3194-42b4-b9cd-a4b8a0ac64b1 for instance 54bf35c4-56a9-4881-b186-93d9900f2db9 on n-h1-858383-14 Oct 18 16:48:38.215802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-6c4d7f3c-56c2-4ff0-81bc-617f4c52b683 req-40f46d7e-af19-4e54-8a50-5027f1a1f189 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039693 Oct 18 16:48:38.216451 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3448/6857] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:38.412567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:38.413352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:38.417584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:38.420503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:38.432782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:38.433304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:38.440113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:38.441230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:38.441935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:38.442507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:38.592076 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60771da8-7bbc-461d-856f-e36345a27b57 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.186369 Oct 18 16:48:38.592657 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3410/6858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:38 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:39.618328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:39.619181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:39.625918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:39.626439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:39.626962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:39.627741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:39.628197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:39.628629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:39.790080 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c13a1999-163e-49ef-b06d-6be810076d6e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1465 microversion: 2.1 time: 0.178261 Oct 18 16:48:39.793613 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3449/6859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:39 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:40.342473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:40.344651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:40.353527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:40.354014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:40.354450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:40.355143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:40.355595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:40.356016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:40.423190 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3f479b6-c009-4cc5-9b81-07efdbccc73e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action" status: 200 len: 24557 microversion: 2.1 time: 0.084371 Oct 18 16:48:40.424983 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3411/6860] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:40 2022] POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action => generated 24557 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:48:40.814674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:40.815337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:40.823752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:40.824558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:40.825052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:40.825865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:40.826365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:40.826806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:40.975321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6738ec14-1a06-4322-bf2f-4154394bdbef tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1649 microversion: 2.1 time: 0.164057 Oct 18 16:48:40.975684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3450/6861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:40 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1649 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:40.998941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:40.999642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:41.007920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.008453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.008921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.009666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.010125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.010550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.142586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5536ffe-adc3-46c8-80bf-47baae2b3c23 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1649 microversion: 2.1 time: 0.147597 Oct 18 16:48:41.143151 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3412/6862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:40 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1649 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:41.164883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:41.165613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:41.172406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.172889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.173305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.174164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.174628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.175164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.327626 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd27ef13-5abc-4e89-b087-d6a15ecc6050 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1649 microversion: 2.1 time: 0.167066 Oct 18 16:48:41.328205 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3451/6863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:41 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1649 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:41.391055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-493826141", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-14", "networks": [{"uuid": "ec670b4d-e7a8-478a-bc83-776ac1ee6274"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:41.456479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] validate_networks() for [('ec670b4d-e7a8-478a-bc83-776ac1ee6274', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:48:41.831748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:48:41.832269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:48:41.832797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:48:41.833389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:48:41.833894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:48:41.844422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.844902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.845399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.846127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:41.846604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:41.847032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:41.866842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Getting quotas for project 9a110f605c9b42349631e73154b82e85. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:48:41.872352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Getting quotas for user 0ed827713408402cb9fb1c1e0a82760a and project 9a110f605c9b42349631e73154b82e85. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:48:41.885417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:48:41.887767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:48:41.933983 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb28ca59-c61a-42f7-bc26-0c2c4c5b601e tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546596 Oct 18 16:48:41.934870 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3413/6864] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:48:41.945698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-727af739-6305-4fa3-b949-2475739c093b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:41.946478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-727af739-6305-4fa3-b949-2475739c093b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:42.015287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-727af739-6305-4fa3-b949-2475739c093b tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1328 microversion: 2.1 time: 0.073411 Oct 18 16:48:42.016214 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3452/6865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:41 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1328 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:43.045192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:43.047260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:43.059538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:43.060887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:43.062123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:43.063791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:43.064895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:43.065964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:43.158865 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77fb0914-7390-4053-bc50-69f0775a81eb tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1425 microversion: 2.1 time: 0.122759 Oct 18 16:48:43.171007 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3414/6866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:43 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1425 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:44.182784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:44.183517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:44.191354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:44.191846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:44.192293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:44.193021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:44.193479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:44.194138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:44.337564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95121fc9-ca78-4cd5-be57-0f03acfeaa6a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.158538 Oct 18 16:48:44.338344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3453/6867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:44 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:44.675280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f5e476-cc45-439d-ad07-f04754076f29", "tag": "1616e9a8-e7e6-4480-9345-6e80cb028e8b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:44.688835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:44.689329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:44.689826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:44.711548 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] Creating event network-changed:1616e9a8-e7e6-4480-9345-6e80cb028e8b for instance 87f5e476-cc45-439d-ad07-f04754076f29 on n-h2-858383-14 Oct 18 16:48:44.720098 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f98a8e54-cf9a-4cbe-8e22-a88e3996a49f req-04f2ce40-b9ef-4158-85e1-f0a8c1a309a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049541 Oct 18 16:48:44.721054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3415/6868] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:45.363942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:45.365171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:45.375789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:45.376287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:45.376728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:45.377477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:45.377942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:45.378395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:45.519917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a424cb3-d225-4e66-aee7-c07bc3917b3a tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.162296 Oct 18 16:48:45.521394 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3454/6869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:45 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:46.545322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:46.546047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:46.552365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:46.552873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:46.553325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:46.554058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:46.554775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:46.555203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:46.706853 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c71dc0be-3917-4188-8802-668fe920cba3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.166415 Oct 18 16:48:46.707473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3416/6870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:46 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:47.734024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:47.734674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:47.742170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:47.742851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:47.743326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:47.744025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:47.744484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:47.744911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:47.882791 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9e80b1e-6ddc-4555-88a1-f9de05baac83 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.155118 Oct 18 16:48:47.883485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3455/6871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:47 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:48.909030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:48.909926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:48.948125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:48.949811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:48.950314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:48.951065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:48.951535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:48.951967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:49.118356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8b3d0cb-3771-49a9-a83b-5e8208b0205f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.214772 Oct 18 16:48:49.118929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3417/6872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:48 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:50.142669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:50.143444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:50.151660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:50.152165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:50.152613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:50.153350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:50.153813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:50.154245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:50.291957 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8094366b-94b8-420d-be7a-bcc713dc52db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.153682 Oct 18 16:48:50.292551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3456/6873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:50 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:50.877322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f5e476-cc45-439d-ad07-f04754076f29", "name": "network-vif-plugged", "status": "completed", "tag": "1616e9a8-e7e6-4480-9345-6e80cb028e8b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:50.891493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:50.892658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:50.893555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:50.905685 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] Creating event network-vif-plugged:1616e9a8-e7e6-4480-9345-6e80cb028e8b for instance 87f5e476-cc45-439d-ad07-f04754076f29 on n-h2-858383-14 Oct 18 16:48:50.911874 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6bfaa44f-c1e8-430a-b1a8-6f65f503b63e req-73e54e11-786f-4000-befa-f83ed2e97f9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038202 Oct 18 16:48:50.912791 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3418/6874] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:51.315833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:51.316392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:51.325143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:51.325646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:51.326093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:51.326854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:51.327336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:51.327769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:51.464971 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1176aab8-b38f-4858-96c2-0efa3db9c311 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1465 microversion: 2.1 time: 0.152867 Oct 18 16:48:51.465636 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3457/6875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:51 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:52.490116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:52.490824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:52.493691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:52.494370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:52.501655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.502144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.502599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.503289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.503744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.504170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.647035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2b2a84d-f87a-409c-9c8a-ebc203d76565 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1649 microversion: 2.1 time: 0.161086 Oct 18 16:48:52.647727 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3419/6876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:52 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:52.670556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:52.671173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:52.673150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:52.680106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.681322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.681780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.682500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.682982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.683396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.814786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b0dfdfed-e740-44f0-b193-c3b4cb77432f tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1649 microversion: 2.1 time: 0.147882 Oct 18 16:48:52.815367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3458/6877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:52 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1649 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:52.838290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:52.839100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:52.846865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.847628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.847921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.848632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:52.849121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:52.849554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:52.990356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e266f0bb-174a-4fa7-be1c-8c762e1428a0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1649 microversion: 2.1 time: 0.157221 Oct 18 16:48:52.990969 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3420/6878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:52 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1649 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:53.019261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:53.019769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:53.027058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:53.027549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:53.027991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:53.028735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:53.029226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:53.029660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:53.055831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:48:53.131290 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6a3b8be4-5a81-4253-9a78-c7831da39d28 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 204 len: 0 microversion: 2.1 time: 0.121691 Oct 18 16:48:53.131794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3459/6879] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:48:53 2022] DELETE /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:48:53.141042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:53.141797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:53.148479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:53.149098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:53.149605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:53.150378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:53.151001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:53.151491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:53.282648 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee45c594-02e0-4086-a2c8-432cb6475456 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1655 microversion: 2.1 time: 0.146044 Oct 18 16:48:53.283324 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3421/6880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:53 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:54.308372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:54.309191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:54.316437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:54.316938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:54.317412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:54.318122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:54.318577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:54.319034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:54.323805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:54.456398 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8b71b2d5-3fa3-4240-af98-a961c647f5b0 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1655 microversion: 2.1 time: 0.152888 Oct 18 16:48:54.456900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3460/6881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:54 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:48:55.170890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f5e476-cc45-439d-ad07-f04754076f29", "name": "network-vif-deleted", "tag": "1616e9a8-e7e6-4480-9345-6e80cb028e8b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:55.197315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.197788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.198228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.224362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] Creating event network-vif-deleted:1616e9a8-e7e6-4480-9345-6e80cb028e8b for instance 87f5e476-cc45-439d-ad07-f04754076f29 on n-h2-858383-14 Oct 18 16:48:55.229931 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ab491bed-4eaa-4a43-af8a-c97fbca6a14d req-4cc26a64-9671-41a3-a531-93af8cad6ad8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063036 Oct 18 16:48:55.230563 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3422/6882] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:55.481318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:55.481938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:55.488205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.488677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.489150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.489844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.490306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.490747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.523342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.524234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.529244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.529244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lazy-loading 'fault' on Instance uuid 87f5e476-cc45-439d-ad07-f04754076f29 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:48:55.577138 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd8551df-89f4-4c1f-9dba-c52b5ee9f417 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 200 len: 1455 microversion: 2.1 time: 0.101147 Oct 18 16:48:55.577718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3461/6883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:55 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:56.601846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:56.603560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 87f5e476-cc45-439d-ad07-f04754076f29] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:56.609996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.610484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.610966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.611667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.612123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.612560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.626100 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] HTTP exception thrown: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Request method failure captured: Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 HTTP/1.1 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtjapyYSiZu-wM1cpRTyblbpf7tYwH15dWj9k_fxCu-7rPFa_voZ6tsCKa3_4kjW2TNvRQlSrB7s1RY9ISgo2CqbMlN_nfQ_EZppiUmUsPKbtVrPUz_NcYWhUxAbhpz5N7sY1Oh_MixyuqYv-5WDfNP90CfkmuJhbRZW5ffmEXzxzoI Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9a110f605c9b42349631e73154b82e85 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestServerMultinode-928464560 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9a110f605c9b42349631e73154b82e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9a110f605c9b42349631e73154b82e85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9a110f605c9b42349631e73154b82e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9a110f605c9b42349631e73154b82e85"}]}] Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestServerMultinode-928464560 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9a110f605c9b42349631e73154b82e85 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestServerMultinode-928464560 Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestServerMultinode-928464560-project-admin Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0ed827713408402cb9fb1c1e0a82760a Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestServerMultinode-928464560-project-admin Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '87f5e476-cc45-439d-ad07-f04754076f29'} Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:56.627718 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Returning 404 to user: Instance 87f5e476-cc45-439d-ad07-f04754076f29 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57cffc91-81a7-40af-9b40-f2bb473104db tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29" status: 404 len: 111 microversion: 2.1 time: 0.032387 Oct 18 16:48:56.634303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3423/6884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:56 2022] GET /compute/v2.1/servers/87f5e476-cc45-439d-ad07-f04754076f29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:48:56.638904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:56.639407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:56.642088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:56.647357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.648213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.648659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.649405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.649867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.650305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.681596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:48:56.762651 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c455128-b0a9-4b30-aa66-a1c5dabcfc50 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 204 len: 0 microversion: 2.1 time: 0.127532 Oct 18 16:48:56.763512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3462/6885] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:48:56 2022] DELETE /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:48:56.772890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:56.774074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:56.777436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:56.781251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.781813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.782340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.783286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:56.783834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:56.784310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:56.789285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=91 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:56.926653 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e2995027-ed57-4c13-93eb-f39986801266 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1655 microversion: 2.1 time: 0.158630 Oct 18 16:48:56.927225 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3424/6886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:56 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:57.951500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:57.952233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:57.959542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:57.960029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:57.960678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:57.962048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:57.962048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:57.963214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:58.098571 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd4ab971-b2de-4be9-853a-5e1123c63bf3 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1655 microversion: 2.1 time: 0.151222 Oct 18 16:48:58.099142 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3463/6887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:57 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:58.862197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bf35c4-56a9-4881-b186-93d9900f2db9", "name": "network-vif-deleted", "tag": "d5467f38-3194-42b4-b9cd-a4b8a0ac64b1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:58.875105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:58.875371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:58.875696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:58.889824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] Creating event network-vif-deleted:d5467f38-3194-42b4-b9cd-a4b8a0ac64b1 for instance 54bf35c4-56a9-4881-b186-93d9900f2db9 on n-h1-858383-14 Oct 18 16:48:58.895143 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-519504c3-5bad-41f6-b67e-e82ae6e9e37b req-67cf2414-8887-4111-b413-0ef964ef93e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036587 Oct 18 16:48:58.895872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3425/6888] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:59.123322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:59.124182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:59.134392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:59.135124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:59.135757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:59.136681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:59.138563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:59.139241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:59.170709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:59.171190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:59.171615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:59.172080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lazy-loading 'fault' on Instance uuid 54bf35c4-56a9-4881-b186-93d9900f2db9 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:48:59.221540 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23490b9a-05ec-4e73-b473-ace4db1c2411 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 200 len: 1455 microversion: 2.1 time: 0.102130 Oct 18 16:48:59.222127 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3464/6889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:59 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:00.247149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:00.247748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] [instance: 54bf35c4-56a9-4881-b186-93d9900f2db9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:00.253911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:00.254387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:00.254815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:00.255492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:00.256114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:00.256533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:00.272334 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] HTTP exception thrown: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Request method failure captured: Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 HTTP/1.1 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtjapyYSiZu-wM1cpRTyblbpf7tYwH15dWj9k_fxCu-7rPFa_voZ6tsCKa3_4kjW2TNvRQlSrB7s1RY9ISgo2CqbMlN_nfQ_EZppiUmUsPKbtVrPUz_NcYWhUxAbhpz5N7sY1Oh_MixyuqYv-5WDfNP90CfkmuJhbRZW5ffmEXzxzoI Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 9a110f605c9b42349631e73154b82e85 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestServerMultinode-928464560 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9a110f605c9b42349631e73154b82e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9a110f605c9b42349631e73154b82e85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9a110f605c9b42349631e73154b82e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9a110f605c9b42349631e73154b82e85"}]}] Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestServerMultinode-928464560 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 9a110f605c9b42349631e73154b82e85 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestServerMultinode-928464560 Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestServerMultinode-928464560-project-admin Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 0ed827713408402cb9fb1c1e0a82760a Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestServerMultinode-928464560-project-admin Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '54bf35c4-56a9-4881-b186-93d9900f2db9'} Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:00.274739 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] Returning 404 to user: Instance 54bf35c4-56a9-4881-b186-93d9900f2db9 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-154e040f-2ee5-4ff5-b7c9-45d63bc95a44 tempest-TestServerMultinode-928464560 tempest-TestServerMultinode-928464560-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9" status: 404 len: 111 microversion: 2.1 time: 0.034384 Oct 18 16:49:00.279797 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3426/6890] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:00 2022] GET /compute/v2.1/servers/54bf35c4-56a9-4881-b186-93d9900f2db9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:49:10.875996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:10.877387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:10.880783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:10.881569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:10.889888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:10.890402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:10.890918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:10.891662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:10.892133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:10.892574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.057534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:11.065801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5cb5997-555c-4e23-b51d-16c255bef8a3 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1682 microversion: 2.1 time: 0.193827 Oct 18 16:49:11.071503 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3465/6891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:10 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:11.189499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:11.192079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:11.196255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=5 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:11.197387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=9 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:11.203946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.204521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.205118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.205814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.206265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.206711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.280797 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af872c46-138f-4e8a-b3dc-5a7f60cf9794 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action" status: 200 len: 32624 microversion: 2.1 time: 0.095068 Oct 18 16:49:11.281520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3427/6892] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:49:11 2022] POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action => generated 32624 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:49:11.410380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:11.411190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:11.422683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.423173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.423608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.424308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.424756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.425221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.558485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26667fc0-424a-4859-8398-8ef865c18788 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1835 microversion: 2.1 time: 0.153780 Oct 18 16:49:11.559062 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3466/6893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:11 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1835 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:11.588753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:11.591289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:11.598306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.598785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.599220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.599901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.600852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.601353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.628279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lazy-loading 'flavor' on Instance uuid fd0cd615-696d-49ad-85da-70729b0ba7cf {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:49:11.640677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Going to try to live migrate instance to another host {{(pid=120570) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 16:49:13.245396 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a42d231-6c43-4003-9781-796942d49fd0 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action" status: 202 len: 0 microversion: 2.1 time: 1.660530 Oct 18 16:49:13.246303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3428/6894] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:49:11 2022] POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action => generated 0 bytes in 1663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:49:13.255250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:13.255869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:13.266924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:13.267570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:13.267985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:13.268914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:13.269487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:13.269943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:13.429351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:13.438051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c3dcf5e-a4e2-4b3c-b023-7e3cebe43a73 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.186644 Oct 18 16:49:13.438654 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3467/6895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:13 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:14.463166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:14.463813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:14.471155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:14.471648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:14.472314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:14.473246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:14.473714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:14.474143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:14.504438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "name": "network-vif-unplugged", "status": "completed", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:14.519423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:14.520174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:14.520704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:14.534604 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] Creating event network-vif-unplugged:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h1-858383-14 Oct 18 16:49:14.543523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-bd8e0124-bf32-4d67-8804-a1901e63d71c req-e805b398-d7fe-456e-a433-f7a3c0c30176 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044353 Oct 18 16:49:14.545407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3468/6896] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:14.773866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:14.783542 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d65f2df-f79d-4a7b-a696-deede2db55ea tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.324780 Oct 18 16:49:14.784516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3429/6897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:14 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:15.810646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:15.811421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:15.817744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:15.818250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:15.818722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:15.819487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:15.820417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:15.820870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:15.967625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:15.976068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27184711-f599-4ad7-964e-31c9f14348a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.170642 Oct 18 16:49:15.976771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3469/6898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:15 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:16.560270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:16.571458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:16.571958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:16.572371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:16.582830 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] Creating event network-changed:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h1-858383-14 Oct 18 16:49:16.588009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-58528210-a9e6-41e8-9857-cd09da5735fb req-308761c8-fbe3-44ad-b96f-ddb1cb5e8aa4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Oct 18 16:49:16.588611 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3430/6899] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:16.999964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:17.000746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:17.007735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:17.008360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:17.009152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:17.010141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:17.010553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:17.010987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:17.223732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:17.233152 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7ddddce5-1187-46b1-b4aa-d955ed5437ee tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.237198 Oct 18 16:49:17.233746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3470/6900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:16 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:18.260579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:18.261290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:18.267709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:18.268553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:18.269020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:18.269756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:18.270222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:18.270897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:18.424500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:18.433854 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87fbf83c-c733-4fbf-899e-fbdaa35ac540 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.178319 Oct 18 16:49:18.434437 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3431/6901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:18 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:19.457681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:19.458341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:19.465265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:19.465758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:19.466207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:19.467121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:19.467399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:19.467834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:19.613915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:19.623104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e075438-b44b-4d9c-a854-dda8148a17a7 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.169563 Oct 18 16:49:19.623615 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3471/6902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:19 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:20.646203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:20.646949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:20.654391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:20.654957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:20.655490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:20.656259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:20.656792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:20.657318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:20.801107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:20.808927 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6bedfa4b-a885-460b-b4b1-3b48ece58acb tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.166659 Oct 18 16:49:20.809536 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3432/6903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:20 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:21.833930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:21.834614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:21.842015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:21.842625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:21.843136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:21.843902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:21.844366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:21.844799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:21.984013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:21.993459 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-274097c7-2e23-4af7-9421-d0175036922a tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.163542 Oct 18 16:49:21.994098 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3472/6904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:21 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:23.017641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:23.018349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:23.026174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:23.026772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:23.027289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:23.028080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:23.028623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:23.029153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:23.171193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:23.180473 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7023f722-ec63-48f4-b752-d1bf1c5f5754 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.166996 Oct 18 16:49:23.181079 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3433/6905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:23 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:24.209316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:24.210704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:24.218947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:24.219459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:24.220109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:24.220623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:24.221419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:24.222127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:24.414458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:24.423161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87c99512-5c76-4b15-ae95-a4a5d829b91f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1692 microversion: 2.1 time: 0.218375 Oct 18 16:49:24.424200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3473/6906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:24 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1692 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:25.448221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:25.448960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:25.455970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.456454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.456890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.457611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.458068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.458490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.615273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:25.624626 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-109f41dd-15ed-467f-a8d8-9664388ff0f4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1682 microversion: 2.1 time: 0.180643 Oct 18 16:49:25.625562 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3434/6907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:25 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:25.648110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:25.649388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:25.657942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.658472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.658915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.659633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.660097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.660582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.801196 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dd895701-6da0-40bf-9885-11e1850883c1 tempest-TestNetworkAdvancedServerOps-545092113 tempest-TestNetworkAdvancedServerOps-545092113-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1835 microversion: 2.1 time: 0.156999 Oct 18 16:49:25.801718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3474/6908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:25 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1835 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:25.825323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:25.826041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:25.832132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.832675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.833204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.833946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:25.834468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:25.834960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:25.978522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:25.987203 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7ee829b-6619-44ee-85a3-231a89fd6c17 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1682 microversion: 2.1 time: 0.165807 Oct 18 16:49:25.988223 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3435/6909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:25 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:26.086893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:26.089254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:26.096754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:26.097375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:26.097880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:26.098650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:26.099109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:26.099533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:26.163360 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0072793b-7566-4d08-bf09-f2468dba4620 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action" status: 200 len: 38448 microversion: 2.1 time: 0.080117 Oct 18 16:49:26.164209 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3475/6910] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:49:26 2022] POST /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf/action => generated 38448 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:49:27.256405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:27.257137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:27.261623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:27.265345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:27.272751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:27.273580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:27.273716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:27.274174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:27.274570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:27.274899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:27.275363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:27.275789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:27.293622 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] Creating event network-changed:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h2-858383-14 Oct 18 16:49:27.298326 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b36ace24-b2a1-4c67-9201-bddc7571df5f req-6a7d08c6-c4e5-4a38-8395-a0690384445d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Oct 18 16:49:27.298921 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3476/6911] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:27.319124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:49:27.437802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6a145d95-ad5c-448e-8416-21e46d5837ac tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 204 len: 0 microversion: 2.1 time: 0.185002 Oct 18 16:49:27.438006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3436/6912] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:49:27 2022] DELETE /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:49:27.447790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:27.448593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:27.456590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:27.457368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:27.458180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:27.459142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:27.460349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:27.461391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:27.628388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:27.638480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c340a76-eb8a-4808-b7ec-c698d72bab0e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1688 microversion: 2.1 time: 0.195780 Oct 18 16:49:27.639741 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3477/6913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:27 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:28.664870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:28.665848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:28.673301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:28.673789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:28.674226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:28.674918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:28.675370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:28.675792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:28.703203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0cd615-696d-49ad-85da-70729b0ba7cf", "name": "network-vif-deleted", "tag": "7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:28.714621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:28.715416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:28.716103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:28.729979 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] Creating event network-vif-deleted:7c61c25d-c8c5-454c-8fd6-cc6fc2fdadb9 for instance fd0cd615-696d-49ad-85da-70729b0ba7cf on n-h2-858383-14 Oct 18 16:49:28.735190 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d5878d50-3b35-4214-98f9-dd74282b5ffb req-1562908c-d39f-4fef-8266-20671b3bb428 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037832 Oct 18 16:49:28.735788 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3478/6914] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:28.756445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:28.764477 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c36b906b-73f2-4754-8581-20a302098b82 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 200 len: 1502 microversion: 2.1 time: 0.104386 Oct 18 16:49:28.765443 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3437/6915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:28 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 1502 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:29.792309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:29.792936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: fd0cd615-696d-49ad-85da-70729b0ba7cf] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:29.799238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:29.799734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:29.800766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:29.801496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:29.801961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:29.802395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:29.815856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] HTTP exception thrown: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Request method failure captured: Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf HTTP/1.1 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtceLIscCOAKhgHifrTrD-khzakT4oXOBQmfBQBAV175ynZt6XNPgWp0jzGNpPIQrr2sCyC78GvUrnacrkN22X5mWjAe0X0-0LXjLKiCnR9k-Xu5yZbhPwppk7xxOfHOQt8Ryc1NrzOO9qnfmtLWd6Hp9TjZnuhqW1fur2in7TSaND4 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}] Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: c0d13a891f6445a2b12c8b30182df7e2 Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'fd0cd615-696d-49ad-85da-70729b0ba7cf'} Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:49:29.817636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Returning 404 to user: Instance fd0cd615-696d-49ad-85da-70729b0ba7cf could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c9594af-bb55-4679-b3f4-d53896cb06ab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf" status: 404 len: 111 microversion: 2.1 time: 0.032636 Oct 18 16:49:29.823491 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3479/6916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:29 2022] GET /compute/v2.1/servers/fd0cd615-696d-49ad-85da-70729b0ba7cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:49:34.011265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50801d62-91f2-4ac9-a139-9708a1e62a55 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '.version_select at 0x7f5fd0f58820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:34.037724 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50801d62-91f2-4ac9-a139-9708a1e62a55 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480135149" status: 202 len: 0 microversion: 2.1 time: 0.031569 Oct 18 16:49:34.038609 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3438/6917] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 16:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480135149 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:49:34.071026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c0a277f-03c9-4530-8685-b46a50513aba tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: .version_select at 0x7f5fd143f790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-936170303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcSaENCpuOQzgtFNj2PLyHp05hVIKnCNwgJOO8qRr5NSZBOIMkXcgRjPuEO9se+zluVEm0XYz8XMjAc6VkUEuPUnmXEKsu6gu1L0hCf0tOzPuh5iWMXDJfEUrJzVgz07w=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:34.087640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c0a277f-03c9-4530-8685-b46a50513aba tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:49:34.093974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4c0a277f-03c9-4530-8685-b46a50513aba tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:49:34.120645 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c0a277f-03c9-4530-8685-b46a50513aba tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054069 Oct 18 16:49:34.121306 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3480/6918] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:49:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:40.859349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1276250898", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8e6e0049-945f-4255-8293-b770d3ffa169"}], "key_name": "tempest-TestNetworkAdvancedServerOps-936170303", "security_groups": [{"name": "tempest-secgroup-smoke-249665212"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:40.871307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:41.058527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] validate_networks() for [('8e6e0049-945f-4255-8293-b770d3ffa169', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:49:41.338481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:41.604871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:49:41.605535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:49:41.606372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:49:41.606984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:49:41.607792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:49:41.618586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:41.619323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:41.619961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:41.620875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:41.621611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:41.622207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:41.647349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:49:41.653822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Getting quotas for user c0d13a891f6445a2b12c8b30182df7e2 and project 79a339cc5db643808022cf6e080fc9d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:49:41.669259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:49:41.686212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:49:41.768849 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9bbf3602-f450-4dce-be90-6d424c24a87f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914014 Oct 18 16:49:41.770455 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3439/6919] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:49:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:49:41.780024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=72 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:41.784694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-748aa8bc-8f24-4c20-a657-25770c67832c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:41.785369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-748aa8bc-8f24-4c20-a657-25770c67832c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:41.787236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:41.886910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-748aa8bc-8f24-4c20-a657-25770c67832c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:41.908355 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-748aa8bc-8f24-4c20-a657-25770c67832c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1266 microversion: 2.1 time: 0.130147 Oct 18 16:49:41.909534 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3481/6920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:41 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:42.933858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:42.936720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:42.957786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:42.959151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:42.959817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:42.960775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:42.962060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:42.962502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:43.057287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:43.067284 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e471d352-7afe-42f9-a99e-ebde1818f8d9 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1318 microversion: 2.1 time: 0.138458 Oct 18 16:49:43.067909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3440/6921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:42 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:44.090885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:44.091498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:44.099406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:44.100156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:44.100808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:44.101799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:44.102542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:44.103157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:44.350627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:44.360163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0180bf88-d1b7-4fbb-ad24-5a25f3559328 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.273020 Oct 18 16:49:44.361031 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3482/6922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:44 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:45.168468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:45.182135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.182836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.183568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.210111 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] Creating event network-changed:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:49:45.215945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c20f0f1e-f15e-4a8d-8d93-444e605ec0f8 req-f0fd555a-d000-4753-a7d2-790a65db1fb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053316 Oct 18 16:49:45.216638 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3441/6923] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:45.384944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:45.385602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:45.398906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.399581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.409317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.410968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.411785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.412275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.655246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:45.664628 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2785662c-4802-4d4c-aa3d-df13f5d63859 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.284311 Oct 18 16:49:45.665592 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3483/6924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:45 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:46.697096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:46.697932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:46.705424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:46.705919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:46.706362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:46.707363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:46.707859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:46.708296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:46.862810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:46.874349 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63df41eb-311a-4c31-ab2f-f8bf77fefc23 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.188676 Oct 18 16:49:46.874937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3442/6925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:46 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:47.900898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:47.902536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:47.911374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:47.912101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:47.912636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:47.913455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:47.914726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:47.915302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:48.176974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:48.185391 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f2313a1-d382-4288-808a-77321c9ed89c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.290358 Oct 18 16:49:48.187056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3484/6926] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:47 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:49.209053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:49.209663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:49.217148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:49.217677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:49.218109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:49.218799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:49.219249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:49.219672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:49.363340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:49.372084 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d9d2f371-a6ee-40a7-ba87-a7d32365235d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.166935 Oct 18 16:49:49.373090 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3443/6927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:49 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:50.395818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:50.397299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:50.407588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:50.408088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:50.408531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:50.409361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:50.409821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:50.410613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:50.612744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:50.625290 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6fedba0f-f91f-44f3-89ea-7f838bd3ef6f tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.231943 Oct 18 16:49:50.626099 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3485/6928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:50 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:51.651338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:51.652069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:51.655063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:51.660377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:51.660937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:51.661466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:51.662226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:51.662750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:51.663479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:51.664365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:51.814519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:51.823672 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61346982-69b2-48e6-9298-408a8b9ae494 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.176954 Oct 18 16:49:51.824374 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3444/6929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:51 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:52.595136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "name": "network-vif-plugged", "status": "completed", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:52.603669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:52.609571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:52.610615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:52.612809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:52.628014 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] Creating event network-vif-plugged:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:49:52.637055 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-875af01b-ed82-4cb3-9bc4-d8d3261e6d82 req-adc95ea6-0e16-454c-ab22-e543d210e720 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044919 Oct 18 16:49:52.639486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3486/6930] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:52.850683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:52.853106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:52.863707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:52.864397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:52.864845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:52.865925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:52.866524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:52.867951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:53.037355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:53.046394 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-219726ce-baf9-4cc7-affc-4729a23bf98e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.199852 Oct 18 16:49:53.047006 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3445/6931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:52 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:54.076796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:54.077592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:54.085047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:54.085584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:54.086148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:54.086879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:54.087579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:54.087996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:54.237309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:54.247899 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e16b478-69a5-47ea-a73e-345b8b80f90b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1391 microversion: 2.1 time: 0.176256 Oct 18 16:49:54.249768 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3487/6932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:54 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:49:55.275539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:55.276097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:55.283175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:55.283755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:55.284456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:55.285409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:55.285865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:55.286361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:55.451507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:55.459769 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f8f544a-3992-4c7d-8376-8053e1d01574 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1563 microversion: 2.1 time: 0.188213 Oct 18 16:49:55.460549 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3446/6933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:55 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:55.482750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:55.483456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:55.490839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:55.491319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:55.492279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:55.493551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:55.494077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:55.494572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:55.635565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:55.644386 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07587792-1d26-4e33-825d-5844a6fcb130 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1563 microversion: 2.1 time: 0.165546 Oct 18 16:49:55.644884 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3488/6934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:55 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:49:57.331185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:57.332806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:57.333433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:57.344867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:57.345836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:57.346325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:57.346760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:57.348076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:57.348860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:57.350157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:57.352153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:57.352921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:57.361783 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] Creating event network-changed:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:49:57.368195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-82833333-c376-4d96-9cea-9ddb3fb64d93 req-9e9df13e-e9dd-4a4a-9d98-acbb56893ec7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038276 Oct 18 16:49:57.371982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3489/6935] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:49:57.515036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:57.525070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f0c5214e-16dc-42af-a569-331a1c67504b tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1563 microversion: 2.1 time: 0.198422 Oct 18 16:49:57.526607 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3447/6936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:57 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:28.856840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=19 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:28.857691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:28.862301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:28.864620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:28.872341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:28.872832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:28.873314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:28.874028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:28.874488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:28.874919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:28.947588 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-deef2747-372c-4c49-9a30-de60ce5d00ff tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action" status: 200 len: 24569 microversion: 2.1 time: 0.092581 Oct 18 16:50:28.954512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3490/6937] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:50:28 2022] POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:50:59.154238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:59.154989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=46 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:59.159217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "716a8cb0-5725-40db-af07-5a18594590ce"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:59.162108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:59.170062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.170591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.171043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.171807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.172275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.172710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.262480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:50:59.263129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:50:59.263749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:50:59.264305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:50:59.264863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:50:59.343958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:59.350063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.350690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.350993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.352381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.352898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.353334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.381610 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8fdc9217-20a8-4658-8a70-02c61f8fc6d6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action" status: 202 len: 1137 microversion: 2.1 time: 0.229173 Oct 18 16:50:59.382273 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3448/6938] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:50:59 2022] POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action => generated 1137 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:50:59.404628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:59.406087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:59.410034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:59.410763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:59.418749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.419605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.425263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.425263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:59.425263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:59.425263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:59.464846 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:50:59.465068 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:50:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 (ip 10.222.0.78) !!! Oct 18 16:50:59.607122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:59.627099 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa86ac11-ce57-4015-afe0-286c0a490760 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.228276 Oct 18 16:50:59.627789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3491/6939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:59 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:00.652409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:00.653061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:00.660090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:00.660624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:00.661030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:00.661729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:00.662186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:00.662614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:00.812846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:00.821159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6615b78b-18c5-4580-af0e-f1257a05cec4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.173214 Oct 18 16:51:00.821734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3449/6940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:00 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:01.845040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:01.845669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:01.852953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:01.853480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:01.853927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:01.854631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:01.855095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:01.855529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:01.998368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:02.006592 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72045544-9827-48d7-8917-56225269cb68 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.165489 Oct 18 16:51:02.007187 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3492/6941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:01 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:03.032552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:03.033939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:03.042800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:03.043382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:03.044011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:03.044901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:03.045596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:03.046181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:03.198441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:03.206505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3101896-006e-4a47-8595-78165e04ecf6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.178578 Oct 18 16:51:03.207147 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3450/6942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:03 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:51:04.231232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:04.231751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:04.238774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:04.239260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:04.239696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:04.240388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:04.240865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:04.241300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:04.386103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:04.394190 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4221ad98-dee3-49f9-91df-e73b852f1693 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.167650 Oct 18 16:51:04.394776 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3493/6943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:04 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:05.418367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:05.418975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:05.425914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:05.426397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:05.426833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:05.427537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:05.427991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:05.428440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:05.577430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:05.585633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22d75d1f-fd38-44b3-a51c-57f3605cdc52 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.171255 Oct 18 16:51:05.586493 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3451/6944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:05 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:06.608794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:06.609432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:06.616815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:06.617520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:06.618051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:06.618747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:06.619460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:06.619886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:06.757350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:06.765915 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef5c28db-4e37-442c-a6d5-fa8a2538df35 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.161025 Oct 18 16:51:06.766491 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3494/6945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:06 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:07.790587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:07.791225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:07.798437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:07.798923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:07.799357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:07.800102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:07.800554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:07.800974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:07.953494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:07.959922 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0ad5a279-5d00-424e-a93c-55b2fc7b8c90 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.173905 Oct 18 16:51:07.960579 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3452/6946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:07 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:08.986466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:08.987281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:08.995210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:08.995838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:08.996388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:08.997215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:08.997779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:08.998214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:09.143679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:09.152917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e9d82643-6aaf-47a5-9d0d-30104c759c62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.171067 Oct 18 16:51:09.153529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3495/6947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:08 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:10.176285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:10.176916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:10.185117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:10.185960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:10.186948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:10.187616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:10.188021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:10.188455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:10.340935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:10.349154 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fac582d3-854d-4f4c-84d9-53c905e06af6 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1690 microversion: 2.1 time: 0.176784 Oct 18 16:51:10.350438 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3453/6948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:10 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:11.380690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:11.381377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:11.389118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:11.389732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:11.390215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:11.391156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:11.391861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:11.392310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:11.833772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:11.842769 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bd146db0-e1c8-4f63-812f-08c70a8bd3a4 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1696 microversion: 2.1 time: 0.472486 Oct 18 16:51:11.843583 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3496/6949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:11 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1696 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:51:12.870304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:12.871809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:12.879219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:12.879765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:12.880120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:12.880811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:12.881309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:12.881722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:13.122655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:13.131511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f880012-0061-4536-a925-aceac292adab tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1696 microversion: 2.1 time: 0.268286 Oct 18 16:51:13.132075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3454/6950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:12 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1696 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:14.155631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:14.156418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:14.163610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:14.164126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:14.164841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:14.165437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:14.165903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:14.166369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:14.342770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:14.358020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90933def-225c-442c-a86e-9f46c427ab6c tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1696 microversion: 2.1 time: 0.206256 Oct 18 16:51:14.358612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3497/6951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:14 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:14.900825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "name": "network-vif-unplugged", "status": "completed", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:14.914505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:14.915487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:14.916248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:14.930075 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] Creating event network-vif-unplugged:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:51:14.935864 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d7219fea-aa20-41a4-93d1-975e7911cfb0 req-6e52c019-c048-4705-90e8-e02c0503d227 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042205 Oct 18 16:51:14.937196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3455/6952] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:15.381552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:15.382164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:15.389523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:15.390011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:15.390449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:15.391148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:15.391603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:15.392030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:15.539791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:15.547986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e33daa3-9c98-4dd8-bf5e-f8aecf09e60d tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1681 microversion: 2.1 time: 0.170340 Oct 18 16:51:15.548898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3498/6953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:15 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:18.944357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "name": "network-vif-plugged", "status": "completed", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:18.960034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:18.961193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:18.961913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:18.987737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] Creating event network-vif-plugged:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:51:18.995054 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-24679763-8115-4bea-a2a2-f1a97730e620 req-1df036a3-52c6-4f5a-a8d7-5ba3121b17bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056375 Oct 18 16:51:18.995669 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3456/6954] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:22.535761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9f0bb68-f359-4ec1-9f1e-2cb2a7a8db4f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Action: 'create', calling method: .version_select at 0x7f5fd1739ca0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-213165858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9YsBO96M3v9rQq7tMa6XeAJLgf1Fx4fDSa/O7LJWqkrmnPg13eqN1ig7RkqPMYfRzruFrd5BQDWZIlA1MNZ4QSsmbLSUmN5qR1LiyODy+MBPSOoQkXYGa6JpHREOyIkg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:22.551518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f9f0bb68-f359-4ec1-9f1e-2cb2a7a8db4f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for project a41380f5938b427c977e7b68dcb484bb. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:51:22.556827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-f9f0bb68-f359-4ec1-9f1e-2cb2a7a8db4f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for user da01928a55724b48807fa0b5f88db27f and project a41380f5938b427c977e7b68dcb484bb. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:51:22.587343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9f0bb68-f359-4ec1-9f1e-2cb2a7a8db4f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.228640 Oct 18 16:51:22.587961 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3499/6955] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:51:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:28.312736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2108008664-access_point-604030338", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "65089305-a283-4de0-897c-045ea3d9be22"}], "key_name": "tempest-TestSecurityGroupsBasicOps-213165858", "security_groups": [{"name": "tempest-secgroup_access--1003618055"}, {"name": "tempest-secgroup_general--1936341496"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:28.512820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] validate_networks() for [('65089305-a283-4de0-897c-045ea3d9be22', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:51:28.920626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:51:28.921074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:51:28.921556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:51:28.922109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:51:28.922693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:51:28.933068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:28.933816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:28.934294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:28.935013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:28.935612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:28.936191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:28.956977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for project a41380f5938b427c977e7b68dcb484bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:51:28.962577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for user da01928a55724b48807fa0b5f88db27f and project a41380f5938b427c977e7b68dcb484bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:51:28.976359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:51:28.979521 n-d-858383-14 devstack@n-api.service[120570]: WARNING nova.utils [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2108008664-access_point-604030338 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2108008664-ac Oct 18 16:51:28.980445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:51:29.031531 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52028228-c58e-444c-94f8-ea1193b0634f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.723788 Oct 18 16:51:29.038496 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3457/6956] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:51:28 2022] POST /compute/v2.1/servers => generated 458 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:51:29.045728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5b5f13e3-73ad-479b-b2d3-9e17dc7b9603 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:29.046704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5b5f13e3-73ad-479b-b2d3-9e17dc7b9603 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:29.051285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=48 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:29.125448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5b5f13e3-73ad-479b-b2d3-9e17dc7b9603 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:29.135851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5b5f13e3-73ad-479b-b2d3-9e17dc7b9603 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1293 microversion: 2.1 time: 0.094483 Oct 18 16:51:29.144751 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3500/6957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:29 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:30.159229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:30.159855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:30.162782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:30.173393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:30.174319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:30.176635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:30.177427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:30.177892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:30.178372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:30.182159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:30.250865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:30.259719 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f2c156b-1552-4502-8359-6a4cc3b7942f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1345 microversion: 2.1 time: 0.104503 Oct 18 16:51:30.260712 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3458/6958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:30 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:51:31.290537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:31.291879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:31.294766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:31.300636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:31.301238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:31.301689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:31.304162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:31.304652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:31.305122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:31.474653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:31.483475 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f99768f0-0560-4674-a045-78814d669fe4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.199828 Oct 18 16:51:31.484217 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3501/6959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:31 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:32.131685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8e1525-6202-48fe-a3eb-8d235044fe50", "tag": "16099de9-74d8-46b2-bba7-b797fd707721"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:32.142991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:32.143474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:32.143903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:32.156160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] Creating event network-changed:16099de9-74d8-46b2-bba7-b797fd707721 for instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 on n-h2-858383-14 Oct 18 16:51:32.161805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f314883e-96d5-4e10-b6b9-f15d6893cb36 req-c0dd5574-2283-4bf1-8487-bc48e3ab2734 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110373 Oct 18 16:51:32.162423 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3459/6960] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:32.510323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:32.510917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:32.518745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:32.519396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:32.520063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:32.521034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:32.521637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:32.522145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:32.775130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:32.783272 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e05b69ac-aa41-4fb0-9adc-c8b8db1c64a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.279323 Oct 18 16:51:32.783874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3502/6961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:32 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:33.808672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:33.809315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:33.815651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:33.816139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:33.816576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:33.817297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:33.817762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:33.818189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:33.970020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:33.979231 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab121ec9-0fce-4994-b483-7ca9d197ade1 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.176529 Oct 18 16:51:33.979973 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3460/6962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:33 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:35.004960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:35.005856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:35.014192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:35.014689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:35.015141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:35.015889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:35.016347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:35.016933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:35.183539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:35.191649 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcea0422-c225-4ce9-8862-267968dc244c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.190594 Oct 18 16:51:35.192170 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3503/6963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:34 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:36.216525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:36.217103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:36.223924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:36.224405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:36.224847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:36.225557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:36.226010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:36.226432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:36.372113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:36.380116 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0784e132-329b-4187-9f6b-85a0273c2bdf tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.167842 Oct 18 16:51:36.380690 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3461/6964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:36 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:37.404574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:37.405252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:37.412731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.413278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.413742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.414484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.415530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.416023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.583685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:37.592441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cce31281-95a7-4252-b462-78f4abae73db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.191865 Oct 18 16:51:37.593094 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3504/6965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:37 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:51:37.684718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8e1525-6202-48fe-a3eb-8d235044fe50", "name": "network-vif-plugged", "status": "completed", "tag": "16099de9-74d8-46b2-bba7-b797fd707721"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:37.695638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.696308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.696920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.711016 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] Creating event network-vif-plugged:16099de9-74d8-46b2-bba7-b797fd707721 for instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 on n-h2-858383-14 Oct 18 16:51:37.717165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fbadb267-92d2-443c-87e1-75a82a3705a4 req-dc3b7734-f2aa-40dd-9738-9bcc7b0c83a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111391 Oct 18 16:51:37.718176 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3462/6966] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:38.616838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:38.617559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:38.625937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:38.626338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:38.626780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:38.627540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:38.627998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:38.628438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:38.780929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:38.788725 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7fab0aa-fc0f-4d02-9fc7-0ccd47a8a467 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1471 microversion: 2.1 time: 0.175816 Oct 18 16:51:38.789346 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3505/6967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:38 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:39.809857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:39.810653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:39.815464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:39.816156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:39.823758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:39.824243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:39.824672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:39.825411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:39.825863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:39.826281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:39.970011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:39.977822 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8136e8a3-a0c6-4147-a7f7-4218e9a044db tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1644 microversion: 2.1 time: 0.169771 Oct 18 16:51:39.978384 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3463/6968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:39 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1644 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:40.006030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:40.007454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:40.010880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:40.017243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.017739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.018187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.018894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.019357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.019792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.167250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:40.175105 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-976c791f-5355-43e6-948e-a672281a4635 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1644 microversion: 2.1 time: 0.178511 Oct 18 16:51:40.175685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3506/6969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:39 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1644 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:40.197542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:40.198155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:40.204104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.204577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.205016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.205707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.206155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.206574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.453774 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5da1c5fa-0bb0-4f1a-83d2-2e77ff97bcef tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1797 microversion: 2.1 time: 0.260421 Oct 18 16:51:40.454357 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3464/6970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:40 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1797 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:42.119938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8e1525-6202-48fe-a3eb-8d235044fe50", "tag": "16099de9-74d8-46b2-bba7-b797fd707721"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:42.133484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:42.134324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:42.134918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:42.146994 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] Creating event network-changed:16099de9-74d8-46b2-bba7-b797fd707721 for instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 on n-h2-858383-14 Oct 18 16:51:42.153329 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f346fed3-4f2f-410e-8a3a-78f8d804f3bf req-0a27504f-70ff-413b-8015-e88f54f13e87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037850 Oct 18 16:51:42.154700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3507/6971] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:49.954328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:49.956609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:49.962817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:49.963300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:49.964367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:49.965106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:49.965572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:49.965997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:50.032644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a7fea6e-6fb2-43cf-8954-11e4295cce9e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action" status: 200 len: 24566 microversion: 2.1 time: 0.231358 Oct 18 16:51:50.033333 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3465/6972] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:51:49 2022] POST /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6/action => generated 24566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:52:21.111357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=13 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:21.112240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=15 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:21.113264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=38 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:21.113584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=37 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:21.118169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:21.118361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:21.118757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:21.128236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:21.129024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:21.129674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:21.130399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:21.130879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:21.131303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:21.131418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:21.131942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:21.132616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:21.149380 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] Creating event network-changed:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:52:21.155578 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a1745345-7506-4c9e-b54c-87f3357349a9 req-882206b5-3593-45ca-b68f-3965de825e81 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044158 Oct 18 16:52:21.156589 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3466/6973] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:21.159996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:52:21.246947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c892124-d917-4024-bff0-6348b2410643 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 204 len: 0 microversion: 2.1 time: 0.137376 Oct 18 16:52:21.247821 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3508/6974] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:52:21 2022] DELETE /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:52:21.257725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:21.258489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:21.266135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:21.266810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:21.267326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:21.268106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:21.268660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:21.269209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:21.430421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:21.438919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f09e6aaa-38b4-459d-987c-4e3d665bf85e tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1687 microversion: 2.1 time: 0.186332 Oct 18 16:52:21.439501 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3467/6975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:21 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:22.465489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:22.466219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:22.474312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:22.474824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:22.475270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:22.476281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:22.476750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:22.477232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:22.842535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:22.850630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbbb2831-4975-4e4c-a24a-06bd9b5cad64 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1687 microversion: 2.1 time: 0.389922 Oct 18 16:52:22.851223 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3509/6976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:22 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1687 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:23.580180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed867a32-bab5-4bdd-9e5a-de5030bef7f6", "name": "network-vif-deleted", "tag": "68ada74e-fdd3-4abc-99b8-c2f744ce9050"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:23.590738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:23.591225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:23.592197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:23.603917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] Creating event network-vif-deleted:68ada74e-fdd3-4abc-99b8-c2f744ce9050 for instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 on n-h1-858383-14 Oct 18 16:52:23.610313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a03097b4-3640-4c0c-85a9-6d95db4bca5a req-bd0e8a71-4849-49d4-a82e-929a5edc6b37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033923 Oct 18 16:52:23.610971 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3468/6977] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:23.874799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:23.875455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:23.882545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:23.883042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:23.883480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:23.884187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:23.884677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:23.885201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:23.920104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:23.920754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:23.921242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:23.921710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lazy-loading 'fault' on Instance uuid ed867a32-bab5-4bdd-9e5a-de5030bef7f6 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:52:23.966041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d13a891f6445a2b12c8b30182df7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a339cc5db643808022cf6e080fc9d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:23.977345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bac8567a-12a3-4491-8e7b-f5e8e01827bd tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 200 len: 1356 microversion: 2.1 time: 0.106772 Oct 18 16:52:23.978065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3510/6978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:23 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:25.003046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:25.003699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] [instance: ed867a32-bab5-4bdd-9e5a-de5030bef7f6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:25.009933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:25.010422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:25.010863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:25.011572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:25.012045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:25.012453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:25.026625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] HTTP exception thrown: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Request method failure captured: Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 HTTP/1.1 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtceLIscCOAKhgHifrTrD-khzakT4oXOBQmfBQBAV175ynZt6XNPgWp0jzGNpPIQrr2sCyC78GvUrnacrkN22X5mWjAe0X0-0LXjLKiCnR9k-Xu5yZbhPwppk7xxOfHOQt8Ryc1NrzOO9qnfmtLWd6Hp9TjZnuhqW1fur2in7TSaND4 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_79a339cc5db643808022cf6e080fc9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/79a339cc5db643808022cf6e080fc9d5"}]}] Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 79a339cc5db643808022cf6e080fc9d5 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-885072695 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: c0d13a891f6445a2b12c8b30182df7e2 Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestNetworkAdvancedServerOps-885072695-project Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'ed867a32-bab5-4bdd-9e5a-de5030bef7f6'} Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:25.028279 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Returning 404 to user: Instance ed867a32-bab5-4bdd-9e5a-de5030bef7f6 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3640486-0c4f-46c9-a9e9-2f6077d92bf8 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6" status: 404 len: 111 microversion: 2.1 time: 0.032547 Oct 18 16:52:25.032748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3469/6979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:24 2022] GET /compute/v2.1/servers/ed867a32-bab5-4bdd-9e5a-de5030bef7f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:52:28.630870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1dae6fe6-43f9-43d5-a099-1bd890afca62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] Calling method '.version_select at 0x7f5fd0ddb9d0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:28.652132 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1dae6fe6-43f9-43d5-a099-1bd890afca62 tempest-TestNetworkAdvancedServerOps-885072695 tempest-TestNetworkAdvancedServerOps-885072695-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-936170303" status: 202 len: 0 microversion: 2.1 time: 0.025402 Oct 18 16:52:28.653118 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3511/6980] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 18 16:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-936170303 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:32.657231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1113609532", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "23279def-17fa-424c-af69-0c8b0adf08cf"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:32.714664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] validate_networks() for [('23279def-17fa-424c-af69-0c8b0adf08cf', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:52:33.074643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:52:33.075066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:52:33.075538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:52:33.076043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:52:33.076664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:52:33.085568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:33.086050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:33.086489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:33.087210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:33.087670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:33.088095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:33.105225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Getting quotas for project 1ea2eb8b2ec747cfa27880a6d9543559. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:52:33.111177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Getting quotas for user 27f082de59aa4dbdb994ecb7fc812f08 and project 1ea2eb8b2ec747cfa27880a6d9543559. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:52:33.124516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:52:33.126837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:52:33.174209 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9214f49e-a166-4681-bb0c-e283f9fa8742 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635149 Oct 18 16:52:33.175016 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3470/6981] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:52:33.187664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f146b166-9976-42cb-a4f5-279d8074f351 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:33.188304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f146b166-9976-42cb-a4f5-279d8074f351 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:33.248755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f146b166-9976-42cb-a4f5-279d8074f351 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:33.256020 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f146b166-9976-42cb-a4f5-279d8074f351 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1215 microversion: 2.1 time: 0.073647 Oct 18 16:52:33.256790 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3512/6982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:33 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:34.280255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:34.280815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:34.286930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:34.287410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:34.287840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:34.288526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:34.288975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:34.289418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:34.355898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:34.367076 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-92c9d390-6676-4954-acf6-b6f061de7c6f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1275 microversion: 2.1 time: 0.091944 Oct 18 16:52:34.367671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3471/6983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:34 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:35.391494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:35.392120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:35.394340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:35.400903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:35.401505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:35.401947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:35.402652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:35.403109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:35.403535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:35.639688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:35.647844 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f9fd8c0-842b-4de8-9282-772e67018a1e tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.260781 Oct 18 16:52:35.648521 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3513/6984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:35 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:35.847831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08154a88-650e-450b-8c0c-c7fa4568042b", "tag": "5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:35.859671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:35.860156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:35.860589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:35.872159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] Creating event network-changed:5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2 for instance 08154a88-650e-450b-8c0c-c7fa4568042b on n-h1-858383-14 Oct 18 16:52:35.877482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7b484199-3e05-4115-969a-04b1e407133d req-5391ccf6-4940-437f-8b70-cef30f65d065 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033325 Oct 18 16:52:35.878330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3472/6985] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:36.672390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:36.673029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:36.679939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:36.680421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:36.680855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:36.681577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:36.682029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:36.682456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:36.817240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:36.825143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07188fd1-90fa-4c97-bbce-d277522cef74 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.157087 Oct 18 16:52:36.825820 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3514/6986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:36 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:37.852356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:37.853072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:37.859332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:37.859815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:37.860249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:37.860946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:37.861430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:37.861854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:38.053958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:38.062918 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8dce7638-341e-4b8b-af2b-9dd90ee7b9ab tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.215543 Oct 18 16:52:38.063838 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3473/6987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:37 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:39.086202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:39.086758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:39.093653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:39.094133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:39.094569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:39.095303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:39.095761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:39.096188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:39.229058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:39.237422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-76dd0aa9-8f3c-4693-9c05-e0dba79cf925 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.155194 Oct 18 16:52:39.237999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3515/6988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:39 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:40.260147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:40.260682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:40.268470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:40.268952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:40.269424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:40.270112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:40.270569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:40.270994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:40.682952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:40.692264 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d1ef9aeb-d41e-4e1f-82f2-5eda51a8a6cf tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.435900 Oct 18 16:52:40.692926 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3474/6989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:40 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:41.717660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:41.718734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:41.726106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:41.726681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:41.727113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:41.728067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:41.728530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:41.728960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:41.874840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:41.882700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-362b99a3-7851-4a5b-ad66-4591965ba983 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.169600 Oct 18 16:52:41.883278 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3516/6990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:41 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:42.907071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:42.907794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:42.915626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:42.916311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:42.916952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:42.918021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:42.918626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:42.919106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:43.059173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:43.066973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52f12ff5-a6c2-4048-ba02-030d36e54ae2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.165583 Oct 18 16:52:43.067527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3475/6991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:42 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:43.348589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08154a88-650e-450b-8c0c-c7fa4568042b", "name": "network-vif-plugged", "status": "completed", "tag": "5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:43.354733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:43.361413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:43.361905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:43.362348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:43.374392 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] Creating event network-vif-plugged:5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2 for instance 08154a88-650e-450b-8c0c-c7fa4568042b on n-h1-858383-14 Oct 18 16:52:43.380574 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4ecd9d7f-03aa-4a0a-9ae3-58225f41f145 req-8324e97b-df28-47cf-8787-7194325f0ce8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036792 Oct 18 16:52:43.381346 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3517/6992] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:44.090509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:44.091110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:44.093093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:44.093814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:44.100650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:44.101174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:44.101621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:44.102324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:44.102789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:44.103226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:44.238871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:44.246854 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4533cdcd-5753-4261-a7d2-2fe3799f691f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1315 microversion: 2.1 time: 0.160215 Oct 18 16:52:44.247406 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3476/6993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:44 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:45.272338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:45.273105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:45.279377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.279858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.280297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.280986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.281506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.282208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.423988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:45.430975 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-093a1f51-04df-4944-b12b-636f6c0b75cc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1502 microversion: 2.1 time: 0.163794 Oct 18 16:52:45.431549 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3518/6994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:45 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:45.452959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:45.454536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:45.460903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.461486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.461923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.462606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.463061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.463482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.598008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:45.605692 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f864af9-c1a5-4fad-ace2-c3b729651e4d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1502 microversion: 2.1 time: 0.156527 Oct 18 16:52:45.606257 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3477/6995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:45 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:45.629211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:45.629757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:45.635714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.636197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.636632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.637352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.637807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.638231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.660752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lazy-loading 'flavor' on Instance uuid 08154a88-650e-450b-8c0c-c7fa4568042b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:52:45.731619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d39fac22-74d7-4b0a-8055-865871b9e463 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action" status: 202 len: 0 microversion: 2.1 time: 0.106982 Oct 18 16:52:45.735833 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3519/6996] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:52:45 2022] POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:45.741169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:45.741792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:45.748105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.748639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.749164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.749895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:45.751031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:45.751514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:45.890182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:45.897935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff505dcc-7e8d-48b4-af36-a21a9951ae07 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1510 microversion: 2.1 time: 0.160764 Oct 18 16:52:45.898506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3478/6997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:45 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:46.923167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:46.924002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:46.930415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:46.930913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:46.931358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:46.932071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:46.932531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:46.932965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:47.075383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:47.084257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d23226c-cf93-43a3-8e14-79afd11cc2dc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1493 microversion: 2.1 time: 0.166858 Oct 18 16:52:47.084861 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3520/6998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:46 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:47.107772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:47.108387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:47.118527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:47.119027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:47.119471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:47.120173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:47.120891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:47.121354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:47.191631 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03d1c5e8-b6ba-4c6c-bbf3-a55d41794df2 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action" status: 202 len: 0 microversion: 2.1 time: 0.087661 Oct 18 16:52:47.193578 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3479/6999] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:52:47 2022] POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:47.201320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:47.202035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:47.208920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:47.209512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:47.210003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:47.210787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:47.211290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:47.211808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:47.392840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:47.400803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bbdb3d09-459e-48ef-ba92-9bd650048c0d tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1499 microversion: 2.1 time: 0.204063 Oct 18 16:52:47.401424 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3521/7000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:47 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:48.429288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:48.430016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:48.436267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:48.436760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:48.437261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:48.437965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:48.439143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:48.439594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:48.581313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:48.589234 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96999a29-959d-4bb6-9a04-0f7cf8bbeaaa tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1499 microversion: 2.1 time: 0.166295 Oct 18 16:52:48.589805 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3480/7001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:48 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:49.614580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:49.615201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:49.621496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:49.621989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:49.622427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:49.623133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:49.623591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:49.624120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:49.856199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:49.865683 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c371bb82-c2d5-468a-97b3-7f5d7ccf417f tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1502 microversion: 2.1 time: 0.256181 Oct 18 16:52:49.867311 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3522/7002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:49 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:49.896585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:49.897327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:49.904218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:49.904714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:49.905193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:49.905912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:49.906370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:49.906798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:49.937715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lazy-loading 'flavor' on Instance uuid 08154a88-650e-450b-8c0c-c7fa4568042b {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:52:50.023678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd4444f1-9631-4353-8e93-901b71e1418b tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action" status: 202 len: 0 microversion: 2.1 time: 0.130413 Oct 18 16:52:50.024272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3481/7003] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:52:49 2022] POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:50.035612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:50.036959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:50.043728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:50.044361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:50.044909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:50.045872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:50.047084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:50.047084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:50.199753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:50.208535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f8c678e3-3f8b-431e-8e84-2196f7065587 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1510 microversion: 2.1 time: 0.177717 Oct 18 16:52:50.209151 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3523/7004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:50 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:51.233426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:51.234243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:51.236286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:51.242319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.242822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.243265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.243980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.244443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.244868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.248432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:51.482498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:51.491583 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a66dcfe-934e-4896-bb12-5606764612ca tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1493 microversion: 2.1 time: 0.263331 Oct 18 16:52:51.492175 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3482/7005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:51 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1493 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:51.518416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:51.519003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:51.521010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:51.526622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.527154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.527609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.528424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.528897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.529368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.604325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ee5b04c4-b179-4768-9b8b-066ca7937f36 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action" status: 202 len: 0 microversion: 2.1 time: 0.091997 Oct 18 16:52:51.605163 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3524/7006] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:52:51 2022] POST /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:51.614352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:51.615154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:51.621838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.622400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.622940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.623739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:51.624292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:51.624789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:51.890537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:51.899833 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acc1a8b7-1745-4fa1-a777-96382647d567 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1499 microversion: 2.1 time: 0.290205 Oct 18 16:52:51.900660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3483/7007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:51 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1499 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:52.927787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:52.928680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:52.941938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:52.943247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:52.945421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:52.946217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:52.946700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:52.947288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:53.181302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:53.193040 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3577e7a1-81d5-492c-aefd-223b468578e0 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1499 microversion: 2.1 time: 0.271095 Oct 18 16:52:53.193900 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3525/7008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:52 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:54.237101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:54.239084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:54.248404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.249196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.249831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.250800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.251516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.252109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.415812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:54.425640 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee5e4c56-c5de-4538-b4be-a90a27caa7a1 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1502 microversion: 2.1 time: 0.207652 Oct 18 16:52:54.426267 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3484/7009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:54 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:54.452379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:54.452881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:54.461340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.461832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.462469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.463347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.464008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.465740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.500382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:52:54.530363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:54.593093 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-010cf555-0d30-4fd7-9917-cdbad5736968 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 204 len: 0 microversion: 2.1 time: 0.143813 Oct 18 16:52:54.593936 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3526/7010] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:52:54 2022] DELETE /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:52:54.604120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:54.604817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:54.612620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.613205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.613732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.614440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:54.614891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:54.615398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:54.759940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:54.770100 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1b87eca9-3ef3-4e77-a9d7-604653319edc tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1508 microversion: 2.1 time: 0.170340 Oct 18 16:52:54.770682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3485/7011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:54 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:55.443636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1357563411", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "65fe46d8-6d69-4eaf-bcb2-07de46f531b2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-213165858", "security_groups": []}, "os:scheduler_hints": {"different_host": ["3e8e1525-6202-48fe-a3eb-8d235044fe50"]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:55.506125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] validate_networks() for [('65fe46d8-6d69-4eaf-bcb2-07de46f531b2', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:52:55.791219 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:52:55.791766 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:52:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b (ip 10.222.0.78) !!! Oct 18 16:52:55.797434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:55.798803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:55.807682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:55.808422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:55.809115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:55.809994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:55.810806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:55.821543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:56.002220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:56.015681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-66df43b3-d6e8-4bad-a4b7-29b47c3e473c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1508 microversion: 2.1 time: 0.225567 Oct 18 16:52:56.017858 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3486/7012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:55 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:56.106807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:52:56.107359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:52:56.108284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:52:56.108879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:52:56.109539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:52:56.125713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:56.127529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:56.128380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:56.129775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:56.130674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:56.131673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:56.152439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for project a41380f5938b427c977e7b68dcb484bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:52:56.158484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Getting quotas for user da01928a55724b48807fa0b5f88db27f and project a41380f5938b427c977e7b68dcb484bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:52:56.179425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:52:56.182104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:52:56.242900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87c40a94-0303-4e3c-8019-376a367f4053 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.804075 Oct 18 16:52:56.243960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3527/7013] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:52:55 2022] POST /compute/v2.1/servers => generated 361 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:52:56.256305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe42466f-042d-4388-9751-a6202f2a836a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:56.256932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe42466f-042d-4388-9751-a6202f2a836a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:56.347541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe42466f-042d-4388-9751-a6202f2a836a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:56.357072 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe42466f-042d-4388-9751-a6202f2a836a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1241 microversion: 2.1 time: 0.104896 Oct 18 16:52:56.358587 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3487/7014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:56 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:52:57.040961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:57.041918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:57.049572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:57.050439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:57.051070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:57.051956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:57.052583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:57.053439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:57.309355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f082de59aa4dbdb994ecb7fc812f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea2eb8b2ec747cfa27880a6d9543559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:57.318532 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3b8cb5c-e723-4316-9b71-cd1f68ce750c tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 200 len: 1508 microversion: 2.1 time: 0.282042 Oct 18 16:52:57.319141 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3528/7015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:57 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:57.383469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:57.384980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:57.396362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:57.396895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:57.397475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:57.398739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:57.399376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:57.400286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:57.487207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:57.501635 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-46e2bdd2-084f-4d44-ab7a-d998f763b3cc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1293 microversion: 2.1 time: 0.122340 Oct 18 16:52:57.502612 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3488/7016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:57 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:57.567091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08154a88-650e-450b-8c0c-c7fa4568042b", "name": "network-vif-deleted", "tag": "5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:57.587117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:57.588326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:57.588934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:57.607236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] Creating event network-vif-deleted:5bf9be59-0b4f-4937-bc58-dbbdd37d7dd2 for instance 08154a88-650e-450b-8c0c-c7fa4568042b on n-h1-858383-14 Oct 18 16:52:57.612870 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9b093761-c9c4-4ff0-94b7-8471d49d07a6 req-0b9365a1-6370-4b71-ae92-d7aa288425c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171118 Oct 18 16:52:57.613609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3529/7017] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:52:58.344637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:58.346468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] [instance: 08154a88-650e-450b-8c0c-c7fa4568042b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:58.366904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:58.367394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:58.367842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:58.368789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:58.369294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:58.370070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:58.387298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] HTTP exception thrown: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Request method failure captured: Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b HTTP/1.1 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnPUGs9Jpg_q0VPHGZg13yvwimq3qnuWRVFKOFOT3feH8KmryRt8agAYqR4301XCbR9xCwSqNZ85xSanna6Z25J8O1z9UIeTtAaQZf4SasOdqfamvtQ9K0-EWBOcS-vA6iGto_CjG-ZiAVeR8a5I_plaU0SgRlGR52Evv412bI0lsQ Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1ea2eb8b2ec747cfa27880a6d9543559 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestServerAdvancedOps-443178818 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ea2eb8b2ec747cfa27880a6d9543559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ea2eb8b2ec747cfa27880a6d9543559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ea2eb8b2ec747cfa27880a6d9543559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ea2eb8b2ec747cfa27880a6d9543559"}]}] Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestServerAdvancedOps-443178818 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1ea2eb8b2ec747cfa27880a6d9543559 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestServerAdvancedOps-443178818 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestServerAdvancedOps-443178818-project Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 27f082de59aa4dbdb994ecb7fc812f08 Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestServerAdvancedOps-443178818-project Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '08154a88-650e-450b-8c0c-c7fa4568042b'} Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:58.389049 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] Returning 404 to user: Instance 08154a88-650e-450b-8c0c-c7fa4568042b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c93918b7-1a79-4796-867a-5de0dc904da5 tempest-TestServerAdvancedOps-443178818 tempest-TestServerAdvancedOps-443178818-project] 10.222.0.78 "GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b" status: 404 len: 111 microversion: 2.1 time: 0.051836 Oct 18 16:52:58.393290 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3489/7018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:58 2022] GET /compute/v2.1/servers/08154a88-650e-450b-8c0c-c7fa4568042b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:52:58.530092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:58.530818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:58.538748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:58.539538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:58.540164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:58.541189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:58.542061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:58.542644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:58.680345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:58.691028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9516d34-fb8f-4af6-bc62-b4031ef591dd tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.166489 Oct 18 16:52:58.703105 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3530/7019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:58 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:59.653446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a4c171-b724-41b3-b8aa-213bcd782c53", "tag": "98ca3f51-7af6-412a-9651-21cf949556c8"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:59.664630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:59.665213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:59.665718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:59.678447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] Creating event network-changed:98ca3f51-7af6-412a-9651-21cf949556c8 for instance f3a4c171-b724-41b3-b8aa-213bcd782c53 on n-h1-858383-14 Oct 18 16:52:59.684054 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b1225603-09fa-43f7-9092-7350467ec7eb req-d066fb5f-dba6-4fc7-9842-f85b93dee829 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034726 Oct 18 16:52:59.685062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3490/7020] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:59.716380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:59.717098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:59.724587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:59.725173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:59.725678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:59.726503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:59.727033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:59.727528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:59.851696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:59.859498 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e576fb8-7756-40e1-8953-e2389ca7b7a6 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.147217 Oct 18 16:52:59.877423 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3531/7021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:59 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:00.889389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:00.890271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:00.899736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:00.900306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:00.900817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:00.901625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:00.902148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:00.902957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:00.999135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:01.007441 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-63d34570-440d-4368-b223-06eb6fe20bae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.123283 Oct 18 16:53:01.008001 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3491/7022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:00 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:02.031525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:02.033743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:02.042027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:02.042895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:02.043565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:02.044355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:02.044888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:02.045509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:02.145583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:02.154522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-75052c50-15e2-496b-b209-6d73bd763641 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.127232 Oct 18 16:53:02.155122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3532/7023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:02 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:03.179668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:03.180198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:03.193037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:03.193788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:03.194343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:03.195190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:03.195837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:03.196455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:03.300110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:03.308918 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd9aeb72-94a4-41cc-9f95-50bd72171b52 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.133692 Oct 18 16:53:03.309808 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3492/7024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:03 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:04.334820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:04.336020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:04.351672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:04.352776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:04.353442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:04.355775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:04.356440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:04.356924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:04.523635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:04.533033 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b15fd014-1c2f-4ae0-b7bc-87fb57dbaa00 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.202300 Oct 18 16:53:04.534022 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3533/7025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:04 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:05.557330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:05.557926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:05.568518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:05.569298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:05.569852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:05.571166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:05.571480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:05.572045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:05.671815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:05.682132 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d84dc348-d97e-4c86-bf0a-de564659cfee tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.128775 Oct 18 16:53:05.682780 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3493/7026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:05 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:05.716429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a4c171-b724-41b3-b8aa-213bcd782c53", "name": "network-vif-plugged", "status": "completed", "tag": "98ca3f51-7af6-412a-9651-21cf949556c8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:05.727921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:05.728410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:05.728855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:05.742120 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] Creating event network-vif-plugged:98ca3f51-7af6-412a-9651-21cf949556c8 for instance f3a4c171-b724-41b3-b8aa-213bcd782c53 on n-h1-858383-14 Oct 18 16:53:05.748108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c4eeb302-7d33-407b-a1a5-2e79f6b92288 req-6c8bd8c4-df0d-4888-b450-2b2a578c9232 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035436 Oct 18 16:53:05.748924 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3534/7027] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:06.708492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:06.709764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:06.716480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:06.721633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:06.722227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:06.722766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:06.724001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:06.724614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:06.725127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:06.826223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:06.835127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-163800e1-2f2e-4dbb-bb77-01dee9789e03 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1299 microversion: 2.1 time: 0.131950 Oct 18 16:53:06.835661 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3494/7028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:06 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:07.858601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:07.860550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:07.863407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:07.864800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:07.873582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:07.874083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:07.874587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:07.875648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:07.876186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:07.876672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:07.998316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:08.006583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3f376b6a-a5ec-43cf-9238-9d8ee26396ae tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1471 microversion: 2.1 time: 0.152165 Oct 18 16:53:08.007438 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3535/7029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:07 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:08.036260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:08.037054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:08.046257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.046888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.047429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.048848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.049402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.049994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.151102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:08.161641 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5127fa4d-4bce-4da8-a622-26320ca31858 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1471 microversion: 2.1 time: 0.129992 Oct 18 16:53:08.162565 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3495/7030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:08 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1471 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:08.190277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:08.191269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:08.200201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.201068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.201707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.202429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.203301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.204603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.325637 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc2c9379-7019-4b79-8e30-17b8fc1b546a tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1624 microversion: 2.1 time: 0.140473 Oct 18 16:53:08.327029 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3536/7031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:08 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1624 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:08.355513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:08.363668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:08.378759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.379530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.380169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.381104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.381738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.382348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.565325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2472bda7-8faf-447a-b6a3-678422a17398 tempest-TestSecurityGroupsBasicOps-525907445 tempest-TestSecurityGroupsBasicOps-525907445-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1915 microversion: 2.1 time: 0.214818 Oct 18 16:53:08.566533 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3496/7032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:08 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1915 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:08.663231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:08.664074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:08.671168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.671967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.673543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.674436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.675042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.675472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.711371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:53:08.875959 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-709e2d97-6a9c-4add-9499-098d1a300f34 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 204 len: 0 microversion: 2.1 time: 0.216249 Oct 18 16:53:08.877595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3537/7033] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:53:08 2022] DELETE /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:53:08.885916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:08.886533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:08.894346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.894983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.895692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:08.896504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:08.897166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:08.897717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:09.032970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:09.044327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bfe6f961-bd7c-43e9-949b-408d1d2c6c4c tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1477 microversion: 2.1 time: 0.162263 Oct 18 16:53:09.050740 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3497/7034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:08 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:10.074290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:10.076717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:10.090747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:10.096889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:10.097929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:10.098872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:10.102823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:10.104612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:10.301321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:10.316715 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-654429da-7e15-4165-b1a7-5809c55650bc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1477 microversion: 2.1 time: 0.246637 Oct 18 16:53:10.319954 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3538/7035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:10 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:11.355161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:11.356578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:11.381302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:11.383580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:11.386498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:11.387871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:11.389790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:11.393821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:11.611508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:11.624733 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2585ba8-1319-4a76-bc7b-6b3781b0e5fc tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 200 len: 1477 microversion: 2.1 time: 0.273886 Oct 18 16:53:11.631065 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3498/7036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:11 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:11.795660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a4c171-b724-41b3-b8aa-213bcd782c53", "name": "network-vif-deleted", "tag": "98ca3f51-7af6-412a-9651-21cf949556c8"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:11.846960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:11.847491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:11.847941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:11.905551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] Creating event network-vif-deleted:98ca3f51-7af6-412a-9651-21cf949556c8 for instance f3a4c171-b724-41b3-b8aa-213bcd782c53 on n-h1-858383-14 Oct 18 16:53:11.936716 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-547553bd-75ed-4ddd-af60-094b0053381b req-1d68d90a-a4e9-4543-843c-c94afe8ae3c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138712 Oct 18 16:53:11.944274 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3539/7037] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:12.661432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:12.662282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: f3a4c171-b724-41b3-b8aa-213bcd782c53] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:12.673956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:12.674202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:12.674955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:12.675592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:12.676084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:12.676519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:12.704717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] HTTP exception thrown: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Request method failure captured: Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 HTTP/1.1 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtmJGfhg9oNs_TFsP3zPQ6BqecozoIFHbf4kYy1TFUHkBGoONANYQ4njpNWw1Jge8E9SUQA8FHZybhtPe8sQa9xF-FvuiccrUP2g0RSBMTcrcI1BgkrANuiSfFQtlxeD_6Do2ehOxHEGDPXHQW-0IY7RPcOdqahZaVa4Tc0RvWc0DHo Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a41380f5938b427c977e7b68dcb484bb Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a41380f5938b427c977e7b68dcb484bb"}]}] Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a41380f5938b427c977e7b68dcb484bb Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestSecurityGroupsBasicOps-2108008664-project Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: da01928a55724b48807fa0b5f88db27f Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2108008664-project Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f3a4c171-b724-41b3-b8aa-213bcd782c53'} Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:53:12.706720 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Returning 404 to user: Instance f3a4c171-b724-41b3-b8aa-213bcd782c53 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:53:12.710847 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cb53a737-e235-4ab6-aae9-89b733902df4 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53" status: 404 len: 111 microversion: 2.1 time: 0.055445 Oct 18 16:53:12.713424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3499/7038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:12 2022] GET /compute/v2.1/servers/f3a4c171-b724-41b3-b8aa-213bcd782c53 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:53:15.058003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1576614899", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7e49403e-787f-4ccd-857b-a221b451fef5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:15.172629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:53:15.846939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:53:15.847640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:53:15.848755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:53:15.849755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:53:15.850356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:53:15.862980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:15.863477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:15.863948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:15.864866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:15.865379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:15.865814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:15.892483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:53:15.902669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:53:15.999025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:53:16.002786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e49403e-787f-4ccd-857b-a221b451fef5',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:53:16.192706 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b476942d-2f17-41f6-934b-04552fe54142 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139023 Oct 18 16:53:16.195083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3540/7039] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:53:16.208251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-25983f3f-0465-4f50-8ad4-2f88ae302337 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:16.209601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-25983f3f-0465-4f50-8ad4-2f88ae302337 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:16.296087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-25983f3f-0465-4f50-8ad4-2f88ae302337 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:16.304679 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-25983f3f-0465-4f50-8ad4-2f88ae302337 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1057 microversion: 2.1 time: 0.102428 Oct 18 16:53:16.321507 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3500/7040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:16 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1057 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:17.331766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:17.332404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:17.342643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.343146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.343731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.345575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.346453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.346957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.429174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:17.438981 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9e1206e-794b-4c7b-8157-cc4c24c0a502 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1155 microversion: 2.1 time: 0.112927 Oct 18 16:53:17.449446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3541/7041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:17 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1155 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:17.793125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8e1525-6202-48fe-a3eb-8d235044fe50", "tag": "16099de9-74d8-46b2-bba7-b797fd707721"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:17.795650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:17.796145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:17.821872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.824184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.824891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.825566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.826530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.827258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.827848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.829215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.832654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.856055 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] Creating event network-changed:16099de9-74d8-46b2-bba7-b797fd707721 for instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 on n-h2-858383-14 Oct 18 16:53:17.866754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ac95c1b9-9ad2-4b9a-a6c6-09180265c8c9 req-a4b0c741-9ef5-4f14-a440-0026c6ca2de8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077140 Oct 18 16:53:17.870058 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3542/7042] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:53:17.883123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:53:17.925687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:18.014907 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-53a450d2-d00b-40f2-bbae-cd31fae7f6a3 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 204 len: 0 microversion: 2.1 time: 0.229703 Oct 18 16:53:18.016249 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3501/7043] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:53:17 2022] DELETE /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:53:18.025642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:18.026519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:18.036567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.037492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.038117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:18.039156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.039775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.040359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:18.270077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:18.278336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d025960-2d89-4469-bf8a-8eff7759cd10 tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1768 microversion: 2.1 time: 0.257189 Oct 18 16:53:18.295303 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3543/7044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:18 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1768 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:18.464201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:18.465335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:18.476570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.478797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.481349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:18.482326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.483132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.483798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:18.654147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:18.665055 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ede0565-f575-4d62-b9d4-1339694a81ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1215 microversion: 2.1 time: 0.205036 Oct 18 16:53:18.665962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3502/7045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:18 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:19.307607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:19.308321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:19.320162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:19.322172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:19.323943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:19.327468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:19.329304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:19.329862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:19.688644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:19.690254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:19.699001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:19.700050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:19.700778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:19.701786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:19.702491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:19.703944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:19.981886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01928a55724b48807fa0b5f88db27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41380f5938b427c977e7b68dcb484bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:19.986691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:19.987946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:19.993695 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-425a6f32-77b1-4997-af57-dd8c43ea134f tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 200 len: 1768 microversion: 2.1 time: 0.690962 Oct 18 16:53:19.994601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3544/7046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:19 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 1768 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:20.014841 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51f15f93-8a7a-4dcc-a0fc-842af0d1d57a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1215 microversion: 2.1 time: 0.330693 Oct 18 16:53:20.032689 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3503/7047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:19 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1215 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:20.065986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d087224-9514-461e-b241-9eff7f4ed563", "tag": "5cdb33aa-ce55-4f1b-a3ee-acae64b646e6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:20.084986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:20.085496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:20.085966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:20.111146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] Creating event network-changed:5cdb33aa-ce55-4f1b-a3ee-acae64b646e6 for instance 7d087224-9514-461e-b241-9eff7f4ed563 on n-h1-858383-14 Oct 18 16:53:20.130619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f859d854-f20f-4bce-9aaf-852b1499632f req-0a3a4ccc-12a0-4140-800c-9e2deac0b788 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069099 Oct 18 16:53:20.131270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3545/7048] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:20.445029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8e1525-6202-48fe-a3eb-8d235044fe50", "name": "network-vif-deleted", "tag": "16099de9-74d8-46b2-bba7-b797fd707721"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:20.459570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:20.460558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:20.461256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:20.474995 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] Creating event network-vif-deleted:16099de9-74d8-46b2-bba7-b797fd707721 for instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 on n-h2-858383-14 Oct 18 16:53:20.482082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ff738c58-8498-48e8-b7c1-07d79434486a req-a9ac6eb8-4073-417c-9380-c9d6f0534eb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040323 Oct 18 16:53:20.484145 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3504/7049] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:21.029516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:21.041514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:21.042876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:21.043868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] [instance: 3e8e1525-6202-48fe-a3eb-8d235044fe50] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:21.066484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.070227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.072051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.073469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.074952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.075310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.076019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.076717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.077742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.078474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.079502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.080674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.115650 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] HTTP exception thrown: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Request method failure captured: Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 HTTP/1.1 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtmJGfhg9oNs_TFsP3zPQ6BqecozoIFHbf4kYy1TFUHkBGoONANYQ4njpNWw1Jge8E9SUQA8FHZybhtPe8sQa9xF-FvuiccrUP2g0RSBMTcrcI1BgkrANuiSfFQtlxeD_6Do2ehOxHEGDPXHQW-0IY7RPcOdqahZaVa4Tc0RvWc0DHo Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a41380f5938b427c977e7b68dcb484bb Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a41380f5938b427c977e7b68dcb484bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a41380f5938b427c977e7b68dcb484bb"}]}] Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a41380f5938b427c977e7b68dcb484bb Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2108008664 Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestSecurityGroupsBasicOps-2108008664-project Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: da01928a55724b48807fa0b5f88db27f Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2108008664-project Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3e8e1525-6202-48fe-a3eb-8d235044fe50'} Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:21.118219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. Oct 18 16:53:21.122068 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:21.124458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Returning 404 to user: Instance 3e8e1525-6202-48fe-a3eb-8d235044fe50 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:53:21.125882 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52c2fa3c-b081-4933-a9ac-637c3cf8000a tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50" status: 404 len: 111 microversion: 2.1 time: 0.107378 Oct 18 16:53:21.131130 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3546/7050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:21 2022] GET /compute/v2.1/servers/3e8e1525-6202-48fe-a3eb-8d235044fe50 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:53:21.319709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:21.327739 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c55ee2c8-9a43-46e0-93a2-abb026f29314 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1215 microversion: 2.1 time: 0.293020 Oct 18 16:53:21.328353 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3505/7051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:21 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:22.353783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:22.354184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:22.361138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:22.363110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.363660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.364146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.365069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.365558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.365992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.536387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:22.551553 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-656a1184-6b12-479d-a643-3e39658eab46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1215 microversion: 2.1 time: 0.202629 Oct 18 16:53:22.552144 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3547/7052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:22 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:23.577573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:23.578177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:23.582650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:23.593499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:23.595036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:23.595636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:23.596551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:23.601581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:23.602188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:24.132004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:24.140296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd90cb27-ba5f-4a4e-9f27-f74e037b71a7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.566580 Oct 18 16:53:24.141758 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3506/7053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:23 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:25.079055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6a43cb2-0e3a-47e6-9f57-b316af564e0e tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] Calling method '.version_select at 0x7f5fd2475a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:25.104209 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6a43cb2-0e3a-47e6-9f57-b316af564e0e tempest-TestSecurityGroupsBasicOps-2108008664 tempest-TestSecurityGroupsBasicOps-2108008664-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-213165858" status: 202 len: 0 microversion: 2.1 time: 0.029180 Oct 18 16:53:25.104859 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3548/7054] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:53:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-213165858 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:53:25.164008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:25.164623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:25.174673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:25.175136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:25.175581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:25.176285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:25.176738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:25.180952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:25.324195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:25.333326 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-726df74f-40a6-4a3f-906b-ec60ff4dcdcf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.173077 Oct 18 16:53:25.333914 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3507/7055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:25 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:26.362066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:26.363464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:26.365703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:26.366604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:26.375555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:26.376890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:26.378523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:26.379498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:26.380253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:26.380848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:26.529384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:26.537401 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05ea8848-3075-4116-8315-9bffbc5333ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.183836 Oct 18 16:53:26.538064 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3549/7056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:26 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:27.689115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:27.689765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:27.692550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:27.698093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:27.698579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:27.699023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:27.699730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:27.700191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:27.700621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:27.858272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:27.868157 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d6fb722-e4e1-4472-b57f-c78a4bf5d836 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.183619 Oct 18 16:53:27.869376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3508/7057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:27 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:28.895713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:28.896327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:28.903222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:28.903708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:28.904146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:28.904838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:28.905321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:28.905753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:29.039243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:29.047465 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-19d37dc4-60f0-418b-8763-9d45a717abf3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.155701 Oct 18 16:53:29.048119 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3550/7058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:28 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:30.070875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:30.071493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:30.079079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:30.079577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:30.080021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:30.080737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:30.081232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:30.081663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:30.217997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:30.226820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a46d8fef-99ba-49f7-9d96-6d3fb3f34a3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.159852 Oct 18 16:53:30.227417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3509/7059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:30 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:31.251423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:31.252094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:31.259106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:31.259590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:31.260028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:31.260725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:31.261205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:31.261636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:31.404189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:31.413910 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29b8aee5-eb2e-4196-8869-14efbde9eca1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.167024 Oct 18 16:53:31.414686 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3551/7060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:31 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:32.439045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:32.439697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:32.446535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:32.447025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:32.447467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:32.448158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:32.448627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:32.449077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:32.584845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:32.592586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-acfe2f7e-7919-4463-b2bb-f044fcca9c0a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.158331 Oct 18 16:53:32.593184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3510/7061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:32 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:33.616898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:33.617538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:33.624641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:33.625164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:33.626222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:33.626932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:33.627398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:33.627828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:33.765583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:33.774219 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e40fff3e-c78a-488e-9648-b9d474bc652f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.161124 Oct 18 16:53:33.774822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3552/7062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:33 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:34.799156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:34.799773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:34.807009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:34.807507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:34.807950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:34.808638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:34.809138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:34.809568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:34.941379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:34.949171 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1e72f055-3247-4671-ab0f-2eeef0942d54 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.155005 Oct 18 16:53:34.949673 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3511/7063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:34 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:35.584324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d087224-9514-461e-b241-9eff7f4ed563", "name": "network-vif-plugged", "status": "completed", "tag": "5cdb33aa-ce55-4f1b-a3ee-acae64b646e6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:35.597401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:35.597882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:35.598315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:35.610180 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] Creating event network-vif-plugged:5cdb33aa-ce55-4f1b-a3ee-acae64b646e6 for instance 7d087224-9514-461e-b241-9eff7f4ed563 on n-h1-858383-14 Oct 18 16:53:35.615958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-bd410361-7831-4399-8224-e9079b2f4a68 req-b45e947b-4733-4bc4-98c9-d8787a472859 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035568 Oct 18 16:53:35.616562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3553/7064] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:35.972098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:35.972717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:35.979733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:35.980218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:35.980664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:35.981444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:35.981910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:35.982342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:36.118950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:36.127039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56e4e948-1bec-442a-b263-313d0d6ffa2a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1203 microversion: 2.1 time: 0.159113 Oct 18 16:53:36.127598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3512/7065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:35 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:37.150220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:37.151130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:37.158807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.159310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.159755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.160461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.160955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.161460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.298413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:37.307295 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ed47427-e51a-478d-8371-c24b6dd871a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1389 microversion: 2.1 time: 0.161481 Oct 18 16:53:37.307894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3554/7066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:37 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:37.329919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:37.330560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:37.337376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.337858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.338304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.338986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.339447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.339873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.474990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:37.482785 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e5b1f2f-67fb-4bef-a846-8514cc94b05c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1389 microversion: 2.1 time: 0.156907 Oct 18 16:53:37.483361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3513/7067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:37 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:37.506015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:37.507080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:37.513007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.513529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.513964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.514648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.515102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.515533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.646407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:37.654528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-049dd459-a352-4cfa-8f05-f2e25eb015fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1389 microversion: 2.1 time: 0.153119 Oct 18 16:53:37.655120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3555/7068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:37 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:37.677976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:37.678484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:37.684770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.685301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.685750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.686462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.686934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.687369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.714789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:53:37.793071 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c27679a7-1089-4f2b-8161-c4febb3e470b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 204 len: 0 microversion: 2.1 time: 0.119597 Oct 18 16:53:37.793745 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3514/7069] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:53:37 2022] DELETE /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:53:37.803472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:37.804117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:37.810482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.810973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.811412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.812140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:37.812596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:37.813055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:37.951951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:37.960445 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-765c58d6-62e5-4e4b-8bb8-4ca43603bc27 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1395 microversion: 2.1 time: 0.160921 Oct 18 16:53:37.961039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3556/7070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:37 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:38.984554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:38.985294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:38.993404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:38.993887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:38.994664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:38.996442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:38.997293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:38.997754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:39.133862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:39.141689 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bceca8b3-d727-4195-b815-0229374785af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1395 microversion: 2.1 time: 0.161609 Oct 18 16:53:39.142361 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3515/7071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:38 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:40.002410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d087224-9514-461e-b241-9eff7f4ed563", "name": "network-vif-deleted", "tag": "5cdb33aa-ce55-4f1b-a3ee-acae64b646e6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:40.013747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:40.014256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:40.014703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:40.027521 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] Creating event network-vif-deleted:5cdb33aa-ce55-4f1b-a3ee-acae64b646e6 for instance 7d087224-9514-461e-b241-9eff7f4ed563 on n-h1-858383-14 Oct 18 16:53:40.034869 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-813e5c26-3457-44b6-bc6e-fa35baead331 req-0bf39d0c-bce7-4f52-947f-a0c7b1d76d97 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036556 Oct 18 16:53:40.035713 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3557/7072] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:40.164141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:40.164822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:40.171828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:40.172318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:40.172767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:40.174078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:40.174552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:40.174979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:40.240265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:40.242643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:40.249942 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-23ba04b5-e64e-4999-a990-74a22ae16084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1188 microversion: 2.1 time: 0.089700 Oct 18 16:53:40.250528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3516/7073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:40 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:41.275924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:41.276524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:41.283297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:41.283779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:41.284215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:41.284915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:41.285400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:41.285824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:41.354640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:41.364548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6feb416e-26d9-4b2c-963f-62d9c87036af tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1188 microversion: 2.1 time: 0.093858 Oct 18 16:53:41.365158 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3558/7074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:41 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:42.388462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:42.389095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:42.397336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:42.397826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:42.398257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:42.398961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:42.399411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:42.399859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:42.469171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:42.478178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85f59806-7c61-49cf-beed-3d546227f6a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1188 microversion: 2.1 time: 0.094139 Oct 18 16:53:42.478769 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3517/7075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:42 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:43.503260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:43.503934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:43.511336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:43.511831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:43.512274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:43.513012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:43.513485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:43.513924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:43.580073 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:43.592183 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16aad6f8-4c38-4122-8a84-d666cc090c12 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1188 microversion: 2.1 time: 0.093346 Oct 18 16:53:43.592771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3559/7076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:43 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:44.615889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:44.616643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:44.624861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:44.625387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:44.625835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:44.626828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:44.627300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:44.627732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:44.659812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:44.660350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:44.660862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:44.661380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 7d087224-9514-461e-b241-9eff7f4ed563 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:53:44.705841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:44.713625 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3a5e5cd8-775a-4147-b9d6-11f1d33b6fe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 200 len: 1193 microversion: 2.1 time: 0.101627 Oct 18 16:53:44.714202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3518/7077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:44 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 1193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:45.738188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:45.738798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 7d087224-9514-461e-b241-9eff7f4ed563] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:45.745700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:45.746440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:45.746877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:45.747566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:45.748018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:45.748445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:45.762308 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 HTTP/1.1 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '7d087224-9514-461e-b241-9eff7f4ed563'} Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:45.763927 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 7d087224-9514-461e-b241-9eff7f4ed563 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b01b6d5-41f6-4949-b29e-b31c918051d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563" status: 404 len: 111 microversion: 2.1 time: 0.031660 Oct 18 16:53:45.769108 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3560/7078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:45 2022] GET /compute/v2.1/servers/7d087224-9514-461e-b241-9eff7f4ed563 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:53:50.820265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-196334431", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "675030fd-2125-42a8-a58d-2d2e17f0bf28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:50.880578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:53:51.357627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:53:51.358125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:53:51.358679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:53:51.359144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:53:51.359621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:53:51.371075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:51.371818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:51.372257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:51.372999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:51.373473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:51.373902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:51.392538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:53:51.397917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:53:51.456606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:53:51.458699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='675030fd-2125-42a8-a58d-2d2e17f0bf28',volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:53:51.588312 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-958db532-3a05-43e0-a8dd-59f7c5963006 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772069 Oct 18 16:53:51.588977 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3519/7079] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:53:51.600663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53da8065-0ce3-4696-aaba-852a49a14f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:51.601381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53da8065-0ce3-4696-aaba-852a49a14f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:51.661490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53da8065-0ce3-4696-aaba-852a49a14f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:51.668580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53da8065-0ce3-4696-aaba-852a49a14f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1056 microversion: 2.1 time: 0.072205 Oct 18 16:53:51.669175 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3561/7080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:51 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1056 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:52.694136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:52.694829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:52.702648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:52.703205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:52.703651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:52.705275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:52.705787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:52.706245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:52.776643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:52.785011 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c9664b9-2b8a-40ea-99b9-146eb3e4e71e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1172 microversion: 2.1 time: 0.097093 Oct 18 16:53:52.785834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3520/7081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:52 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1172 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:53.808554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:53.809579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:53.812675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:53.820974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:53.821640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:53.822192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:53.823008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:53.823573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:53.824556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:53.843686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=71 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:54.043121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:54.051945 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e61dc04-9a0c-4f0f-890b-370b9fa91160 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1214 microversion: 2.1 time: 0.247621 Oct 18 16:53:54.052799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3562/7082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:53 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:54.130212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790daaad-819e-4d29-9f8b-30a5eb42e6f3", "tag": "9ff3f752-cfa1-4043-b705-9fc1f4225d8b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:54.142555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:54.144458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:54.144933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:54.145436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:54.158656 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] Creating event network-changed:9ff3f752-cfa1-4043-b705-9fc1f4225d8b for instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 on n-h1-858383-14 Oct 18 16:53:54.163895 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-75557214-0a4d-48ad-b474-dbe9867f9307 req-43ed09d5-5f77-47c0-87cb-deff22c7f4e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038663 Oct 18 16:53:54.164705 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3521/7083] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:55.075602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:55.076222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:55.084705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.085261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.085704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.086411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.086867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.087320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.241438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:55.249673 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21080bfa-3b00-48c2-8f33-716cd0907ea4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1214 microversion: 2.1 time: 0.178057 Oct 18 16:53:55.250247 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3563/7084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:55 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:56.275245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:56.275856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:56.283847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:56.284343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:56.284793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:56.285523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:56.285990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:56.286427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:56.429656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:56.437628 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13416124-2e79-4b75-9053-ed2665a5ea4a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1214 microversion: 2.1 time: 0.168068 Oct 18 16:53:56.439045 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3522/7085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:56 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:57.461512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:57.462177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:57.470266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.470800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.471254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.471992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.472456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.472897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.618847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:57.630851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2c83fc3-da19-4b2c-8dd5-56a9ddf6d669 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1214 microversion: 2.1 time: 0.173150 Oct 18 16:53:57.631426 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3564/7086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:57 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:58.652921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:58.653557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:58.661505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:58.661998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:58.662525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:58.663226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:58.663684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:58.664109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:58.813575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:58.823576 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00b9d000-9bdc-480f-8393-8f080a540509 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.174594 Oct 18 16:53:58.824279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3523/7087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:58 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:59.846730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:59.847566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:59.854436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:59.854921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:59.855358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:59.856049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:59.856499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:59.856946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:59.989325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:59.997306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2e9987bc-c2a2-42bc-a364-b948a415658f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.154568 Oct 18 16:53:59.997870 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3565/7088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:59 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:01.020343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:01.020959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:01.027804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:01.028347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:01.028726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:01.029435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:01.029893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:01.030320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:01.162765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:01.170868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49ab3ca0-3e91-4f35-b54f-4cf42c892b40 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.155056 Oct 18 16:54:01.171443 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3524/7089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:01 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:02.194601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:02.195341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:02.197958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:02.204889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:02.205427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:02.205875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:02.206580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:02.207041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:02.207475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:02.346090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:02.354002 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9456a009-3c16-4acd-9e92-9ed81c58399b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.163352 Oct 18 16:54:02.355011 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3566/7090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:02 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:03.377870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:03.378492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:03.380498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:03.381196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:03.388440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:03.388931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:03.389397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:03.390121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:03.390586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:03.391710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:03.525114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:03.533753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40036cae-7828-4fab-a375-3544580b241c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.160335 Oct 18 16:54:03.534316 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3525/7091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:03 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:04.556411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:04.557074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:04.564239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:04.564954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:04.565186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:04.565901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:04.566568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:04.566786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:04.705743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:04.713600 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f56e1c8d-d61c-4480-b881-06f3bc90fd0f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.161227 Oct 18 16:54:04.714169 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3567/7092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:04 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:05.737836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:05.738502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:05.745347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:05.745843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:05.746291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:05.747251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:05.747712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:05.748150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:05.886540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:05.895012 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc3623fa-2614-45fe-8fc7-2a9d5373eeba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.161957 Oct 18 16:54:05.895595 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3526/7093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:05 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:06.917809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:06.918429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:06.926066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:06.926553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:06.927614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:06.928329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:06.928792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:06.929275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:07.074711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:07.083611 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-43517a9d-072e-482b-abf7-9d1f91770867 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.169714 Oct 18 16:54:07.084195 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3568/7094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:06 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:07.785846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790daaad-819e-4d29-9f8b-30a5eb42e6f3", "name": "network-vif-plugged", "status": "completed", "tag": "9ff3f752-cfa1-4043-b705-9fc1f4225d8b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:07.796978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:07.797603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:07.798044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:07.811360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] Creating event network-vif-plugged:9ff3f752-cfa1-4043-b705-9fc1f4225d8b for instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 on n-h1-858383-14 Oct 18 16:54:07.816750 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-13a368cd-1f26-431c-ae0a-1476004c9f91 req-dfa49d2b-1ba6-4c8a-a1f9-c69f4b6d7a20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035371 Oct 18 16:54:07.817400 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3527/7095] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:08.106366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:08.106888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:08.114892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:08.115427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:08.115863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:08.116576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:08.117118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:08.117561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:08.251425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:08.260485 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-032c22b4-ca1c-469a-a88e-1eef913c1082 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.158052 Oct 18 16:54:08.261091 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3569/7096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:08 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:09.285239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:09.285948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:09.292968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:09.293577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:09.294023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:09.294727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:09.295187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:09.295626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:09.443306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:09.451367 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0acf4042-f894-42aa-8b60-75d22b522da3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1202 microversion: 2.1 time: 0.170977 Oct 18 16:54:09.451931 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3528/7097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:09 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:10.476024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:10.476681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:10.484032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.484645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.485106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.485804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.486575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.487011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.634590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:10.644148 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00da60a3-b8a4-455f-b5c3-e9d551d989b5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1389 microversion: 2.1 time: 0.173066 Oct 18 16:54:10.644801 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3570/7098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:10 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1389 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:10.667486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:10.668136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:10.675934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.676436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.676879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.677632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.678089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.678521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.816936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:10.825112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4831b052-93ad-4293-b642-c99608ee5c5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1389 microversion: 2.1 time: 0.161634 Oct 18 16:54:10.825699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3529/7099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:10 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:10.848438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:10.849172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:10.855452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.856026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.856532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.857336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:10.857861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:10.858495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:10.993236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:11.001288 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7518a8d8-c3c8-4209-b515-98d874160779 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1389 microversion: 2.1 time: 0.156724 Oct 18 16:54:11.002464 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3571/7100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:10 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:11.024244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:11.024677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:11.030852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.031347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.031792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.032501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.033111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.033591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.062098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:54:11.147840 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5f06ca0-70e5-4542-a957-d872bb2172ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 204 len: 0 microversion: 2.1 time: 0.126933 Oct 18 16:54:11.148590 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3530/7101] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:54:11 2022] DELETE /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:54:11.156744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:11.157598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:11.163839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.164351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.164791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.165515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.165965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.166386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.308670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:11.317554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-571695d7-03d8-4309-8bac-1b13e3cc286b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1395 microversion: 2.1 time: 0.164480 Oct 18 16:54:11.318277 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3572/7102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:11 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:12.341646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:12.342369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:12.349943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:12.350439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:12.350881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:12.351627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:12.352089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:12.352520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:12.503691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:12.506353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:12.514486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb19cf19-d7b3-475d-92a9-f5476e836566 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1395 microversion: 2.1 time: 0.177190 Oct 18 16:54:12.515452 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3531/7103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:12 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1395 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:13.352425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790daaad-819e-4d29-9f8b-30a5eb42e6f3", "name": "network-vif-deleted", "tag": "9ff3f752-cfa1-4043-b705-9fc1f4225d8b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:13.364799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:13.365311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:13.365752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:13.378823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] Creating event network-vif-deleted:9ff3f752-cfa1-4043-b705-9fc1f4225d8b for instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 on n-h1-858383-14 Oct 18 16:54:13.384363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-76333292-6630-4af4-bfbe-c3c6aa6b6774 req-d9324ae9-3464-4794-a765-0f92d2e35517 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Oct 18 16:54:13.385065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3573/7104] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:13.539359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:13.539982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:13.548323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:13.548985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:13.549644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:13.550400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:13.550877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:13.551314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:13.627869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:13.636073 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39f76d7e-0077-4ff8-b2d1-8576588d7039 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1187 microversion: 2.1 time: 0.100559 Oct 18 16:54:13.636666 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3532/7105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:13 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:14.661655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:14.662484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:14.669101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:14.669594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:14.670028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:14.670725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:14.671260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:14.671684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:14.742751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:14.751416 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a159d2d-fee8-46b2-b670-17c1477e6369 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1187 microversion: 2.1 time: 0.096073 Oct 18 16:54:14.752319 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3574/7106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:14 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:15.776405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:15.777221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:15.784659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:15.785215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:15.785657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:15.786392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:15.786878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:15.787301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:15.856228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:15.865361 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c4faccc-4461-4b71-9b53-af4488e77831 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1187 microversion: 2.1 time: 0.092936 Oct 18 16:54:15.865953 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3533/7107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:15 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:16.888580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:16.889232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:16.896799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:16.897318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:16.897764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:16.898941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:16.899642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:16.899843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:16.966787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:16.975538 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a5368b82-553a-4e45-b63b-fa8c85ccc8b9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1187 microversion: 2.1 time: 0.090957 Oct 18 16:54:16.976327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3575/7108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:16 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:17.998699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:17.999350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:18.007754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:18.008251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:18.008694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:18.009430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:18.009893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:18.010327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:18.046730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:18.047219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:18.047667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:18.048192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 790daaad-819e-4d29-9f8b-30a5eb42e6f3 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:54:18.092706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:18.100128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09363ef7-7163-4cf2-a3be-350ac312df4b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 200 len: 1146 microversion: 2.1 time: 0.105728 Oct 18 16:54:18.100704 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3534/7109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:17 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 1146 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:19.123788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:19.124405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 790daaad-819e-4d29-9f8b-30a5eb42e6f3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:19.130979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:19.131467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:19.131905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:19.132600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:19.133079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:19.133514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:19.147622 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 HTTP/1.1 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '790daaad-819e-4d29-9f8b-30a5eb42e6f3'} Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:54:19.149347 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 790daaad-819e-4d29-9f8b-30a5eb42e6f3 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8fdbf9e9-d520-41ec-a637-19334de6a4db tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3" status: 404 len: 111 microversion: 2.1 time: 0.031268 Oct 18 16:54:19.153783 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3576/7110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:19 2022] GET /compute/v2.1/servers/790daaad-819e-4d29-9f8b-30a5eb42e6f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:54:40.177985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008864898", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0f6b0ae0-e5fe-4310-ab15-a9174dcd8672", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:40.188598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:40.189905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=21 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:40.278574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:54:40.679601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:54:40.680158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:54:40.680651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:54:40.681096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:54:40.681514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:54:40.690517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:40.691004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:40.691450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:40.692183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:40.692650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:40.693120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:40.709715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:54:40.715048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:54:40.728386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:54:40.730510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0f6b0ae0-e5fe-4310-ab15-a9174dcd8672',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:54:40.804620 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b43c69f-e5d3-4c16-8e11-3895fe6db102 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631557 Oct 18 16:54:40.805322 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3535/7111] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:54:40.816484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8814b8c4-cbc5-45c4-b77d-e4d1bcf44e3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:40.817134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8814b8c4-cbc5-45c4-b77d-e4d1bcf44e3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:40.820968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:40.821868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=81 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:40.878634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8814b8c4-cbc5-45c4-b77d-e4d1bcf44e3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:40.885671 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8814b8c4-cbc5-45c4-b77d-e4d1bcf44e3b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1057 microversion: 2.1 time: 0.073148 Oct 18 16:54:40.886244 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3577/7112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:40 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:41.907666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:41.908361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:41.916653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:41.917807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:41.918455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:41.919345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:41.920431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:41.921050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:41.995872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:42.010166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8323e866-261f-486a-b53e-68dd9cd302cc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1117 microversion: 2.1 time: 0.106297 Oct 18 16:54:42.010948 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3536/7113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:41 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1117 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:43.035717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:43.037678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:43.046586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:43.047391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:43.048025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:43.049228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:43.049957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:43.050597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:43.311639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:43.320458 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0203db03-d5b4-471f-b492-9d4cf07297e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.290983 Oct 18 16:54:43.321191 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3578/7114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:43 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:43.765181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7777c0f-b7a5-4dff-b2ca-d7e253debdb6", "tag": "02248ccc-be35-47e4-8b9c-b225e904fa97"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:43.778333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:43.778817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:43.779252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:43.792439 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] Creating event network-changed:02248ccc-be35-47e4-8b9c-b225e904fa97 for instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 on n-h1-858383-14 Oct 18 16:54:43.797671 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-82ea97ab-ca87-4f59-b66f-78243ce3f680 req-eae633da-7272-4fd8-902e-b872189afcef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036970 Oct 18 16:54:43.799653 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3537/7115] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:44.346393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:44.348442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:44.359213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:44.360044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:44.361052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:44.362815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:44.363649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:44.364246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:44.592589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:44.601539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-89b66628-aa44-469b-a512-4cbb9737683b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.261540 Oct 18 16:54:44.602240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3579/7116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:44 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:45.626112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:45.628076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:45.634742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:45.635215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:45.635656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:45.636356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:45.636813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:45.637427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:45.821194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:45.837410 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8b7262d8-7e05-4dea-bed4-c37393b6bbc8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.216274 Oct 18 16:54:45.840445 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3538/7117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:45 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:46.867781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:46.868389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:46.877350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:46.877897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:46.878349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:46.879059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:46.879519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:46.879955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:47.083243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:47.096129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88d1bdb1-f049-45f7-9663-60441f8c5d65 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.234938 Oct 18 16:54:47.097005 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3580/7118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:46 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:48.127237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:48.128302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:48.138615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:48.140510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:48.140937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:48.141635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:48.142833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:48.143270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:48.298151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:48.306465 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-04770626-84d2-4766-b0c9-befd021ae53b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.184418 Oct 18 16:54:48.307393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3539/7119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:48 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:49.330025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:49.330795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:49.337026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:49.337464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:49.337933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:49.338606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:49.339064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:49.339483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:49.479716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:49.489159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-facbc712-3402-4775-9fa6-4116bd21fd37 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.163419 Oct 18 16:54:49.489682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3581/7120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:49 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:50.512470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:50.513102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:50.520775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:50.521281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:50.521722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:50.522417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:50.522870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:50.523295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:50.659824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:50.668066 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-340839c3-d4ab-40e5-97b4-21baffc78e8e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.159801 Oct 18 16:54:50.668645 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3540/7121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:50 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:51.692067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:51.692689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:51.695472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:51.701575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:51.702094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:51.702531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:51.703259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:51.703712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:51.704134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:51.838657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:51.847236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e8ce0cc1-8ad9-4d08-adfe-af08d481afd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.159995 Oct 18 16:54:51.847828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3582/7122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:51 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:52.870866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:52.871517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:52.873996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:52.874830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:52.882068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:52.882566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:52.883012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:52.883717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:52.884178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:52.884612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:53.020352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:53.028149 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aeed0359-9eb9-4b80-b0f1-99e5f2bf56de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.161226 Oct 18 16:54:53.028724 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3541/7123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:52 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:54.051119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:54.052599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:54.059598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:54.060083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:54.060521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:54.061245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:54.061705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:54.062129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:54.199143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:54.207683 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24cb65b0-e59e-4cad-b605-7790964545e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.160499 Oct 18 16:54:54.208275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3583/7124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:54 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:55.230633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:55.231252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:55.238869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:55.239367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:55.239821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:55.240528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:55.241007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:55.241450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:55.377667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:55.385719 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16c5ffb8-3726-41f8-b7b3-00163702f4bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1169 microversion: 2.1 time: 0.158933 Oct 18 16:54:55.386315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3542/7125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:55 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:56.413986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:56.415338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:56.422909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:56.424171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:56.424708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:56.425485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:56.425964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:56.426412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:56.563433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:56.571345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f36554a-c3a2-454c-8790-855b8a11765d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1215 microversion: 2.1 time: 0.163525 Oct 18 16:54:56.571912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3584/7126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:56 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:57.593999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:57.594653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:57.602240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:57.602727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:57.603227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:57.603932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:57.604391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:57.604823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:57.736689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:57.744469 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33a370ac-1bc0-4ba1-a6fc-0c8ada6a4a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.154383 Oct 18 16:54:57.745064 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3543/7127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:57 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:58.768106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:58.768645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:58.775656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:58.776145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:58.776590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:58.777358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:58.777820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:58.778253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:58.915713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:58.923627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0369113-9e11-4d96-a9e9-43e6bd592db2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.159586 Oct 18 16:54:58.924215 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3585/7128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:58 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:59.946647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:59.947272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:59.954270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:59.954802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:59.955329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:59.956032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:59.956497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:59.956932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:00.089666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:00.098933 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9d12516-cf30-4991-b3b6-bcb7f10c193e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.156211 Oct 18 16:55:00.099508 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3544/7129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:59 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:01.122372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:01.122991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:01.130626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:01.131111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:01.131554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:01.132249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:01.132709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:01.133185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:01.264242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:01.272583 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-507463cc-d349-4ded-a12c-791e39ed96d0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.154333 Oct 18 16:55:01.273266 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3586/7130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:01 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:02.295076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:02.295718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:02.303158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:02.303645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:02.304084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:02.304785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:02.305271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:02.305702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:02.439617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:02.447363 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-392637b4-9628-40b4-8415-12d6451a0e39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.156387 Oct 18 16:55:02.447944 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3545/7131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:02 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:03.471716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:03.472325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:03.479289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:03.479769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:03.480204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:03.480888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:03.481390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:03.481813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:03.610865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:03.618921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-684b612f-a262-42d6-85eb-33e05babc484 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.151822 Oct 18 16:55:03.619498 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3587/7132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:03 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:04.642306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:04.643730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:04.650848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:04.651328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:04.652654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:04.653470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:04.653954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:04.654400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:04.791908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:04.800726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc35ad7f-05eb-4d34-a243-43ebbff8a592 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.162359 Oct 18 16:55:04.801344 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3546/7133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:04 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:05.824526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:05.825189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:05.833151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:05.833643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:05.834084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:05.834780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:05.835238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:05.835671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:05.975148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:05.982931 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93f86f3f-936e-4f0e-a3c6-09be9ced7c22 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.162368 Oct 18 16:55:05.983504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3588/7134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:05 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:07.006186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:07.006848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:07.013792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:07.014265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:07.014705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:07.015409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:07.015852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:07.016281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:07.146723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:07.154482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2ad9b912-2921-417e-bb55-1e199ccd57ce tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.152358 Oct 18 16:55:07.155052 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3547/7135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:07 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:08.027403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7777c0f-b7a5-4dff-b2ca-d7e253debdb6", "name": "network-vif-plugged", "status": "completed", "tag": "02248ccc-be35-47e4-8b9c-b225e904fa97"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:08.038258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:08.038744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:08.039206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:08.050984 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] Creating event network-vif-plugged:02248ccc-be35-47e4-8b9c-b225e904fa97 for instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 on n-h1-858383-14 Oct 18 16:55:08.055947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-dd8172d9-52b7-4876-b833-4a78f4cb7be6 req-eb68a92a-528a-4cd8-9736-2fbc1c91d6f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032267 Oct 18 16:55:08.056557 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3589/7136] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:08.178359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:08.178934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:08.185799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:08.186298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:08.186740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:08.187441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:08.187907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:08.188738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:08.317778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:08.325490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0d18882b-9923-448b-9e30-59b841c710fa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.151749 Oct 18 16:55:08.326046 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3548/7137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:08 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:09.350473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:09.351220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:09.357464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:09.357944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:09.358385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:09.359079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:09.359575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:09.360087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:09.500647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:09.508573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-86a34ee1-b229-4024-b99c-9b073e05faae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1203 microversion: 2.1 time: 0.164404 Oct 18 16:55:09.509197 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3590/7138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:09 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:10.532045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:10.532638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:10.535521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:10.541150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.541657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.542107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:10.542823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.543287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.543722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:10.547518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=77 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:10.696951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:10.705198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d59137cd-d39a-4e06-a63e-4ef41a741977 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1389 microversion: 2.1 time: 0.177118 Oct 18 16:55:10.712782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3549/7139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:10 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1389 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:10.728224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:10.728850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:10.735942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.736439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.736883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:10.737621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.738077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.738513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:10.873604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:10.875911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=79 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:10.883921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c285085d-4291-4493-8461-19ac7822122b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1389 microversion: 2.1 time: 0.159624 Oct 18 16:55:10.884523 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3591/7140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:10 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:10.906099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:10.906751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:10.912900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.913430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.913873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:10.914574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:10.915036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:10.915472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:11.049193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:11.057497 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7742242-4273-49ce-915d-a462fe71e0de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1389 microversion: 2.1 time: 0.155320 Oct 18 16:55:11.058062 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3550/7141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:10 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:55:11.138568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:11.139065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:11.140894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=33 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:11.146395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:11.146879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:11.147316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:11.148007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:11.148457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:11.148880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:11.178712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:55:11.261281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2dc8d551-d080-449e-91c1-9149d67bb331 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 204 len: 0 microversion: 2.1 time: 0.126261 Oct 18 16:55:11.262173 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3592/7142] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:55:11 2022] DELETE /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:55:11.270486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:11.271113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:11.277648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:11.278185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:11.278630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:11.279376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:11.279842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:11.280276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:11.417681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:11.426017 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bdcb5bc7-9c74-469b-9467-742445dd106a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1395 microversion: 2.1 time: 0.159737 Oct 18 16:55:11.426585 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3551/7143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:11 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:12.450405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:12.451118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:12.458309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:12.458805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:12.459257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:12.459964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:12.460432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:12.460874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:12.601584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:12.610787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-219dc480-8ee2-4031-8de7-0bf8a0460522 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1395 microversion: 2.1 time: 0.164619 Oct 18 16:55:12.611393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3593/7144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:12 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:13.490668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7777c0f-b7a5-4dff-b2ca-d7e253debdb6", "name": "network-vif-deleted", "tag": "02248ccc-be35-47e4-8b9c-b225e904fa97"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:13.502531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:13.504627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:13.505197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:13.518755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] Creating event network-vif-deleted:02248ccc-be35-47e4-8b9c-b225e904fa97 for instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 on n-h1-858383-14 Oct 18 16:55:13.526056 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a5d30ce6-7a22-44ff-b233-35748c35598f req-804bef5f-6aaa-4f29-a47d-feb126356347 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040205 Oct 18 16:55:13.526666 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3552/7145] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:13.635673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:13.636299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:13.644494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:13.645118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:13.645580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:13.646299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:13.646762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:13.647199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:13.712277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:13.720631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d27392f-0416-416d-b471-86567d15efb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1188 microversion: 2.1 time: 0.089174 Oct 18 16:55:13.721257 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3594/7146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:13 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:14.745041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:14.745637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:14.753933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:14.754418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:14.754857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:14.755548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:14.756006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:14.756426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:14.823196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:14.832264 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7a08313f-f447-4590-a5c2-909677891b7d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1188 microversion: 2.1 time: 0.091206 Oct 18 16:55:14.833047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3553/7147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:14 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:15.855257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:15.855904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:15.863704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:15.864237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:15.864679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:15.865446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:15.865907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:15.866340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:15.938689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:15.948231 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24d7b27d-186a-43ff-a271-15d5a58dcb01 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1188 microversion: 2.1 time: 0.096712 Oct 18 16:55:15.948860 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3595/7148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:15 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:16.972533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:16.977595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:16.984747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:16.985258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:16.985698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:16.986399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:16.986850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:16.987283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:17.050384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:17.058145 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f637eae-4577-46d7-8983-54670d2e86e2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1188 microversion: 2.1 time: 0.090339 Oct 18 16:55:17.058721 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3554/7149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:16 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:18.082090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:18.082882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:18.090904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:18.091389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:18.091825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:18.092518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:18.092973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:18.093480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:18.134585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:18.135193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:18.135638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:18.136084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:55:18.183481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:18.191249 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f947ec3f-50e5-405e-b6ed-1640e9a2479c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 200 len: 1147 microversion: 2.1 time: 0.113618 Oct 18 16:55:18.192763 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3596/7150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:18 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 1147 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:19.215874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:19.216495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:19.223781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:19.224274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:19.224724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:19.225462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:19.225920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:19.226352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:19.240717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 HTTP/1.1 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b7777c0f-b7a5-4dff-b2ca-d7e253debdb6'} Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:19.242427 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c383c2d-48bf-4fd8-9aa9-bf30c01943de tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 404 len: 111 microversion: 2.1 time: 0.031954 Oct 18 16:55:19.246482 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3555/7151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:19 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:55:20.343387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:20.343958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:20.350448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:20.350939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:20.351380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:20.352099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:20.352564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:20.353018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:20.367519 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 HTTP/1.1 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b7777c0f-b7a5-4dff-b2ca-d7e253debdb6'} Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:55:20.369234 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c181975-b705-4330-854e-fec2bcb0d36d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 404 len: 111 microversion: 2.1 time: 0.031742 Oct 18 16:55:20.373232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3597/7152] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:55:20 2022] DELETE /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:55:20.380523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:20.381262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: b7777c0f-b7a5-4dff-b2ca-d7e253debdb6] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:20.388318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:20.388810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:20.389288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:20.389997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:20.390460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:20.390892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:20.405279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 HTTP/1.1 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b7777c0f-b7a5-4dff-b2ca-d7e253debdb6'} Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:20.406826 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff6d521f-4787-436d-b936-2a8c81d6d740 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6" status: 404 len: 111 microversion: 2.1 time: 0.032226 Oct 18 16:55:20.410734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3556/7153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:20 2022] GET /compute/v2.1/servers/b7777c0f-b7a5-4dff-b2ca-d7e253debdb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:55:40.172921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-703688089", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "69bb83c6-23b8-4a78-9a08-dfe5c01d2ef3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:40.183923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:40.184578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:40.238885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:55:40.605160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:55:40.605586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:55:40.606068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:55:40.606479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:55:40.606894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:55:40.619607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:40.620442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:40.621229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:40.622004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:40.622720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:40.623154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:40.643187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:55:40.649801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:55:40.709437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:55:40.711559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69bb83c6-23b8-4a78-9a08-dfe5c01d2ef3',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:55:40.843697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d336edd-1cdc-48c4-a727-cfadf487a243 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674507 Oct 18 16:55:40.844771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3598/7154] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:55:40.855724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3c21dddc-ac9e-42c2-a82e-8bba8a2d2f95 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:40.856335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3c21dddc-ac9e-42c2-a82e-8bba8a2d2f95 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:40.859332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=15 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:40.860195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=35 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:40.913800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3c21dddc-ac9e-42c2-a82e-8bba8a2d2f95 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:40.920651 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3c21dddc-ac9e-42c2-a82e-8bba8a2d2f95 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1070 microversion: 2.1 time: 0.068919 Oct 18 16:55:40.921246 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3557/7155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:40 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1070 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:41.947515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:41.948711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:41.956165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:41.956945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:41.957569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:41.959361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:41.960365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:41.960984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:42.040499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:42.048844 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f721b3df-fd1c-4cd5-a874-55520d9783c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1176 microversion: 2.1 time: 0.108626 Oct 18 16:55:42.049622 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3599/7156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:41 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1176 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:43.073773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:43.074945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:43.082789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:43.083859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:43.084492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:43.085237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:43.085723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:43.086332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:43.235716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:43.244031 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6353666a-9baa-42a4-b9a8-0afc8535f0e6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1228 microversion: 2.1 time: 0.174477 Oct 18 16:55:43.244833 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3558/7157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:43 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:43.389729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b42fe-e33d-4044-8cb1-9d03241f6dea", "tag": "286521f1-e68e-406e-9b27-96b290266300"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:43.402416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:43.403234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:43.403760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:43.416356 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] Creating event network-changed:286521f1-e68e-406e-9b27-96b290266300 for instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea on n-h1-858383-14 Oct 18 16:55:43.423019 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b90d48e4-7a49-4b77-aaa5-6ac3048f42d5 req-69d5e413-3d1f-45d4-b31f-1169e2d60d63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037410 Oct 18 16:55:43.423790 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3600/7158] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:44.268518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:44.269472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:44.277762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:44.278364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:44.278871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:44.279976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:44.280517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:44.281991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:44.431550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:44.439474 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-924d55a4-cabf-4338-9dd8-b0e6ef24b6e5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1228 microversion: 2.1 time: 0.175276 Oct 18 16:55:44.440060 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3559/7159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:44 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1228 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:45.465287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:45.466169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:45.472208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:45.472695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:45.473167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:45.474514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:45.475334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:45.475452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:45.609146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:45.617415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-230d2ba4-469d-4157-b9db-a69b082e09aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1228 microversion: 2.1 time: 0.157405 Oct 18 16:55:45.617996 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3601/7160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:45 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:46.641174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:46.641829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:46.653077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:46.653877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:46.655240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:46.655380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:46.656109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:46.656552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:46.801118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:46.809882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-56fe02bb-6dd3-44b7-999b-fa70f541c697 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1228 microversion: 2.1 time: 0.172714 Oct 18 16:55:46.810464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3560/7161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:46 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:47.833145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:47.833832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:47.840662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:47.841270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:47.841712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:47.842399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:47.842851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:47.843273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:47.980495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:47.988323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12b4a2d9-feb7-455e-b25f-434affd84a8a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.159241 Oct 18 16:55:47.988824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3602/7162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:47 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:49.012061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:49.012676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:49.019328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:49.019805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:49.020241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:49.021178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:49.021636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:49.022066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:49.153967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:49.161943 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e0a156e-9d43-44bf-b65e-7c341aaf4f3d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.153752 Oct 18 16:55:49.162513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3561/7163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:49 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:50.185461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:50.186006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:50.192784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:50.193430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:50.193870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:50.194549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:50.194999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:50.195423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:50.325125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:50.334579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-142835aa-05f6-40aa-a0c1-3e3281c4048f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.153126 Oct 18 16:55:50.335166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3603/7164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:50 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:51.357875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:51.358532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:51.361345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:51.367381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:51.367875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:51.368321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:51.369042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:51.369511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:51.369940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:51.500612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:51.508536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2c75327-7a3a-449d-9653-b14702d6e0c9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.154600 Oct 18 16:55:51.509198 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3562/7165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:51 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:52.530934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:52.531556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:52.533631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:52.534314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:52.542051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:52.542543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:52.542986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:52.543696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:52.544154 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:52.544588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:52.684934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:52.692967 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c32c658-5d94-4cea-a130-d8bac9e50d9c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.165823 Oct 18 16:55:52.693563 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3604/7166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:52 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:53.715999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:53.716638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:53.723318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:53.723900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:53.724336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:53.725043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:53.725502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:53.725926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:53.858840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:53.867447 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1587bad-e487-49ef-a568-758ec3ed5d45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.155485 Oct 18 16:55:53.868029 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3563/7167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:53 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:54.890751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:54.891366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:54.899278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:54.899767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:54.900201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:54.900896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:54.901379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:54.901809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:55.035916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:55.043811 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-73fc5997-fe91-4474-9a34-5b882a4b8a29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.156936 Oct 18 16:55:55.044443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3605/7168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:54 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:56.068146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:56.068774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:56.075814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:56.076318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:56.076758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:56.077511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:56.077979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:56.078414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:56.214452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:56.224009 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fad2318e-bd00-456b-9b39-3b5836be8c81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.159271 Oct 18 16:55:56.224851 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3564/7169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:56 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:57.249578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:57.250192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:57.258010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:57.258501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:57.258948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:57.259642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:57.260100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:57.260531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:57.390599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:57.398468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-26ebaaeb-d956-4b84-987e-429952da5e97 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.153106 Oct 18 16:55:57.399041 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3606/7170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:57 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:58.243025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b42fe-e33d-4044-8cb1-9d03241f6dea", "name": "network-vif-plugged", "status": "completed", "tag": "286521f1-e68e-406e-9b27-96b290266300"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:58.255743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:58.256442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:58.257038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:58.278750 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] Creating event network-vif-plugged:286521f1-e68e-406e-9b27-96b290266300 for instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea on n-h1-858383-14 Oct 18 16:55:58.284387 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e401be78-9c16-4125-bf09-bbcf6aabbe49 req-8e5401fb-c7c4-40a6-a1ee-9668cbd8e88b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044840 Oct 18 16:55:58.284803 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3565/7171] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:58.420985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:58.421664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:58.429115 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:58.429613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:58.430058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:58.430760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:58.431221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:58.431650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:58.564369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:58.572662 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c056cd90-8625-4b89-ac5d-4e1775f9d095 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.155694 Oct 18 16:55:58.573275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3607/7172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:58 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:59.597128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:59.597839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:59.604615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:59.605137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:59.605576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:59.606265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:59.606718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:59.607144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:59.744424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:59.752323 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5765df75-ecef-47dc-aba3-fed24243e02a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1216 microversion: 2.1 time: 0.160320 Oct 18 16:55:59.752891 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3566/7173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:59 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:00.775255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:00.775873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:00.782829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.783323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.783805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.784505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.784960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.785411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.930021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:00.938348 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4398d24d-207e-4e4c-ab35-e334ce8def72 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1402 microversion: 2.1 time: 0.167110 Oct 18 16:56:00.938933 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3608/7174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:00 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1402 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:00.961075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:00.961726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:00.969130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.969692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.970143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.970844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.971311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.971737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:01.104787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:01.112587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10b5e646-7748-4976-ace8-90a5d6543110 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1402 microversion: 2.1 time: 0.156158 Oct 18 16:56:01.113185 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3567/7175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:00 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:01.136024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-377117283"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:01.138832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:01.144840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:01.145881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:01.146409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:01.147099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:01.147558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:01.147986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:01.241236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Attempting to quiesce instance before volume snapshot. Oct 18 16:56:01.308563 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 18 16:56:01.385051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Creating snapshot from volume 69bb83c6-23b8-4a78-9a08-dfe5c01d2ef3. {{(pid=120571) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 18 16:56:02.291575 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3e49e77a-bba0-41da-8e5f-ddcd90a872dd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea/action" status: 202 len: 0 microversion: 2.1 time: 1.159348 Oct 18 16:56:02.297510 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3609/7176] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 16:56:01 2022] POST /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea/action => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:56:03.453652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1810941687", "imageRef": "12bbbb36-4448-4978-b289-ec6f7a5f22ec", "flavorRef": "452", "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:03.512477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:56:03.895291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:56:03.895719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:56:03.896204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:56:03.896619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:56:03.897100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:56:03.905938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:03.906428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:03.906875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:03.907633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:03.908098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:03.908528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:03.926335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:56:03.932650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:56:03.946102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:56:03.948708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8c196a8b-5faf-495c-9091-bb7c66b344fc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:56:04.025318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5f586fa6-97db-4e64-92a9-67bd95d2501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575471 Oct 18 16:56:04.025989 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3568/7177] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:56:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:56:04.039663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f36ca73-afda-4838-8c1a-5acba67cb72e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:04.040396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f36ca73-afda-4838-8c1a-5acba67cb72e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:04.095929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f36ca73-afda-4838-8c1a-5acba67cb72e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:04.103666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f36ca73-afda-4838-8c1a-5acba67cb72e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1230 microversion: 2.1 time: 0.070293 Oct 18 16:56:04.104287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3610/7178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:04 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:05.128144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:05.128961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:05.135414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:05.135903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:05.136689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:05.137147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:05.137612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:05.138041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:05.213369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:05.221601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8daaf754-9848-4749-9b58-fbb02ed161dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1290 microversion: 2.1 time: 0.098796 Oct 18 16:56:05.222214 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3569/7179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:05 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:06.245554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:06.246127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:06.254169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:06.254731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:06.255338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:06.256106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:06.256583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:06.257051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:06.442484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:06.451677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b20495d6-548e-4893-b1b5-e0d369536b9e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.210189 Oct 18 16:56:06.456975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3611/7180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:06 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:06.918925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0647d691-e61e-427d-9f7b-9b2e7dc83da8", "tag": "83dd42e5-daf0-4fa3-bbcb-2f8368aad348"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:06.934043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:06.937096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:06.937741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:06.954459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] Creating event network-changed:83dd42e5-daf0-4fa3-bbcb-2f8368aad348 for instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 on n-h2-858383-14 Oct 18 16:56:06.960848 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a9caa088-fd40-46ad-91ec-c7a728dd76d2 req-6bbf8e70-920f-4bdc-95ea-d3de00a15504 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046866 Oct 18 16:56:06.962044 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3570/7181] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:56:07.476223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:07.476857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:07.484009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:07.484539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:07.485172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:07.485894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:07.486369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:07.486847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:07.631314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:07.639770 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6040901f-7600-468a-bfc6-42f2dd1a4c31 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.167842 Oct 18 16:56:07.640758 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3612/7182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:07 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:08.666729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:08.668202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:08.675134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:08.676006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:08.677256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:08.677964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:08.678421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:08.678845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:08.867783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:08.884618 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67da8f8f-b0a0-4c21-be31-2ef7133103a3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.223017 Oct 18 16:56:08.885997 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3571/7183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:08 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:09.914963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:09.916568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:09.927468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:09.928217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:09.930537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:09.932708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:09.934738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:09.934738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:10.114772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:10.127631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f6d9024-4361-409e-b02f-ea419cdf7ad2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.220514 Oct 18 16:56:10.130229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3613/7184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:09 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:11.166759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:11.169670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:11.179691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:11.187789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:11.191195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:11.192827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:11.194631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:11.194631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:11.194631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:11.201085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=73 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:11.376861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:11.387195 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3432458f-848b-4969-bb58-338b7194a8c4 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.231491 Oct 18 16:56:11.388161 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3572/7185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:11 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:12.412834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:12.413513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:12.417789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:12.422743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:12.422904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:12.423416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:12.424162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:12.426129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:12.426129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:12.430942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:12.709633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:12.717646 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6e327d6-bce9-4047-93ac-f63594a930d5 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.309728 Oct 18 16:56:12.718590 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3614/7186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:12 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:13.741780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:13.742449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:13.750450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:13.750942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:13.751386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:13.752082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:13.752543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:13.752975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:13.915069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:13.939854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:13.945158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:13.953153 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eea9c131-e234-4d22-b34f-6deff11bffb0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.215508 Oct 18 16:56:13.953732 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3573/7187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:13 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:14.976340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:14.977005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:14.981493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:14.986456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:14.986963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:14.987614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:14.988285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:14.988764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:14.989226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:15.132041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:15.140159 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4efcf043-968f-42f8-bf47-7537372d61a9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.167646 Oct 18 16:56:15.140946 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3615/7188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:14 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:16.164211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:16.164836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:16.172111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:16.172599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:16.173080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:16.173773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:16.174232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:16.174665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:16.314832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:16.323311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b9aa811-b7a8-4e57-a49e-788443389f2b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.163066 Oct 18 16:56:16.337074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3574/7189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:16 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:17.349153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:17.349826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:17.359636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:17.360028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:17.360487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:17.361253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:17.361728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:17.362176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:17.506635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:17.514757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-232fac81-6d4c-41e1-9dbe-04edf14db143 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.170675 Oct 18 16:56:17.515478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3616/7190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:17 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:18.539294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:18.540318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:18.547015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:18.547498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:18.547933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:18.548641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:18.549101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:18.549525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:18.695837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:18.704471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e537f86f-c150-4c5c-81f5-e652256fceda tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1342 microversion: 2.1 time: 0.169757 Oct 18 16:56:18.705074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3575/7191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:18 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:19.729923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:19.730618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:19.738007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:19.738340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:19.738696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:19.739411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:19.739910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:19.740349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:20.223177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:20.231185 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5151070-f1e8-4565-b8bc-7c18a2955fae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1388 microversion: 2.1 time: 0.505573 Oct 18 16:56:20.231771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3617/7192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:19 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1388 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:21.255547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:21.256283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:21.259398 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:56:21.259546 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:56:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 (ip 10.222.0.78) !!! Oct 18 16:56:21.267363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:21.267891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:21.268354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:21.269154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:21.269649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:21.270074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:21.414382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:21.422373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6765d723-2bea-459a-a272-ca2a9e49d8bb tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.172116 Oct 18 16:56:21.422991 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3576/7193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:21 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:22.447124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:22.447753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:22.450677 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:56:22.450821 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 (ip 10.222.0.78) !!! Oct 18 16:56:22.457717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:22.458216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:22.458665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:22.459459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:22.459933 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:22.460376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:22.598914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:22.606829 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b97b5ef9-d287-42be-9e6f-dbcec2f7a2cf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.163563 Oct 18 16:56:22.607417 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3618/7194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:22 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:23.632001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:23.632624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:23.639646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:23.640128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:23.640565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:23.641302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:23.641755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:23.642181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:23.793452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:23.803345 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5f55ac5-5063-439b-b29d-8032660f8cf9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.176110 Oct 18 16:56:23.804127 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3577/7195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:23 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:24.827606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:24.828394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:24.836979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:24.837960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:24.838521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:24.839582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:24.840352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:24.841057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:25.003939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:25.012900 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5067cdee-c26e-4419-a95f-8aa9b227927b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.189251 Oct 18 16:56:25.013995 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3619/7196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:24 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:26.036886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:26.037450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:26.044468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:26.044953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:26.045482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:26.046188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:26.046649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:26.047069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:26.191529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:26.203277 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-12c6dfe5-6d2d-4e40-8e0d-ba23138f3c59 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.170671 Oct 18 16:56:26.204216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3578/7197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:26 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:27.229097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:27.229764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:27.238814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:27.239445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:27.239889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:27.240596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:27.241152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:27.241721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:27.396122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:27.404215 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fc98f407-a25a-4b88-b2f5-6a9992cde95c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.180057 Oct 18 16:56:27.404794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3620/7198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:27 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:28.429216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:28.429984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:28.437525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:28.438010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:28.438521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:28.439264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:28.439723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:28.440244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:28.592493 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:28.602483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f227e8e9-49a2-4c35-8121-c49971e1514c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.178348 Oct 18 16:56:28.603059 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3579/7199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:28 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:29.633045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:29.633667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:29.642492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:29.643108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:29.643804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:29.644981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:29.645573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:29.646184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:29.805744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:29.814302 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe8b95e7-5f90-439e-998e-d34abfbd83df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.185126 Oct 18 16:56:29.814889 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3621/7200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:29 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:30.839348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:30.840170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:30.847160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:30.847848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:30.848427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:30.849191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:30.850454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:30.850454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:31.015313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:31.024515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51bb78ee-80c4-4796-b1f3-b9708648e3a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.189008 Oct 18 16:56:31.025183 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3580/7201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:30 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:32.049703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:32.050338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:32.057436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:32.057941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:32.058396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:32.059113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:32.059611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:32.060030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:32.214042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:32.223204 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-94e9d123-3895-4dae-9742-45886a9c073d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.177698 Oct 18 16:56:32.223814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3622/7202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:32 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:32.934467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0647d691-e61e-427d-9f7b-9b2e7dc83da8", "name": "network-vif-plugged", "status": "completed", "tag": "83dd42e5-daf0-4fa3-bbcb-2f8368aad348"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:32.949754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:32.950395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:32.951135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:32.964508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] Creating event network-vif-plugged:83dd42e5-daf0-4fa3-bbcb-2f8368aad348 for instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 on n-h2-858383-14 Oct 18 16:56:32.969757 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-12631d49-e2c9-4961-954d-3f5125ce1a4f req-c608908e-af55-4da8-b9be-2e3b277e1d9a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039531 Oct 18 16:56:32.970359 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3581/7203] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:56:33.246479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:33.247037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:33.255292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:33.255791 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:33.256388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:33.257139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:33.257659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:33.258110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:33.408053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:33.417064 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9c5ab7f9-3056-4107-b6d3-555bbd2e952f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.175177 Oct 18 16:56:33.417742 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3623/7204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:33 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:34.441857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:34.442582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:34.449276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:34.449773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:34.450225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:34.450924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:34.451387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:34.451882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:34.610122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:34.618824 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a67ac5f-f337-4c75-a2fb-1cfac0bdf93b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1376 microversion: 2.1 time: 0.182152 Oct 18 16:56:34.619403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3582/7205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:34 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:35.642289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:35.642961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:35.650392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:35.650895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:35.651352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:35.652067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:35.652538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:35.652982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:35.796986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:35.806499 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92b3cf2f-bd3f-494a-a93c-d2bd6feb8073 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1563 microversion: 2.1 time: 0.168094 Oct 18 16:56:35.807081 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3624/7206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:35 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:35.829196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:35.829816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:35.837076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:35.837566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:35.838009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:35.838711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:35.839181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:35.839612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:35.979817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:35.987605 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b93fa313-3b7c-4fc6-9e79-19150bed7acc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1563 microversion: 2.1 time: 0.162380 Oct 18 16:56:35.988957 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3583/7207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:35 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:36.083822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:36.084375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:36.090378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:36.090866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:36.091310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:36.092007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:36.092468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:36.092902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:36.119804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:56:36.200784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbf481fb-3947-454b-82ca-a1071cc964ee tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 204 len: 0 microversion: 2.1 time: 0.120390 Oct 18 16:56:36.201873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3625/7208] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:56:36 2022] DELETE /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:56:36.211105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:36.211786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:36.218287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:36.218776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:36.219221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:36.219923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:36.220386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:36.220819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:36.363852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:36.374460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-95def5eb-13a1-4339-962f-82d052281169 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1569 microversion: 2.1 time: 0.167445 Oct 18 16:56:36.375278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3584/7209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:36 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:37.400878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:37.401817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:37.410404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:37.411005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:37.411673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:37.412353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:37.412904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:37.413821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:37.628609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:37.638487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b9c4074-0c84-4d95-9af9-fdb952060bc3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1569 microversion: 2.1 time: 0.242576 Oct 18 16:56:37.639081 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3626/7210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:37 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:38.499467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0647d691-e61e-427d-9f7b-9b2e7dc83da8", "name": "network-vif-deleted", "tag": "83dd42e5-daf0-4fa3-bbcb-2f8368aad348"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:38.510730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:38.511519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:38.512201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:38.524925 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] Creating event network-vif-deleted:83dd42e5-daf0-4fa3-bbcb-2f8368aad348 for instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 on n-h2-858383-14 Oct 18 16:56:38.536233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e7d9d7f3-50af-46cd-9bdb-f139ed9019be req-e48c46d7-0df8-4f8a-8e4b-821ec9f9e207 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149051 Oct 18 16:56:38.537279 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3585/7211] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:56:38.663409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:38.663982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:38.671755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:38.672266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:38.672726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:38.673480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:38.673956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:38.674431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:38.751660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:38.763425 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-796a3fab-fdd8-4201-8c12-c29e1ef6724a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1361 microversion: 2.1 time: 0.104474 Oct 18 16:56:38.764028 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3627/7212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:38 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1361 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:39.790143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:39.791188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:39.803837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:39.804463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:39.804915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:39.805661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:39.806302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:39.806728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:39.896124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:39.905658 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db869ac1-e66d-4383-bdab-eec30f65ab7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1361 microversion: 2.1 time: 0.122131 Oct 18 16:56:39.906388 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3586/7213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:39 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1361 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:40.932779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:40.934117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:40.942552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:40.943390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:40.943535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:40.944231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:40.944695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:40.945181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:41.031966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:41.042122 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc00e981-2ba8-4e6a-8f62-d12307cc7678 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1361 microversion: 2.1 time: 0.113986 Oct 18 16:56:41.042722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3628/7214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:40 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:42.072480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:42.073527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:42.082558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=30 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:42.084815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:42.085341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:42.085792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:42.086508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:42.086968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:42.087396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:42.092300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=82 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:42.153261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:42.161490 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c1f9c1a-c1c7-46d8-8b6d-c0cba7c2e6b6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1361 microversion: 2.1 time: 0.095455 Oct 18 16:56:42.162076 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3587/7215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:42 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:43.185921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:43.186551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:43.189498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:43.196901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:43.197779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:43.198245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:43.198974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:43.199451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:43.199894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:43.203252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:43.238818 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:43.239331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:43.239846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:43.240317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 0647d691-e61e-427d-9f7b-9b2e7dc83da8 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:56:43.284359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:43.293217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1a25b15-59bb-4fd8-a188-aba54cee50a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 200 len: 1366 microversion: 2.1 time: 0.111700 Oct 18 16:56:43.293798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3629/7216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:43 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:44.315997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:44.316619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:44.323926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:44.324426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:44.324867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:44.325618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:44.326078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:44.326507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:44.342513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 HTTP/1.1 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '0647d691-e61e-427d-9f7b-9b2e7dc83da8'} Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:44.343805 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cdb6e777-151d-41cd-9685-7c93ec82f9f0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 404 len: 111 microversion: 2.1 time: 0.033310 Oct 18 16:56:44.351294 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3588/7217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:44 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:48.635693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:48.636246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:48.642542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:48.643038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:48.643499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:48.644235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:48.644960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:48.645434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:48.670188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:56:48.746813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a5e761b-5879-4f50-a5a4-406988e3a3a6 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 204 len: 0 microversion: 2.1 time: 0.114898 Oct 18 16:56:48.747685 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3630/7218] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:56:48 2022] DELETE /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:56:48.756964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:48.757615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:48.764362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:48.764852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:48.765334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:48.766037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:48.766517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:48.766927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:48.899907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:48.907878 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4cd2c840-dac9-421d-9732-e6fee9a5a3a0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1408 microversion: 2.1 time: 0.155808 Oct 18 16:56:48.908444 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3589/7219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:48 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:49.932584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:49.933350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:49.941947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:49.942669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:49.943158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:49.943899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:49.944377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:49.944828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:50.082448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:50.090488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f91931ca-c46d-49d2-bb85-e21d1336bbe9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1408 microversion: 2.1 time: 0.162444 Oct 18 16:56:50.091063 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3631/7220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:49 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:51.072754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b42fe-e33d-4044-8cb1-9d03241f6dea", "name": "network-vif-deleted", "tag": "286521f1-e68e-406e-9b27-96b290266300"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:51.084039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:51.084531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:51.084945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:51.098354 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] Creating event network-vif-deleted:286521f1-e68e-406e-9b27-96b290266300 for instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea on n-h1-858383-14 Oct 18 16:56:51.103659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1e411753-e114-4039-8b9d-fa989ca33308 req-6b077887-3afb-49d0-8a20-7624f7844eaf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Oct 18 16:56:51.104271 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3590/7221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:56:51.114430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:51.115755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:51.125870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:51.126301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:51.126769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:51.127505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:51.127978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:51.129090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:51.198497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:51.207865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cca1c0f-545e-4e8b-9462-5b5d71de7793 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1201 microversion: 2.1 time: 0.097804 Oct 18 16:56:51.208456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3632/7222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:51 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:52.232817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:52.233571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:52.240793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:52.241296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:52.241730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:52.242422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:52.242931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:52.243360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:52.310869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:52.318873 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f746691-cebd-4788-a03c-1d446f18782c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1201 microversion: 2.1 time: 0.091376 Oct 18 16:56:52.319433 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3591/7223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:52 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:53.342142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:53.342779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:53.350989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:53.351491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:53.351944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:53.352665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:53.353181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:53.353625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:53.422108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:53.430896 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc382127-54f8-42e5-bbbd-e9a5c6653bfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1201 microversion: 2.1 time: 0.092567 Oct 18 16:56:53.431596 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3633/7224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:53 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:54.454960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:54.456258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:54.464437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:54.464925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:54.465390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:54.466117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:54.466708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:54.467400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:54.546389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:54.556829 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d087c39c-4187-4c58-9dc3-b52f39da7eb8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1201 microversion: 2.1 time: 0.106000 Oct 18 16:56:54.557461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3592/7225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:54 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:55.584252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:55.584968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:55.592089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:55.592586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:55.593061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:55.593770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:55.594258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:55.594685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:55.632397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:55.632777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:55.633257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:55.633722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 9f2b42fe-e33d-4044-8cb1-9d03241f6dea {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:56:55.680711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:55.689133 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df29ba07-39c5-474b-8808-c9bd5047c247 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 200 len: 1206 microversion: 2.1 time: 0.108844 Oct 18 16:56:55.689722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3634/7226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:55 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 1206 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:56:56.713765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:56.715296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:56.721439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:56.722463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:56.723627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:56.723627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:56.724343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:56.724783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:56.739818 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea HTTP/1.1 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9f2b42fe-e33d-4044-8cb1-9d03241f6dea'} Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:56.741522 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc2950b2-c6ac-4472-969e-fb44d6d57bb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 404 len: 111 microversion: 2.1 time: 0.033152 Oct 18 16:56:56.745196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3593/7227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:56 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:58.886178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:58.886679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:58.893775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:58.894900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:58.895354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:58.896064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:58.896532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:58.896972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:58.911097 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 HTTP/1.1 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0647d691-e61e-427d-9f7b-9b2e7dc83da8'} Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:58.912953 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69c18c72-1eb8-4aa4-8b7e-085a4863106c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 404 len: 111 microversion: 2.1 time: 0.032129 Oct 18 16:56:58.916581 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3635/7228] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:56:58 2022] DELETE /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:58.923233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:58.923891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 0647d691-e61e-427d-9f7b-9b2e7dc83da8] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:58.931764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:58.932265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:58.932707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:58.933470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:58.933929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:58.934361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:58.950569 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 HTTP/1.1 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '0647d691-e61e-427d-9f7b-9b2e7dc83da8'} Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:58.952119 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 0647d691-e61e-427d-9f7b-9b2e7dc83da8 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a5ab46cd-367c-4312-9401-ca0b00e13e45 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8" status: 404 len: 111 microversion: 2.1 time: 0.034341 Oct 18 16:56:58.955850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3594/7229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:58 2022] GET /compute/v2.1/servers/0647d691-e61e-427d-9f7b-9b2e7dc83da8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:59.345755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:59.346259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:59.352755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:59.353284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:59.353734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:59.354426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:59.354891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:59.355328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:59.369757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea HTTP/1.1 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9f2b42fe-e33d-4044-8cb1-9d03241f6dea'} Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:59.371949 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52d39811-ac26-4dbf-acf5-42f829728881 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 404 len: 111 microversion: 2.1 time: 0.031528 Oct 18 16:56:59.377300 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3636/7230] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:56:59 2022] DELETE /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:59.383259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:59.383884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 9f2b42fe-e33d-4044-8cb1-9d03241f6dea] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:59.389955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:59.390444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:59.390889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:59.391584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:59.392078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:59.392508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:59.406176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea HTTP/1.1 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9f2b42fe-e33d-4044-8cb1-9d03241f6dea'} Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:56:59.407708 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 9f2b42fe-e33d-4044-8cb1-9d03241f6dea could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69be2678-ea4e-474a-8534-ed9fa9b0c43e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea" status: 404 len: 111 microversion: 2.1 time: 0.029834 Oct 18 16:56:59.412560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3595/7231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:59 2022] GET /compute/v2.1/servers/9f2b42fe-e33d-4044-8cb1-9d03241f6dea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:59.484793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-505ddaea-0389-4a55-8ba2-0f4956167c03 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: .version_select at 0x7f5fd182f1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-3522167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6Kbg9q28YfMtBTpIke8MNnJ3HBjvlWLDCrT++ppcSZBxqFu5UBi8Dl3d1mXQ9QQUQPFnUZqZ0uq9Vg4RYWGglTP0v8AkFHviW7jV0mF+9hjKrEed/fPT0HFug6PD3B2w=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:59.501521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-505ddaea-0389-4a55-8ba2-0f4956167c03 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:56:59.506789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-505ddaea-0389-4a55-8ba2-0f4956167c03 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:56:59.533344 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-505ddaea-0389-4a55-8ba2-0f4956167c03 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052428 Oct 18 16:56:59.534076 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3637/7232] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 16:56:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:57:15.791203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1017409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3522167", "security_groups": [{"name": "tempest-secgroup-smoke-292247391"}], "block_device_mapping_v2": [{"uuid": "63bc68f5-4f67-4ef7-a52b-646751bfd053", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:57:15.802562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=17 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:15.803209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=33 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:15.907824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:57:16.291690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:57:16.292135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:57:16.292605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:57:16.293024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:57:16.293438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:57:16.303121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:16.303597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:16.304030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:16.304751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:16.305241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:16.305665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:16.323110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:57:16.328426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:57:16.387288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:57:16.389476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63bc68f5-4f67-4ef7-a52b-646751bfd053',volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:57:16.519861 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1b40687-9d61-49a0-9d49-139a13ea22ab tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733362 Oct 18 16:57:16.520565 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3596/7233] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:57:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:57:16.530116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:16.531032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:16.531744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:16.535618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a32ded97-77eb-47a2-94b0-b287e9670d82 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:16.537338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a32ded97-77eb-47a2-94b0-b287e9670d82 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:16.598474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a32ded97-77eb-47a2-94b0-b287e9670d82 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:16.605670 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a32ded97-77eb-47a2-94b0-b287e9670d82 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1089 microversion: 2.1 time: 0.077521 Oct 18 16:57:16.606245 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3638/7234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:16 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:17.631766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:17.632403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:17.638734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:17.639226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:17.639668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:17.640375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:17.640849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:17.641301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:17.720339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:17.728591 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da6a65c3-3708-44a9-a05a-0d4cda8afeb7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1195 microversion: 2.1 time: 0.102416 Oct 18 16:57:17.729200 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3597/7235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:17 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1195 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:18.753912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:18.755348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:18.761534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:18.762040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:18.762689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:18.763405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:18.764098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:18.764727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:18.996727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:19.005761 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5368b58-d371-4f0a-9fb9-ad5558951bb9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1272 microversion: 2.1 time: 0.256119 Oct 18 16:57:19.006620 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3639/7236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:18 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:19.245509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa0577b-f340-40b5-a40e-31a1275fbb03", "tag": "ade2a9c2-05d4-4eee-9a11-746fd21553c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:57:19.259625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:19.261080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:19.261733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:19.275375 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] Creating event network-changed:ade2a9c2-05d4-4eee-9a11-746fd21553c1 for instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 on n-h1-858383-14 Oct 18 16:57:19.280722 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7a3f792d-436c-4a53-be4f-02b8873e30da req-0e6fabd0-022b-4bab-a674-26adfbaf9f62 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039990 Oct 18 16:57:19.281557 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3598/7237] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:57:20.036775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:20.037803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:20.045700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:20.046405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:20.046958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:20.047835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:20.048569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:20.049151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:20.296254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:20.305411 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ab09c2ca-ccb7-4bec-a65f-a1dbcb230b78 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1272 microversion: 2.1 time: 0.273221 Oct 18 16:57:20.306275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3640/7238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:20 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:21.331761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:21.332358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:21.339754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:21.340236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:21.340674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:21.341406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:21.341862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:21.342286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:21.481359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:21.492892 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e592b684-3622-4981-9c03-5eb317f68482 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1272 microversion: 2.1 time: 0.166208 Oct 18 16:57:21.493519 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3599/7239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:21 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:22.518706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:22.519357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:22.527538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:22.528050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:22.528507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:22.529261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:22.529765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:22.530210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:22.688099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:22.703056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f98d4765-aead-4950-b8ba-af57142450aa tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1272 microversion: 2.1 time: 0.184201 Oct 18 16:57:22.703056 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3641/7240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:22 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:23.722527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:23.723145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:23.731016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:23.731509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:23.731946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:23.732639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:23.733127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:23.733559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:23.877251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:23.885262 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a12c03af-23c0-49e8-92c5-01d31d84261d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.166573 Oct 18 16:57:23.885903 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3600/7241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:23 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:24.907845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:24.908503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:24.916834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:24.917309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:24.917582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:24.918290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:24.918760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:24.919199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:25.061892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:25.070408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40237595-7978-40e0-a93d-c53ed573001f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.166468 Oct 18 16:57:25.071001 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3642/7242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:24 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:26.095769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:26.096379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:26.103369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:26.103855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:26.104290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:26.104980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:26.105460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:26.105887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:26.254540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:26.263344 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19f43472-251e-48e0-971a-a3823849c848 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.171587 Oct 18 16:57:26.263961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3601/7243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:26 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:27.286982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:27.287760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:27.290358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:27.295282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:27.295785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:27.296240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:27.296959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:27.297458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:27.297911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:27.436119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:27.444502 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b97c703-a54a-44c9-b9bc-8da3ad613713 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.161567 Oct 18 16:57:27.445123 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3643/7244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:27 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:28.472369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:28.473402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:28.476090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:28.476924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:28.486975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:28.487466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:28.487901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:28.488596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:28.489087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:28.489517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:28.630289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:28.642582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f856234-f247-48a5-ae5b-035390d8c4ae tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.174362 Oct 18 16:57:28.643397 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3602/7245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:28 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:29.666409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:29.667015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:29.674182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:29.674688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:29.675146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:29.675860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:29.676328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:29.676770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:29.821163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:29.829110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99ac6fea-c8c9-4a2e-878b-01f0b98bc164 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.166577 Oct 18 16:57:29.829694 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3644/7246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:29 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:30.852963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:30.853915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:30.860912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:30.861443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:30.861885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:30.862589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:30.863051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:30.863491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:31.006235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:31.014932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3c5b53c-25c6-4fb7-b705-40ef912df432 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.166993 Oct 18 16:57:31.015516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3603/7247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:30 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:32.039880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:32.040522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:32.047615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:32.048123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:32.048589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:32.049344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:32.049821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:32.050275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:32.183303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:32.191260 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7680b3dd-0b6d-4052-b713-9373816cf437 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.156098 Oct 18 16:57:32.191767 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3645/7248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:32 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:32.841843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa0577b-f340-40b5-a40e-31a1275fbb03", "name": "network-vif-plugged", "status": "completed", "tag": "ade2a9c2-05d4-4eee-9a11-746fd21553c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:57:32.852307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:32.853415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:32.853415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:32.865838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] Creating event network-vif-plugged:ade2a9c2-05d4-4eee-9a11-746fd21553c1 for instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 on n-h1-858383-14 Oct 18 16:57:32.871560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4322a2f2-87c7-4641-97ca-4845b46f1fcf req-f65167b5-c838-49c0-9d38-8700396cbb35 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116135 Oct 18 16:57:32.872222 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3604/7249] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:57:33.215422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:33.216086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:33.223118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:33.223614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:33.224089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:33.225363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:33.225839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:33.226272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:33.366806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:33.376257 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-188b2978-40dc-4de2-99e0-d1f43316223d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1260 microversion: 2.1 time: 0.164681 Oct 18 16:57:33.376849 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3646/7250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:33 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:34.401549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:34.402329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:34.408758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:34.409359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:34.409822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:34.410597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:34.411068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:34.411497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:34.551981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:34.560802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3f6bfdd-1b56-48f6-8ba3-f17ccb6e8ec9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1446 microversion: 2.1 time: 0.165315 Oct 18 16:57:34.561425 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3605/7251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:34 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:34.583962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:34.585253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:34.592310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:34.592813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:34.593300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:34.594021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:34.594502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:34.594949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:34.738444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:34.746469 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-87a7adb1-31b8-4c54-86ef-bd10996d2dfc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1446 microversion: 2.1 time: 0.166458 Oct 18 16:57:34.747045 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3647/7252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:34 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:57:36.772393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa0577b-f340-40b5-a40e-31a1275fbb03", "tag": "ade2a9c2-05d4-4eee-9a11-746fd21553c1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:57:36.783143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:36.783652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:36.784086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:36.796288 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] Creating event network-changed:ade2a9c2-05d4-4eee-9a11-746fd21553c1 for instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 on n-h1-858383-14 Oct 18 16:57:36.801445 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-45586ebe-2be0-4abb-8bb8-cb3d0c6230eb req-0af1395e-2e1f-48a2-8548-107bca72dc49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Oct 18 16:57:36.802284 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3606/7253] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:59:28.897424 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:59:28.898597 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:59:28.899209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=22 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:28.900579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=54 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:28.901997 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:59:28.902142 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 (ip 10.222.0.78) !!! Oct 18 16:59:28.903235 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:59:28.903355 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 (ip 10.222.0.78) !!! Oct 18 16:59:28.904427 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:59:28.904541 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 16:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 (ip 10.222.0.78) !!! Oct 18 16:59:29.117964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:29.119253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:29.127026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:29.127564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:29.128172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:29.128892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:29.129509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:29.130045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:29.157586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:59:29.239463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4b136a73-6680-4ebf-81ad-4796b1555e5c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 204 len: 0 microversion: 2.1 time: 0.343684 Oct 18 16:59:29.240185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3648/7254] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:59:28 2022] DELETE /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:59:29.247616 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:59:29.249158 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 16:59:29.250137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:29.250879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=50 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:29.252673 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:59:29.252823 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 16:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 (ip 10.222.0.78) !!! Oct 18 16:59:29.261533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:29.262246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:29.271831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:29.272324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:29.272757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:29.273499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:29.273966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:29.274402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:29.552735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:29.561675 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e0cd758-9380-4999-bea9-53cc40f7fef1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1570 microversion: 2.1 time: 0.316102 Oct 18 16:59:29.562272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3607/7255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:29 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1570 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:59:30.585673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:30.586396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:30.602816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:30.603352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:30.604516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:30.605274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:30.605742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:30.606181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:30.610272 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51780. Oct 18 16:59:30.613430 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51778. Oct 18 16:59:30.823239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:30.831251 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-578cbb10-14d5-4e21-8f65-03543be3afa3 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1570 microversion: 2.1 time: 0.249869 Oct 18 16:59:30.831823 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3649/7256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:30 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:31.855728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:31.856369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:31.865417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:31.865915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:31.866547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:31.867261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:31.867729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:31.868463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:31.886565 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51790. Oct 18 16:59:31.887370 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51788. Oct 18 16:59:31.943216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:31.952736 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec3be9b6-8034-4268-bedb-18dba331c940 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1503 microversion: 2.1 time: 0.101519 Oct 18 16:59:31.953380 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3608/7257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:31 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1503 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:32.064262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa0577b-f340-40b5-a40e-31a1275fbb03", "name": "network-vif-deleted", "tag": "ade2a9c2-05d4-4eee-9a11-746fd21553c1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:59:32.075211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:32.075721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:32.076174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:32.089512 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] Creating event network-vif-deleted:ade2a9c2-05d4-4eee-9a11-746fd21553c1 for instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 on n-h1-858383-14 Oct 18 16:59:32.095276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-198529bd-8d2e-4b71-9dfd-31912f9644b2 req-93f04451-09fe-4fb7-a9cc-5aee37fb9623 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090502 Oct 18 16:59:32.099221 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3650/7258] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:59:32.980168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:32.981535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:32.989186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:32.989872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:32.990519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:32.991390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:32.992008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:32.993230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:33.064451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:33.073421 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1bd807e4-91d2-4d72-80ce-dd0bb5458084 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1220 microversion: 2.1 time: 0.098393 Oct 18 16:59:33.074416 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3609/7259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:32 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:34.098242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:34.098971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:34.107512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:34.108018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:34.108504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:34.109255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:34.109849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:34.110301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:34.175210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:34.183787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-afc0388b-9ed5-453f-af02-b04329154172 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1220 microversion: 2.1 time: 0.089823 Oct 18 16:59:34.184363 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3651/7260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:34 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:35.207137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:35.207897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:35.215923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:35.216456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:35.216907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:35.217657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:35.218126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:35.218725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:35.286170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:35.294770 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c54c8a5-4c25-472e-b02f-4295dee8d2b1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1220 microversion: 2.1 time: 0.091439 Oct 18 16:59:35.295376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3610/7261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:35 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:36.316800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:36.317505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:36.324761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:36.325307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:36.325768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:36.326480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:36.326959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:36.327404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:36.359287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:36.359786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:36.360247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:36.360711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 6aa0577b-f340-40b5-a40e-31a1275fbb03 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:59:36.404719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:36.412773 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8c6a7697-a7ad-46ae-b81c-233171274641 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 200 len: 1225 microversion: 2.1 time: 0.099908 Oct 18 16:59:36.413400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3652/7262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:36 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:37.436581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:37.437302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:37.444508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:37.445121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:37.445564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:37.446272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:37.446726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:37.447632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:37.461820 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 HTTP/1.1 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6aa0577b-f340-40b5-a40e-31a1275fbb03'} Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:59:37.464215 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a9e778e-21e5-40b0-8875-74ce3640f03f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 404 len: 111 microversion: 2.1 time: 0.033123 Oct 18 16:59:37.468575 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3611/7263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:37 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:59:37.517686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1399220192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3522167", "security_groups": [{"name": "tempest-secgroup-smoke-292247391"}], "block_device_mapping_v2": [{"uuid": "63bc68f5-4f67-4ef7-a52b-646751bfd053", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:59:37.645500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 16:59:38.096509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:59:38.096951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:59:38.097476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:59:38.097897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:59:38.098321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:59:38.107292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:38.107785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:38.108231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:38.108960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:38.109452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:38.109888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:38.127559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:59:38.132883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:59:38.191688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:59:38.193870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63bc68f5-4f67-4ef7-a52b-646751bfd053',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:59:38.325166 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53db769b-a373-4828-a40b-d7d23acfee5d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811229 Oct 18 16:59:38.325841 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3653/7264] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:59:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:59:38.337077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-79e7372a-93de-4874-9588-355d0d3a4912 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:38.337692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-79e7372a-93de-4874-9588-355d0d3a4912 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:38.394586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-79e7372a-93de-4874-9588-355d0d3a4912 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:38.401750 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-79e7372a-93de-4874-9588-355d0d3a4912 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1092 microversion: 2.1 time: 0.068496 Oct 18 16:59:38.402325 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3612/7265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:38 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:39.427169 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:39.428069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:39.435931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:39.436521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:39.437070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:39.437879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:39.438542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:39.439008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:39.517799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:39.526515 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4e2e42b5-7a31-487e-b1cc-194688e2b1d7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1208 microversion: 2.1 time: 0.104455 Oct 18 16:59:39.526515 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3654/7266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:39 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1208 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:40.548807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:40.549475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:40.558593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:40.559445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:40.559956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:40.560732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:40.561430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:40.562055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:40.703557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:40.712327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-79b4f3b1-0a66-42f9-9086-3afbe85be351 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1275 microversion: 2.1 time: 0.167544 Oct 18 16:59:40.713415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3613/7267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:40 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:40.946631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2288aa5-815b-4288-a3e6-eda4a3dc92ef", "tag": "72da9f30-913f-4133-b0ca-f44111b6aba6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:59:40.961424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:40.961929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:40.963417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:40.977359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] Creating event network-changed:72da9f30-913f-4133-b0ca-f44111b6aba6 for instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef on n-h1-858383-14 Oct 18 16:59:40.984014 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d36dad8b-30e3-4a15-87ec-4035f5ec31b5 req-47d7c91d-abe3-49ea-acd5-80dddea2b8db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059159 Oct 18 16:59:40.985060 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3655/7268] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:59:41.741584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:41.742848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:41.755539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:41.756640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:41.757599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:41.759005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:41.759962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:41.760917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:41.928785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:41.937928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d20a454-c628-46cc-bdea-eea5a730b98b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1275 microversion: 2.1 time: 0.204189 Oct 18 16:59:41.938736 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3614/7269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:41 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:42.963303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:42.964295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:42.971195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:42.971799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:42.972293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:42.973093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:42.973633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:42.974304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:43.119990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:43.129046 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0ecedbd2-80ba-4b10-996d-f8b4a9a6501a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1275 microversion: 2.1 time: 0.171329 Oct 18 16:59:43.129650 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3656/7270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:42 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:44.152199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:44.153021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:44.160429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:44.160929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:44.161402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:44.162136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:44.162633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:44.163066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:44.344940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:44.352845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bf7c634-c1ca-4c2b-8d0c-2ce067db12df tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1275 microversion: 2.1 time: 0.205038 Oct 18 16:59:44.354067 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3615/7271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:44 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:45.376484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:45.377149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:45.385143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:45.385948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:45.386406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:45.387125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:45.387596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:45.388039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:45.524137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:45.532246 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-102f2cd1-921b-4865-ac2a-f3bd3a30250c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.159857 Oct 18 16:59:45.532830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3657/7272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:45 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:46.555733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:46.556399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:46.563459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:46.563939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:46.564374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:46.565091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:46.565551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:46.565971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:46.702596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:46.710416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3af04423-6eac-4a52-b91a-223e40284868 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.158572 Oct 18 16:59:46.710980 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3616/7273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:46 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:47.734062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:47.734699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:47.741681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:47.742186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:47.742650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:47.743354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:47.743879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:47.744395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:47.882349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:47.890422 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f61eea04-2d1c-4bb0-b790-d920553c4d29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.160260 Oct 18 16:59:47.891008 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3658/7274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:47 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:59:48.914817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:48.915425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:48.918732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:48.924193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:48.924682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:48.925146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:48.925844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:48.926303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:48.926726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:49.067426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:49.075451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d956718c-3676-4158-9fbe-206cb5591f29 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.164550 Oct 18 16:59:49.076022 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3617/7275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:48 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:50.098646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:50.099311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:50.101316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:50.102331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:50.109777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:50.110281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:50.110733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:50.111447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:50.111916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:50.112356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:50.251722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:50.260029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9ce44d2-047d-40cb-b251-56e2fcd31a19 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.165010 Oct 18 16:59:50.260655 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3659/7276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:50 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:51.283252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:51.283799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:51.290829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:51.291307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:51.291743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:51.293022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:51.293487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:51.293918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:51.434710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:51.442842 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa810fc4-9414-47ae-a486-2ae34c2c6bb1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.163565 Oct 18 16:59:51.443415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3618/7277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:51 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:52.466938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:52.468015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:52.475275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:52.475761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:52.476208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:52.476911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:52.477409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:52.477843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:52.611728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:52.619710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a98baaba-1b08-4bce-93a0-b9a61007f495 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.157612 Oct 18 16:59:52.620937 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3660/7278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:52 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:53.642805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:53.643404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:53.650534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:53.651536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:53.652158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:53.652852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:53.653337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:53.653795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:53.803154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:53.812266 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f90cc19c-4f8f-4576-9a70-4792678d361d tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.173227 Oct 18 16:59:53.812869 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3619/7279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:53 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:54.835866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:54.836484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:54.843869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:54.844369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:54.844814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:54.845558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:54.846028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:54.846468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:55.001361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:55.009466 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d09eca93-5730-48ec-b455-7eb22d44de75 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.177493 Oct 18 16:59:55.010054 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3661/7280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:54 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:55.561868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2288aa5-815b-4288-a3e6-eda4a3dc92ef", "name": "network-vif-plugged", "status": "completed", "tag": "72da9f30-913f-4133-b0ca-f44111b6aba6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:59:55.575082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:55.575576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:55.576018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:55.587318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] Creating event network-vif-plugged:72da9f30-913f-4133-b0ca-f44111b6aba6 for instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef on n-h1-858383-14 Oct 18 16:59:55.593505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-881e67b6-3a3c-46fa-a755-bc96c3529739 req-f0dcfff1-5cb5-43d2-8628-f612a8d5b92d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094305 Oct 18 16:59:55.594104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3620/7281] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:59:56.032587 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:56.033401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:56.040248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:56.040743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:56.041220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:56.041920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:56.042386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:56.042948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:56.182779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:56.191414 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c393940f-bb2d-41b1-b714-da2d95676dd7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1263 microversion: 2.1 time: 0.162751 Oct 18 16:59:56.192017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3662/7282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:56 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:57.216322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:57.216947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:57.223148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:57.223713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:57.224176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:57.224862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:57.225344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:57.225772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:57.368748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:57.377904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94ec295e-3784-4a39-999a-ace8ab844d51 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1449 microversion: 2.1 time: 0.167535 Oct 18 16:59:57.378497 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3621/7283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:57 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:57.402288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:59:57.402948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:59:57.412036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:57.412529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:57.412989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:57.413716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:57.414181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:57.414617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:57.549623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:59:57.557742 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b07750b3-30bf-4ec7-87c8-931a2624b9bf tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1449 microversion: 2.1 time: 0.159532 Oct 18 16:59:57.558990 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3663/7284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:59:57 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:59:59.463352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2288aa5-815b-4288-a3e6-eda4a3dc92ef", "tag": "72da9f30-913f-4133-b0ca-f44111b6aba6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:59:59.469264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=33 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:59.475525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:59:59.476283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:59:59.477109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:59:59.480637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=77 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:59.490987 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] Creating event network-changed:72da9f30-913f-4133-b0ca-f44111b6aba6 for instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef on n-h1-858383-14 Oct 18 16:59:59.496318 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e4d443d5-e896-4477-99a2-1097c7baa0a5 req-921eefd0-0b91-44c9-9c39-2d0b22892b4b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092647 Oct 18 16:59:59.496938 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3622/7285] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:01:38.990452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:38.991459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:38.996464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-369108729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3522167", "security_groups": [{"name": "tempest-secgroup-smoke-292247391"}], "block_device_mapping_v2": [{"uuid": "f8dd2500-7630-467e-9553-62c8b7acd118", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54019db0-74a9-4f66-948b-c3a9d84df732"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:39.121940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] validate_networks() for [('54019db0-74a9-4f66-948b-c3a9d84df732', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:01:39.612498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:01:39.613463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:01:39.613967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:01:39.614491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:01:39.614954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:01:39.630294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:39.630723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:39.631177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:39.631915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:39.632459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:39.632903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:39.652099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:01:39.657486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Getting quotas for user d1d84bc45eab4331867402556438b14e and project f1c0cd39309c4ba7bfce299a9ee0516a. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:01:39.715601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:01:39.717845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8dd2500-7630-467e-9553-62c8b7acd118',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:01:39.843606 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aad13773-1bdf-40fb-8f59-b53c16c77721 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.856031 Oct 18 17:01:39.850786 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3664/7286] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:01:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:01:39.856019 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:01:39.858488 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:01:39.859111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:39.859849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:39.861169 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:01:39.861415 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 (ip 10.222.0.78) !!! Oct 18 17:01:39.875003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c24a2e8b-4cee-4a4d-9fa5-e11acf4e6408 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:39.875959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c24a2e8b-4cee-4a4d-9fa5-e11acf4e6408 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:39.938869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c24a2e8b-4cee-4a4d-9fa5-e11acf4e6408 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:39.948810 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c24a2e8b-4cee-4a4d-9fa5-e11acf4e6408 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1091 microversion: 2.1 time: 0.096450 Oct 18 17:01:39.949452 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3623/7287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:39 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1091 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:40.972787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5007d2c1-247a-41e4-8b47-0d7419e1bc39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:40.973463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5007d2c1-247a-41e4-8b47-0d7419e1bc39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:41.030504 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5007d2c1-247a-41e4-8b47-0d7419e1bc39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:41.037987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5007d2c1-247a-41e4-8b47-0d7419e1bc39 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1091 microversion: 2.1 time: 0.070190 Oct 18 17:01:41.038572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3665/7288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:40 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:42.060063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:42.060809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:42.072835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:42.073640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:42.074162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:42.074949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:42.075544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:42.076071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:42.082245 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52044. Oct 18 17:01:42.084971 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52046. Oct 18 17:01:42.166520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:42.175512 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1296a80d-299b-46b0-a19a-32aa3d44a842 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1207 microversion: 2.1 time: 0.119241 Oct 18 17:01:42.176730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3624/7289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:42 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1207 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:43.203040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:43.205731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:43.218259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:43.218764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:43.219214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:43.220072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:43.220546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:43.220983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:43.557881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cb6942-f4c9-4a1a-a295-988db85c6943", "tag": "6827ddd8-a883-4d49-acf2-80bd75fa60fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:43.575369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:43.575859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:43.576295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:43.601749 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] Creating event network-changed:6827ddd8-a883-4d49-acf2-80bd75fa60fb for instance 80cb6942-f4c9-4a1a-a295-988db85c6943 on n-h2-858383-14 Oct 18 17:01:43.611255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-13a18568-cddf-4e3b-ac6f-d866da3c6a25 req-0bf1d5b5-1bd9-4f44-b992-dd00f92b0070 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058609 Oct 18 17:01:43.611959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3625/7290] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:01:43.826226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:43.834431 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ceef4d8-37e4-4ad8-aba1-e8c1b2daeb81 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1274 microversion: 2.1 time: 0.638245 Oct 18 17:01:43.835312 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3666/7291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:43 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1274 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:44.859807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:44.860638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:44.870094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:44.870596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:44.871041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:44.871744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:44.872203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:44.872635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:45.015660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:45.024082 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-536a4249-26cd-4275-ba8e-1d108edbc1f7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1274 microversion: 2.1 time: 0.169327 Oct 18 17:01:45.028739 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3626/7292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:44 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:46.048447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:46.049468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:46.057244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:46.057742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:46.058225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:46.058929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:46.059396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:46.059864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:46.191799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:46.200226 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecebeaa7-cee2-47eb-8ec7-00f670ea95ed tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1274 microversion: 2.1 time: 0.156231 Oct 18 17:01:46.200913 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3667/7293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:46 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:47.223961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:47.224577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:47.231463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:47.231944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:47.232381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:47.233088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:47.233545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:47.233969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:47.365278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:47.372910 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7eab7e1-dc84-4189-a28d-7509402b1dc7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.153667 Oct 18 17:01:47.373505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3627/7294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:47 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:48.397663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:48.398287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:48.405049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:48.405550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:48.405995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:48.406691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:48.407155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:48.407592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:48.545750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:48.554091 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-324b1385-65b4-4847-b368-47484014d0e7 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.161260 Oct 18 17:01:48.554668 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3668/7295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:48 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:49.577385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:49.578069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:49.585660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:49.586185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:49.586610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:49.587328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:49.587751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:49.588155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:49.729591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:49.737389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54975173-7938-493e-8e05-5a741aafe66b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.163838 Oct 18 17:01:49.737952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3628/7296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:49 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:01:50.761327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:50.762035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:50.764984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:50.771415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:50.771929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:50.772439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:50.773284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:50.773768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:50.774266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:50.923748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:50.932448 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9e43b231-2362-4500-98ae-a27fb59886ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.175495 Oct 18 17:01:50.933392 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3669/7297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:50 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:51.953367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:51.959072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:51.959694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:51.966249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:51.966734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:51.967173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:51.967867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:51.968330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:51.968756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:52.113570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:52.122233 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94578b18-4f2e-4d3f-bbc4-aa569f85f7f1 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.169787 Oct 18 17:01:52.122959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3629/7298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:51 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:01:53.147857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:53.148495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:53.150374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:53.156367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:53.156875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:53.157379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:53.158092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:53.158573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:53.159016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:53.296299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:53.304360 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be6fae72-e4bf-466e-874b-4ca0e7ea9a10 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.160862 Oct 18 17:01:53.304929 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3670/7299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:53 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:54.327605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:54.328151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:54.335366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:54.335846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:54.336280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:54.336961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:54.337456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:54.337876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:54.483051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:54.491389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2a0aab9a-15cf-49a4-8a26-c64b320f3810 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.167834 Oct 18 17:01:54.491992 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3630/7300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:54 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:55.515048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:55.515672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:55.524714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:55.525241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:55.525694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:55.526578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:55.527056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:55.527523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:55.659485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:55.667774 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d19a69c3-2ca4-4d08-8a69-217c4142e3f2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.156700 Oct 18 17:01:55.668347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3671/7301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:55 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:56.690984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:56.691571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:56.698466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:56.698945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:56.699377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:56.700065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:56.700517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:56.700941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:56.835822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:56.843509 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-124e029b-5693-46b9-bbaa-1c0a96c94690 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.156418 Oct 18 17:01:56.844071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3631/7302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:56 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:57.866605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:57.867254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:57.874053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:57.874549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:57.875009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:57.876040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:57.876508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:57.876950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:58.011692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:58.019405 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d5377817-10a8-4842-9f74-79f7827c6837 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.156675 Oct 18 17:01:58.020798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3672/7303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:57 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:58.422810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80cb6942-f4c9-4a1a-a295-988db85c6943", "name": "network-vif-plugged", "status": "completed", "tag": "6827ddd8-a883-4d49-acf2-80bd75fa60fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:58.447172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:58.447658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:58.448091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:58.460526 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] Creating event network-vif-plugged:6827ddd8-a883-4d49-acf2-80bd75fa60fb for instance 80cb6942-f4c9-4a1a-a295-988db85c6943 on n-h2-858383-14 Oct 18 17:01:58.465759 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-74168893-3c6b-40e7-9590-dea2e60e03f9 req-db9be930-8332-41f0-b5e5-69fbb4b6f60b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046840 Oct 18 17:01:58.466338 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3632/7304] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:01:59.042642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:59.043290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:59.050465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:59.050998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:59.051447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:59.052370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:59.052826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:59.053293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:59.189108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:59.196936 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-caf1cab7-59ce-4d41-b394-b7895e8c76a2 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1262 microversion: 2.1 time: 0.158196 Oct 18 17:01:59.197544 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3673/7305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:59 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:02:00.220610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:02:00.221255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:02:00.229250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:02:00.229732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:02:00.230170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:02:00.230850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:02:00.231306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:02:00.231730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:02:00.368409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:02:00.376474 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e3b02f1c-33d2-420d-97e9-b82fc6116036 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1449 microversion: 2.1 time: 0.160266 Oct 18 17:02:00.377056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3633/7306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:02:00 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:02:00.400057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:02:00.400690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:02:00.407510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:02:00.408010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:02:00.408465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:02:00.409211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:02:00.409685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:02:00.410127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:02:00.542957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:02:00.550857 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7953d2b8-ab31-4cd3-8ee8-ebd6b29c6a46 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1449 microversion: 2.1 time: 0.154752 Oct 18 17:02:00.551438 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3674/7307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:02:00 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:02:02.191512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cb6942-f4c9-4a1a-a295-988db85c6943", "tag": "6827ddd8-a883-4d49-acf2-80bd75fa60fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:02:02.202536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:02:02.203107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:02:02.203618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:02:02.215016 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] Creating event network-changed:6827ddd8-a883-4d49-acf2-80bd75fa60fb for instance 80cb6942-f4c9-4a1a-a295-988db85c6943 on n-h2-858383-14 Oct 18 17:02:02.220095 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fcad612c-aa50-4e44-a88c-23e22cbf8a02 req-51c3fe2b-b164-4fef-9172-27f97f8a591f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032452 Oct 18 17:02:02.220707 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3634/7308] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:34.071964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=26 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:34.073052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:34.073052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:34.073660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=54 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:34.075089 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:03:34.075358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:34.075690 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:03:34.076241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=56 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:34.078060 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:03:34.078443 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 (ip 10.222.0.78) !!! Oct 18 17:03:34.079528 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:03:34.080312 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 (ip 10.222.0.78) !!! Oct 18 17:03:34.092118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.092737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.093311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.094144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.094694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.095049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cb6942-f4c9-4a1a-a295-988db85c6943", "tag": "6827ddd8-a883-4d49-acf2-80bd75fa60fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:34.095219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.108353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.108844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.109316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.122844 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] Creating event network-changed:6827ddd8-a883-4d49-acf2-80bd75fa60fb for instance 80cb6942-f4c9-4a1a-a295-988db85c6943 on n-h2-858383-14 Oct 18 17:03:34.128659 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d925865a-c1bd-428c-b941-b7a10b5bd6fb req-fca70ee8-11dd-4183-a21e-f82eeca58619 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059194 Oct 18 17:03:34.130075 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3635/7309] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:34.130951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:03:34.236921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35ac4a0b-99af-4e91-b7d5-2f4226b90324 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 204 len: 0 microversion: 2.1 time: 0.170834 Oct 18 17:03:34.237990 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3675/7310] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:03:34 2022] DELETE /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:03:34.249447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:34.250164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:34.258183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.258682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.259119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.259855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.260308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.260736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.413191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:34.421348 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f872738-ca75-4ea4-8c3f-d9141d83bbc0 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1574 microversion: 2.1 time: 0.177190 Oct 18 17:03:34.421855 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3636/7311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:34 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:03:35.445788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:35.446526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:35.453657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:35.454163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:35.454624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:35.455336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:35.455814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:35.456260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:35.599636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:35.607700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-155abaa0-a830-4b4e-81a3-9daaafb7b3dc tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1574 microversion: 2.1 time: 0.167025 Oct 18 17:03:35.608299 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3676/7312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:35 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:36.575081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80cb6942-f4c9-4a1a-a295-988db85c6943", "name": "network-vif-deleted", "tag": "6827ddd8-a883-4d49-acf2-80bd75fa60fb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:36.588280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:36.588769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:36.589241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:36.604848 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] Creating event network-vif-deleted:6827ddd8-a883-4d49-acf2-80bd75fa60fb for instance 80cb6942-f4c9-4a1a-a295-988db85c6943 on n-h2-858383-14 Oct 18 17:03:36.610255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-dd9b4dca-51f5-434e-b81f-ff82c9fc08c4 req-f3e910c1-b4fb-4dc8-88ff-607f3f1c49cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038869 Oct 18 17:03:36.610897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3637/7313] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:36.633045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:36.633783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:36.653964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:36.654624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:36.655236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:36.656081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:36.656648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:36.657229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:36.727191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:36.735331 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-57d48a84-daf1-4757-b1bb-54ae2e83a611 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1222 microversion: 2.1 time: 0.106518 Oct 18 17:03:36.735932 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3677/7314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:36 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:37.759599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:37.760203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:37.766518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:37.766996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:37.767432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:37.768115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:37.768570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:37.769010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:37.837491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:37.845535 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-705ad64a-9e92-44d2-8302-7614a65c7b6e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1222 microversion: 2.1 time: 0.091122 Oct 18 17:03:37.846112 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3638/7315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:37 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:03:38.868917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:38.869590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:38.876908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:38.877445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:38.877905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:38.878631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:38.879120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:38.879663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:38.948317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:38.956566 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8bf5d4b-7c7d-4e6e-979a-13eca094b239 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1222 microversion: 2.1 time: 0.091549 Oct 18 17:03:38.957952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3678/7316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:38 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:39.979963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:39.980609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:39.987512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:39.988888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:39.989422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:39.990172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:39.990630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:39.991061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:40.055272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:40.064059 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68fc5bd5-af3c-411a-9226-9f8cca0ef36a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1222 microversion: 2.1 time: 0.087920 Oct 18 17:03:40.064652 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3639/7317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:39 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:41.088307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:41.088960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:41.096301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:41.096795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:41.097286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:41.098646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:41.099110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:41.099549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:41.130540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:41.131020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:41.131467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:41.131926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid 80cb6942-f4c9-4a1a-a295-988db85c6943 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:03:41.176866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:41.184731 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f71f55c-59a8-4f55-9558-0226be24899c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 200 len: 1227 microversion: 2.1 time: 0.100274 Oct 18 17:03:41.185349 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3679/7318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:41 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 1227 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:42.209976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:42.210519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 80cb6942-f4c9-4a1a-a295-988db85c6943] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:42.216680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:42.217523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:42.217969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:42.218654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:42.219107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:42.219533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:42.233279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 HTTP/1.1 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '80cb6942-f4c9-4a1a-a295-988db85c6943'} Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:42.234908 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 80cb6942-f4c9-4a1a-a295-988db85c6943 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eba20f49-c2eb-4cbc-aa24-68bfce766b00 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943" status: 404 len: 111 microversion: 2.1 time: 0.031287 Oct 18 17:03:42.239383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3640/7319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:42 2022] GET /compute/v2.1/servers/80cb6942-f4c9-4a1a-a295-988db85c6943 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:03:48.846489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:48.848496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:48.848884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2288aa5-815b-4288-a3e6-eda4a3dc92ef", "tag": "72da9f30-913f-4133-b0ca-f44111b6aba6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:48.855882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:48.856382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:48.856833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:48.857579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:48.858126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:48.858510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:48.871049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:48.871469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:48.872455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:48.889061 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] Creating event network-changed:72da9f30-913f-4133-b0ca-f44111b6aba6 for instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef on n-h1-858383-14 Oct 18 17:03:48.892695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:03:48.896753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3b8902ca-8f68-4db1-bfdc-5962eec9c72f req-a8ff6c71-a06d-4cde-b426-98be2df7f589 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053484 Oct 18 17:03:48.897711 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3641/7320] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:48.999299 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc020a6a-3a7e-4864-b7f9-0cb33775e45f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 204 len: 0 microversion: 2.1 time: 0.158971 Oct 18 17:03:49.000442 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3680/7321] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:03:48 2022] DELETE /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 17:03:49.016644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:49.017553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:49.025814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:49.026660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:49.027423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:49.028378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:49.029267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:49.030004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:49.186030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:49.196257 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ab3f9306-1d6e-438c-9919-6593f18c12d8 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1574 microversion: 2.1 time: 0.185122 Oct 18 17:03:49.196954 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3642/7322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:49 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:50.225908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:50.226885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:50.235323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:50.235908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:50.236275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:50.237007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:50.237481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:50.237954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:50.414908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:50.422813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0a841c0d-1e2d-40c8-98db-bfa2b0b2957a tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1574 microversion: 2.1 time: 0.203148 Oct 18 17:03:50.423400 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3681/7323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:50 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:51.313227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2288aa5-815b-4288-a3e6-eda4a3dc92ef", "name": "network-vif-deleted", "tag": "72da9f30-913f-4133-b0ca-f44111b6aba6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:51.327026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:51.328466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:51.328906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:51.343416 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] Creating event network-vif-deleted:72da9f30-913f-4133-b0ca-f44111b6aba6 for instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef on n-h1-858383-14 Oct 18 17:03:51.349978 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5cb9fcd7-efb4-4872-bd30-c79f6881acbe req-41b01401-8c9c-4ced-8437-1a4ab5579eec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040634 Oct 18 17:03:51.350619 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3643/7324] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:03:51.450808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:51.452097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:51.463982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:51.464826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:51.465988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:51.467651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:51.467651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:51.468486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:51.558817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:51.567551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-962cf399-46b6-48a6-8bd0-e04b50a9ea90 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1223 microversion: 2.1 time: 0.123130 Oct 18 17:03:51.568293 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3682/7325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:51 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:03:52.599430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:52.600146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:52.606472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:52.606964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:52.607403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:52.608108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:52.608569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:52.609017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:52.674986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:52.685273 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50290a63-c457-4edd-8dbf-bdbbf74200ba tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1223 microversion: 2.1 time: 0.092010 Oct 18 17:03:52.686158 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3644/7326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:52 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:53.708905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:53.709593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:53.716575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:53.717112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:53.717571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:53.718294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:53.718770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:53.719219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:53.794005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:53.802848 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cd3af273-7f92-4457-a722-4e6a5820bea9 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1223 microversion: 2.1 time: 0.098566 Oct 18 17:03:53.803459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3683/7327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:53 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:54.826228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:54.826861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:54.834881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:54.835374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:54.835824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:54.836533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:54.837007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:54.837460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:54.910914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:54.919085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9543998e-64d0-4afd-9103-a3ee4728f4bd tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1223 microversion: 2.1 time: 0.096807 Oct 18 17:03:54.919668 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3645/7328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:54 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:55.943084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:55.943839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:55.951357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:55.952732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:55.953527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:55.954266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:55.954739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:55.955182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:55.990351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:55.990351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:55.990671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:55.990983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lazy-loading 'fault' on Instance uuid c2288aa5-815b-4288-a3e6-eda4a3dc92ef {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:03:56.037049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d84bc45eab4331867402556438b14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:56.045562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b238022a-805a-4899-a27c-08de7c81555f tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 200 len: 1182 microversion: 2.1 time: 0.106529 Oct 18 17:03:56.046329 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3684/7329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:55 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 1182 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:57.070461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:57.071071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: c2288aa5-815b-4288-a3e6-eda4a3dc92ef] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:57.078124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.078620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.079060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.079780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.080244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.080668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.095589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef HTTP/1.1 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c2288aa5-815b-4288-a3e6-eda4a3dc92ef'} Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.097308 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance c2288aa5-815b-4288-a3e6-eda4a3dc92ef could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c43d1020-634c-4e77-a09c-347cc869109e tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef" status: 404 len: 111 microversion: 2.1 time: 0.032916 Oct 18 17:03:57.101368 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3646/7330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:57 2022] GET /compute/v2.1/servers/c2288aa5-815b-4288-a3e6-eda4a3dc92ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:03:57.589610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:57.590123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:57.597225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.597772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.598228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.598938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.599420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.599865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.613945 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 HTTP/1.1 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '6aa0577b-f340-40b5-a40e-31a1275fbb03'} Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:03:57.615636 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-93cb1ac5-c9a5-4c25-ba0a-ea2420943d7b tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 404 len: 111 microversion: 2.1 time: 0.031494 Oct 18 17:03:57.619920 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3685/7331] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:03:57 2022] DELETE /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:03:57.626476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:57.627097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] [instance: 6aa0577b-f340-40b5-a40e-31a1275fbb03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:57.634340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.634828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.635269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.635964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:57.636424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:57.636855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:57.650950 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] HTTP exception thrown: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Request method failure captured: Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 HTTP/1.1 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtnyt2Cw7fIqygpb3r-TfzSVRKlssiEE7Ug-3_alYqEZxXGkYrKgr9f__pWdanNipcg8khqBAvIaVZOs2qHc0EVC65d0ov9iua2gdU90e82yi-J84F4lMt-S4MkkRQrsgZps_DSBVffHj6ikE2j6z25avRkBtlhf0Rqz8_t-FHuGvNM Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1c0cd39309c4ba7bfce299a9ee0516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1c0cd39309c4ba7bfce299a9ee0516a"}]}] Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f1c0cd39309c4ba7bfce299a9ee0516a Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048886178 Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: d1d84bc45eab4331867402556438b14e Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestVolumeBootPattern-2048886178-project Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '6aa0577b-f340-40b5-a40e-31a1275fbb03'} Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:03:57.652494 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Returning 404 to user: Instance 6aa0577b-f340-40b5-a40e-31a1275fbb03 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-986ecc3b-5cc1-46eb-933e-ade8f7316449 tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03" status: 404 len: 111 microversion: 2.1 time: 0.031676 Oct 18 17:03:57.660778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3647/7332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:57 2022] GET /compute/v2.1/servers/6aa0577b-f340-40b5-a40e-31a1275fbb03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:04:01.101686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-56d66ec4-dd37-45f7-a854-6b759a74d27c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] Calling method '.version_select at 0x7f5fd1101940>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:01.142833 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-56d66ec4-dd37-45f7-a854-6b759a74d27c tempest-TestVolumeBootPattern-2048886178 tempest-TestVolumeBootPattern-2048886178-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-3522167" status: 202 len: 0 microversion: 2.1 time: 0.045647 Oct 18 17:04:01.143442 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3686/7333] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 17:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-3522167 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:04:20.328186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=26 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.328936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=50 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.465777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1642682922", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:20.520937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] validate_networks() for None {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:04:20.717360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:04:20.717780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:04:20.718255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:04:20.718670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:04:20.719083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:04:20.729765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:20.730280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:20.730770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:20.731593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:20.732088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:20.732519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:20.753701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Getting quotas for project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:04:20.759858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Getting quotas for user 67e4bd35d43546fa8b05663559f01a9c and project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:04:20.773694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:04:20.776095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:04:20.825892 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf6c674d-efa2-4137-9199-7d65be37a2d0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502794 Oct 18 17:04:20.826672 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3648/7334] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:04:20.838424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.839811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.843969 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7392b55-312e-46e0-a313-977d5fcca0cc tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:20.844641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7392b55-312e-46e0-a313-977d5fcca0cc tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:20.911027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7392b55-312e-46e0-a313-977d5fcca0cc tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:20.918274 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7392b55-312e-46e0-a313-977d5fcca0cc tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1222 microversion: 2.1 time: 0.081526 Oct 18 17:04:20.919449 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3687/7335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:20 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:21.943638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:21.944253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:21.951397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:21.951890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:21.952336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:21.953072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:21.953541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:21.953976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:22.018600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:22.028916 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc4d14c3-fc2e-4696-8e9a-309f5f668b40 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1274 microversion: 2.1 time: 0.089907 Oct 18 17:04:22.030100 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3649/7336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:21 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:23.055070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:23.055652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:23.062819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:23.063339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:23.063800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:23.065320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:23.065974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:23.066427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:23.648336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:23.656389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b4e4246-cbdc-4492-afed-25c89fdea526 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.605423 Oct 18 17:04:23.657006 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3688/7337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:23 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:24.069737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c61e15-2571-40e5-ade2-1949b5d5ba07", "tag": "eefcdd00-ea3d-4237-81df-83b1f85cc03b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:24.087154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:24.087154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:24.087154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:24.098513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] Creating event network-changed:eefcdd00-ea3d-4237-81df-83b1f85cc03b for instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 on n-h1-858383-14 Oct 18 17:04:24.105236 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1a42af72-2af4-4392-ab97-5893219f08e9 req-853447c3-6c15-4b68-9dfc-fcded148ac21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045549 Oct 18 17:04:24.106047 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3650/7338] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:24.681729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:24.682354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:24.689500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:24.690503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:24.690951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:24.691658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:24.692127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:24.692562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:24.832965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:24.841032 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7b5a9d5-f855-4632-a265-53a8847a59c1 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.163241 Oct 18 17:04:24.841625 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3689/7339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:24 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:25.865569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:25.866277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:25.873923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:25.874412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:25.874853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:25.875547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:25.876248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:25.876683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:26.006834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:26.014524 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-60f1bbe9-8cb8-4df6-8106-ccbacddbdf3b tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.153304 Oct 18 17:04:26.015097 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3651/7340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:25 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:27.036569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:27.037135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:27.044116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:27.044629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:27.045250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:27.045977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:27.046454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:27.046902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:27.180126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:27.188057 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-310d4873-16b4-45c1-85d0-fea619384fc5 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.155430 Oct 18 17:04:27.188641 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3690/7341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:27 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:28.211783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:28.212330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:28.219214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:28.219697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:28.220134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:28.221361 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:28.221821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:28.222240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:28.357434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:28.365305 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea65e88d-1ec0-4451-9865-e3fe452ab681 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.157450 Oct 18 17:04:28.365894 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3652/7342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:28 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:29.388555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:29.389220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:29.396759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:29.397388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:29.397842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:29.398569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:29.399043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:29.399484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:29.537858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:29.545795 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4a76c9d3-3618-4d38-8984-9a7c76e87141 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.161160 Oct 18 17:04:29.546910 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3691/7343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:29 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:30.569250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:30.570018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:30.576743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:30.577300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:30.577811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:30.578522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:30.579042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:30.579478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:30.693672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c61e15-2571-40e5-ade2-1949b5d5ba07", "name": "network-vif-plugged", "status": "completed", "tag": "eefcdd00-ea3d-4237-81df-83b1f85cc03b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:30.704101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:30.704597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:30.705058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:30.720820 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] Creating event network-vif-plugged:eefcdd00-ea3d-4237-81df-83b1f85cc03b for instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 on n-h1-858383-14 Oct 18 17:04:30.727071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-7b4c4203-b760-4acf-a193-d36dffda1cd6 req-125d4fa7-a178-45d6-843e-f9f76722b6ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Oct 18 17:04:30.727683 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3692/7344] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:30.743815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:30.766355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:30.832808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:30.841384 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c8eaed8-e3df-4703-a54d-8ce8a4279a6a tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.276028 Oct 18 17:04:30.841967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3653/7345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:30 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:31.861489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:31.866599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:31.867308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:31.873836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:31.874333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:31.874783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:31.875478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:31.875941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:31.876629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:32.066880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:32.074640 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-165c442d-945e-40c2-9e4c-d3fd946a334c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1322 microversion: 2.1 time: 0.214226 Oct 18 17:04:32.075213 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3693/7346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:31 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:33.098306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:33.099000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:33.105752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.106267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.106709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.107406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.107870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.108300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.241657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:33.249460 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91928420-a3a5-4a6f-b5b5-ed2657b0f041 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1472 microversion: 2.1 time: 0.155654 Oct 18 17:04:33.249976 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3654/7347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:33 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:04:33.324536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9860f892-12f3-484c-97ee-90b9f91966f7 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '.version_select at 0x7f5fd1130790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:33.389531 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9860f892-12f3-484c-97ee-90b9f91966f7 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/86b3e67110a842468e7cb0b06e283c0a" status: 200 len: 371 microversion: 2.1 time: 0.117769 Oct 18 17:04:33.390104 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3694/7348] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 17:04:33 2022] GET /compute/v2.1/os-quota-sets/86b3e67110a842468e7cb0b06e283c0a => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:33.402781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7ba8c15a-fa4b-4221-8d5a-8833a925d913 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1860426312", "id": 176567407, "os-flavor-access:is_public": "True"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:33.420291 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7ba8c15a-fa4b-4221-8d5a-8833a925d913 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021272 Oct 18 17:04:33.420868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3655/7349] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:04:33 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:33.433112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "176567407"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:33.435362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:33.441802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.442295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.442744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.443440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.443905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.444343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.533804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6489a248796748aeaf0d7b220ddf0f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b3e67110a842468e7cb0b06e283c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:33.540476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1860426312 {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:04:33.547543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.548034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.548479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.549245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.549713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.550673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.571670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Getting quotas for project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:04:33.576871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Getting quotas for user 67e4bd35d43546fa8b05663559f01a9c and project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:04:33.589548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] ram quota exceeded for 86b3e67110a842468e7cb0b06e283c0a, tried to resize instance. Oct 18 17:04:33.590109 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Request method failure captured: Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action HTTP/1.1 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 38 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtyUGmmyr4XgYaQiw4Ml5E7tw__FDeqgwxbA61pVxXPpvcrSoQjQIOANgb0jtyI1SqirBD90NpQb4UGGQrxFQm43Xj38mQgc63lYv52PbhZ-fOG9p-h3kLKvw1UDo6SvQ5vV4l3TrQtO4ATIplCz6ZUzxThg7--Wp4KMWQSbRJm6Db4 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 86b3e67110a842468e7cb0b06e283c0a Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader,admin Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader,admin Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b3e67110a842468e7cb0b06e283c0a"}]}] Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 86b3e67110a842468e7cb0b06e283c0a Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersAdminNegativeTestJSON-1942844947-project-admin Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 6489a248796748aeaf0d7b220ddf0f1c Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1942844947-project-admin Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: {"resize": {"flavorRef": "176567407"}} Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'b9c61e15-2571-40e5-ade2-1949b5d5ba07', 'body': {'resize': {'flavorRef': '176567407'}}} Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:33.592187 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fd3efedf-ed20-48b2-94b1-c258cc45226d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action" status: 403 len: 118 microversion: 2.1 time: 0.164517 Oct 18 17:04:33.596571 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3695/7350] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:04:33 2022] POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action => generated 118 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:04:33.603274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5fd4910b-cdd7-4430-928c-01497769ad72 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:33.619818 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5fd4910b-cdd7-4430-928c-01497769ad72 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/176567407" status: 202 len: 0 microversion: 2.1 time: 0.020335 Oct 18 17:04:33.620374 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3656/7351] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 17:04:33 2022] DELETE /compute/v2.1/flavors/176567407 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:04:33.628454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65f5eea0-563d-4987-9b11-6aa2bcadd44e tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:33.649281 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65f5eea0-563d-4987-9b11-6aa2bcadd44e tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024703 Oct 18 17:04:33.649965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3696/7352] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 17:04:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:33.670510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8bde98b3-240b-46da-bc65-0b1ce3a55224 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '.version_select at 0x7f5fd290c8b0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:33.738096 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8bde98b3-240b-46da-bc65-0b1ce3a55224 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/86b3e67110a842468e7cb0b06e283c0a" status: 200 len: 371 microversion: 2.1 time: 0.071262 Oct 18 17:04:33.738691 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3657/7353] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 17:04:33 2022] GET /compute/v2.1/os-quota-sets/86b3e67110a842468e7cb0b06e283c0a => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:33.750580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d071d47d-fd29-44d5-b7c7-64ee91f29838 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-689648966", "id": 2019582259, "os-flavor-access:is_public": "True"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:33.769393 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d071d47d-fd29-44d5-b7c7-64ee91f29838 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022024 Oct 18 17:04:33.770026 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3697/7354] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:04:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:33.782375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2019582259"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:33.785307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:33.791291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.791781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.792222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.792919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.793409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.793843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.960581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6489a248796748aeaf0d7b220ddf0f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b3e67110a842468e7cb0b06e283c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:33.966816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-689648966 {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:04:33.974277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.974616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.975055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.975789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:33.976247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:33.976677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:33.998901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Getting quotas for project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:04:34.005340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Getting quotas for user 67e4bd35d43546fa8b05663559f01a9c and project 61b0c7bca57442c5a27df4586ea9c1b7. Resources: {'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:04:34.018728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.compute.api [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] cores quota exceeded for 86b3e67110a842468e7cb0b06e283c0a, tried to resize instance. Oct 18 17:04:34.019362 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Request method failure captured: Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action HTTP/1.1 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 39 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtyUGmmyr4XgYaQiw4Ml5E7tw__FDeqgwxbA61pVxXPpvcrSoQjQIOANgb0jtyI1SqirBD90NpQb4UGGQrxFQm43Xj38mQgc63lYv52PbhZ-fOG9p-h3kLKvw1UDo6SvQ5vV4l3TrQtO4ATIplCz6ZUzxThg7--Wp4KMWQSbRJm6Db4 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 86b3e67110a842468e7cb0b06e283c0a Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader,admin Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader,admin Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b3e67110a842468e7cb0b06e283c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b3e67110a842468e7cb0b06e283c0a"}]}] Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 86b3e67110a842468e7cb0b06e283c0a Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1942844947 Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-1942844947-project-admin Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 6489a248796748aeaf0d7b220ddf0f1c Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1942844947-project-admin Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: {"resize": {"flavorRef": "2019582259"}} Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9c61e15-2571-40e5-ade2-1949b5d5ba07', 'body': {'resize': {'flavorRef': '2019582259'}}} Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:34.021669 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6279a994-12d3-4eeb-8ac5-70bdcbbdc4df tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action" status: 403 len: 113 microversion: 2.1 time: 0.244838 Oct 18 17:04:34.026132 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3658/7355] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:04:33 2022] POST /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07/action => generated 113 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:04:34.033706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6841f9f1-33f5-4f19-8abe-333f8f7c31a6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:34.052598 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6841f9f1-33f5-4f19-8abe-333f8f7c31a6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2019582259" status: 202 len: 0 microversion: 2.1 time: 0.024025 Oct 18 17:04:34.053280 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3698/7356] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 18 17:04:34 2022] DELETE /compute/v2.1/flavors/2019582259 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:04:34.061270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b3151935-12c9-4b9e-bb5f-be07f52cf43d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:34.082275 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b3151935-12c9-4b9e-bb5f-be07f52cf43d tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024113 Oct 18 17:04:34.082879 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3659/7357] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 17:04:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:04:34.104664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:34.105223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:34.111276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:34.111779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:34.112241 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:34.113762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:34.114244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:34.114693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:34.140400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:04:34.217359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c02d7507-5e22-4119-8a1b-11bc1d85094c tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 204 len: 0 microversion: 2.1 time: 0.116335 Oct 18 17:04:34.218047 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3699/7358] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:04:34 2022] DELETE /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:04:34.226576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:34.227211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:34.234127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:34.234613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:34.235053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:34.235741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:34.236201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:34.236630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:34.374785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:34.383504 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-419b48ce-7954-4117-9aac-c545c735b2f0 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1478 microversion: 2.1 time: 0.160955 Oct 18 17:04:34.384074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3660/7359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:34 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:35.407132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:35.407857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:35.415955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:35.416450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:35.417224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:35.417638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:35.418107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:35.418547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:35.550854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:35.558765 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fe23d9c-3b89-4d6b-ae78-6604a1a96e24 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1478 microversion: 2.1 time: 0.155947 Oct 18 17:04:35.559353 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3700/7360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:35 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:36.353816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c61e15-2571-40e5-ade2-1949b5d5ba07", "name": "network-vif-deleted", "tag": "eefcdd00-ea3d-4237-81df-83b1f85cc03b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:36.365095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:36.365909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:36.367189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:36.384075 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] Creating event network-vif-deleted:eefcdd00-ea3d-4237-81df-83b1f85cc03b for instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 on n-h1-858383-14 Oct 18 17:04:36.390843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d00bc082-6ace-48b2-936f-d007cb9b3148 req-dc3fe72e-f23b-4ed3-9e54-d4b6b6089b99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104564 Oct 18 17:04:36.392401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3661/7361] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:36.582655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:36.583302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:36.590215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:36.590703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:36.591151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:36.591844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:36.592601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:36.593064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:36.624749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:36.625273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:36.625723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:36.626438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lazy-loading 'fault' on Instance uuid b9c61e15-2571-40e5-ade2-1949b5d5ba07 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:04:36.667581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e4bd35d43546fa8b05663559f01a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b0c7bca57442c5a27df4586ea9c1b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:36.676014 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-65467b08-a0ef-483d-954d-abb6541edc0e tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 200 len: 1312 microversion: 2.1 time: 0.096924 Oct 18 17:04:36.676739 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3701/7362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:36 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:37.700923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:37.701682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] [instance: b9c61e15-2571-40e5-ade2-1949b5d5ba07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:37.709613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:37.710097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:37.710537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:37.711228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:37.711682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:37.712110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:37.725503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] HTTP exception thrown: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Request method failure captured: Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 HTTP/1.1 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtyTIpr7DcRIMdVkoUZUV31GMJWR6QydrWP2b0MX4t81wzDjvsWJlZ9u0oBGixoxvpqVRd9U5VqSGSdW3onb0JZ18ZBEblpHUWdAtbgViE0scI4ikMdHUAfWwa-T3rsWMXtd9GZfdmqmIxrbAPzvV8FN9MmdriuKrpABLjInXGiqWeE Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 61b0c7bca57442c5a27df4586ea9c1b7 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490244597 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61b0c7bca57442c5a27df4586ea9c1b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61b0c7bca57442c5a27df4586ea9c1b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61b0c7bca57442c5a27df4586ea9c1b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61b0c7bca57442c5a27df4586ea9c1b7"}]}] Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490244597 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 61b0c7bca57442c5a27df4586ea9c1b7 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490244597 Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersAdminNegativeTestJSON-1490244597-project Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 67e4bd35d43546fa8b05663559f01a9c Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490244597-project Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'b9c61e15-2571-40e5-ade2-1949b5d5ba07'} Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:37.727111 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] Returning 404 to user: Instance b9c61e15-2571-40e5-ade2-1949b5d5ba07 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b50f710e-873c-4e1b-b1d3-49b3830613b9 tempest-ServersAdminNegativeTestJSON-1490244597 tempest-ServersAdminNegativeTestJSON-1490244597-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07" status: 404 len: 111 microversion: 2.1 time: 0.031957 Oct 18 17:04:37.731701 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3662/7363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:37 2022] GET /compute/v2.1/servers/b9c61e15-2571-40e5-ade2-1949b5d5ba07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:04:43.833416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:43.834203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:43.962130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1800373669", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "60437173-5441-4765-a518-827237a6f217"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:44.021312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] validate_networks() for [('60437173-5441-4765-a518-827237a6f217', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:04:44.431280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:04:44.431719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:04:44.432210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:04:44.432666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:04:44.433135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:04:44.443206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:44.443707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:44.444163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:44.444905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:44.445403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:44.445852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:44.463355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Getting quotas for project a9ad5c546e4347e8b509097ff87db145. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:04:44.468557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Getting quotas for user 5736d7229efa498ab1e3ad6676b239a9 and project a9ad5c546e4347e8b509097ff87db145. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:04:44.481371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:04:44.483698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:04:44.527830 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [6283e544-4afa-4ae4-bfd8-aa385d8ccf5a] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:04:45.536850 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [6283e544-4afa-4ae4-bfd8-aa385d8ccf5a] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52514. Oct 18 17:04:45.541203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96302f53-be51-4c6f-8956-73e4c406b79e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714906 Oct 18 17:04:45.541950 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3702/7364] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:04:45.553713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc45c400-334b-4ba0-947e-378e2e689d3d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:45.554344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc45c400-334b-4ba0-947e-378e2e689d3d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:45.558111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:45.558935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:45.617865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc45c400-334b-4ba0-947e-378e2e689d3d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:45.625575 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc45c400-334b-4ba0-947e-378e2e689d3d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1215 microversion: 2.1 time: 0.076409 Oct 18 17:04:45.626763 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3663/7365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:45 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:46.650490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:46.651128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:46.659282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:46.660628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:46.661210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:46.661936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:46.662406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:46.662848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:46.744656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:46.753361 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15dd0ee8-a2d5-4bee-8570-ec6fee7f1ed5 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1267 microversion: 2.1 time: 0.107252 Oct 18 17:04:46.759872 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3703/7366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:46 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:47.777374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:47.778113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:47.780956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=57 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:47.793037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:47.793978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:47.795403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:47.796572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:47.797291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:47.798962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:47.939658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:47.948415 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0f8aa5e1-7f6b-4aa7-b06f-a739bb8eac8d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.175045 Oct 18 17:04:47.949012 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3664/7367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:47 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:48.311543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:48.322042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:48.322548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:48.322998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:48.335163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] Creating event network-changed:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h1-858383-14 Oct 18 17:04:48.340177 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a68015de-530b-4b94-ba2e-a3bb20e5ff04 req-8508ff98-169b-4967-92a1-8e713a5f6a5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032359 Oct 18 17:04:48.340980 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3704/7368] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:48.971735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:48.972347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:48.979224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:48.979709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:48.980150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:48.980841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:48.981326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:48.981757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:49.115475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:49.123370 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cf7da089-23db-498a-8d75-efc3fd2ca77a tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.155534 Oct 18 17:04:49.123950 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3665/7369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:48 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:50.149718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:50.150443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:50.156755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:50.157310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:50.157775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:50.158487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:50.158961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:50.159418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:50.295303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:50.303266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15cf7538-6cbc-471d-9813-a71960407977 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.159256 Oct 18 17:04:50.303831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3705/7370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:50 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:51.326028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:51.326674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:51.329402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:51.336116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:51.336605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:51.337066 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:51.337767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:51.338221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:51.338650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:51.473605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:51.481360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ffdd28fc-0972-42c2-b2d4-1a7497969fe4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.159203 Oct 18 17:04:51.481936 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3666/7371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:51 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:52.504432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:52.505079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:52.507872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:52.513553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:52.514082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:52.514530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:52.515235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:52.515705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:52.516138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:52.521833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:52.658943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:52.667784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f311249-a270-47df-ab25-16a33221d201 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.167731 Oct 18 17:04:52.668378 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3706/7372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:52 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:53.690581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:53.691872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:53.698906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:53.699398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:53.699843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:53.700543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:53.701028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:53.701482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:53.836451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:53.844201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e292cd71-7015-4811-97a3-a0dcc9fe26a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.157516 Oct 18 17:04:53.844782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3667/7373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:53 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:54.784006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "name": "network-vif-plugged", "status": "completed", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:54.790428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:54.791246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:54.799837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:54.800402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:54.800865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:54.812824 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] Creating event network-vif-plugged:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h1-858383-14 Oct 18 17:04:54.818179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2a79eb16-c62e-46d2-b8c3-656ce24b4f0f req-2361fe99-068e-4498-abc3-28a3a34c90e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037877 Oct 18 17:04:54.818994 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3707/7374] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:04:54.867973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:54.868609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:54.875698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:54.876440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:54.876887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:54.877622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:54.878086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:54.878559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:55.014990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:55.023582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c10684d9-084d-4c90-aade-359016b775a0 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.159763 Oct 18 17:04:55.024261 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3668/7375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:54 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:56.046838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:56.047607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:56.055509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:56.056009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:56.056455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:56.057200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:56.057667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:56.058112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:56.194030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:56.201821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d20d9a2-7449-4323-b041-9c70be06e72d tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1315 microversion: 2.1 time: 0.159544 Oct 18 17:04:56.202391 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3708/7376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:56 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:57.224501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:57.225182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:57.227096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:57.233690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.234185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.234632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.235330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.235795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.236228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.368087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:57.375903 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5079b378-6089-4b12-82b8-8024a5aaf7dd tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1502 microversion: 2.1 time: 0.155695 Oct 18 17:04:57.376679 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3669/7377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:57 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:57.399989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:04:57.402386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:57.410129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.410645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.411091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.411790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.412255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.412687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.444108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:57.449548 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:04:57.455955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:04:57.457462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:04:57.457800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:04:57.458218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:04:57.458639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:04:57.524835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dbd6d67f-33c3-4311-8831-3c0f02ffdd58 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "POST /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f/action" status: 202 len: 0 microversion: 2.1 time: 0.128715 Oct 18 17:04:57.525569 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3709/7378] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:04:57 2022] POST /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:04:57.533783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:57.534399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:57.540571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.541089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.541524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.542213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:57.542668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:57.543267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:57.685585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:57.694176 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8162af53-dc0e-4cc1-bedf-a7ecd5da96a2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1511 microversion: 2.1 time: 0.164369 Oct 18 17:04:57.694944 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3670/7379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:57 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:58.717277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:58.718013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:58.725896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:58.726402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:58.726855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:58.727562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:58.728033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:58.728475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:58.861150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:04:58.869655 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61ab55e8-ae55-4868-bd6d-828962d01dab tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1511 microversion: 2.1 time: 0.157182 Oct 18 17:04:58.870255 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3710/7380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:58 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:04:59.893331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:04:59.894021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:04:59.901694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:59.902185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:59.902629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:04:59.903329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:04:59.903786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:04:59.904217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:00.038344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:00.046357 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4eae1bef-8c9d-479e-90e4-99f8d4e6b729 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.157030 Oct 18 17:05:00.046940 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3671/7381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:04:59 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:01.069578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:01.070225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:01.076523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:01.077049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:01.077502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:01.078202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:01.078669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:01.079107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:01.207597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:01.215429 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ad2f85d-89d8-4174-90c6-e07a031671d6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.149743 Oct 18 17:05:01.216012 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3711/7382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:01 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:02.238648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:02.239171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:02.246798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:02.247286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:02.247728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:02.248425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:02.248885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:02.249342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:02.383530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:02.391270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2fc3074a-2ca5-4d0a-a491-4085a148b146 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.156642 Oct 18 17:05:02.391845 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3672/7383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:02 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:03.414188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:03.414810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:03.421658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:03.422155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:03.422603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:03.423303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:03.423771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:03.424209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:03.554227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:03.561935 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-375583ef-b9ea-4c0e-b69b-a15e0c082cdc tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.151776 Oct 18 17:05:03.562501 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3712/7384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:03 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:04.586961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:04.587566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:04.594397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:04.594873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:04.595307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:04.595984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:04.596440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:04.596866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:04.734768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:04.744090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dc71fea4-04ca-4d90-9254-b58c19f52479 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.161654 Oct 18 17:05:04.744684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3673/7385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:04 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:05.767766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:05.768395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:05.775714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:05.776213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:05.776795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:05.777578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:05.778060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:05.778505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:05.908862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:05.917296 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe1b6055-348e-47e1-8151-de2743f963fe tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.153429 Oct 18 17:05:05.917875 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3713/7386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:05 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:06.940608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:06.941260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:06.948727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:06.949263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:06.949712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:06.950422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:06.950889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:06.951325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:07.083623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:07.091749 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db4960e6-86cc-4e08-9557-8233a002e538 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.155178 Oct 18 17:05:07.092323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3674/7387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:06 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:08.115341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:08.116511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:08.123448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:08.123997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:08.124437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:08.125185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:08.125663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:08.126107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:08.255720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:08.264224 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e813e34f-3645-4c28-b605-79bfdf38c515 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.152775 Oct 18 17:05:08.264801 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3714/7388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:08 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:09.287770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:09.289265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:09.295917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:09.296411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:09.296864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:09.297600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:09.298069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:09.298506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:09.433290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:09.441062 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-580600d0-eadf-45dc-bb73-ecff88546f8f tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.157187 Oct 18 17:05:09.441643 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3675/7389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:09 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:10.464883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:10.465477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:10.472295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:10.472787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:10.473276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:10.473975 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:10.474441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:10.474880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:10.961979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:10.969841 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5e9a05f5-1605-4e7b-ae59-6a54223910e6 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.509848 Oct 18 17:05:10.970438 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3715/7390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:10 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:11.994367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:11.994991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:12.002098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.002589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.003037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.003737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.004203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.004638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.137174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:12.144884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-740aa760-3d2f-45d4-b185-487c39496a20 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.155095 Oct 18 17:05:12.145484 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3676/7391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:11 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:13.168599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:13.169355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:13.176352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:13.176848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:13.177333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:13.178031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:13.178495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:13.178932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:13.309704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:13.317410 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb955444-37e4-464a-b4ee-6acd4ec336ed tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.152665 Oct 18 17:05:13.317986 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3716/7392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:13 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:14.342233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:14.342849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:14.350405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:14.350935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:14.352179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:14.352945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:14.353450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:14.353884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:14.496129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:14.504260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-201dd248-dc1c-4031-8c46-68892cbba744 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.165944 Oct 18 17:05:14.504836 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3677/7393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:14 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:15.527901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:15.528559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:15.536120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:15.536618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:15.537104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:15.537814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:15.538285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:15.538730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:15.671883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:15.680702 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03d025ff-2ac4-4fbd-9b16-84e43cf17855 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.156708 Oct 18 17:05:15.681317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3717/7394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:15 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:16.705316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:16.705936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:16.713039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:16.713533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:16.713967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:16.714653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:16.715105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:16.715532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:16.846001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:16.854587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b7976a5f-4c14-44f2-801e-ae199179c785 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.153203 Oct 18 17:05:16.855180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3678/7395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:16 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:17.878865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:17.879500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:17.887085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:17.887586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:17.888039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:17.888746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:17.889273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:17.889720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:18.019878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:18.027782 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ea8538d-65c4-411d-849f-a74852ea648c tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.153077 Oct 18 17:05:18.028386 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3718/7396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:17 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:19.051548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:19.052170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:19.059455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:19.059944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:19.060384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:19.061112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:19.061574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:19.062007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:19.065948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=91 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:19.196224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:19.203973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55fbdf73-317a-489d-a815-ed03623ddceb tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.156309 Oct 18 17:05:19.204551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3679/7397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:19 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:20.231170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:20.231707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:20.238663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:20.239166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:20.239625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:20.240334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:20.240805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:20.241280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:20.368896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:20.376949 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-027ad0be-64a5-44df-966c-8fd39cbec1a4 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.151879 Oct 18 17:05:20.377550 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3719/7398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:20 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:21.399849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:21.400487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:21.403334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=28 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:21.408767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:21.409285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:21.409730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:21.410433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:21.410915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:21.411325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:21.548114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:21.556355 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-177195ed-d4db-416c-839d-4ecacbaad0c3 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.160504 Oct 18 17:05:21.557095 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3680/7399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:21 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:22.579372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:22.580000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:22.582786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=32 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:22.588489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:22.588986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:22.589464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:22.590162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:22.590631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:22.591071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:22.593632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:22.727286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:22.735222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6b8cc966-76da-46ba-948e-55486b730b10 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.159717 Oct 18 17:05:22.735787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3720/7400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:22 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:23.759622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:23.760226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:23.767129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:23.767619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:23.768060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:23.768757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:23.769253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:23.769686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:23.902521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:23.910279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-75a001a8-151d-49f3-9199-65191e1d7d70 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.155311 Oct 18 17:05:23.910849 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3681/7401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:23 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:24.934612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:24.935358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:24.942248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:24.942742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:24.943192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:24.943895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:24.944355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:24.944789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:25.076032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:25.083865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae542be5-d742-41c8-b6ed-70bc041bb045 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.153187 Oct 18 17:05:25.084450 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3721/7402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:24 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:26.109343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:26.109962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:26.116775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:26.117290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:26.117781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:26.118731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:26.119194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:26.119626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:26.253661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:26.261495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a403c2d-4c3f-43a2-b50d-fe07eff96e9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1516 microversion: 2.1 time: 0.156138 Oct 18 17:05:26.262073 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3682/7403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:26 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:27.124385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "name": "network-vif-unplugged", "status": "completed", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:27.135087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:27.136366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:27.136609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:27.148821 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Creating event network-vif-unplugged:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h2-858383-14 Oct 18 17:05:27.155189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] Instance e6168a38-fa6d-4964-abe6-c03d198f729f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:05:27.167740 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f0b5fc67-53be-452b-bdce-f34f1d8562e0 req-65a87203-84dc-47f9-bd7e-a6f20035b820 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105285 Oct 18 17:05:27.168539 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3722/7404] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:27.285309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:27.285936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:27.293178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:27.293684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:27.294132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:27.294841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:27.295305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:27.295740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:27.554729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:27.563151 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e27c6caf-4809-4975-85d7-4bd3226de275 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1515 microversion: 2.1 time: 0.281781 Oct 18 17:05:27.563740 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3683/7405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:27 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:28.589852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:28.590576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:28.596837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:28.597378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:28.597837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:28.598545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:28.599022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:28.599469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:28.735887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:28.743738 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ae887fb-e5dd-4969-8bf8-d478969e72f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1513 microversion: 2.1 time: 0.159886 Oct 18 17:05:28.744360 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3723/7406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:28 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:29.182056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:29.192369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:29.192788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:29.193252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:29.205041 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Creating event network-changed:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h2-858383-14 Oct 18 17:05:29.210476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] Instance e6168a38-fa6d-4964-abe6-c03d198f729f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:05:29.222095 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f384ef45-7182-455b-bb98-10ff5d900f7b req-61bfdc2d-b35a-4431-b223-d9778fe85543 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044050 Oct 18 17:05:29.222668 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3684/7407] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:29.769120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:29.769721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:29.776662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:29.777201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:29.777658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:29.778365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:29.778835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:29.779278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:29.909659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:29.917579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16b123ba-a982-4397-aae5-5cac65fa924b tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1513 microversion: 2.1 time: 0.152912 Oct 18 17:05:29.918161 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3724/7408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:29 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:30.943837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:30.944561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:30.952592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:30.953130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:30.953575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:30.954290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:30.954748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:30.955182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:31.176450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:31.185090 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f7bafe6-21c6-4ec7-88c9-b18fd07703aa tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1510 microversion: 2.1 time: 0.247480 Oct 18 17:05:31.185671 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3685/7409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:30 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:31.207316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:31.207885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:31.215391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:31.215895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:31.216350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:31.217108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:31.217577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:31.218022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:31.245085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:05:31.298182 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Found an unconfirmed migration during delete, id: 16, status: finished Oct 18 17:05:32.841323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a8e11651-7b35-4d7c-95db-837fd018ac9e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 204 len: 0 microversion: 2.1 time: 1.637580 Oct 18 17:05:32.842251 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3725/7410] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:05:31 2022] DELETE /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 0 bytes in 1639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:05:32.850536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:32.851162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:32.859176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:32.859670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:32.860115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:32.860822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:32.861322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:32.861759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:33.304570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:33.312965 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8132e7ab-e9b5-42d3-b07b-aa634c47ca0e tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1502 microversion: 2.1 time: 0.466539 Oct 18 17:05:33.313583 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3686/7411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:32 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:05:33.494408 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "name": "network-vif-plugged", "status": "completed", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:33.505031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:33.505539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:33.505988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:33.517122 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] Creating event network-vif-plugged:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h2-858383-14 Oct 18 17:05:33.521911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f40af463-d0cd-4845-97c3-70e8019adddb req-f86c1b6c-b465-4da2-bc14-82f3e13a6a2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086390 Oct 18 17:05:33.522505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3726/7412] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:34.336933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:34.337638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:34.344410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:34.344892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:34.345365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:34.346075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:34.346511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:34.346942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:34.551353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:34.559549 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5eb3a620-846a-43b9-aef6-b5874ebd2be7 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1502 microversion: 2.1 time: 0.227139 Oct 18 17:05:34.560369 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3687/7413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:34 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:34.928907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6168a38-fa6d-4964-abe6-c03d198f729f", "name": "network-vif-deleted", "tag": "b9fd88aa-fff1-4395-a92e-f8ab0f61cc03"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:34.942858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:34.943640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:34.944320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:34.958047 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] Creating event network-vif-deleted:b9fd88aa-fff1-4395-a92e-f8ab0f61cc03 for instance e6168a38-fa6d-4964-abe6-c03d198f729f on n-h2-858383-14 Oct 18 17:05:34.963896 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-40116353-36a1-4917-91fd-0ed5f145d008 req-2f096f30-a41b-4e3a-9e77-7f432acbd7fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040328 Oct 18 17:05:34.964751 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3727/7414] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:35.583263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:35.583909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:35.591671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:35.592162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:35.592600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:35.593328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:35.593786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:35.594218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:35.625472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:35.625960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:35.626661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:35.627112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lazy-loading 'fault' on Instance uuid e6168a38-fa6d-4964-abe6-c03d198f729f {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:05:35.670183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5736d7229efa498ab1e3ad6676b239a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad5c546e4347e8b509097ff87db145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:35.678248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df15669c-1b31-4d0b-9f8e-be76cfc44685 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 200 len: 1305 microversion: 2.1 time: 0.098877 Oct 18 17:05:35.678805 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3688/7415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:35 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:36.704594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:36.705356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:36.712212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.712710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.713684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.713999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.714488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.714923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.729799 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] HTTP exception thrown: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Request method failure captured: Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f HTTP/1.1 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtyrtTIgc_sUfKkRs-8A8frc3b1b_M4kuDXJgmgpD4hnpI4PJ8-Yff0VHXSyOpRuMuGEpo7yzKrX4dd4ZmZht9ZN8jpQZUZW17BlYNT2VBRJ4Ud_3W_G6JXFHhsIiwGX_I-S-MLI05L0IGI74QMVNARROlRXHAgmTpBTwMvHktJA8zA Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}] Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 5736d7229efa498ab1e3ad6676b239a9 Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e6168a38-fa6d-4964-abe6-c03d198f729f'} Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.731670 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Returning 404 to user: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-022d6a73-57e9-42f8-9d16-f3fb22d7fb69 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 404 len: 111 microversion: 2.1 time: 0.034026 Oct 18 17:05:36.738251 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3728/7416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:36 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:05:36.752771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:36.753385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:36.760356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.761097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.761782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.762846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.763373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.764189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.781480 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] HTTP exception thrown: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Request method failure captured: Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f HTTP/1.1 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtyrtTIgc_sUfKkRs-8A8frc3b1b_M4kuDXJgmgpD4hnpI4PJ8-Yff0VHXSyOpRuMuGEpo7yzKrX4dd4ZmZht9ZN8jpQZUZW17BlYNT2VBRJ4Ud_3W_G6JXFHhsIiwGX_I-S-MLI05L0IGI74QMVNARROlRXHAgmTpBTwMvHktJA8zA Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}] Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 5736d7229efa498ab1e3ad6676b239a9 Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'e6168a38-fa6d-4964-abe6-c03d198f729f'} Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:05:36.783676 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Returning 404 to user: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:05:36.788067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9504eea6-9573-4da2-b9c9-e7c8dd7ef404 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 404 len: 111 microversion: 2.1 time: 0.038312 Oct 18 17:05:36.791625 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3689/7417] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:05:36 2022] DELETE /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:05:36.796781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:36.797433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] [instance: e6168a38-fa6d-4964-abe6-c03d198f729f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:36.804103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.804684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.805816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.806804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:36.807356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:36.807771 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:36.824812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] HTTP exception thrown: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Request method failure captured: Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f HTTP/1.1 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtyrtTIgc_sUfKkRs-8A8frc3b1b_M4kuDXJgmgpD4hnpI4PJ8-Yff0VHXSyOpRuMuGEpo7yzKrX4dd4ZmZht9ZN8jpQZUZW17BlYNT2VBRJ4Ud_3W_G6JXFHhsIiwGX_I-S-MLI05L0IGI74QMVNARROlRXHAgmTpBTwMvHktJA8zA Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9ad5c546e4347e8b509097ff87db145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9ad5c546e4347e8b509097ff87db145"}]}] Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: a9ad5c546e4347e8b509097ff87db145 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-DeleteServersTestJSON-30527060 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 5736d7229efa498ab1e3ad6676b239a9 Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-DeleteServersTestJSON-30527060-project Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'e6168a38-fa6d-4964-abe6-c03d198f729f'} Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:36.826374 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] Returning 404 to user: Instance e6168a38-fa6d-4964-abe6-c03d198f729f could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-25878d27-4cc6-43ac-b8ba-17b8493fd7f2 tempest-DeleteServersTestJSON-30527060 tempest-DeleteServersTestJSON-30527060-project] 10.222.0.78 "GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f" status: 404 len: 111 microversion: 2.1 time: 0.035109 Oct 18 17:05:36.830874 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3729/7418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:36 2022] GET /compute/v2.1/servers/e6168a38-fa6d-4964-abe6-c03d198f729f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:05:45.474024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1106080275", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e6a37fa3-fd10-4bf9-b224-21f9e4dc5ecf"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:45.532170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] validate_networks() for [('e6a37fa3-fd10-4bf9-b224-21f9e4dc5ecf', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:05:45.928172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:05:45.928797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:05:45.930317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:05:45.931052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:05:45.931650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:05:45.941450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:45.941941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:45.942381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:45.943139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:45.943601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:45.944038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:45.961672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:05:45.967388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for user 16cc5ee3776f44278d82caa0299cc37a and project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:05:45.980450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:05:45.982801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:05:46.030400 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-16811b45-ae8e-4f96-958d-27fdd97a3629 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702194 Oct 18 17:05:46.030962 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3690/7419] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:05:46.042916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1282fb20-57ef-46a4-ad76-9a722faa0a29 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:46.043554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1282fb20-57ef-46a4-ad76-9a722faa0a29 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:46.108196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1282fb20-57ef-46a4-ad76-9a722faa0a29 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:46.116632 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1282fb20-57ef-46a4-ad76-9a722faa0a29 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1218 microversion: 2.1 time: 0.078466 Oct 18 17:05:46.117913 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3730/7420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:46 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:47.140670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:47.142146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:47.156360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:47.157151 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:47.158059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:47.161181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:47.162289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:47.163422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:47.257141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:47.269771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-08423b60-3a93-4c47-a5d2-49a6e8c6b5e3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1278 microversion: 2.1 time: 0.133242 Oct 18 17:05:47.271159 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3691/7421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:47 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:48.297369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:48.298016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:48.302389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:48.308825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:48.309367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:48.309827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:48.310555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:48.311035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:48.311545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:48.558510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:48.570707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0897e942-39e8-4edb-b83b-6bc6f549e9e8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.278361 Oct 18 17:05:48.571446 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3731/7422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:48 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:48.810739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:48.822800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:48.823317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:48.823782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:48.835733 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] Creating event network-changed:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h1-858383-14 Oct 18 17:05:48.841136 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-81a7d145-a19c-4c39-80a2-34b91c4d65e1 req-bc66b1e8-f79d-4b64-81c9-4540860dcc55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Oct 18 17:05:48.841741 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3692/7423] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:49.594056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:49.594695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:49.602481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:49.602837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:49.603295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:49.604002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:49.604476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:49.604919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:49.735337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:49.743667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-52557dc7-c71d-41d9-bf72-0490a8537f4f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.153527 Oct 18 17:05:49.744252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3732/7424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:49 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:50.768543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:50.769227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:50.775910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:50.776387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:50.776821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:50.777553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:50.778005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:50.778429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:50.781075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=72 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:50.909410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:50.918170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17512fea-eb93-4ea9-aa9b-84f9a2caaf0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.154905 Oct 18 17:05:50.918739 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3693/7425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:50 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:51.940702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:51.941369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:51.948942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:51.949473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:51.949928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:51.950646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:51.951121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:51.951566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:52.081324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:52.089808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2723190-3845-4c94-9e95-df5912c7df1e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.153015 Oct 18 17:05:52.090384 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3733/7426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:51 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:53.113423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:53.114301 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:53.116980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:53.122534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:53.123025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:53.123460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:53.124199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:53.124651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:53.125100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:53.263433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:53.271269 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-33c17ea8-77a8-47ca-9d47-953ea17f6c9f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.161879 Oct 18 17:05:53.271844 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3694/7427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:53 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:54.294796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:54.295429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:54.298174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:54.303590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.304090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.304544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:54.305809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.306284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.306730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:54.446845 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:54.454878 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e3a381d1-1f7a-4030-a149-ea7fe1ff14f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.163948 Oct 18 17:05:54.455560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3734/7428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:54 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:55.147312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "name": "network-vif-plugged", "status": "completed", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:55.159336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:55.160291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:55.160861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:55.176488 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] Creating event network-vif-plugged:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h1-858383-14 Oct 18 17:05:55.181712 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-15f8cd58-3cc6-488f-9cbc-402e53db2869 req-fa7fa9d5-6aa4-4b34-b3cd-207bd60eef09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038208 Oct 18 17:05:55.182321 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3695/7429] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:55.479626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:55.480256 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:55.487145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:55.487640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:55.488090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:55.488790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:55.489277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:55.489717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:55.622273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:55.630225 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-29b978aa-5446-4070-b268-c444bf9c1c18 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.155500 Oct 18 17:05:55.630798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3735/7430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:55 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:56.653035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:56.653798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:56.658820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:56.659457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:56.666424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:56.666901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:56.667339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:56.668021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:56.668478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:56.668902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:56.822725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:56.830832 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8a4ec86-8e75-4316-8e75-2946b89837cd tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1318 microversion: 2.1 time: 0.178732 Oct 18 17:05:56.831406 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3696/7431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:56 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:57.853982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:57.854606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:57.856542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:57.862667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:57.863162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:57.863609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:57.864302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:57.864765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:57.865243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:57.999159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:58.007284 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d0aeb074-efe6-4c85-b984-33b641175942 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1507 microversion: 2.1 time: 0.157701 Oct 18 17:05:58.007969 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3736/7432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:57 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:58.029400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:58.029955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.036798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.037319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.037763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.038462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.038920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.039977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.170614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:58.178309 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5096d7ca-19c4-4ce2-b066-7ccca56862f2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1507 microversion: 2.1 time: 0.152838 Oct 18 17:05:58.178897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3697/7433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:58 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:58.199915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:58.202371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.208297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.208798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.209290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.209996 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.210470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.211481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.275335 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-11f52569-62a2-4d99-8abe-218605479f1d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "PUT /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1079 microversion: 2.1 time: 0.079279 Oct 18 17:05:58.275964 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3737/7434] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 17:05:58 2022] PUT /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1079 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:58.295031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:58.295573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.301494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.301981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.302419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.303102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.303554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.303977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.437932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:58.446253 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3f01932f-f3dd-4e16-a926-34efbc2e867a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1505 microversion: 2.1 time: 0.154518 Oct 18 17:05:58.446415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3698/7435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:58 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:58.468069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:58.468692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.474991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.475492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.475947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.477299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.477902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.478344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.610837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:58.618823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6eb79c69-3b7f-4ff5-9721-5d32ce90c235 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1505 microversion: 2.1 time: 0.154577 Oct 18 17:05:58.619393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3738/7436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:58 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:58.641677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:58.643982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.650792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.651278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.651716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.652404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.652861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.653326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.727693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:58.734370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Old instance type m1.heat2, new instance type m1.heat {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:05:58.741297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:05:58.741721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:05:58.742190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:05:58.742623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:05:58.743147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:05:58.852377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-886bcf0a-175e-4ca9-862e-df6064d314ae tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790/action" status: 202 len: 0 microversion: 2.1 time: 0.214559 Oct 18 17:05:58.853005 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3699/7437] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:05:58 2022] POST /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:05:58.861286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:58.861904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:58.869416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.869923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.870377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:58.871096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:58.871561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:58.872001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:59.033300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:59.041339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9dcdcf10-44a4-4c19-8ebb-c1f845cafee2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1516 microversion: 2.1 time: 0.183955 Oct 18 17:05:59.041907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3739/7438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:58 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:00.065303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:00.066038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:00.073220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:00.073636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:00.074076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:00.074783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:00.075261 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:00.075676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:00.207961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:00.216054 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-00e72078-0521-4544-98f0-00def90aa572 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1516 microversion: 2.1 time: 0.155597 Oct 18 17:06:00.216630 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3700/7439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:00 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:01.239750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:01.240303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:01.247850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:01.248339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:01.248787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:01.249518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:01.249982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:01.250418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:01.388093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:01.395896 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c5311f8c-2284-48e3-b85f-5b06f14269ff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.160093 Oct 18 17:06:01.396463 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3740/7440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:01 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:02.419558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:02.420199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:02.426987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:02.427472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:02.427905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:02.428585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:02.429071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:02.429503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:02.561200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:02.568768 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d541b5f-ca75-445b-ae8c-c7e631ca8dc5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.153049 Oct 18 17:06:02.569366 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3701/7441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:02 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:03.592868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:03.593523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:03.600338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:03.600833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:03.601910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:03.602644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:03.603122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:03.603566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:03.734883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:03.743192 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c12d8fe-d38d-4563-a6bb-e2aca0dff2e5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.154188 Oct 18 17:06:03.743764 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3741/7442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:03 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:04.769976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:04.770716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:04.777970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:04.778507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:04.778953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:04.779642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:04.780102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:04.780529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:04.915360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:04.923085 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-55020e31-4bcf-40c2-af67-f39466de6251 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.157085 Oct 18 17:06:04.923682 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3702/7443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:04 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:05.946266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:05.947496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:05.954310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:05.954802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:05.955250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:05.955945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:05.956409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:05.956846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:06.091986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:06.099786 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-46eb4b6d-d424-47a3-b02e-ea3fc4c6e44b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.157431 Oct 18 17:06:06.100385 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3742/7444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:05 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:07.124262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:07.124905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:07.132434 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:07.132917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:07.133403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:07.134891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:07.135374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:07.135815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:07.276617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:07.284681 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2618ff6d-667c-4383-a21c-d92c4c489fb0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.164335 Oct 18 17:06:07.285282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3703/7445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:07 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:08.309082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:08.309646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:08.316491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:08.316981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:08.317456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:08.318149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:08.318608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:08.319040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:08.451493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:08.459237 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9d5c36b-aad9-458f-bd4a-631c57f69afa tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.154154 Oct 18 17:06:08.459814 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3743/7446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:08 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:09.483574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:09.484188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:09.491175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:09.491674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:09.492097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:09.492783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:09.493268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:09.493706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:09.940797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:09.948624 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be702460-ee54-4509-8269-b13a6662339b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.469237 Oct 18 17:06:09.949233 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3704/7447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:09 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:10.971979 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:10.972558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:10.979835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:10.980258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:10.980705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:10.981433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:10.981899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:10.982335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:11.123230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:11.131467 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de78b3a4-9f8b-4ad9-abd6-c49d528d39dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.163491 Oct 18 17:06:11.132548 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3744/7448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:10 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:12.154621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:12.155230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:12.161314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:12.161816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:12.162248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:12.162925 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:12.163375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:12.163792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:12.296243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:12.303938 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77ec6e50-7960-40be-8836-439ae86acc6b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.153403 Oct 18 17:06:12.304499 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3705/7449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:12 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:13.328828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:13.329394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:13.336175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:13.336665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:13.337140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:13.337839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:13.338553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:13.338991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:13.472161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:13.480458 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-86c34f5d-30c3-4f72-a41b-027da7327717 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.155559 Oct 18 17:06:13.481039 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3745/7450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:13 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:14.504316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:14.504937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:14.512396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:14.512879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:14.513355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:14.514053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:14.514513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:14.514942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:14.648309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:14.656160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f15106c3-43d6-4283-85a0-88fe5d51c167 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.156010 Oct 18 17:06:14.656728 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3706/7451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:14 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:15.679636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:15.680263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:15.687593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:15.688093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:15.688550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:15.689304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:15.689779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:15.690219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:15.820674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:15.825132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:15.830108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-816fe756-a152-4628-b232-f7cc50d6842e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.154426 Oct 18 17:06:15.830691 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3746/7452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:15 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:16.853336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:16.853954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:16.861415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:16.861902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:16.862348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:16.863038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:16.863515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:16.863926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:16.997505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:17.005543 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d98afe41-1633-4b86-971c-34dbed1e379f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.156145 Oct 18 17:06:17.006119 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3707/7453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:16 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:18.029243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:18.029871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:18.037665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:18.038160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:18.038614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:18.039313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:18.039774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:18.040208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:18.174104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:18.181992 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2258275-2367-4975-8f5d-60f6d6e82ac2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.157526 Oct 18 17:06:18.182560 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3747/7454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:18 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:19.205875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:19.206423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:19.213345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:19.213828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:19.214328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:19.215018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:19.215474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:19.215902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:19.343522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:19.351117 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e4099984-ec00-4e4f-a499-8fe5e931dfc9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.149164 Oct 18 17:06:19.351684 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3708/7455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:19 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:20.374457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:20.375076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:20.382617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:20.383157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:20.383610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:20.384337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:20.384892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:20.385377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:20.525834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:20.534561 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0902797f-9261-4828-99f5-64ea8418d917 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.164026 Oct 18 17:06:20.535836 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3748/7456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:20 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:21.559355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:21.559882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:21.566930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:21.567408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:21.567842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:21.568522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:21.568974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:21.569465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:21.572041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:21.707631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:21.716143 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf79c1e3-9169-43e7-93bd-f8b9b98bc6f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.161413 Oct 18 17:06:21.716730 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3709/7457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:21 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:22.739526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:22.740158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:22.747646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:22.748143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:22.748597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:22.749335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:22.749807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:22.750250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:22.889057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:22.896927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acc11abc-a5c2-48c2-b55a-0c2d5cbb438c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.161280 Oct 18 17:06:22.897531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3749/7458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:22 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:23.920410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:23.921031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:23.923698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:23.928878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:23.929394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:23.929833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:23.930530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:23.930981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:23.931432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:24.063934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:24.071604 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-041f905a-7bb7-4855-8c98-d76e247f61f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.155294 Oct 18 17:06:24.072168 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3710/7459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:23 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:25.095566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:25.096221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:25.098898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=32 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:25.104425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:25.105945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:25.106414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:25.107134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:25.107607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:25.108053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:25.240191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:25.248309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6f02aea-bdeb-4a93-8314-4afa14df1b9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.156704 Oct 18 17:06:25.248890 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3750/7460] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:25 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:26.271867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:26.272407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:26.280092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:26.280575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:26.281043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:26.281742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:26.282204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:26.282636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:26.420889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:26.429183 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c82074f8-6205-4f84-9ebb-54ea1a29d379 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.161235 Oct 18 17:06:26.429772 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3711/7461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:26 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:27.452624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:27.453287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:27.460158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:27.460661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:27.461156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:27.461862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:27.462455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:27.462904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:27.623830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:27.631887 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-941d7e4d-6c43-4b24-b2c2-7c7d03094bb9 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1521 microversion: 2.1 time: 0.183676 Oct 18 17:06:27.632478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3751/7462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:27 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:28.210483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "name": "network-vif-unplugged", "status": "completed", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:28.222131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:28.222609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:28.223032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:28.235996 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Creating event network-vif-unplugged:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h2-858383-14 Oct 18 17:06:28.241371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] Instance f31efca2-4784-4e06-8e96-380af52f1790 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:06:28.253174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f7e9a67b-82d1-47d3-a85d-4060b2ca7c0a req-d35001cd-0b1e-4182-b446-f857598e9a41 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046960 Oct 18 17:06:28.253786 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3712/7463] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:28.655547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:28.656190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:28.663075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:28.663586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:28.664045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:28.664764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:28.665269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:28.665716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:28.799631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:28.807803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03f33e7d-362b-4c3a-9671-0b7e11802fa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1520 microversion: 2.1 time: 0.156035 Oct 18 17:06:28.808489 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3752/7464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:28 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:29.832257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:29.832982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:29.840931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:29.841449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:29.841882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:29.842571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:29.843019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:29.843440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:29.976647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:29.984568 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-da73e85a-d512-4158-8f6e-3818ecc827f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1518 microversion: 2.1 time: 0.156814 Oct 18 17:06:29.985170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3713/7465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:29 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:30.279815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:30.290151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:30.290644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:30.291119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:30.302699 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Creating event network-changed:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h2-858383-14 Oct 18 17:06:30.308651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] Instance f31efca2-4784-4e06-8e96-380af52f1790 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:06:30.319440 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-bd4299ce-1777-4114-8c18-05b07fc4e83b req-a3c5e611-aa82-4bc5-bbba-3ab5381aad9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044046 Oct 18 17:06:30.320065 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3753/7466] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:31.008313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:31.008930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:31.015978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:31.016459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:31.016894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:31.017611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:31.018068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:31.018495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:31.154690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:31.162515 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e83d34aa-c76d-4a16-b120-5e87798032cb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1518 microversion: 2.1 time: 0.158040 Oct 18 17:06:31.163084 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3714/7467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:31 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:32.188869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:32.189657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:32.195785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.196270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.196714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.197473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.197939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.199385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.331066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:32.338867 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96c642d1-3536-4c45-89d6-45b4775377c0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1515 microversion: 2.1 time: 0.156109 Oct 18 17:06:32.339765 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3754/7468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:32 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:32.362041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:32.362574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:32.369597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.370727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.371525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.371897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.372351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.372774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.429435 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0958dfa4-7a25-42a8-9893-5fff93c24432 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790/action" status: 204 len: 0 microversion: 2.1 time: 0.071115 Oct 18 17:06:32.430050 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3715/7469] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:06:32 2022] POST /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:06:32.438980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:32.439609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:32.445974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.446350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.446828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.447561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:32.448093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:32.448767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:32.672879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:32.680638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06ef103c-17c8-4464-bc73-d32d154ae75b tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1515 microversion: 2.1 time: 0.245608 Oct 18 17:06:32.681264 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3755/7470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:32 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:33.705842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:33.706538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:33.713320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:33.714444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:33.715215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:33.715983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:33.716524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:33.717104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:33.866047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:33.875292 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff86f43e-2321-46c5-8dd9-22b2e7b36e19 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1507 microversion: 2.1 time: 0.174654 Oct 18 17:06:33.875883 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3716/7471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:33 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:33.898660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:33.899292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:33.906726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:33.907331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:33.907821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:33.908535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:33.909026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:33.909675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:34.391193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:34.398893 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2da6066b-81e0-452a-b4fd-ef010e2e33ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1507 microversion: 2.1 time: 0.504190 Oct 18 17:06:34.399486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3756/7472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:33 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:34.426168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'create', calling method: .version_select at 0x7f5fd6413b80>, body: {"keypair": {"name": "tempest-keypair-1323357467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOemrXk7gCsE+GpGroRFbyBBrhptkuiN34bIAbn8tG6ImxGNI6JTOtaK8lYCs7AiJHw31pr7v/lEw+6ZGY/mDtr7B1o4Qr3/nVq2PjQ0+Uv8SC0IuyUUBYx7qlaQLOw9Q=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:34.441458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:06:34.446497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for user 16cc5ee3776f44278d82caa0299cc37a and project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:06:34.460530 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:06:35.467435 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52874. Oct 18 17:06:35.484630 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e5b7b4f9-10cc-407a-8bbe-6ff25491b8be tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.062232 Oct 18 17:06:35.485321 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3717/7473] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:06:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:35.649502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "name": "network-vif-plugged", "status": "completed", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:35.662437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:35.662868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:35.663583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:35.677486 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] Creating event network-vif-plugged:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h2-858383-14 Oct 18 17:06:35.686863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8f0b80b3-c7b3-4879-bc7f-7c6888f637f0 req-64566a43-e78f-4613-8a7c-d58f745278aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041253 Oct 18 17:06:35.688044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3757/7474] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:36.679407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:36.680033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:36.686257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:36.686751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:36.687206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:36.687957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:36.688420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:36.688852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:36.826624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:36.834324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14c00cb1-4274-4820-8161-cda756ad7497 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 200 len: 1507 microversion: 2.1 time: 0.159813 Oct 18 17:06:36.834917 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3718/7475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:36 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:36.857874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:36.858464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:36.865459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:36.865953 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:36.866400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:36.867239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:36.867699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:36.868135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:36.898165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:06:36.975998 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-449c0a6e-f06c-476f-8c00-c9c2305d0233 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 204 len: 0 microversion: 2.1 time: 0.122547 Oct 18 17:06:36.976600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3758/7476] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:06:36 2022] DELETE /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:06:37.045640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-785682874", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "e6a37fa3-fd10-4bf9-b224-21f9e4dc5ecf"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:37.100198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] validate_networks() for [('e6a37fa3-fd10-4bf9-b224-21f9e4dc5ecf', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:06:37.476131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:06:37.476549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:06:37.477051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:06:37.477462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:06:37.477910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:06:37.486794 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:37.487275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:37.487710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:37.488427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:37.488874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:37.489342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:37.507363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:06:37.513803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Getting quotas for user 16cc5ee3776f44278d82caa0299cc37a and project 81547b3d503f4b5bb056399d6c353ebb. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:06:37.530260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:06:37.532587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:06:37.577676 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65991841-731b-441d-9015-87392da6fada tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537035 Oct 18 17:06:37.578358 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3719/7477] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:06:37.590160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63c2e926-12e0-4853-867a-83c9477cc9dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:37.591764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63c2e926-12e0-4853-867a-83c9477cc9dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:37.658108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63c2e926-12e0-4853-867a-83c9477cc9dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:37.666206 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63c2e926-12e0-4853-867a-83c9477cc9dc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1217 microversion: 2.1 time: 0.080179 Oct 18 17:06:37.666873 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3759/7478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:37 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:38.690785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:38.691513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:38.698893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:38.699471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:38.699989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:38.701067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:38.701624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:38.702880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:38.806468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:38.816199 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8bbbb38a-82eb-440a-8d67-a01f98a90fc0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1213 microversion: 2.1 time: 0.130168 Oct 18 17:06:38.816778 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3720/7479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:38 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:39.111031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31efca2-4784-4e06-8e96-380af52f1790", "name": "network-vif-deleted", "tag": "9553d1bc-73c9-4cc5-af76-ef3ea40f59a3"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:39.123894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:39.124439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:39.130898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:39.144453 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] Creating event network-vif-deleted:9553d1bc-73c9-4cc5-af76-ef3ea40f59a3 for instance f31efca2-4784-4e06-8e96-380af52f1790 on n-h2-858383-14 Oct 18 17:06:39.150357 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-23ec7e2d-eb74-4bae-a584-1b6274372258 req-74616092-4608-4f91-a55c-e5d96fc28561 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043291 Oct 18 17:06:39.151639 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3760/7480] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:39.840173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:39.841831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:39.849030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:39.849612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:39.850302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:39.851128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:39.851587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:39.852028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:40.097317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:40.105450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bea42cd7-ea42-4ba3-876c-8e6c45322355 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.269221 Oct 18 17:06:40.106199 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3721/7481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:39 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:41.131049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:41.131776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:41.138572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:41.139070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:41.139530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:41.140243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:41.140722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:41.141200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:41.175663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23eaf9e-8bd5-4687-9627-f8ce9bb12841", "tag": "fadb4cb3-430b-4596-9306-d921213e40c6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:41.191853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:41.192353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:41.192789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:41.204897 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] Creating event network-changed:fadb4cb3-430b-4596-9306-d921213e40c6 for instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 on n-h2-858383-14 Oct 18 17:06:41.210159 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-546d1ebe-0eb7-4e76-9e3e-e9aeb0b4a540 req-4eec3c39-6339-47e4-b798-1dfeb9734917 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039131 Oct 18 17:06:41.210990 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3722/7482] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:06:41.284833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:41.292728 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3a0c990-22ca-42b4-8846-fc4c98366478 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.167070 Oct 18 17:06:41.293344 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3761/7483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:41 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:42.316912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:42.317552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:42.323708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:42.324191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:42.324631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:42.325964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:42.326440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:42.326848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:42.762742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:42.770467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-424444de-108b-46bf-ab5a-9ea78b019092 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.458851 Oct 18 17:06:42.771034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3723/7484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:42 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:43.794586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:43.795132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:43.802004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:43.802496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:43.802945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:43.803649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:43.804112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:43.804551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:43.933696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:43.941664 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5149cc31-ed42-441c-831e-d8c646b245a6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.151662 Oct 18 17:06:43.942250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3762/7485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:43 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:44.963651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:44.964387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:44.971194 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:44.971674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:44.972117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:44.972802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:44.973279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:44.973706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:45.105726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:45.113921 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-27332044-4d6d-47c4-bb9e-3ddda1293695 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.154129 Oct 18 17:06:45.114486 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3724/7486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:44 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:46.138311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:46.139020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:46.145957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:46.146457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:46.146906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:46.147611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:46.148081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:46.148516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:46.287764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:46.295651 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-459471c2-ffbc-4d95-b23a-d2de5535a63a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.161859 Oct 18 17:06:46.296235 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3763/7487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:46 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:47.319308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:47.319871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:47.327456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:47.327941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:47.328379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:47.329093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:47.329554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:47.329980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:47.468548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:47.476182 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5948edeb-331f-48f7-85fe-f7cc5caed9f4 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.160874 Oct 18 17:06:47.476747 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3725/7488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:47 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:47.706601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23eaf9e-8bd5-4687-9627-f8ce9bb12841", "name": "network-vif-plugged", "status": "completed", "tag": "fadb4cb3-430b-4596-9306-d921213e40c6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:47.713278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:47.719417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:47.719939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:47.720414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:47.733527 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] Creating event network-vif-plugged:fadb4cb3-430b-4596-9306-d921213e40c6 for instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 on n-h2-858383-14 Oct 18 17:06:47.737324 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9d73b0f3-b448-472d-ac54-fc375a5a5561 req-c8527c36-d269-4374-ad6b-b919634f0cfd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Oct 18 17:06:47.737956 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3764/7489] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:06:48.499832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:48.500439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:48.502674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:48.503365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=10 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:48.509828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:48.510303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:48.510734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:48.511416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:48.511863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:48.512313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:48.646254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:48.654532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6ecbba07-e9c6-4137-95cb-dd34245c0a7d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1317 microversion: 2.1 time: 0.159195 Oct 18 17:06:48.655101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3726/7490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:48 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:49.679775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:49.680491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:49.687260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:49.687761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:49.688215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:49.688946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:49.689445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:49.689889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:49.692526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:49.823943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:49.832443 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2198d0f3-40e9-4fbf-864d-007095b4cdcb tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1507 microversion: 2.1 time: 0.157879 Oct 18 17:06:49.833090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3765/7491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:49 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:49.855259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:49.856506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:49.863579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:49.864148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:49.864662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:49.865403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:49.865866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:49.866299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:49.870455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:50.104591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:50.113503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0512416e-e4b6-4379-ae6a-377862b1b394 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1507 microversion: 2.1 time: 0.262079 Oct 18 17:06:50.114086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3727/7492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:49 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:50.136617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:06:50.139056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:50.145019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:50.145578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:50.146043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:50.146760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:50.147925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:50.148538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:50.179067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:50.184717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Old instance type m1.heat2, new instance type m1.heat {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:06:50.191454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:06:50.191830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:06:50.192326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:06:50.192751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:06:50.193219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:06:50.263146 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b00a6ab4-7301-4a08-844f-363f6fe5af4a tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841/action" status: 202 len: 0 microversion: 2.1 time: 0.130159 Oct 18 17:06:50.265155 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3766/7493] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:06:50 2022] POST /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:06:50.272067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:50.273165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:50.281267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:50.281963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:50.282402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:50.283104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:50.283559 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:50.283981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:50.487841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:50.496694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8224a644-98ce-4413-8ed0-38821e8f1ac7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1514 microversion: 2.1 time: 0.228554 Oct 18 17:06:50.497393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3728/7494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:50 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:06:51.523238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:51.523800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:51.531513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:51.532016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:51.532469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:51.533217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:51.533691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:51.534134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:51.669387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:51.677375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-24570710-75dd-4dd4-a958-39141b5bb0c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1514 microversion: 2.1 time: 0.159202 Oct 18 17:06:51.677965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3767/7495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:51 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:52.701116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:52.701784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:52.709406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:52.709896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:52.710340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:52.711041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:52.711498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:52.711927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:52.842631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:52.850465 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-443dd31c-635b-4050-9ae4-25122c481836 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.153324 Oct 18 17:06:52.851040 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3729/7496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:52 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:53.875493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:53.876122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:53.883361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:53.883857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:53.884305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:53.885016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:53.885493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:53.885930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:54.018541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:54.026324 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-84020c9b-d82e-48e3-a02e-4f4abc765e9d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.155532 Oct 18 17:06:54.026895 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3768/7497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:53 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:55.050030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:55.050635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:55.053784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:55.059435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:55.059668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:55.060108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:55.060795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:55.061271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:55.061697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:55.200761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:55.208425 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd380916-46fa-429b-88cf-8b4f7b7a64c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.162226 Oct 18 17:06:55.209001 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3730/7498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:55 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:06:56.232614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:56.233188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:56.236148 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:06:56.236295 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 (ip 10.222.0.78) !!! Oct 18 17:06:56.237412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:56.248638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:56.249183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:56.249638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:56.250356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:56.250828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:56.251271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:56.390679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:56.398698 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5a81db3-39d3-4efc-8f98-0cad886e30c7 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.170879 Oct 18 17:06:56.399279 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3769/7499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:56 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:57.422747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:57.423396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:57.430352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:57.430831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:57.431267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:57.431952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:57.432409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:57.432833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:57.567796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:57.576078 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-30d606fd-b78d-459d-8138-d3b73a68cbff tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.157258 Oct 18 17:06:57.576655 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3731/7500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:57 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:58.599785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:58.600465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:58.607990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:58.608484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:58.608931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:58.609656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:58.610122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:58.610565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:58.739935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:58.748571 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-526a39fd-3fb0-42d0-8181-aa817bc125bc tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.152628 Oct 18 17:06:58.749240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3770/7501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:58 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:06:59.772003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:06:59.772657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:06:59.779923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:59.780407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:59.780844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:59.781573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:06:59.782029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:06:59.782457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:06:59.927016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:06:59.936900 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3d1e3eff-1552-4673-baa8-00f4fcca0777 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.168718 Oct 18 17:06:59.938167 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3732/7502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:06:59 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:00.961498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:00.962136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:00.970738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:00.971249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:00.971753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:00.972609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:00.973215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:00.973758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:01.108332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:01.116110 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a9911cf6-4a0d-49d5-a4cf-fa5d7c3e2124 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.158523 Oct 18 17:07:01.116697 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3771/7503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:00 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:02.140494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:02.141102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:02.147899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:02.148387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:02.148821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:02.149532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:02.149991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:02.150415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:02.281965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:02.289554 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-22355654-3112-4efc-87cd-1f7f0491d579 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.153564 Oct 18 17:07:02.290129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3733/7504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:02 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:03.312819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:03.313502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:03.320429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:03.320923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:03.321404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:03.322104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:03.322569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:03.323001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:03.454738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:03.462491 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc81888d-87f3-40a6-9005-13833aad8c0d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.153658 Oct 18 17:07:03.463057 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3772/7505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:03 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:07:04.486248 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:04.486869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:04.493726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:04.494207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:04.494645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:04.495323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:04.495776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:04.496197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:04.628741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:04.636479 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1086b53-24f4-4cc5-b57e-cfab7adab8a0 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.154187 Oct 18 17:07:04.637061 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3734/7506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:04 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:05.660209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:05.660835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:05.667742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:05.668236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:05.668682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:05.670206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:05.670702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:05.671140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:05.802901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:05.811235 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7fe4cc3-3df3-4559-9c3c-96e0511a5d96 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.154822 Oct 18 17:07:05.811791 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3773/7507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:05 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:06.834214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:06.834854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:06.842791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:06.843276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:06.843715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:06.844398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:06.844857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:06.845313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:06.981246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:06.991020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e1aac9d-0f13-4ee4-b8e6-776a3fbb47ab tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.160670 Oct 18 17:07:06.991606 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3735/7508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:06 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:08.015036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:08.015703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:08.022712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:08.023215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:08.023674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:08.024390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:08.024871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:08.025345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:08.159654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:08.167389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dde018f-fe07-4d16-a8de-36ffad5509b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.156290 Oct 18 17:07:08.167960 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3774/7509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:08 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:09.191258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:09.191869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:09.198700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:09.199177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:09.199606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:09.200283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:09.200734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:09.201183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:09.345469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:09.353286 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20d7ef68-0bb7-415b-8c2b-86599c2b9c8c tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.165923 Oct 18 17:07:09.353857 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3736/7510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:09 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:10.377966 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:10.378506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:10.385586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:10.386098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:10.386534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:10.387239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:10.387704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:10.388139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:10.524701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:10.532706 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-007bedab-4008-4e01-890d-d8cede00bc74 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.159027 Oct 18 17:07:10.533321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3775/7511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:10 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:11.556347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:11.556888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:11.563836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:11.564317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:11.564756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:11.565474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:11.565936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:11.566364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:11.700252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:11.708547 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c00eb8e5-6274-46fb-8cec-d0433bb55aa8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.156181 Oct 18 17:07:11.709221 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3737/7512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:11 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:12.732051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:12.733373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:12.740407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:12.740908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:12.741396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:12.742111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:12.742581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:12.743027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:12.877801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:12.885623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-253be035-da11-4855-9285-1b494ed705a3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.157493 Oct 18 17:07:12.886207 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3776/7513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:12 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:13.909349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:13.909959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:13.916223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:13.916731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:13.917203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:13.917883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:13.918349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:13.918771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:14.051419 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:14.059172 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07035f8e-e1c8-4dfb-b9e8-741fcac19cc2 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.153791 Oct 18 17:07:14.059750 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3738/7514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:13 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:15.082897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:15.083520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:15.090315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:15.090808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:15.091262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:15.092605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:15.093099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:15.093537 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:15.229009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:15.237525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc12e1ca-e4ae-431a-a79d-3c03b42a6e5d tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.158499 Oct 18 17:07:15.238098 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3777/7515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:15 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:16.262322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:16.262872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:16.269647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:16.270126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:16.270560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:16.271314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:16.271829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:16.272276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:16.405766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:16.413463 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-651bd682-a95f-4712-b8ee-47f4c6a4517e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.155138 Oct 18 17:07:16.414202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3739/7516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:16 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:17.438008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:17.438668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:17.445849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:17.446259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:17.446706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:17.447413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:17.447882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:17.448321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:17.585657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:17.593990 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7e22357c-2ba0-4a0a-8b23-64321d087f1f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.160484 Oct 18 17:07:17.594563 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3778/7517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:17 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:18.616735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:18.617525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:18.625118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:18.625594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:18.626045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:18.626950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:18.627401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:18.627819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:18.764163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:18.771912 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e0008c1-de8e-4a79-a8e1-cff45a82e90f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1519 microversion: 2.1 time: 0.159087 Oct 18 17:07:18.772497 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3740/7518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:18 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:19.496222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23eaf9e-8bd5-4687-9627-f8ce9bb12841", "name": "network-vif-unplugged", "status": "completed", "tag": "fadb4cb3-430b-4596-9306-d921213e40c6"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:19.506834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:19.507326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:19.507776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:19.519508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Creating event network-vif-unplugged:fadb4cb3-430b-4596-9306-d921213e40c6 for instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 on n-h1-858383-14 Oct 18 17:07:19.525015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:07:19.535817 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b68d728a-6c76-437d-ac7a-17cda44cb00f req-1e20df92-c1ee-4548-aa9e-e27647b02043 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044133 Oct 18 17:07:19.536794 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3779/7519] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:19.796175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:19.797025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:19.806061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:19.807114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:19.807631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:19.808413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:19.809132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:19.809644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:19.949025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:19.951399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=87 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:19.958550 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd0ed1d6-758c-49d4-9a4f-871de050a978 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1518 microversion: 2.1 time: 0.167048 Oct 18 17:07:19.959097 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3741/7520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:19 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:20.985223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:20.985948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:20.992233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:20.992733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:20.993230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:20.993941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:20.994417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:20.994866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:20.999636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:21.133851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:21.141718 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-feaa905e-e0dd-4ab3-aa2e-fab7e43615b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1516 microversion: 2.1 time: 0.162355 Oct 18 17:07:21.142295 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3780/7521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:20 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:21.550382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23eaf9e-8bd5-4687-9627-f8ce9bb12841", "tag": "fadb4cb3-430b-4596-9306-d921213e40c6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:21.561410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:21.561892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:21.562329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:21.574360 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Creating event network-changed:fadb4cb3-430b-4596-9306-d921213e40c6 for instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 on n-h1-858383-14 Oct 18 17:07:21.580745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:07:21.591551 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0908302a-435c-4877-8eff-04291a345d68 req-a22e6b31-bfe7-4582-9dad-efd9572833a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044930 Oct 18 17:07:21.592175 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3742/7522] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:22.164920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:22.165659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:22.173239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:22.173744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:22.174205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:22.174915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:22.175391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:22.175844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:22.306782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:22.314883 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a3a0e5aa-bb58-4ec4-afaa-6e1ca362e86f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1516 microversion: 2.1 time: 0.153877 Oct 18 17:07:22.315471 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3781/7523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:22 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:23.338652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:23.339346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:23.346186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.346661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.347090 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.347776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.348225 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.348645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.489233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:23.497202 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-67e9faf5-a560-42e7-a051-3728222b08b5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1513 microversion: 2.1 time: 0.163579 Oct 18 17:07:23.498433 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3743/7524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:23 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:23.522544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:23.523092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:23.529938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.530435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.530912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.531609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.532075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.532716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.593921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7021113-880e-4cdc-a72d-f245664274c8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "POST /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841/action" status: 204 len: 0 microversion: 2.1 time: 0.075003 Oct 18 17:07:23.594586 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3782/7525] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:07:23 2022] POST /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:07:23.602735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:23.603430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:23.609659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.610214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.610653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.611450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:23.611904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:23.612324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:23.821729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:23.830356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-75287344-80c7-4e80-ac55-3916036cb6b6 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1513 microversion: 2.1 time: 0.231516 Oct 18 17:07:23.831169 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3744/7526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:23 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:24.855503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:24.856266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:24.863292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:24.863796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:24.864261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:24.865225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:24.865708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:24.866940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.012328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:25.020554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c846e989-c828-42df-9d81-6053ab6bd066 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1505 microversion: 2.1 time: 0.170294 Oct 18 17:07:25.021166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3783/7527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:24 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:25.049885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:25.051231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:25.063763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.064828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.064828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.065631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.065895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.066326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.202233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:25.210174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9380e4c-e5e1-4289-8334-4f57759d20ba tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1505 microversion: 2.1 time: 0.165805 Oct 18 17:07:25.210748 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3745/7528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:25 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:25.233934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:25.234572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:25.240572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.241111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.241574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.242281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.242755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.243202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.373872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:25.382012 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40511117-f477-4301-9e24-b19de82a318e tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1505 microversion: 2.1 time: 0.152777 Oct 18 17:07:25.382595 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3784/7529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:25 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:25.405812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:25.406235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:25.408211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=32 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:25.413542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.414031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.414480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.415177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.415643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.416272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.442026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:07:25.520718 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01f2db59-8a95-4f97-bd3a-0d4eb6b27137 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 204 len: 0 microversion: 2.1 time: 0.119280 Oct 18 17:07:25.521558 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3746/7530] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:07:25 2022] DELETE /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:07:25.537453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:25.537971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:25.543901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.544468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.544927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.545859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.546331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.546777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.573258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:07:25.623965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.compute.api [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Instance is already in deleting state, ignoring this request Oct 18 17:07:25.624819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-66050c53-8bbb-4afc-ba3f-98763aa4ae10 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 204 len: 0 microversion: 2.1 time: 0.091434 Oct 18 17:07:25.625668 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3785/7531] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:07:25 2022] DELETE /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:07:25.634852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:25.635555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:25.642123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.642617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.643058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.643755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:25.644214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:25.644641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:25.782662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:25.790469 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8689b0ef-9fa2-45fb-a1bf-78fbefa016a5 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1511 microversion: 2.1 time: 0.160018 Oct 18 17:07:25.791042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3747/7532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:25 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:26.813786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:26.814420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:26.817324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=34 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:26.822927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:26.823437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:26.823893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:26.824608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:26.825285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:26.825855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:26.971992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cc5ee3776f44278d82caa0299cc37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81547b3d503f4b5bb056399d6c353ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:26.979677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7c400ca-6399-44ea-863c-626202178738 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 200 len: 1511 microversion: 2.1 time: 0.169974 Oct 18 17:07:26.980250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3786/7533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:26 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:27.550223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23eaf9e-8bd5-4687-9627-f8ce9bb12841", "name": "network-vif-deleted", "tag": "fadb4cb3-430b-4596-9306-d921213e40c6"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:27.565788 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:27.566282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:27.566723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:27.580270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] Creating event network-vif-deleted:fadb4cb3-430b-4596-9306-d921213e40c6 for instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 on n-h1-858383-14 Oct 18 17:07:27.587019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b07bddb9-b76b-41c8-a34e-b00752b8cbbd req-3b683846-2bae-4686-84a1-70fc36b81a33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040825 Oct 18 17:07:27.587614 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3748/7534] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:28.003832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:28.004454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: a23eaf9e-8bd5-4687-9627-f8ce9bb12841] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:28.011545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.012041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.012498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.013249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.014046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.014590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.028205 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] HTTP exception thrown: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Request method failure captured: Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 HTTP/1.1 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtzpPXpCLcU4My_gkfjnLP8VhfU6sPQvrM-1cIbzFOOcqZqA0DciL-2XRGn2IEIGU8V2Yd9txQTxh4n6xJDpSjCkdrgK_jR9vVe2SME4NF-ybDbEyv-xHPmyAu2OHFHr_MGJF1-kCpaHPBZ2HeUFTKNA3_lHgl0T0OjhpjTxgEfSIe8 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}] Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 16cc5ee3776f44278d82caa0299cc37a Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'a23eaf9e-8bd5-4687-9627-f8ce9bb12841'} Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.030659 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Returning 404 to user: Instance a23eaf9e-8bd5-4687-9627-f8ce9bb12841 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae1bc4a1-9738-4c35-8a70-7666d70642f8 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841" status: 404 len: 111 microversion: 2.1 time: 0.032462 Oct 18 17:07:28.035442 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3787/7535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:27 2022] GET /compute/v2.1/servers/a23eaf9e-8bd5-4687-9627-f8ce9bb12841 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:07:28.041442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eeb0d746-9538-46d1-bb4b-62ca85c676b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '.version_select at 0x7f5fd0f6d820>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:28.062644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eeb0d746-9538-46d1-bb4b-62ca85c676b3 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323357467" status: 202 len: 0 microversion: 2.1 time: 0.025300 Oct 18 17:07:28.063232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3749/7536] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 17:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323357467 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:07:28.682343 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:28.682987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:28.689742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.690238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.690692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.691394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.691865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.692308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.706843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] HTTP exception thrown: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Request method failure captured: Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 HTTP/1.1 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTtzpPXpCLcU4My_gkfjnLP8VhfU6sPQvrM-1cIbzFOOcqZqA0DciL-2XRGn2IEIGU8V2Yd9txQTxh4n6xJDpSjCkdrgK_jR9vVe2SME4NF-ybDbEyv-xHPmyAu2OHFHr_MGJF1-kCpaHPBZ2HeUFTKNA3_lHgl0T0OjhpjTxgEfSIe8 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}] Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 16cc5ee3776f44278d82caa0299cc37a Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'f31efca2-4784-4e06-8e96-380af52f1790'} Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:07:28.708387 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Returning 404 to user: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-27e7ec07-de93-4eac-959c-46ae7e6e83f1 tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 404 len: 111 microversion: 2.1 time: 0.031930 Oct 18 17:07:28.712477 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3788/7537] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:07:28 2022] DELETE /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:07:28.720438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:28.721275 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] [instance: f31efca2-4784-4e06-8e96-380af52f1790] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:28.728623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.729157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.729600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.730292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:28.730759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:28.731187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:28.745226 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] HTTP exception thrown: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Request method failure captured: Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 HTTP/1.1 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTtzpPXpCLcU4My_gkfjnLP8VhfU6sPQvrM-1cIbzFOOcqZqA0DciL-2XRGn2IEIGU8V2Yd9txQTxh4n6xJDpSjCkdrgK_jR9vVe2SME4NF-ybDbEyv-xHPmyAu2OHFHr_MGJF1-kCpaHPBZ2HeUFTKNA3_lHgl0T0OjhpjTxgEfSIe8 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81547b3d503f4b5bb056399d6c353ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81547b3d503f4b5bb056399d6c353ebb"}]}] Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 81547b3d503f4b5bb056399d6c353ebb Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1217550065 Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 16cc5ee3776f44278d82caa0299cc37a Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerDiskConfigTestJSON-1217550065-project Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f31efca2-4784-4e06-8e96-380af52f1790'} Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:07:28.746905 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] Returning 404 to user: Instance f31efca2-4784-4e06-8e96-380af52f1790 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a43889db-3c54-4ee5-b1f0-b247af92097f tempest-ServerDiskConfigTestJSON-1217550065 tempest-ServerDiskConfigTestJSON-1217550065-project] 10.222.0.78 "GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790" status: 404 len: 111 microversion: 2.1 time: 0.034150 Oct 18 17:07:28.752213 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3750/7538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:28 2022] GET /compute/v2.1/servers/f31efca2-4784-4e06-8e96-380af52f1790 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:07:37.822673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e17907aa-f742-4c29-974f-4da74a208aba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: .version_select at 0x7f5fd2196ca0>, body: {"keypair": {"name": "tempest-keypair-1508672407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG43RT40AHnnGUJIeD1bMEE+N17+zFlaGkT5pFZwjuVlSQQF05DD52b+IYUMBfld0Bsjn6zWRVGKcKUPlKJQ/Pw06bzHNCTC0bRZX4Lisg47aLpN1wWkVZAtmkQPFhaNEA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:37.839402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e17907aa-f742-4c29-974f-4da74a208aba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:07:37.845621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e17907aa-f742-4c29-974f-4da74a208aba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:07:37.877487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e17907aa-f742-4c29-974f-4da74a208aba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202703 Oct 18 17:07:37.878203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3789/7539] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:07:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:39.204890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2033649582", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "059c9b7e-df92-413b-97ce-2f8dac1bd268"}], "security_groups": [{"name": "tempest-securitygroup--196977741"}], "key_name": "tempest-keypair-1508672407", "user_data": "}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:39.242222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:39.243379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:39.357130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] validate_networks() for [('059c9b7e-df92-413b-97ce-2f8dac1bd268', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:07:39.847573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:07:39.848099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:07:39.848666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:07:39.849175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:07:39.849710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:07:39.861635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:39.862250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:39.863632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:39.864576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:39.865180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:39.865893 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:39.890946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:07:39.897336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:07:39.912175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:07:39.914970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:07:39.971504 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b6180a5c-0e0d-437e-8dad-80ec80a902b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.771384 Oct 18 17:07:39.977315 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3751/7540] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:07:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:07:39.993499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2704d018-1931-46da-b62d-a81679341f2b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:39.994553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2704d018-1931-46da-b62d-a81679341f2b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:40.002124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:40.078898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2704d018-1931-46da-b62d-a81679341f2b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:40.091686 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2704d018-1931-46da-b62d-a81679341f2b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1239 microversion: 2.1 time: 0.110427 Oct 18 17:07:40.092411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3790/7541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:39 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:41.117271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:41.117972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:41.131634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:41.132237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:41.133505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:41.134263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:41.134743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:41.135183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:41.222618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:41.232459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57b3b165-d535-4e7f-b4a2-2658e92d9b24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1299 microversion: 2.1 time: 0.118994 Oct 18 17:07:41.233195 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3752/7542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:41 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:42.258683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:42.259316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:42.266467 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:42.266968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:42.267425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:42.268143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:42.268615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:42.269094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:42.412145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:42.422803 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e42bf3dc-a3fe-48e7-84e0-1f6ff731ac69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.167817 Oct 18 17:07:42.423407 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3791/7543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:42 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:42.749414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:42.760104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:42.760750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:42.761297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:42.773952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] Creating event network-changed:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h2-858383-14 Oct 18 17:07:42.779427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0d6550a9-e038-4aa6-acce-5e56812d03f2 req-6ba8cf6c-f021-41c7-abb5-265f986d1844 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Oct 18 17:07:42.780034 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3753/7544] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:43.448080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:43.448712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:43.456372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:43.456875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:43.457347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:43.458067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:43.458534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:43.458973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:43.591248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:43.599061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f946d4bc-6a76-42fb-8827-47c17fdffa5a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.155054 Oct 18 17:07:43.599637 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3792/7545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:43 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:44.624511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:44.625265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:44.631731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:44.632215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:44.632654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:44.633371 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:44.633858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:44.634295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:44.766597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:44.774342 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a2e94fe4-b8a4-4a4e-bb88-e0978e2af0fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.155780 Oct 18 17:07:44.774920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3754/7546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:44 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:45.798052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:45.799017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:45.806794 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:45.807291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:45.807748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:45.808466 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:45.808934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:45.809474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:45.961278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:45.969931 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-958cffe8-3bba-4a01-b37f-f0847bb8901b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.176575 Oct 18 17:07:45.970731 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3793/7547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:45 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:46.993839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:46.994451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:47.002113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:47.002591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:47.003025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:47.003703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:47.004257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:47.004681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:47.138753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:47.146473 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8f19df5-0c6a-4e80-9a31-0e98fa4dd064 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.156455 Oct 18 17:07:47.146967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3755/7548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:46 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:47.963590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "name": "network-vif-plugged", "status": "completed", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:47.975269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:47.975775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:47.976227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:47.988839 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] Creating event network-vif-plugged:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h2-858383-14 Oct 18 17:07:47.994043 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-286cf48a-151c-4bb7-9004-5f06fc59746d req-dd345cb1-0488-4aba-bbca-f62b32bca58d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 Oct 18 17:07:47.994653 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3794/7549] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:48.172480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:48.173148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:48.179898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:48.180380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:48.180813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:48.181518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:48.181973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:48.182394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:48.313618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:48.321271 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e2e58fe-523d-47b8-9006-ec2db3c1c9a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.153440 Oct 18 17:07:48.321834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3756/7550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:48 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:49.345255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:49.345967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:49.352334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:49.352828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:49.353301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:49.354000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:49.354465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:49.354924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:49.490317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:49.499298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bc4e0f65-e840-4fb1-8188-137bfcf158ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1364 microversion: 2.1 time: 0.159277 Oct 18 17:07:49.499887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3795/7551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:49 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:50.522636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:50.523279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:50.526156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:50.526856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:50.533145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:50.533640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:50.534081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:50.534787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:50.535246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:50.535673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:50.670628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:07:50.678333 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5ba0c014-c14b-43b3-9ef7-dbcfd8afd9b4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1550 microversion: 2.1 time: 0.159621 Oct 18 17:07:50.678909 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3757/7552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:07:50 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:07:50.701898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:07:50.702458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:50.704533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:50.710765 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:50.711269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:50.711727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:50.712445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:50.712921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:50.713399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:50.791823 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9be86917-7352-4a3b-98f2-4d161b6363a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094510 Oct 18 17:07:50.792419 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3796/7553] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:07:50 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:51.729857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:51.740482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:51.741099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:51.741606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:51.753389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] Creating event network-changed:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h2-858383-14 Oct 18 17:07:51.758773 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-190a289f-cd08-40bd-a672-22ddea43fbd8 req-a00b7b92-fdf7-49fe-9d79-999ec1011bc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Oct 18 17:07:51.759376 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3758/7554] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:08:56.403854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:56.404686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=30 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:56.406031 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 17:08:56.413255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:56.413886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:56.421715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.422860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.423435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.424151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.424622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.425108 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.555770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:56.563572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-44530e22-bea0-457d-94e3-b7c4f72f8643 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.162171 Oct 18 17:08:56.564144 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3797/7555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:56 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:56.584036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:56.584772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:56.589991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:56.590692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:56.598932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.599448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.599880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.600555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.601031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.601457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.738190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:56.745952 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e55fea2-d34d-4045-82e2-55ad02460795 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.164056 Oct 18 17:08:56.746527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3759/7556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:56 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:56.768952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:56.769636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:56.775649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.776151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.776606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.777361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.777838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.778284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.913757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:56.921551 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3d5c2f00-7afb-48fd-b07c-63342697559a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.156940 Oct 18 17:08:56.922806 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3798/7557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:56 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:56.944823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:56.947071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:56.952942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.954021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.954480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.955167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:56.955614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:56.956040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:56.986989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:56.992314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:08:56.998675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:08:56.999092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:08:56.999557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:08:56.999987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:08:57.000396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:08:57.063331 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0748191f-5b7c-4b46-a420-dc69e810db5b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/action" status: 202 len: 0 microversion: 2.1 time: 0.122448 Oct 18 17:08:57.063945 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3760/7558] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:08:56 2022] POST /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:08:57.071972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:57.072602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:57.078993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:57.079769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:57.080286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:57.081609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:57.082095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:57.082551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:57.239417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:57.247535 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99c503d4-4697-400b-9ba3-bf5929734338 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1678 microversion: 2.1 time: 0.179297 Oct 18 17:08:57.248270 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3799/7559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:57 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:58.272726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:58.273385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:58.280100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:58.280584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:58.281046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:58.282047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:58.282507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:58.282942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:58.497623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:58.506137 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-80c62cc7-2c87-4fb7-bfbd-fefb066f40a5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1678 microversion: 2.1 time: 0.238317 Oct 18 17:08:58.506758 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3761/7560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:58 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:59.530615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:59.531686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:59.538619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:59.539227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:59.539681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:59.540380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:59.540842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:59.541308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:59.672934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:59.680653 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-16c3d570-2e8a-4738-a857-4b4c53bfd34d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.154065 Oct 18 17:08:59.681260 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3800/7561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:59 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:00.705306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:00.705919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:00.712921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:00.713433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:00.713865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:00.714550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:00.715002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:00.715425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:00.851284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:00.858892 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8e734106-5958-458e-8e20-949071bf7666 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.157984 Oct 18 17:09:00.860123 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3762/7562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:00 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:01.884065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:01.884694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:01.891226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:01.891821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:01.892288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:01.893047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:01.893532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:01.893986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:02.029792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:02.038617 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b577bd6c-7e04-42d8-bd80-68d57203fbce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.158458 Oct 18 17:09:02.039195 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3801/7563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:01 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:03.061278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:03.061895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:03.069411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:03.069901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:03.070342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:03.071208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:03.071544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:03.071966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:03.202388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:03.210202 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-adab1602-302e-43a1-87e1-95ae167bb82e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.152810 Oct 18 17:09:03.210777 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3763/7564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:03 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:09:04.234719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:04.235318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:04.242377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:04.242878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:04.243336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:04.244047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:04.244512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:04.244952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:04.378421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:04.386179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e4a9e07-2757-4ca0-a50f-49c3229d8b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.155963 Oct 18 17:09:04.386743 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3802/7565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:04 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:05.410485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:05.411095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:05.417897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:05.418386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:05.418823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:05.419513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:05.419969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:05.420396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:05.555682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:05.563432 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2b0682b8-30e5-4a3c-a230-e8a7d02fffe6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.157682 Oct 18 17:09:05.564008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3764/7566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:05 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:06.587051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:06.587674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:06.594671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:06.595162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:06.595612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:06.596314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:06.596785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:06.597251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:06.727882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:06.736528 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-035d08a0-5b77-4fae-8396-34d15681fb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.153373 Oct 18 17:09:06.737128 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3803/7567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:06 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:09:07.760688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:07.761331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:07.769074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:07.769552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:07.769982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:07.770661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:07.771110 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:07.771528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:07.902353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:07.910058 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6e1ffe5e-a8e7-4e93-b47f-b1a1d72431f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.153306 Oct 18 17:09:07.910618 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3765/7568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:07 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:08.933846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:08.934532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:08.942153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:08.942768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:08.943261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:08.944137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:08.944704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:08.945309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:09.080255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:09.088022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51c394be-36f8-46f1-8238-6d1a66fba171 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.158099 Oct 18 17:09:09.088596 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3804/7569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:08 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:10.112049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:10.112668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:10.119728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:10.120218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:10.120664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:10.121391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:10.121854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:10.122291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:10.257264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:10.265178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb09c847-24ee-421d-887f-be974871d9ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1683 microversion: 2.1 time: 0.157687 Oct 18 17:09:10.265762 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3766/7570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:10 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:11.290629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:11.291289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:11.299748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:11.300278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:11.300746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:11.301536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:11.302038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:11.302473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:11.540816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:11.549760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d882bae-fe87-4a44-9b42-cc015b7e1188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1682 microversion: 2.1 time: 0.263124 Oct 18 17:09:11.550367 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3805/7571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:11 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:11.601337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "name": "network-vif-unplugged", "status": "completed", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:11.612934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:11.613630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:11.614065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:11.626520 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Creating event network-vif-unplugged:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h1-858383-14 Oct 18 17:09:11.632224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:09:11.645886 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8a83746a-57b7-4866-a924-9faddbf85d0a req-533b09e5-e979-4408-afc2-8b2269251606 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048419 Oct 18 17:09:11.646498 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3767/7572] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:12.574138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:12.574778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:12.582928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:12.583501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:12.584044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:12.584827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:12.585936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:12.586382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:12.725018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:12.732929 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83fd787f-7882-42d1-9259-c3ea54033e69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1682 microversion: 2.1 time: 0.162683 Oct 18 17:09:12.733529 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3806/7573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:12 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:09:13.677758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:13.687460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:13.688065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:13.688648 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:13.699891 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Creating event network-changed:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h1-858383-14 Oct 18 17:09:13.705379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:09:13.716057 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-be4ed669-6a55-488c-9bbc-00a22b00b28d req-1b28760d-8a1d-4877-a739-c2b9c9f0a629 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043950 Oct 18 17:09:13.716658 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3768/7574] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:13.757714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:13.758348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:13.765184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:13.765687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:13.766822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:13.767563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:13.768043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:13.768491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:13.901658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:13.910624 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fa0332c1-9d07-42a0-b70e-514cd6a733f7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1680 microversion: 2.1 time: 0.156764 Oct 18 17:09:13.911216 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3807/7575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:13 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:14.935735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:14.936427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:14.944138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:14.944679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:14.945139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:14.945831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:14.946309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:14.946732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:15.077521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:15.085661 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0435de86-b2a2-41c5-bbd8-068d19ff7f2a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1680 microversion: 2.1 time: 0.154265 Oct 18 17:09:15.086228 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3769/7576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:14 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:16.109866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:16.110883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:16.117984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.118573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.119130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.119921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.120475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.121009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.601149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:16.609021 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a996e5a3-8883-4a30-a735-4c54c8710971 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1677 microversion: 2.1 time: 0.503006 Oct 18 17:09:16.609684 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3808/7577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:16 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1677 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:16.632441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:16.633051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:16.639992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.640490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.640969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.641775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.642236 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.642670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.701608 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65f3e955-e4d3-44b5-bc09-0d3cd2500658 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/action" status: 204 len: 0 microversion: 2.1 time: 0.072924 Oct 18 17:09:16.702272 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3770/7578] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:09:16 2022] POST /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:09:16.711430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:16.712069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:16.718484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.720309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.720939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.721805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:16.722278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:16.722727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:16.874572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:16.883522 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5bbeed67-79ab-4919-8f84-297ca91b02fb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1677 microversion: 2.1 time: 0.176169 Oct 18 17:09:16.884222 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3809/7579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:16 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:17.909638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:17.910982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:17.917325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:17.918018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:17.918463 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:17.919159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:17.919796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:17.920227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:18.062698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "name": "network-vif-plugged", "status": "completed", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:18.076581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:18.077476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:18.078105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:18.081891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:18.095346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-892edb2b-56a7-4937-bf4e-49ee739ba792 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1677 microversion: 2.1 time: 0.190711 Oct 18 17:09:18.102799 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] Creating event network-vif-plugged:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h1-858383-14 Oct 18 17:09:18.109241 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3771/7580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:17 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:18.110722 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5ad4ab75-ec61-43f3-88f0-8eca3590db9f req-51d4aab4-9ab0-43af-ad2b-105e25c42cf1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050534 Oct 18 17:09:18.111795 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3810/7581] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:09:19.118839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:19.119448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:19.126278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.126751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.127441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.128118 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.128566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.128984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.259811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:19.268296 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-156b0973-9933-4b35-a60b-fd457591ab44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.153142 Oct 18 17:09:19.268731 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3772/7582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:19 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:19.293206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:19.293943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:19.300173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.300674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.301163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.301876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.302348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.302821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.439936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:19.447865 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0897f68e-0053-4578-a218-589f582558c8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.159754 Oct 18 17:09:19.448373 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3811/7583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:19 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:19.471174 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:19.471807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:19.480561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.481126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.481574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.482272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.482739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.483170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.615810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:19.618201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:19.626346 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb89d04b-eff4-4f6c-94b5-b8ae96ab6300 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1669 microversion: 2.1 time: 0.159856 Oct 18 17:09:19.626955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3773/7584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:19 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:19.649007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:19.649533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:19.655508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.656006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.657006 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.657878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.658345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.658779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.685070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:09:19.732511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:19.769372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37f55b3f-04ee-47f7-b2a1-65c29b791c0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 204 len: 0 microversion: 2.1 time: 0.124034 Oct 18 17:09:19.769986 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3812/7585] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:09:19 2022] DELETE /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:09:19.778466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:19.779082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:19.787145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.787331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.787670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.788358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:19.788809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:19.789255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:19.924772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:19.932765 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-593d1020-6b89-40aa-ac40-5177103915dd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1675 microversion: 2.1 time: 0.158467 Oct 18 17:09:19.933581 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3774/7586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:19 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:20.957461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:20.958184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:20.965136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:20.965640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:20.966100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:20.966811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:20.967284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:20.967730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:21.097249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:21.105022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d6397c6e-e018-4b5f-b044-77ea17e049f6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1675 microversion: 2.1 time: 0.152256 Oct 18 17:09:21.105600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3813/7587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:20 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:22.055930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcdb4364-5518-4d6c-beab-31b49a159fe9", "name": "network-vif-deleted", "tag": "13e19c99-c697-40c8-a499-d5f5387b7920"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:22.072700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:22.074020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:22.074722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:22.093036 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] Creating event network-vif-deleted:13e19c99-c697-40c8-a499-d5f5387b7920 for instance fcdb4364-5518-4d6c-beab-31b49a159fe9 on n-h1-858383-14 Oct 18 17:09:22.098228 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0c4f4858-226a-4861-ae55-e4f4e1247e39 req-dd1510c4-54ac-4bb8-9525-0ffbe5b904e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049741 Oct 18 17:09:22.099815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3775/7588] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:22.129518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:22.130077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:22.138252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:22.139032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:22.139698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:22.140614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:22.141312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:22.141929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:22.216463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:22.226436 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9e91a80-7c07-4bde-8c74-8708ae08db51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 200 len: 1324 microversion: 2.1 time: 0.101588 Oct 18 17:09:22.227156 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3814/7589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:22 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 1324 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:23.253024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:23.253753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:23.260116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.260600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.261070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.261767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.262223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.262650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.276684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 HTTP/1.1 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'fcdb4364-5518-4d6c-beab-31b49a159fe9'} Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:09:23.278410 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0a6cdf40-d50d-4b91-86a0-66714c89b2b9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 404 len: 111 microversion: 2.1 time: 0.032325 Oct 18 17:09:23.284896 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3776/7590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:23 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:09:23.292874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:23.293561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:23.300692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.301227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.301687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.302402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.302876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.303317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.317654 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 HTTP/1.1 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'fcdb4364-5518-4d6c-beab-31b49a159fe9'} Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:09:23.319318 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:09:23.326282 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71d1ed11-e98f-453d-9074-d4a6d9d8778b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 404 len: 111 microversion: 2.1 time: 0.031813 Oct 18 17:09:23.327427 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3815/7591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:23 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:09:23.369035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1556094192", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "059c9b7e-df92-413b-97ce-2f8dac1bd268"}], "security_groups": [{"name": "tempest-securitygroup--196977741"}], "key_name": "tempest-keypair-1508672407", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:23.476661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] validate_networks() for [('059c9b7e-df92-413b-97ce-2f8dac1bd268', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:09:23.846663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:09:23.847629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:09:23.847629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:09:23.848288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:09:23.848906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:09:23.857828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.858305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.858734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.859450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:23.859906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:23.860326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:23.876616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:09:23.882057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:09:23.894903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:09:23.897240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:09:23.944784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f81df026-9057-4b73-bb3b-c70ca40becce tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.579590 Oct 18 17:09:23.945633 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3777/7592] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:09:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:09:23.957625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c99067ff-5be6-4d00-be2b-8ef0a33d12c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:23.958575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c99067ff-5be6-4d00-be2b-8ef0a33d12c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:24.017557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c99067ff-5be6-4d00-be2b-8ef0a33d12c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:24.024460 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c99067ff-5be6-4d00-be2b-8ef0a33d12c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1239 microversion: 2.1 time: 0.071709 Oct 18 17:09:24.025301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3816/7593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:23 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:25.051652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:25.052359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:25.061307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:25.061798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:25.062241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:25.062935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:25.063391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:25.063814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:25.142037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:25.149932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7b1f4f05-cb74-4398-8196-9ccb83aa0e35 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1309 microversion: 2.1 time: 0.104426 Oct 18 17:09:25.150520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3778/7594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:25 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:26.174621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:26.175292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:26.184019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:26.184527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:26.184984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:26.185782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:26.186254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:26.186701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:26.326107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:26.334477 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d9b160d-7588-4b7f-a865-07683d530f21 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.163975 Oct 18 17:09:26.335293 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3817/7595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:26 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:26.743546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:26.750738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:26.756348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:26.756847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:26.757300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:26.769968 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] Creating event network-changed:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h2-858383-14 Oct 18 17:09:26.775127 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7e34921b-4928-467c-ad33-3b6340ad2c3c req-da7434b5-44bb-4d53-a399-d69c38d13835 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Oct 18 17:09:26.775661 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3779/7596] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:27.358359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:27.359072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:27.362825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:27.369181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:27.369686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:27.370259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:27.371027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:27.371492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:27.372044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:27.508386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:27.516449 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8bcfa31b-8330-46a2-a18f-49b8c8b20543 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.161982 Oct 18 17:09:27.517050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3818/7597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:27 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:28.541311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:28.542008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:28.548111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:28.549336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:28.549775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:28.550462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:28.550918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:28.551339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:28.681804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:28.689405 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-532a727e-43c0-475e-a323-9faa9cf27d68 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.153210 Oct 18 17:09:28.689966 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3780/7598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:28 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:29.712435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:29.713087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:29.720007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:29.720506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:29.720964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:29.721699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:29.722167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:29.722608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:29.855725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:29.864194 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ccaa779a-d144-4f63-8705-2379c1f02a8f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.155653 Oct 18 17:09:29.864770 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3819/7599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:29 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:30.889016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:30.890039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:30.897328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:30.897813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:30.898246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:30.898931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:30.899381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:30.899821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:31.139203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:31.146894 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6bdfc7b5-7e5b-4176-bf8c-a31c082a3b4b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.261840 Oct 18 17:09:31.147463 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3781/7600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:30 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:32.171302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:32.171938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:32.179001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:32.179510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:32.179988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:32.180695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:32.181272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:32.181724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:32.372700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:32.381488 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-532edf12-ed30-41d8-a45b-a239d383df06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.214313 Oct 18 17:09:32.382087 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3820/7601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:32 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:32.397283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "name": "network-vif-plugged", "status": "completed", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:32.406999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:32.408111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:32.408524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:32.422168 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] Creating event network-vif-plugged:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h2-858383-14 Oct 18 17:09:32.428216 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5643b799-3509-4ecf-af5d-67e23ff28149 req-b4697c3a-c0f5-4afa-9b99-6481c0874097 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036099 Oct 18 17:09:32.428908 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3782/7602] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:33.405784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:33.406334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:33.413954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:33.414457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:33.414912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:33.415621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:33.416119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:33.416562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:33.558159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:33.566596 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f69aee99-634a-4c49-a5c7-cbc211d27c51 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1364 microversion: 2.1 time: 0.164797 Oct 18 17:09:33.567167 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3821/7603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:33 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:34.589592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:34.590656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:34.595409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:34.596241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:34.603323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:34.603805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:34.604243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:34.604935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:34.605421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:34.605878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:34.743572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:09:34.753534 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7f577c0a-9c9b-4e39-9b88-da76b9d34f58 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1550 microversion: 2.1 time: 0.165847 Oct 18 17:09:34.754129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3783/7604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:09:34 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:09:34.777117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:09:34.777734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:09:34.779538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:34.786528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:34.787041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:34.787496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:34.788226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:34.788700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:34.789178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:34.871676 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1b928c5f-413e-49e8-884b-90f56d84ba75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098413 Oct 18 17:09:34.872281 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3822/7605] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:09:34 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:09:35.840256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:09:35.851198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:09:35.851683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:09:35.852143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:09:35.863513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] Creating event network-changed:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h2-858383-14 Oct 18 17:09:35.868609 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-75cb24cd-db22-4373-a80c-79069964b130 req-b6b09a76-7d37-4484-aa51-a90d014cf21a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034891 Oct 18 17:09:35.869238 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3784/7606] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:39.582748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=9 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:39.583498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:39.584643 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:10:39.584791 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action (ip 10.222.0.78) !!! Oct 18 17:10:39.590153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:39.599676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:39.600171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:39.600623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:39.624121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Going to try to stop instance {{(pid=120571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 17:10:39.666573 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f204aed0-a449-4739-83d1-8361d8552034 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action" status: 202 len: 0 microversion: 2.1 time: 0.086093 Oct 18 17:10:39.667329 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3823/7607] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:10:39 2022] POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:10:39.676413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=11 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:39.677598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=43 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:39.678490 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:10:39.678647 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd (ip 10.222.0.78) !!! Oct 18 17:10:39.684981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:39.685923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:39.694836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:39.695324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:39.695772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:39.696495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:39.696954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:39.697421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:39.836629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:39.845163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8b58051-d6ae-48ff-a2dd-3d2ac9cc3932 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.171482 Oct 18 17:10:39.845742 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3785/7608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:39 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:40.869689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:40.871033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:40.877615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:40.878111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:40.878560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:40.879253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:40.879717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:40.880151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:41.017282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:41.025088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-42f13648-fa04-4224-b253-4387f439e203 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.160688 Oct 18 17:10:41.025666 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3824/7609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:40 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:42.050651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:42.051260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:42.058789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:42.059266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:42.059703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:42.060386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:42.060835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:42.061281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:42.191993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:42.199846 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-950701da-431c-4aa2-9e4b-5fd26cd2f83b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.153172 Oct 18 17:10:42.200439 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3786/7610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:42 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:43.223461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:43.224035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:43.231140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:43.231631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:43.232076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:43.232773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:43.233265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:43.233701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:43.366891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:43.375309 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7d8efff0-6670-414a-896a-b95f4bcccd1b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.155753 Oct 18 17:10:43.375888 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3825/7611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:43 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:44.399295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:44.399884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:44.407256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:44.407732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:44.408166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:44.408845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:44.409326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:44.409744 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:44.551806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:44.559706 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-032d3736-2c0d-4124-9b9e-b8ac8e402c4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.164347 Oct 18 17:10:44.560286 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3787/7612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:44 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:45.583997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:45.584562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:45.591412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:45.591908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:45.592359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:45.593091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:45.593564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:45.594003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:45.725747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:45.734086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d4e740b-ca06-4c85-8df4-ba95691f35ae tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.153819 Oct 18 17:10:45.735348 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3826/7613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:45 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:46.758750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:46.759367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:46.767031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:46.767549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:46.767987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:46.768677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:46.769170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:46.769607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:46.903045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:46.910717 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72e7459f-53cb-48da-ba12-9a58f139710b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.155847 Oct 18 17:10:46.911281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3788/7614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:46 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:47.934736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:47.935403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:47.942342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:47.942847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:47.943309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:47.944050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:47.944532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:47.944980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:48.074695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:48.082468 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7de9bf91-41b2-485e-91ff-63490e5b8c37 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.151823 Oct 18 17:10:48.083049 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3827/7615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:47 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:49.106930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:49.107532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:49.114503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:49.114977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:49.115406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:49.116081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:49.116529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:49.116950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:49.252271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:49.260232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3fbdc8e-20f8-4261-853f-db480b6557cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.157720 Oct 18 17:10:49.261393 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3789/7616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:49 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:50.284901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:50.285462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:50.293155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.293701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.294163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.294876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.295352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.295796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.428855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:50.437015 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c27c2ac-4129-40d4-ba3e-47dd2b149c9c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1656 microversion: 2.1 time: 0.156034 Oct 18 17:10:50.437626 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3828/7617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:50 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:50.460585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:50.462829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:50.470546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.471024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.471455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.472131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.472577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.473014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.501091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:50.507254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Old instance type m1.heat2, new instance type m1.heat {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:10:50.514428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:10:50.514849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:10:50.515319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:10:50.515719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:10:50.516121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:10:50.580489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fc777494-1a47-45e2-933f-4b1f248f5e1e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action" status: 202 len: 0 microversion: 2.1 time: 0.123771 Oct 18 17:10:50.581212 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3790/7618] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:10:50 2022] POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:10:50.590012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:50.590671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:50.596891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.597471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.597989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.598703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:50.599172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:50.599609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:50.765043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:50.772947 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1949c21-a1af-4b27-ad68-f0422971bcb8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.187563 Oct 18 17:10:50.773907 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3829/7619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:50 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:51.799459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:51.800107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:51.807152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:51.807639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:51.808078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:51.809320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:51.809779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:51.810210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:51.943167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:51.951121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-43515ed9-887f-4889-a9d5-69a58749f460 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1679 microversion: 2.1 time: 0.156595 Oct 18 17:10:51.951699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3791/7620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:51 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:10:52.974995 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:52.975623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:52.983655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.984153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.984609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:52.985360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.985828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.986270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:53.123848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:53.132298 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fe170d3b-7abc-464c-b143-c4eb138abf0e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1684 microversion: 2.1 time: 0.161127 Oct 18 17:10:53.133024 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3830/7621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:52 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:54.156613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:54.157254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:54.164117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:54.164601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:54.165065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:54.165752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:54.166203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:54.166627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:54.300909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:54.308513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3047005f-2265-4bcd-802e-4acc6bfecb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1684 microversion: 2.1 time: 0.155935 Oct 18 17:10:54.309678 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3792/7622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:54 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:55.332483 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:55.339428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:55.347826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.348458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.348922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.349757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.350229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.350669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.580935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:55.601324 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3b807872-c846-47b3-b84e-686d6f527f3a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1683 microversion: 2.1 time: 0.267483 Oct 18 17:10:55.601962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3831/7623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:55 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1683 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:55.661133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "name": "network-vif-unplugged", "status": "completed", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:55.672628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.673438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.673897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.686809 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Creating event network-vif-unplugged:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h1-858383-14 Oct 18 17:10:55.692659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:10:55.704438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-63149871-1a31-4ae0-b383-42a595768df5 req-2ef7502d-2582-4090-874f-a0dc4e2a6084 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133843 Oct 18 17:10:55.705282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3793/7624] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:10:56.627625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:56.628431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:56.636186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:56.637192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:56.637651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:56.638362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:56.638830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:56.639405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:56.770740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:56.779343 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9ecef154-76a3-4028-83a5-93283c5af9cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1683 microversion: 2.1 time: 0.155917 Oct 18 17:10:56.780166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3832/7625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:56 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:57.733556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:57.742979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.743451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.743876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.755177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Creating event network-changed:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h1-858383-14 Oct 18 17:10:57.760431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:10:57.770945 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d9b5904e-d964-4530-b964-9cc56d913b46 req-cbd0f953-4cf1-4b7b-a40a-d1827c2d5cea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042946 Oct 18 17:10:57.771516 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3794/7626] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:57.803635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:57.804271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:57.811571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.812082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.812538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.813285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.813764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.814212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.953316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:57.961354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-acd22d99-afef-40ed-9e48-7f680ec5d3c0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1681 microversion: 2.1 time: 0.162231 Oct 18 17:10:57.961943 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3833/7627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:57 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:58.988612 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:58.989346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:58.995719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:58.996897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:58.997436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:58.998726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:58.999186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:58.999611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.139691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:59.147971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-889a61b2-ebd1-42d1-8400-185198194fd1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1677 microversion: 2.1 time: 0.165550 Oct 18 17:10:59.148576 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3795/7628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:58 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:10:59.171894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:59.172507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:59.179671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.180185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.180644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.181399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.181878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.182327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.248375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1a1b0e2f-9de0-4de7-83b6-af216ef8a3b0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action" status: 204 len: 0 microversion: 2.1 time: 0.080217 Oct 18 17:10:59.249129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3834/7629] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:10:59 2022] POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:10:59.258820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:59.259668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:59.267748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.268498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.269144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.270070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.270636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.271165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.507536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:59.516017 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-df75ad7e-a6a3-4280-b4bb-ce0f50b90875 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1677 microversion: 2.1 time: 0.261436 Oct 18 17:10:59.516599 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3796/7630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:59 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:00.541240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:00.541990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:00.548566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:00.549107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:00.549565 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:00.550295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:00.550772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:00.551215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:00.691382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:00.699760 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3bcccd7e-0f59-443c-b6c3-583ea3443dd2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1677 microversion: 2.1 time: 0.163587 Oct 18 17:11:00.701043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3835/7631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:00 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:01.725148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:01.725762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:01.732701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:01.733234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:01.733673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:01.734367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:01.734821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:01.735243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:01.867989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:01.876338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb21b2ce-0d3c-46e2-a32f-8d307ad298ac tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1656 microversion: 2.1 time: 0.155099 Oct 18 17:11:01.876944 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3797/7632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:01 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:01.900144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:01.900779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:01.908355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:01.908859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:01.909372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:01.910076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:01.910551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:01.910998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:02.046472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:02.054287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90558b8b-5400-4939-998a-c51396f5a1ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1656 microversion: 2.1 time: 0.158112 Oct 18 17:11:02.054857 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3836/7633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:01 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:02.077827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:02.083897 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:02.084397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:02.084814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:02.106753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Going to try to start instance {{(pid=120570) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 17:11:02.154904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9238da0-dd97-4b43-ae59-2e4e5185e61f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action" status: 202 len: 0 microversion: 2.1 time: 0.080950 Oct 18 17:11:02.155699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3798/7634] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:11:02 2022] POST /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:11:02.163759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:02.164423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:02.171276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:02.171821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:02.172552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:02.173381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:02.173886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:02.174380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:02.191037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:02.336733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "name": "network-vif-plugged", "status": "completed", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:02.349097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:02.349585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:02.350015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:02.360983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:02.362174 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] Creating event network-vif-plugged:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h1-858383-14 Oct 18 17:11:02.367304 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-07d41108-3c92-40b8-8bba-69f7e7371f2d req-a58b8333-33e4-4c9c-a95b-da454150c166 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098022 Oct 18 17:11:02.368485 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3799/7635] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:11:02.370749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d3dc800-d0b1-4556-9260-ef5631d0d3a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1665 microversion: 2.1 time: 0.210786 Oct 18 17:11:02.372729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3837/7636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:02 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1665 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:03.396132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:03.396824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:03.405506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:03.405991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:03.406422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:03.407108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:03.407557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:03.407975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:03.429340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:03.549941 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:03.557644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f1c38a6c-2ae1-4e47-aeb4-452b192936cb tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1665 microversion: 2.1 time: 0.165697 Oct 18 17:11:03.558499 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3800/7637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:03 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:04.583245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:04.583934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:04.591278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.591887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.592409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:04.593246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.593728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.594177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:04.732856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:04.740943 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6014c07a-ff59-4d00-b561-1a37d0fe00a7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1669 microversion: 2.1 time: 0.161559 Oct 18 17:11:04.741541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3838/7638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:04 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:04.765535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:04.767074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:04.773422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.774206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.774651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:04.775355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.775815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.776239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:04.809450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:11:04.888505 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01290eb3-b5e7-4ddf-8b8f-41e17f0e358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 204 len: 0 microversion: 2.1 time: 0.127005 Oct 18 17:11:04.889150 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3801/7639] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:11:04 2022] DELETE /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:11:04.898412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:04.899366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:04.911018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.911540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.911991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:04.912699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:04.913202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:04.913642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:05.050552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:05.058579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-340d9757-fc7e-464f-b561-ba810f6e8cad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1675 microversion: 2.1 time: 0.164078 Oct 18 17:11:05.059139 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3839/7640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:04 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:06.082865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:06.083565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:06.090511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:06.090996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:06.091438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:06.092139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:06.092594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:06.093041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:06.232095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:06.240035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06448796-bb2a-47d7-9f8e-1cf3dbb6d2df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1675 microversion: 2.1 time: 0.161458 Oct 18 17:11:06.240610 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3802/7641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:06 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:07.265378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:07.266176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:07.273718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:07.274325 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:07.274879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:07.275677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:07.276261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:07.276796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:07.287537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922ed6fb-3e7f-49b0-93a6-dc4494e3bedd", "name": "network-vif-deleted", "tag": "94685a0f-83b9-4573-a0de-26765a2cf0d3"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:07.300534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:07.301105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:07.301539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:07.314313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] Creating event network-vif-deleted:94685a0f-83b9-4573-a0de-26765a2cf0d3 for instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd on n-h1-858383-14 Oct 18 17:11:07.330394 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-348a0cd6-e6d2-4439-9a8e-beb0f31ddf99 req-cbcfd2e8-299d-4be6-9c0a-c04e9dee8a59 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Oct 18 17:11:07.331072 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3803/7642] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:11:07.358174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:07.367086 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-77d9befc-1a09-4c0b-8aae-5ee114524642 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 200 len: 1608 microversion: 2.1 time: 0.106976 Oct 18 17:11:07.368232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3840/7643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:07 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 1608 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:08.393948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:08.394643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:08.400691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:08.401212 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:08.401646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:08.402427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:08.402876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:08.403397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:08.416353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd HTTP/1.1 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '922ed6fb-3e7f-49b0-93a6-dc4494e3bedd'} Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:08.418456 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61bd9c2d-e8da-43ca-aa0b-40e8d17402ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 404 len: 111 microversion: 2.1 time: 0.031039 Oct 18 17:11:08.423492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3804/7644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:08 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:11:08.436822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:08.437618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:08.444668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:08.445238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:08.445701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:08.446415 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:08.446888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:08.447334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:08.460613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd HTTP/1.1 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '922ed6fb-3e7f-49b0-93a6-dc4494e3bedd'} Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:08.462297 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c958bfc1-5816-45d9-b627-cd088a641ec4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 404 len: 111 microversion: 2.1 time: 0.031940 Oct 18 17:11:08.466675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3841/7645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:08 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:11:08.513279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-450347832", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "059c9b7e-df92-413b-97ce-2f8dac1bd268"}], "security_groups": [{"name": "tempest-securitygroup--196977741"}], "key_name": "tempest-keypair-1508672407", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:08.620822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] validate_networks() for [('059c9b7e-df92-413b-97ce-2f8dac1bd268', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:11:09.038308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:11:09.038773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:11:09.039244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:11:09.039641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:11:09.040045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:11:09.048940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:09.049444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:09.049874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:09.050589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:09.051036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:09.051452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:09.068407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:11:09.073617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:11:09.086254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:11:09.088533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:11:09.134339 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2773e823-a258-455d-94f9-96c5ecfa272c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.625303 Oct 18 17:11:09.134982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3805/7646] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:11:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:11:09.146612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ea06058-5f7d-421d-a244-725bf0a0d08e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:09.147242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ea06058-5f7d-421d-a244-725bf0a0d08e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:09.202174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3ea06058-5f7d-421d-a244-725bf0a0d08e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:09.209042 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ea06058-5f7d-421d-a244-725bf0a0d08e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1238 microversion: 2.1 time: 0.066212 Oct 18 17:11:09.209594 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3842/7647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:09 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:10.234819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:10.235696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:10.238284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:10.245692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:10.246268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:10.247714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:10.248433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:10.248896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:10.249352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:10.645838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:10.653982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7268b5ee-29ad-4762-87b5-d6e9249ed3a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1298 microversion: 2.1 time: 0.425984 Oct 18 17:11:10.654554 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3806/7648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:10 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1298 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:11.678801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:11.679572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:11.683267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=43 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:11.688724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:11.689264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:11.689722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:11.690434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:11.690924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:11.691350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:11.836867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:11.845255 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b3ea16e1-ac33-48d3-9796-5095826ea557 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.170330 Oct 18 17:11:11.845838 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3843/7649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:11 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:12.093765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:12.103381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:12.103856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:12.104280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:12.115782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] Creating event network-changed:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:11:12.120784 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-7fda300b-85b1-42f2-8a0f-a0ce1483d7e3 req-2538fe05-eb7f-449d-856c-f9b2d7067ab7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095619 Oct 18 17:11:12.121937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3807/7650] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:11:12.869170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:12.869800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:12.876915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:12.877692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:12.878150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:12.878853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:12.879331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:12.879769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:13.015394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:13.023075 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ae93ce83-6594-4fc4-bfc5-d59ad6d6239b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.157835 Oct 18 17:11:13.023644 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3844/7651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:12 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:14.047076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:14.047816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:14.055046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:14.055525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:14.055960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:14.056646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:14.057134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:14.057582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:14.189582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:14.197254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57fedc04-7a2a-420f-8366-849125cc16ca tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.154527 Oct 18 17:11:14.197834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3808/7652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:14 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:15.221846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:15.222472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:15.229371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:15.229869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:15.230319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:15.231665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:15.232133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:15.232592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:15.368202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:15.376158 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06fe2cf5-7fb8-4f3a-85bf-0831017b6ac3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.158181 Oct 18 17:11:15.376747 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3845/7653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:15 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:16.399669 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:16.400319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:16.407316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:16.407803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:16.408246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:16.408935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:16.409415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:16.409845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:16.546747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:16.554870 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-69a8fd16-7254-4502-927e-72775b26e625 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.159090 Oct 18 17:11:16.555732 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3809/7654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:16 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:16.985769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-plugged", "status": "completed", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:16.998179 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:16.998694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:16.999147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:17.011164 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] Creating event network-vif-plugged:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:11:17.018008 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1d0cbbe1-e9c7-4619-a465-906877047a94 req-aa466c1a-8877-49a1-8caa-46d0d801508d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Oct 18 17:11:17.018824 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3846/7655] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:11:17.579251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:17.579822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:17.586668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:17.587147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:17.587583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:17.588270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:17.588726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:17.589310 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:17.725072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:17.733509 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-552f52d2-fd18-40d7-88ac-478682398e67 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1363 microversion: 2.1 time: 0.158239 Oct 18 17:11:17.734099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3810/7656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:17 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:18.758509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:18.759217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:18.765600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:18.766135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:18.766581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:18.767298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:18.767763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:18.768199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:18.908242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:11:18.916053 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85d80057-7dd9-47c0-9aa5-0c736ebd2d13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1549 microversion: 2.1 time: 0.162785 Oct 18 17:11:18.916623 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3847/7657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:18 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:11:18.940581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:18.941102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:18.947873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:18.948346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:18.948777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:18.949509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:18.950535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:18.950678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:19.028128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-39bf3990-1802-4aa7-9a0b-6dfeba5d4854 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090901 Oct 18 17:11:19.028727 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3811/7658] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:11:18 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:11:19.974417 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:11:19.979319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:19.986170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:19.986662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:19.987116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:19.998561 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] Creating event network-changed:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:11:20.003741 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4cd5a754-1521-48e2-bd7f-d3a896b80f5a req-96a4e21e-541f-4634-96ba-4e601eee8eca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033064 Oct 18 17:11:20.004326 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3848/7659] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:12:31.989782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:31.990812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:31.993933 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=11 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:31.994958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:32.001722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:32.004182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:32.012092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:32.012569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:32.013021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:32.013697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:32.014149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:32.014572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:32.044420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:32.049748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Old instance type m1.heat2, new instance type m1.heat {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:12:32.056058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:12:32.056490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:12:32.056942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:12:32.057382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:12:32.057766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:12:32.123737 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21b6b38c-8109-4627-af5e-4602a45b858e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/action" status: 202 len: 0 microversion: 2.1 time: 0.135239 Oct 18 17:12:32.124355 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3812/7660] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:12:31 2022] POST /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:12:32.131641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=11 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:32.132499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=51 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:32.133820 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:12:32.133974 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 (ip 10.222.0.78) !!! Oct 18 17:12:32.140715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:32.141481 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:32.149584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:32.150077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:32.150527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:32.151904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:32.152381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:32.152852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:32.311167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:32.319440 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c28ae328-bf94-47fa-b386-410a0119d76a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1677 microversion: 2.1 time: 0.190470 Oct 18 17:12:32.320166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3849/7661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:32 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:33.344484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:33.345139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:33.351956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:33.352531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:33.352977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:33.353694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:33.354691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:33.355127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:33.488415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:33.498521 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-064926b7-0632-4906-92f3-92c30d55475c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1677 microversion: 2.1 time: 0.158101 Oct 18 17:12:33.499202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3813/7662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:33 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:34.523047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:34.523668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:34.531128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:34.531619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:34.532066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:34.532764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:34.533253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:34.533690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:34.666480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:34.675233 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6ccc07e3-5a20-46f4-b7d3-31692e85e827 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.156101 Oct 18 17:12:34.675798 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3850/7663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:34 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:35.700715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:35.701386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:35.708083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:35.708566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:35.709021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:35.709705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:35.710153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:35.710573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:35.843997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:35.851641 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe7041db-c5e8-448e-b68d-5cab23763777 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.155178 Oct 18 17:12:35.852209 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3814/7664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:35 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:36.874328 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:36.875010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:36.882102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:36.882593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:36.883035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:36.883727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:36.884196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:36.884631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:37.020903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:37.029594 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bb8ca3f1-ca57-42bb-8811-6c1f48a1998c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.159240 Oct 18 17:12:37.030165 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3851/7665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:36 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:38.098166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:38.098811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:38.105383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:38.105869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:38.106305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:38.106992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:38.107449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:38.107873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:38.237060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:38.245467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cbd0645c-22e3-4902-a0ba-425916e80046 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.194978 Oct 18 17:12:38.246197 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3815/7666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:38 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:39.268250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:39.270348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:39.276040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:39.276611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:39.277082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:39.277785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:39.278249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:39.278682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:39.413583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:39.421494 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00e564dd-6934-4a9b-969c-21a6c914ca19 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.157181 Oct 18 17:12:39.422078 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3852/7667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:39 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:40.446389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:40.447002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:40.454513 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:40.454996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:40.455435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:40.456122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:40.456579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:40.457024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:40.593462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:40.601107 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-21099ee0-5338-4d3e-9cfc-ae8fb2e15769 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.158902 Oct 18 17:12:40.601688 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3816/7668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:40 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:41.623911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:41.624456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:41.631532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:41.632028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:41.632479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:41.633211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:41.633690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:41.634130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:42.029595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:42.037426 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e032d6ad-f734-49e4-b736-110fff79a6a6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.417511 Oct 18 17:12:42.037999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3853/7669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:41 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:43.061144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:43.061758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:43.068005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:43.068481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:43.068911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:43.069619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:43.070073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:43.070500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:43.201394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:43.209308 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-513cc3d5-7946-490f-9e2c-48949518cc44 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.152287 Oct 18 17:12:43.209878 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3817/7670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:43 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:44.234442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:44.235059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:44.241910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:44.242407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:44.242860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:44.243648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:44.244711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:44.245239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:44.378356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:44.386190 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ba787990-6ca7-4977-bb0e-1405b68bf7d8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.155719 Oct 18 17:12:44.386753 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3854/7671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:44 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:45.409281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:45.409871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:45.416822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:45.417329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:45.417761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:45.418444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:45.418895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:45.419318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:45.550793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:45.559099 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-421328ec-2ade-45b0-8b02-922af597c188 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1682 microversion: 2.1 time: 0.153748 Oct 18 17:12:45.559670 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3818/7672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:45 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:46.583053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:46.583686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:46.591395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:46.591905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:46.592359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:46.593100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:46.593577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:46.594022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:46.836369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:46.844524 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-03620293-201d-4fb9-b67e-762816157358 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1681 microversion: 2.1 time: 0.265272 Oct 18 17:12:46.845229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3855/7673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:46 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:47.027854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-unplugged", "status": "completed", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:47.038950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:47.039610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:47.040043 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:47.054094 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Creating event network-vif-unplugged:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h1-858383-14 Oct 18 17:12:47.060630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:12:47.073678 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8cdce0d6-3f34-4bbc-903b-aae629053766 req-284e9dbb-e9e1-4442-a5f9-56675beb01ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050817 Oct 18 17:12:47.074481 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3819/7674] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:12:47.867940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:47.869356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:47.876668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:47.877222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:47.877944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:47.878665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:47.879140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:47.879588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:48.135165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:48.145727 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b04a556b-ac35-4d74-bbc0-060203323139 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1681 microversion: 2.1 time: 0.281653 Oct 18 17:12:48.146327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3856/7675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:47 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1681 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:49.089213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:49.099536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:49.100006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:49.100431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:49.111928 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Creating event network-changed:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h1-858383-14 Oct 18 17:12:49.117041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:12:49.128324 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-689eede6-6df0-49a3-bd58-363a90e385a5 req-8b599d7e-92d3-4b51-b383-614b904b0b77 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043356 Oct 18 17:12:49.128897 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3820/7676] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:12:49.174862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:49.175516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:49.183001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:49.183814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:49.184285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:49.185041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:49.185536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:49.185988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:49.321465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:49.330044 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-644cb603-b465-475d-8faf-032bfe542e23 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1679 microversion: 2.1 time: 0.160428 Oct 18 17:12:49.330632 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3857/7677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:49 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:50.356234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:50.356950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:50.363033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:50.363511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:50.363943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:50.364620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:50.365093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:50.365514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:50.500233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:50.508161 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e85fa24-8028-4ad0-b4de-49720b80d550 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1679 microversion: 2.1 time: 0.157536 Oct 18 17:12:50.508734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3821/7678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:50 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:51.530673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:51.531314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:51.538275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.538782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.539242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.539959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.540463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.541445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.757662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:51.765872 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9097b262-5231-4b48-a0fd-f60b7635e0d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1676 microversion: 2.1 time: 0.239154 Oct 18 17:12:51.766748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3858/7679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:51 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:12:51.789009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:51.789640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:51.797354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.797837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.798274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.798965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.799414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.799834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.837709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.837709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.838146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.838861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.839313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.839732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.859923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:12:51.864920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:12:51.966702 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-82be7275-6816-4663-8115-cfd60511f1c2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/action" status: 202 len: 0 microversion: 2.1 time: 0.181337 Oct 18 17:12:51.967336 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3822/7680] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:12:51 2022] POST /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:12:51.983609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:51.984252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:51.990692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.991200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.991653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:51.992370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:51.992843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:51.993321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:52.194832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:52.202808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b3bc296-f623-408d-a7c5-15f0fd10bb00 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.223224 Oct 18 17:12:52.203389 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3859/7681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:51 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:53.226950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:53.227650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:53.238998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:53.239481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:53.239923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:53.240611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:53.241092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:53.241520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:53.378061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:53.385806 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10274969-f37e-44e7-a553-ec2cc4b3c02c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.163183 Oct 18 17:12:53.386387 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3823/7682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:53 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:54.411081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:54.411711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:54.418770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:54.419269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:54.419726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:54.420439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:54.420913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:54.421400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:54.563228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:54.570991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a1176e1-cd63-45b9-880f-1a1cbff0c45e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.164088 Oct 18 17:12:54.571565 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3860/7683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:54 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:54.634237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-plugged", "status": "completed", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:54.647251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:54.647932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:54.648551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:54.663767 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Creating event network-vif-plugged:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h1-858383-14 Oct 18 17:12:54.670206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:12:54.681089 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-8e91bf55-de79-4a8e-8f4c-0331de3ea1db req-660ecb14-780b-4e5c-afd9-6885dcf77e16 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050654 Oct 18 17:12:54.681961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3824/7684] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:12:55.408449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-unplugged", "status": "completed", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:55.419353 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:55.419957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:55.420247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:55.433322 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Creating event network-vif-unplugged:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:12:55.438814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:12:55.451427 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-f786f729-248b-4fb0-9b18-e6568a05c42f req-114d0422-5f85-45f1-9814-ec2ca24b1819 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046624 Oct 18 17:12:55.452418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3861/7685] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:12:55.597605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:55.598315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:55.605253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:55.605773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:55.606286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:55.606987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:55.607444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:55.607870 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:55.612079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:55.810833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:55.818647 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-442dfc35-14bd-468e-991d-b26b38ef1c10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.225430 Oct 18 17:12:55.819224 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3825/7686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:55 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:56.845194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:56.845923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:56.852304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:56.852717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:56.853245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:56.854029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:56.854506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:56.854954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:56.988194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:56.996170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b005dac-01e7-4f37-9abb-081e0e22d2fc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.156244 Oct 18 17:12:56.996742 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3862/7687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:56 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:57.468141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:12:57.478243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:57.479040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:57.479483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:57.490963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Creating event network-changed:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:12:57.496961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:12:57.507614 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-f20ee68f-bd0b-44d8-9205-f6b1368ac8b6 req-82607639-35e8-44aa-b6c0-e98145119a4f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043117 Oct 18 17:12:57.508202 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3826/7688] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:12:58.019951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:58.020577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:58.027538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:58.028041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:58.028494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:58.029247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:58.029713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:58.030151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:58.160175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:58.168315 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb84689d-0918-4734-8b1f-737d549a1e4d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.152465 Oct 18 17:12:58.168871 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3863/7689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:58 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:12:59.193333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:12:59.194064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:12:59.200962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:59.201476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:59.201916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:59.202609 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:12:59.203068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:12:59.203490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:12:59.351466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:12:59.361446 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc6cb45f-4334-4953-b9e3-d8b0953ccd2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1675 microversion: 2.1 time: 0.173266 Oct 18 17:12:59.362129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3827/7690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:12:59 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:00.385867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:00.386516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:00.393420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.393925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.394381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.395093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.395566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.396012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.531484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:00.539380 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ad974498-f3c7-4605-afbe-607e046bb458 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1668 microversion: 2.1 time: 0.157588 Oct 18 17:13:00.539967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3864/7691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:00 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:00.562101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:00.562705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:00.569763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.570252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.570689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.571386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.572426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.572857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.700842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:00.708453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0707aaac-211d-404f-8eca-59f9c3bbef7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1668 microversion: 2.1 time: 0.150150 Oct 18 17:13:00.709033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3828/7692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:00 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:00.730802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:00.731435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:00.737755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.738260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.738722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.739431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.739913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.740360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.873092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:00.876628 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=100 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:00.881685 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99e51edd-aa41-4008-8025-4aa682b2cdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1668 microversion: 2.1 time: 0.154811 Oct 18 17:13:00.882261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3865/7693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:00 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:00.905718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:00.906148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:00.912071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.912551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.913019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.913705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:00.914161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:00.914785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:00.941918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:13:01.016940 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c0c9dd24-f0a2-4309-9b84-bd7bb092358f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 204 len: 0 microversion: 2.1 time: 0.114788 Oct 18 17:13:01.017586 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3829/7694] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:13:00 2022] DELETE /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:13:01.027199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:01.027835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:01.034083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:01.034586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:01.035043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:01.035762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:01.036238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:01.036686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:01.167977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:01.175844 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-263f66dd-2431-4025-b5fc-cca59c2d60ab tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1674 microversion: 2.1 time: 0.153568 Oct 18 17:13:01.176427 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3866/7695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:01 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:01.400059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-plugged", "status": "completed", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:01.410022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:01.410473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:01.410901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:01.426640 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] Creating event network-vif-plugged:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:13:01.432483 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-44d20911-e88a-4807-83af-866e10f7f88c req-67d95980-c9c1-42e1-a333-1cf25e9c66c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035826 Oct 18 17:13:01.433184 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3830/7696] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:13:02.202166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:02.203284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:02.207200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=37 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:02.213874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:02.214668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:02.215329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:02.216268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:02.216740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:02.217233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:02.350763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:02.358813 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d9988c3-e833-4471-8c97-60eded646958 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1674 microversion: 2.1 time: 0.162879 Oct 18 17:13:02.359385 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3867/7697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:02 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:03.383245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:03.383978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:03.388625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:03.390088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:03.395795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:03.396359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:03.396926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:03.397723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:03.398264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:03.398761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:03.456758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5513c4-35bb-4dfe-9c39-7cb760550f03", "name": "network-vif-deleted", "tag": "1a47f095-520a-40f9-afad-8a84ad7b3a7f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:03.469375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:03.470249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:03.470708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:03.482959 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] Creating event network-vif-deleted:1a47f095-520a-40f9-afad-8a84ad7b3a7f for instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 on n-h2-858383-14 Oct 18 17:13:03.489266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c85a5cb0-b36f-4cab-af56-5b4212c87a75 req-d42d6e7b-b089-4ea9-bb1f-4bb30399f589 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036048 Oct 18 17:13:03.490038 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3868/7698] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:13:03.490911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:03.500067 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d8f33a86-01cd-4d53-ad2b-38d2e7b746a3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 200 len: 1607 microversion: 2.1 time: 0.121060 Oct 18 17:13:03.500655 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3831/7699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:03 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 1607 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:04.525727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:04.526684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:04.532964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:04.533455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:04.533913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:04.534731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:04.535223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:04.535651 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:04.549819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 HTTP/1.1 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4c5513c4-35bb-4dfe-9c39-7cb760550f03'} Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:13:04.551484 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b35d90c9-f0c6-4721-8d0d-e746bd7ed62c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 404 len: 111 microversion: 2.1 time: 0.032763 Oct 18 17:13:04.556435 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3869/7700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:04 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:13:04.571182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:04.572031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:04.578866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:04.579425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:04.579938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:04.580704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:04.581276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:04.581776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:04.596175 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 HTTP/1.1 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '4c5513c4-35bb-4dfe-9c39-7cb760550f03'} Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:13:04.598000 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f6d9f7b5-9513-47fc-8686-6075710f0b06 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 404 len: 111 microversion: 2.1 time: 0.032043 Oct 18 17:13:04.604289 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3832/7701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:04 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:13:04.654202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1289917514", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "059c9b7e-df92-413b-97ce-2f8dac1bd268"}], "security_groups": [{"name": "tempest-securitygroup--196977741"}], "key_name": "tempest-keypair-1508672407", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:04.761798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] validate_networks() for [('059c9b7e-df92-413b-97ce-2f8dac1bd268', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:13:05.517185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:13:05.517625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:13:05.518111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:13:05.518534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:13:05.518958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:13:05.528515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:05.529174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:05.529486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:05.530220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:05.530690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:05.531127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:05.547956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:13:05.553139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:13:05.566870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:13:05.569215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:13:05.623321 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-60127f6e-bc28-4f6a-9b8e-f98b095d1c7d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973677 Oct 18 17:13:05.623981 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3870/7702] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:13:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:13:05.636170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a6f5787-e26c-4d99-9ba5-5a46de8f99b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:05.636786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a6f5787-e26c-4d99-9ba5-5a46de8f99b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:05.695143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1a6f5787-e26c-4d99-9ba5-5a46de8f99b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:05.704020 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a6f5787-e26c-4d99-9ba5-5a46de8f99b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1239 microversion: 2.1 time: 0.072328 Oct 18 17:13:05.704591 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3833/7703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:05 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:06.733008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:06.733932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:06.741276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:06.741815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:06.742423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:06.743165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:06.743637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:06.744848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:06.840011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:06.848074 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c3526848-b504-4a24-8578-a0d9087af58f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1299 microversion: 2.1 time: 0.122109 Oct 18 17:13:06.848650 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3871/7704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:06 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:07.872343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:07.873081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:07.880038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:07.880531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:07.880976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:07.881704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:07.882165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:07.882594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:08.017725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:08.025482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2feb3efc-386f-4f8f-a868-086bf5252dcc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.157717 Oct 18 17:13:08.026054 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3834/7705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:07 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:08.152566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:08.163658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:08.164427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:08.164873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:08.178259 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] Creating event network-changed:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:13:08.183893 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b6846afc-6991-4c94-9869-c7154304b3d4 req-85a43281-c4f4-4bd5-b868-9b59b1a49cd4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036126 Oct 18 17:13:08.184514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3872/7706] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:13:09.049714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:09.050324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:09.057061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:09.057611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:09.058091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:09.059404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:09.059875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:09.060306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:09.191487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:09.199140 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b550709d-3e02-499e-822f-4699949527f9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.153263 Oct 18 17:13:09.199699 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3835/7707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:09 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:10.223873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:10.225255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:10.233311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:10.233811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:10.234262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:10.234981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:10.235444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:10.235882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:10.377473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:10.386248 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f9b68e2c-eb2f-47c6-b277-752fa7dbfc10 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.166444 Oct 18 17:13:10.386952 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3873/7708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:10 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:13:11.410814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:11.411437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:11.419705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:11.420192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:11.420638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:11.421401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:11.421861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:11.422290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:11.553155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:11.561311 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e0ef561-3e44-4171-b42d-07ede240be69 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.154382 Oct 18 17:13:11.561884 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3836/7709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:11 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:12.585306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:12.585972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:12.593052 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:12.593554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:12.594004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:12.594705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:12.595170 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:12.595601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:12.730410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:12.738098 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-de60ab2f-4455-4ab2-a05e-5a6525657ec6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.156705 Oct 18 17:13:12.738680 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3874/7710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:12 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:13.762918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:13.763467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:13.769673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:13.770155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:13.770591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:13.771271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:13.771721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:13.772142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:14.224929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:14.233674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2d2e9c94-c6d2-445e-9e90-22337218f764 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.475390 Oct 18 17:13:14.234241 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3837/7711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:13 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:14.665265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-plugged", "status": "completed", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:14.676910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:14.677513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:14.677945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:14.689408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] Creating event network-vif-plugged:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:13:14.694713 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9cc6da91-417f-4b20-b7c3-2b0ff1fee4da req-fac320f4-9711-402a-9d38-89b1fb3887c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033760 Oct 18 17:13:14.695320 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3875/7712] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:13:15.257821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:15.258435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:15.265260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:15.265742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:15.266178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:15.266861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:15.267316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:15.267740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:15.400843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:15.409467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-35565d32-7432-4206-9e5c-bcef22f6face tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1364 microversion: 2.1 time: 0.155490 Oct 18 17:13:15.410061 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3838/7713] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:15 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:16.430473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:16.431269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:16.437264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:16.437998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:16.445285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:16.445704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:16.446218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:16.446976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:16.447416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:16.447915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:16.579746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:13:16.587589 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12878498-80a7-41b6-b779-a5d07b3ff065 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1551 microversion: 2.1 time: 0.158036 Oct 18 17:13:16.588107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3876/7714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:13:16 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:13:16.611271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:13:16.611817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:13:16.613661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:16.619670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:16.620706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:16.621280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:16.621983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:16.622444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:16.622875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:16.700549 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f89453ba-32f9-4701-8cd6-27891b27e336 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093086 Oct 18 17:13:16.701180 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3839/7715] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:13:16 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:13:17.649851 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:13:17.660304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:13:17.660801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:13:17.661285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:13:17.672868 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] Creating event network-changed:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:13:17.677901 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2f5f58bc-f50a-47f1-a2a0-52de63bbe02b req-df0afb77-1620-4007-8eb4-a5f181fe0ae2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031831 Oct 18 17:13:17.678527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3877/7716] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:14:33.330049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=19 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:33.330785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:33.332444 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:14:33.332911 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 (ip 10.222.0.78) !!! Oct 18 17:14:33.338768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:33.339376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:33.347980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:33.348485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:33.348918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:33.349625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:33.350082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:33.350500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:33.549443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:33.557165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4c5e725b-e13b-4ce6-946f-07d0e51fb156 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1670 microversion: 2.1 time: 0.229594 Oct 18 17:14:33.557734 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3840/7717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:33 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:33.579773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:33.580468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=48 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:33.581658 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:14:33.581799 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments (ip 10.222.0.78) !!! Oct 18 17:14:33.592880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ed032a4-ed31-4ad0-ba98-f66073f95023"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:14:33.595318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:33.603945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:33.604446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:33.604898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:33.605639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:33.606592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:33.607163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:34.030108 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3475011c-f87c-4e58-b60d-6bc47e3d635f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453053 Oct 18 17:14:34.030729 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3878/7718] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:14:33 2022] POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:14:44.753557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:14:44.755828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:44.758031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:44.758883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:44.765511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:44.765982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:44.766422 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:44.767369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:44.767839 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:44.768296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:44.807665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:44.814457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Old instance type m1.heat2, new instance type m1.heat {{(pid=120570) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:14:44.821785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:14:44.822206 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:14:44.822708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:14:44.823116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:14:44.823525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:14:44.885225 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:14:45.892980 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53836. Oct 18 17:14:45.896215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4cba1ff5-ef9f-4b32-a734-d1e2ed5ba4e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/action" status: 202 len: 0 microversion: 2.1 time: 1.147040 Oct 18 17:14:45.896834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3841/7719] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:14:44 2022] POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/action => generated 0 bytes in 1148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:14:45.903233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:45.904089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:45.908972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:45.909824 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:45.918239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:45.918858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:45.919332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:45.920292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:45.921042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:45.921499 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:46.087715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:46.096451 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bf10ca35-acd8-48fa-97ea-42bf7482afee tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1725 microversion: 2.1 time: 0.195117 Oct 18 17:14:46.097051 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3879/7720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:45 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:47.120805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:47.121472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:47.128942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:47.129457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:47.129886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:47.130572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:47.131021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:47.131442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:47.260439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:47.270385 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-24043098-4d70-47cf-ab9c-e8626b6cdb2e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1725 microversion: 2.1 time: 0.154481 Oct 18 17:14:47.271031 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3842/7721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:47 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:48.294136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:48.294682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:48.302118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:48.302613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:48.303069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:48.303798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:48.304267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:48.304705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:48.440955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:48.449240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c596992-74a9-4c61-be0f-a200145ca93f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.159122 Oct 18 17:14:48.449831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3880/7722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:48 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:49.474050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:49.474671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:49.481490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:49.482005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:49.482450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:49.483146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:49.483599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:49.484026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:49.622763 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:49.632232 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77929af3-6dad-40a4-bd5b-3f708a425325 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.162093 Oct 18 17:14:49.632809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3843/7723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:49 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:50.658114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:50.658745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:50.665602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:50.666127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:50.666568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:50.667282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:50.667763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:50.668208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:50.800808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:50.809144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-640bf863-9bce-4345-8582-7ec91ee5dc20 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156113 Oct 18 17:14:50.809723 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3881/7724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:50 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:51.832106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:51.832654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:51.839504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:51.839995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:51.840456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:51.841176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:51.841636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:51.842067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:51.976346 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:51.984742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2581c2fb-060b-49ca-9e3f-0e9db07daa50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156772 Oct 18 17:14:51.985850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3844/7725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:51 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:53.009023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:53.009747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:53.016542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:53.017069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:53.017527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:53.018236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:53.018703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:53.019143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:53.152323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:53.161347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-05ea7bb5-9e56-45a1-8e5b-1744c425bda3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156290 Oct 18 17:14:53.161923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3882/7726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:53 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:54.186041 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:54.186588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:54.193926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:54.194403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:54.194836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:54.195518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:54.195967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:54.196388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:54.329414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:54.337916 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb2c0d8f-3c94-4502-a480-006aecb59d07 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.155771 Oct 18 17:14:54.338489 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3845/7727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:54 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:55.360245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:55.360884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:55.368085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:55.368594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:55.369079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:55.369789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:55.370267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:55.370713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:55.502127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:55.511509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b5aa985-75dc-4858-a425-6de14ff695e0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.155163 Oct 18 17:14:55.512085 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3883/7728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:55 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:56.536255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:56.537572 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:56.544845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:56.545376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:56.545823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:56.546557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:56.547017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:56.547447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:56.684021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:56.692461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f004ebb2-5e26-461c-97d1-35736758f710 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.160957 Oct 18 17:14:56.693063 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3846/7729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:56 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:57.716490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:57.717097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:57.724750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:57.725287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:57.725740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:57.726448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:57.726919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:57.727359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:57.860054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:57.869092 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6bb35174-9a2e-43d1-a7ba-71d5c7b7414e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156543 Oct 18 17:14:57.869678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3884/7730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:57 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:14:58.892912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:14:58.893563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:14:58.900408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:58.900889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:58.901355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:58.902035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:14:58.902484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:14:58.902906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:14:59.036180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:14:59.044456 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-17c672f1-97c0-415e-94c4-4b1e8764ad9b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.155402 Oct 18 17:14:59.045031 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3847/7731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:14:58 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:00.068420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:00.069077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:00.076021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:00.076526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:00.076983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:00.077728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:00.078207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:00.078655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:00.211377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:00.219921 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b4dc215b-23df-4e46-8b1c-392fbafe087e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156026 Oct 18 17:15:00.220519 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3885/7732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:00 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:01.244384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:01.244913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:01.251700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:01.252184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:01.252621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:01.254332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:01.254833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:01.255287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:01.388566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:01.396817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ddd1ce11-90fe-4958-86b6-73d90c93f7e2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156788 Oct 18 17:15:01.397438 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3848/7733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:01 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:02.420829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:02.421494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:02.428164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:02.428672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:02.429161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:02.429880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:02.430358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:02.430808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:02.567086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:02.575663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-96f585b5-4be0-4a6d-90ae-7243e1681ed4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.158989 Oct 18 17:15:02.576246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3886/7734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:02 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:03.599860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:03.600484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:03.607566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:03.608053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:03.608496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:03.609235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:03.609703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:03.610135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:03.742020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:03.750260 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eaf533ad-11f2-4bf4-87ef-c0f3a6f0cbb6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.154964 Oct 18 17:15:03.750834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3849/7735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:03 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:04.775751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:04.776381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:04.783242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:04.783738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:04.784191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:04.785828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:04.786112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:04.786553 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:04.921430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:04.929961 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-172b5d86-3d35-4c2f-a2a5-4e5069959f5c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.158077 Oct 18 17:15:04.930777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3887/7736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:04 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:05.953328 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:05.953950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:05.961322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:05.961809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:05.962246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:05.962937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:05.963399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:05.963829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:06.096623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:06.105597 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dcbc9584-2182-4688-b4c7-3a3b31cabdd9 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.156183 Oct 18 17:15:06.106181 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3850/7737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:05 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:07.130399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:07.131030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:07.138096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:07.138600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:07.139050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:07.139762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:07.140233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:07.140673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:07.275799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:07.284235 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d92a03f4-bb74-4e86-9824-938a180820d7 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.158711 Oct 18 17:15:07.285107 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3888/7738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:07 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:08.308167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:08.308722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:08.315756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:08.316556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:08.317196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:08.317898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:08.318357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:08.318789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:08.460573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:08.469165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2831cd33-6007-4a10-b150-e2af7478bb2f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.164969 Oct 18 17:15:08.469752 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3851/7739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:08 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:09.494057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:09.494827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:09.501964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:09.502477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:09.502937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:09.504847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:09.505354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:09.505804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:09.642273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:09.651802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02b0e634-87ca-4355-af31-902a34102e24 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.162004 Oct 18 17:15:09.652387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3889/7740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:09 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:10.675935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:10.677333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:10.684737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:10.685192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:10.686750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:10.687466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:10.687929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:10.688362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:10.829911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:10.839270 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ff2d3114-25d6-4b7c-aa42-c9b9400b8e9a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.167406 Oct 18 17:15:10.841028 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3852/7741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:10 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:11.863965 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:11.864726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:11.872644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:11.873201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:11.873672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:11.874420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:11.874906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:11.875361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:12.017745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:12.027736 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12baab49-f254-42fb-b2a3-eb677d9b5d04 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1730 microversion: 2.1 time: 0.167854 Oct 18 17:15:12.028676 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3890/7742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:11 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:12.715002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-unplugged", "status": "completed", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:12.726779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:12.727654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:12.728357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:12.742468 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Creating event network-vif-unplugged:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h2-858383-14 Oct 18 17:15:12.748191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:15:12.760787 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0e8378d9-fef0-4a20-b94b-613367dff5dc req-f1a222e4-315a-4dd7-8cc9-78fadcb80094 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049601 Oct 18 17:15:12.761442 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3853/7743] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:13.052104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:13.052779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:13.059835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:13.060351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:13.060820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:13.061568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:13.062049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:13.062506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:13.209365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:13.218093 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9797b02a-c807-42c4-bb87-72c52eb7e011 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1729 microversion: 2.1 time: 0.170116 Oct 18 17:15:13.218678 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3891/7744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:13 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:14.244018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:14.244647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:14.251775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:14.252239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:14.252675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:14.253948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:14.254404 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:14.254827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:14.396892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:14.405307 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18deb50d-b8a7-4a51-b5c7-474acc000d2d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.165589 Oct 18 17:15:14.405961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3854/7745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:14 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:14.799191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:14.810424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:14.810923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:14.811374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:14.824015 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Creating event network-changed:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h2-858383-14 Oct 18 17:15:14.829685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:15:14.841051 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-809a2db2-25df-4e8f-bec2-a0c02270ce74 req-35b7ec40-7a30-4c43-8f7f-e6f34210737e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045526 Oct 18 17:15:14.841859 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3892/7746] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:15.432158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:15.434269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:15.444619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=33 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:15.446597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:15.446779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:15.447208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:15.448171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:15.448884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:15.449589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:15.453842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:15.637637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:15.647611 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d4f6a77a-1957-488f-83e8-8cf190d4fc7a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.219959 Oct 18 17:15:15.648316 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3855/7747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:15 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:16.672087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:16.672810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:16.674775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:16.680540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:16.681064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:16.681518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:16.682225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:16.682695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:16.683136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:16.685950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=83 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:16.820699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:16.829564 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4c393ea-09a9-420a-b68a-982e0e85bdc8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.162545 Oct 18 17:15:16.830166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3893/7748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:16 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:17.854825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:17.855503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:17.864351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:17.865205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:17.865945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:17.866785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:17.867239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:17.867664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:18.021617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:18.030155 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-193d2ee4-9ca2-4128-a830-c6216ad07a09 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.179255 Oct 18 17:15:18.030766 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3856/7749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:17 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:19.055003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:19.055637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:19.062653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:19.063155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:19.063608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:19.064312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:19.064787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:19.065261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:19.200607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:19.209336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b3b50797-e790-4b3a-869c-d0efeaaf20bd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.158520 Oct 18 17:15:19.209912 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3894/7750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:19 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:20.233023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:20.233566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:20.241020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:20.241515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:20.241950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:20.242629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:20.243085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:20.243506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:20.376046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:20.384556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-af9c3148-831d-46fb-8058-719bdd1bfe8d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.155544 Oct 18 17:15:20.385170 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3857/7751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:20 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:21.407744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:21.408378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:21.415695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:21.416194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:21.416648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:21.417452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:21.417922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:21.418363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:21.554173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:21.562516 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6aa12eab-57e6-40b2-b243-7f89f14abf6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.158679 Oct 18 17:15:21.563102 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3895/7752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:21 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:22.587054 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:22.587601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:22.594481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:22.594972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:22.595416 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:22.596113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:22.597309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:22.597760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:22.733388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:22.742397 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cfbeb456-60f8-4056-98af-3b6328de5a75 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.159304 Oct 18 17:15:22.742966 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3858/7753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:22 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:23.766470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:23.767004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:23.774987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:23.775498 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:23.775959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:23.776685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:23.777191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:23.777644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:23.911954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:23.920261 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-90f07ad9-b620-4ed6-9966-e7c76c06216f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.157893 Oct 18 17:15:23.920841 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3896/7754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:23 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:24.944857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:24.945551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:24.952447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:24.953202 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:24.953779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:24.954605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:24.954605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:24.955958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:25.086615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:25.094801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c267a0ab-2789-4639-83f9-bf5974d3992b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.154982 Oct 18 17:15:25.095378 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3859/7755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:24 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:26.118316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:26.118947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:26.125859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:26.126356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:26.126803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:26.127502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:26.128708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:26.129177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:26.258193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:26.266478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-335a3927-253f-4c95-ac68-1ef4d1a57e50 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1727 microversion: 2.1 time: 0.152086 Oct 18 17:15:26.267050 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3897/7756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:26 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:27.289908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:27.290554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:27.298067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.298556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.298986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.300187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.300865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.301329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.435087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:27.443907 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4a5d8370-a16a-4f37-ad81-c75de613eda1 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1724 microversion: 2.1 time: 0.157915 Oct 18 17:15:27.444473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3860/7757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:27 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:27.467493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:27.468055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:27.475165 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.475669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.476128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.476886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.477476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.477925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.515825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.516322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.516780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.517555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.518032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.518501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.539720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:15:27.544962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Getting quotas for user 101a08f6424e4c18a6eb2befca74cf68 and project 48cf8bb1719c49e597f6ca98c34e9889. Resources: {'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:15:27.652406 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c6ddf4a-b2b9-4168-a61e-98fe827ca58e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/action" status: 202 len: 0 microversion: 2.1 time: 0.188714 Oct 18 17:15:27.653070 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3898/7758] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:15:27 2022] POST /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:15:27.661875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:27.662487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:27.668923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.669465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.670025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.670857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:27.671439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:27.672005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:27.876474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:27.885712 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-be8c5868-3459-434b-8303-a80daeca00d5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.228348 Oct 18 17:15:27.886339 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3861/7759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:27 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:28.910857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:28.911533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:28.917927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:28.918428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:28.918882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:28.919588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:28.920091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:28.920486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:29.053772 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:29.062088 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d170c131-8185-4bcd-b76a-539031be92d2 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.156749 Oct 18 17:15:29.062671 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3899/7760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:28 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:30.031291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-plugged", "status": "completed", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:30.042166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:30.042652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:30.043086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:30.055616 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Creating event network-vif-plugged:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h2-858383-14 Oct 18 17:15:30.061467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:15:30.073326 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a716e98e-0e45-4c56-9f4e-6aab87b97177 req-67d3d194-0161-42ad-a438-8870bccf14b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045611 Oct 18 17:15:30.074108 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3862/7761] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:30.087031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:30.087770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:30.094857 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:30.095366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:30.095828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:30.096721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:30.097484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:30.097948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:30.234954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:30.243927 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0617306d-d72b-4db6-98c9-9e52753ae03c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.160996 Oct 18 17:15:30.244504 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3900/7762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:30 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:31.271458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:31.272162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:31.278438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:31.278923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:31.279359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:31.280051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:31.280508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:31.280938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:31.425721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:31.434253 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e79addf2-c27a-415b-98ae-ad3340e3499f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.168749 Oct 18 17:15:31.434964 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3863/7763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:31 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:32.457657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:32.458357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:32.472356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:32.473064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:32.473676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:32.474420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:32.474897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:32.475344 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:32.615961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:32.624372 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ff3aadf-bb05-4cd3-90c7-8f07ba937afc tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.170855 Oct 18 17:15:32.624956 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3901/7764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:32 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:33.171733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-unplugged", "status": "completed", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:33.183515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:33.184140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:33.184825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:33.200613 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Creating event network-vif-unplugged:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:15:33.206044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:15:33.219322 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-41b956f0-cb21-4371-bca9-23f0dfe3c34a req-dc06b174-0e27-4ee2-88c2-ad1fde8e42b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051942 Oct 18 17:15:33.219939 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3864/7765] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:33.649949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:33.653401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:33.662644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:33.663161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:33.663621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:33.664354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:33.664829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:33.665299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:33.887730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:33.900691 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a95a3f2b-26fa-4424-82ee-4829ff1f56c6 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.254165 Oct 18 17:15:33.901993 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3902/7766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:33 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:34.926577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:34.928056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:34.936424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:34.936745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:34.937297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:34.938031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:34.938492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:34.938985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:35.091433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:35.101471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-62249e2c-55cf-4826-90f5-cf5ce53a847b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.179404 Oct 18 17:15:35.102215 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3865/7767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:34 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:35.257852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:35.269254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:35.270458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:35.271004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:35.284215 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Creating event network-changed:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:15:35.291962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:15:35.304471 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-64fe42cb-4d83-431b-8bee-24063dc506c8 req-22aaa144-d2a9-4983-957b-3d9109868909 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051262 Oct 18 17:15:35.305541 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3903/7768] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:36.125978 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:36.127393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:36.134439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:36.134932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:36.135373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:36.136455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:36.136955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:36.137406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:36.302783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:36.311851 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e63ddbe-9c19-460a-b683-9814383a4b7e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.189777 Oct 18 17:15:36.312424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3866/7769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:36 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:37.338870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:37.339517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:37.346157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:37.346659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:37.347117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:37.349382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:37.349871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:37.350321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:37.495436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:37.504729 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-135b3eb3-f8c4-41a9-a131-c0613cecca6c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.171247 Oct 18 17:15:37.505358 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3904/7770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:37 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:38.528099 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:38.528649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:38.536642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:38.537183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:38.537708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:38.538615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:38.539073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:38.539500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:38.682748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:38.692331 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3caf32a4-ba89-45dd-9e97-97b4265f892a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.168237 Oct 18 17:15:38.692910 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3867/7771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:38 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:39.716459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:39.717024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:39.718980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:39.725731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:39.726230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:39.726685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:39.727401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:39.727871 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:39.728312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:39.864742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:39.873358 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6feadc5-9d70-43ba-8862-65c699b2f620 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.160860 Oct 18 17:15:39.873962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3905/7772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:39 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:40.954171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:40.954811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:40.961908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:40.962397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:40.962831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:40.963528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:40.963982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:40.964406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:41.102768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:41.111059 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a4c9644-8209-41ba-aa99-1d95a098bdba tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.160756 Oct 18 17:15:41.111631 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3868/7773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:40 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:42.135513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:42.136155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:42.143422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:42.143855 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:42.144355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:42.145109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:42.146255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:42.146757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:42.282391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:42.291318 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0797f381-0f4e-42de-a4bc-acb421fda590 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.159779 Oct 18 17:15:42.291906 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3906/7774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:42 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:43.315285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:43.315852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:43.323286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:43.323780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:43.324219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:43.324916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:43.325398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:43.325826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:43.458747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:43.467926 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b773c793-9edf-42bc-bf28-160072c9bfd4 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.156648 Oct 18 17:15:43.468495 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3869/7775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:43 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:15:44.492087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:44.492981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:44.500193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:44.500694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:44.501180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:44.501897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:44.502371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:44.502842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:44.505805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:44.650071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:44.658839 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9418ce43-53d1-4860-a38e-464401e0063e tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.170837 Oct 18 17:15:44.659423 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3907/7776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:44 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:45.683624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:45.684242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:45.687160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=30 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:45.692634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:45.693154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:45.693597 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:45.694292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:45.694746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:45.695169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:45.698077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=86 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:45.835599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:45.845180 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e963192a-b518-46c4-ab3d-108e9ca2508a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.165851 Oct 18 17:15:45.845937 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3870/7777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:45 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:46.870790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:46.871424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:46.874250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:15:46.879804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:46.880324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:46.880776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:46.881523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:46.882000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:46.882450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:47.018743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:47.027982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-67382830-d38c-4075-ac54-3be3de231214 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1723 microversion: 2.1 time: 0.161776 Oct 18 17:15:47.028568 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3908/7778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:46 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:48.050717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:48.051380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:48.059863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.060353 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.060795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.061523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.061981 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.062407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.193162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:48.201684 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa8ffc9e-e259-4a56-9713-c5ff78f1bc13 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1716 microversion: 2.1 time: 0.154833 Oct 18 17:15:48.202262 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3871/7779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:48 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:48.224629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:48.225315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:48.232980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.233507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.233959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.234664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.235135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.235576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.370391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:48.378965 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1aed6bc-e876-417f-a46a-2ad8beb369cd tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1716 microversion: 2.1 time: 0.158264 Oct 18 17:15:48.379542 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3909/7780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:48 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:48.401857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:48.402483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:48.408425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.408908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.409381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.410074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.410536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.410962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.543214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:48.551532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1fd54827-abba-4366-bef3-608c0918ac6b tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1716 microversion: 2.1 time: 0.154245 Oct 18 17:15:48.552095 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3872/7781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:48 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:48.574336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:48.574850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:48.580893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.581458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.581906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.582607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.583076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.583517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.609786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:15:48.687346 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eed6dc47-20fa-47eb-aee1-d0c2695a21fa tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 204 len: 0 microversion: 2.1 time: 0.117348 Oct 18 17:15:48.687922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3910/7782] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:15:48 2022] DELETE /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:15:48.697421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:48.698210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:48.706551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.707039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.707507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.708204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:48.708659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:48.709130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:48.863767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:48.872563 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6be28370-5a5c-4dae-9d9b-80528672e9a0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1722 microversion: 2.1 time: 0.180387 Oct 18 17:15:48.873165 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3873/7783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:48 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:15:49.505709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-plugged", "status": "completed", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:49.520757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:49.521293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:49.521740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:49.532794 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] Creating event network-vif-plugged:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:15:49.537856 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1970ad28-72bc-4758-8cba-8f2edb33c887 req-c90ec189-2d79-446f-aa20-93ae26c3981b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Oct 18 17:15:49.538464 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3911/7784] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:49.897518 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:49.898134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:49.905797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:49.906285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:49.906724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:49.907418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:49.907875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:49.908302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:50.046590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:50.055955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01731100-1980-410c-bff8-dff6fac6144f tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1722 microversion: 2.1 time: 0.162185 Oct 18 17:15:50.056794 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3874/7785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:49 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:51.081273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:51.082049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:51.089564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:51.090086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:51.090549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:51.091280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:51.091763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:51.092213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:51.194312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:51.205042 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-83c2bdd2-2545-410b-8d10-0e671b5c849c tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1655 microversion: 2.1 time: 0.129153 Oct 18 17:15:51.207463 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3912/7786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:51 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:51.423697 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0016c7ca-eff3-46bf-8417-aedecda57a16", "name": "network-vif-deleted", "tag": "0851b6ff-ac56-4350-8679-3d0607d6bf82"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:15:51.434294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:51.434872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:51.435368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:51.450411 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] Creating event network-vif-deleted:0851b6ff-ac56-4350-8679-3d0607d6bf82 for instance 0016c7ca-eff3-46bf-8417-aedecda57a16 on n-h1-858383-14 Oct 18 17:15:51.455405 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b5a5cfc5-bf27-45a8-8036-af63871360cd req-455684ed-8301-4aa7-bbdf-7ff137cab33b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035481 Oct 18 17:15:51.456000 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3875/7787] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:15:52.231193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:52.232428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:52.242240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:52.243592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:52.244103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:52.245094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:52.245579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:52.246061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:52.319944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:52.329389 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-297a5c59-b52e-4923-a1a3-8d06a8a6758a tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1370 microversion: 2.1 time: 0.103450 Oct 18 17:15:52.329970 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3913/7788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:52 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:53.357076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:53.357783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:53.364051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:53.364537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:53.364973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:53.365731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:53.366186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:53.366611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:53.435956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:53.444309 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a96bf881-29a8-4d3a-b4e3-3b9bcb609dcf tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1370 microversion: 2.1 time: 0.093015 Oct 18 17:15:53.445098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3876/7789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:53 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:54.469247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:54.470880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:54.478357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:54.478978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:54.479611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:54.480735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:54.481576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:54.482189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:54.549297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:54.560194 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7f806596-53a1-48e1-8823-437f05a018b5 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1370 microversion: 2.1 time: 0.094666 Oct 18 17:15:54.560799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3914/7790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:54 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:55.584165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:55.584722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:55.592530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:55.593051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:55.593491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:55.594196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:55.594653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:55.595079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:55.663734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a08f6424e4c18a6eb2befca74cf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cf8bb1719c49e597f6ca98c34e9889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:15:55.672742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9cbc270e-bc08-4661-8681-2996bad05fa8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 200 len: 1370 microversion: 2.1 time: 0.092691 Oct 18 17:15:55.673348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3877/7791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:55 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:15:56.696948 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:56.697608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:56.704489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:56.705017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:56.705515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:56.706231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:56.706706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:56.707150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:56.720484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 HTTP/1.1 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0016c7ca-eff3-46bf-8417-aedecda57a16'} Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:15:56.722218 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f2e9807b-627e-42e9-8623-448101b9a4ff tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 404 len: 111 microversion: 2.1 time: 0.031943 Oct 18 17:15:56.730061 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3915/7792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:15:56 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:15:56.790109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:15:56.793024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:15:56.801578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:56.802069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:56.802511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:56.803211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:15:56.803672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:15:56.804107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:15:56.817571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments HTTP/1.1 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '0016c7ca-eff3-46bf-8417-aedecda57a16'} Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:15:56.819243 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-117ca90b-5951-4f76-96cd-eb1afafb5ab0 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035333 Oct 18 17:15:56.824461 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3878/7793] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:15:56 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.148497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.149047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.156139 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.156643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.157162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.157877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.158356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.158806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.172508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 HTTP/1.1 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0016c7ca-eff3-46bf-8417-aedecda57a16'} Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.174118 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed4877b4-40f9-47d3-8c85-d1d40edeb687 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 404 len: 111 microversion: 2.1 time: 0.031066 Oct 18 17:16:00.178600 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3916/7794] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:00 2022] DELETE /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.184843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.185570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 0016c7ca-eff3-46bf-8417-aedecda57a16] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.192360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.192843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.193316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.194011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.194473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.194906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.208981 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 HTTP/1.1 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '0016c7ca-eff3-46bf-8417-aedecda57a16'} Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.210491 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 0016c7ca-eff3-46bf-8417-aedecda57a16 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e857c73-e6ca-4105-b78d-6b9b6854fa5d tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16" status: 404 len: 111 microversion: 2.1 time: 0.030927 Oct 18 17:16:00.216189 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3879/7795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:00 2022] GET /compute/v2.1/servers/0016c7ca-eff3-46bf-8417-aedecda57a16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:16:00.220406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.220916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.227150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.227647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.228098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.228793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.229290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.229735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.244570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 HTTP/1.1 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4c5513c4-35bb-4dfe-9c39-7cb760550f03'} Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.246203 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.251373 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-07d17744-b346-4a5c-8f5f-d34090763092 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 404 len: 111 microversion: 2.1 time: 0.031140 Oct 18 17:16:00.252418 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3917/7796] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:00 2022] DELETE /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.256702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.257363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 4c5513c4-35bb-4dfe-9c39-7cb760550f03] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.264774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.265300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.265743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.266446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.266906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.267352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.283753 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 HTTP/1.1 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '4c5513c4-35bb-4dfe-9c39-7cb760550f03'} Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.285813 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 4c5513c4-35bb-4dfe-9c39-7cb760550f03 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7637cd2-b895-4abe-b6bc-8a68755822ad tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03" status: 404 len: 111 microversion: 2.1 time: 0.034743 Oct 18 17:16:00.290196 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3880/7797] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:00 2022] GET /compute/v2.1/servers/4c5513c4-35bb-4dfe-9c39-7cb760550f03 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:16:00.296145 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.296668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.302913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.303493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.303865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.305278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.305839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.306049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.321353 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd HTTP/1.1 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '922ed6fb-3e7f-49b0-93a6-dc4494e3bedd'} Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.322941 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7f1ccad-432c-48ac-8570-b5808c96b252 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 404 len: 111 microversion: 2.1 time: 0.032225 Oct 18 17:16:00.328158 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3918/7798] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:00 2022] DELETE /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.333971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.334765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.340856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.341362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.341802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.343247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.343700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.344126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.357895 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd HTTP/1.1 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '922ed6fb-3e7f-49b0-93a6-dc4494e3bedd'} Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.359414 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance 922ed6fb-3e7f-49b0-93a6-dc4494e3bedd could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c62bf242-4106-4101-a3f3-01570d431831 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd" status: 404 len: 111 microversion: 2.1 time: 0.031038 Oct 18 17:16:00.364776 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3881/7799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:00 2022] GET /compute/v2.1/servers/922ed6fb-3e7f-49b0-93a6-dc4494e3bedd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.370327 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.370844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.377184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.377693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.378402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.379119 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.379593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.380040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.394638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 HTTP/1.1 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'fcdb4364-5518-4d6c-beab-31b49a159fe9'} Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.396219 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5a07a9a4-c541-4bc3-9c39-865b92cef5e3 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 404 len: 111 microversion: 2.1 time: 0.032053 Oct 18 17:16:00.400828 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3919/7800] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:00 2022] DELETE /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.406586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.407201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] [instance: fcdb4364-5518-4d6c-beab-31b49a159fe9] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:00.414111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.414595 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.415048 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.415708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:00.416155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:00.416715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:00.431254 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] HTTP exception thrown: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Request method failure captured: Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 HTTP/1.1 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt1ZmtrEWW9PyWmn0GXDUxp2qNo-qa9z7lrc4Mp_D6jwYk0zKmKqiajnOD94MuDj3DYB3voyGGyEuZytbAT462GJOnALBKj45zQS6UC1GmyIMKv_fN6gg-NbNCtblmDySZkVvJ-Hh7J_jTNfOFKX0E0GHEqNKfP9h9JesQwNDrN1GgM Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_48cf8bb1719c49e597f6ca98c34e9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/48cf8bb1719c49e597f6ca98c34e9889"}]}] Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 48cf8bb1719c49e597f6ca98c34e9889 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServerActionsTestJSON-1804106169 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 101a08f6424e4c18a6eb2befca74cf68 Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServerActionsTestJSON-1804106169-project Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'fcdb4364-5518-4d6c-beab-31b49a159fe9'} Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:00.432773 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Returning 404 to user: Instance fcdb4364-5518-4d6c-beab-31b49a159fe9 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13f60ac9-2e58-4b57-bd1a-d7111acfdda8 tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9" status: 404 len: 111 microversion: 2.1 time: 0.031560 Oct 18 17:16:00.437051 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3882/7801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:00 2022] GET /compute/v2.1/servers/fcdb4364-5518-4d6c-beab-31b49a159fe9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:00.442717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6cde37ac-aa45-43ef-bd7a-64cab3eb57df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] Calling method '.version_select at 0x7f5fd04074c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:00.466886 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6cde37ac-aa45-43ef-bd7a-64cab3eb57df tempest-ServerActionsTestJSON-1804106169 tempest-ServerActionsTestJSON-1804106169-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508672407" status: 202 len: 0 microversion: 2.1 time: 0.027787 Oct 18 17:16:00.467478 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3920/7802] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 17:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508672407 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:16:09.840892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8085315", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b33b1e3f-b395-41b5-a527-585e9bd3ad10"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:09.899975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] validate_networks() for [('b33b1e3f-b395-41b5-a527-585e9bd3ad10', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:16:10.393589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:16:10.394010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:16:10.394481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:16:10.394888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:16:10.395293 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:16:10.404271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:10.404746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:10.405232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:10.405953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:10.406407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:10.406835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:10.423790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Getting quotas for project 55d328634e984b4ca6449d6c1f63f2d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:16:10.429795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Getting quotas for user a2567dc42e4c4e949168bc42f88531ef and project 55d328634e984b4ca6449d6c1f63f2d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:16:10.444020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:16:10.446761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:16:10.501589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f08bbc6-014c-4a6b-89c1-e1188e281475 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834540 Oct 18 17:16:10.502460 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3883/7803] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:16:10.511990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:10.512755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:10.517476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e64c1e39-14db-4adc-b70c-39ead90bbb87 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:10.518109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e64c1e39-14db-4adc-b70c-39ead90bbb87 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:10.604458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e64c1e39-14db-4adc-b70c-39ead90bbb87 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:10.611972 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e64c1e39-14db-4adc-b70c-39ead90bbb87 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1214 microversion: 2.1 time: 0.101955 Oct 18 17:16:10.612799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3921/7804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:10 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:11.636436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:11.637164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:11.644214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:11.644701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:11.645176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:11.645873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:11.646520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:11.646951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:11.717420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:11.726332 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-04aa15d4-d468-4d80-b45d-6eed42f11032 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1266 microversion: 2.1 time: 0.094924 Oct 18 17:16:11.727009 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3884/7805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:11 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:12.752698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:12.753745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:12.761258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:12.761884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:12.762403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:12.763184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:12.764534 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:12.765161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:13.025178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:13.035613 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7eba1e9b-8109-4f19-b66f-500c0389e9bd tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.289736 Oct 18 17:16:13.036862 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3922/7806] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:12 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:13.584302 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9a4728-666e-47c9-afe7-0e1cb2970f62", "tag": "8d47c48f-5015-412b-8e38-add0d65d9cd5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:13.598555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:13.598747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:13.599357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:13.611587 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] Creating event network-changed:8d47c48f-5015-412b-8e38-add0d65d9cd5 for instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 on n-h1-858383-14 Oct 18 17:16:13.616040 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3fa45963-5168-423d-b2e9-dc0898adc018 req-3902918f-2bd3-4b3b-a17a-9d5189584629 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121608 Oct 18 17:16:13.617417 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3885/7807] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:16:14.059269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:14.059927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:14.062145 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:16:14.062295 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 (ip 10.222.0.78) !!! Oct 18 17:16:14.070324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:14.070937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:14.071402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:14.072167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:14.072635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:14.073116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:14.205439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:14.214068 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6d2e5a7-2ef8-4d35-bb14-d7399b3abed0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.158771 Oct 18 17:16:14.214660 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3923/7808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:14 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:16:15.238211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:15.238940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:15.245104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:15.245579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:15.246005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:15.246681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:15.247128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:15.247547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:15.382450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:15.390496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-27bda6c7-eda6-4ec1-847f-98c6a991bf67 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.157260 Oct 18 17:16:15.391053 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3886/7809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:15 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:16.414563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:16.415197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:16.422102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:16.422605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:16.423059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:16.423838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:16.424601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:16.425084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:16.569480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:16.577194 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-61a95a1f-f7b3-469b-b31e-3b302f3cb3f4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.167212 Oct 18 17:16:16.577762 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3924/7810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:16 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:17.599725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:17.600337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:17.603338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:17.608348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:17.608889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:17.609364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:17.610057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:17.610602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:17.610991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:17.617104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=70 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:17.757400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:17.765695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4b38d494-658e-4819-a2ba-b3fe6885e67a tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.169875 Oct 18 17:16:17.766480 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3887/7811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:17 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:18.789303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:18.790060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:18.797149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:18.797656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:18.798183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:18.798842 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:18.799316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:18.799764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:18.939518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:18.948386 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58a22f64-a556-4f35-8cdb-6be828dc02e0 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.163146 Oct 18 17:16:18.949045 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3925/7812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:18 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:19.683276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a4728-666e-47c9-afe7-0e1cb2970f62", "name": "network-vif-plugged", "status": "completed", "tag": "8d47c48f-5015-412b-8e38-add0d65d9cd5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:19.693532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:19.694035 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:19.694470 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:19.706211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] Creating event network-vif-plugged:8d47c48f-5015-412b-8e38-add0d65d9cd5 for instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 on n-h1-858383-14 Oct 18 17:16:19.711160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-56e10405-9749-4d58-af44-b2463026ae07 req-adbc0225-d5cd-4748-b173-318b56c65f06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089512 Oct 18 17:16:19.711768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3888/7813] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:16:19.971776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:19.972419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:19.979382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:19.979883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:19.980338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:19.981097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:19.981573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:19.982021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:20.120944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:20.128980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f41f78d-f6a2-4855-90f4-7d4bda0d3b23 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.161128 Oct 18 17:16:20.129572 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3926/7814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:19 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:21.149830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:21.150606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:21.156175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:21.156891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:21.163997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:21.164483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:21.164923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:21.165643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:21.166105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:21.166545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:21.301539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:21.311320 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87aef5a7-244b-49b3-9f69-1031d350384d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1314 microversion: 2.1 time: 0.162175 Oct 18 17:16:21.311911 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3889/7815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:21 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:22.333774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:22.334330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:22.336245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:22.343286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:22.343789 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:22.344250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:22.344963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:22.345462 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:22.346138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:22.482200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:22.489989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d86f67e-fdc2-4ca4-9b7c-aefd1d080e27 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.160347 Oct 18 17:16:22.490582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3927/7816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:22 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:22.552281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-240677453", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b33b1e3f-b395-41b5-a527-585e9bd3ad10"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:22.606996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] validate_networks() for [('b33b1e3f-b395-41b5-a527-585e9bd3ad10', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:16:22.982947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:16:22.983372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:16:22.983852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:16:22.984264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:16:22.984677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:16:22.993435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:22.993915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:22.994349 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:22.995569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:22.996325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:22.996802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:23.014523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Getting quotas for project 55d328634e984b4ca6449d6c1f63f2d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:16:23.020569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Getting quotas for user a2567dc42e4c4e949168bc42f88531ef and project 55d328634e984b4ca6449d6c1f63f2d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:16:23.033309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:16:23.035654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:16:23.081847 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f798c1f-89ec-4ab4-80c8-83a2ba6522ae tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533318 Oct 18 17:16:23.082510 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3890/7817] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:16:23.094114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-286e5db6-2e46-43ce-83dd-6697a22d6c33 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:23.094766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-286e5db6-2e46-43ce-83dd-6697a22d6c33 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:23.150461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-286e5db6-2e46-43ce-83dd-6697a22d6c33 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:23.157700 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-286e5db6-2e46-43ce-83dd-6697a22d6c33 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1216 microversion: 2.1 time: 0.067760 Oct 18 17:16:23.158622 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3928/7818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:23 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:24.181540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:24.182254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:24.190103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:24.190521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:24.190970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:24.191688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:24.192106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:24.192737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:24.266498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:24.274544 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ee009f00-e64f-44ec-a462-32161dfa0a18 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1276 microversion: 2.1 time: 0.097895 Oct 18 17:16:24.275133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3891/7819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:24 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:25.300536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:25.301519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:25.309822 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:25.310334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:25.310786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:25.311571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:25.312044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:25.312491 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:25.800850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:25.809467 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a02875d9-1dad-4aeb-8dd5-d2be3370880f tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.512592 Oct 18 17:16:25.810601 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3929/7820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:25 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:26.046843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279213f5-5f5c-45af-8c29-624f5076ff17", "tag": "58831f95-4995-4f40-8e09-0e86386dd9cb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:26.056552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:26.057083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:26.057517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:26.069542 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] Creating event network-changed:58831f95-4995-4f40-8e09-0e86386dd9cb for instance 279213f5-5f5c-45af-8c29-624f5076ff17 on n-h2-858383-14 Oct 18 17:16:26.077880 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2a2357f8-86a5-47c4-bcaf-55553b224429 req-532d8d2c-5437-4cd2-873a-ea572cb94c49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094378 Oct 18 17:16:26.078492 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3892/7821] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:16:26.833472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:26.834105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:26.842485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:26.843322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:26.843836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:26.844767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:26.845330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:26.845856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:26.980143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:26.988475 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-040254f1-3a44-42d8-93c5-dfa3728f33b4 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.159150 Oct 18 17:16:26.989060 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3930/7822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:26 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:28.013711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:28.014411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:28.020718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:28.021224 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:28.021660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:28.022340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:28.022789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:28.023210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:28.153282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:28.161390 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1d380fe4-31c5-4f35-91f2-9f790b1396ad tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.152892 Oct 18 17:16:28.161572 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3893/7823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:28 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:29.184468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:29.185135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:29.192066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:29.192567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:29.193042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:29.193751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:29.194222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:29.194665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:29.330106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:29.338591 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6dbe6e2e-4cbb-4b3d-a5fb-baf41a8faca5 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.158774 Oct 18 17:16:29.339183 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3931/7824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:29 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:30.361824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:30.362457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:30.369367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:30.369844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:30.370280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:30.370962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:30.371903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:30.372319 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:30.511797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:30.520560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fb90dbe8-fe8c-4671-a1a4-ffff67137891 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.162544 Oct 18 17:16:30.521169 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3894/7825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:30 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:16:31.544284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:31.544940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:31.551470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:31.551960 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:31.552407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:31.553138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:31.553610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:31.554047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:31.693930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:31.702525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b1ddba35-0c75-4e4b-b735-a495142aa558 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.162858 Oct 18 17:16:31.703133 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3932/7826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:31 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:32.142176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279213f5-5f5c-45af-8c29-624f5076ff17", "name": "network-vif-plugged", "status": "completed", "tag": "58831f95-4995-4f40-8e09-0e86386dd9cb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:32.153299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:32.153989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:32.154435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:32.169545 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] Creating event network-vif-plugged:58831f95-4995-4f40-8e09-0e86386dd9cb for instance 279213f5-5f5c-45af-8c29-624f5076ff17 on n-h2-858383-14 Oct 18 17:16:32.174494 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-841044fb-c2b6-40a1-8f14-ac44668f97a3 req-c59d4512-109b-428f-8ca3-15415fa98955 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036123 Oct 18 17:16:32.175280 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3895/7827] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:16:32.726201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:32.726734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:32.734131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:32.734631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:32.735077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:32.735782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:32.736246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:32.736687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:32.870043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:32.879136 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1d121262-5238-420e-abaf-a7d4be221e9d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1316 microversion: 2.1 time: 0.157037 Oct 18 17:16:32.879719 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3933/7828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:32 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:33.900768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:33.901557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:33.907271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:33.908064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:33.915025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:33.915535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:33.915969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:33.916656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:33.917143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:33.917569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:34.059962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:34.068148 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-78665443-efe1-49fb-b13e-f93bdab4225d tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1505 microversion: 2.1 time: 0.168293 Oct 18 17:16:34.068729 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3896/7829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:33 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:34.091435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:34.091951 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:34.093817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:34.100245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:34.100741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:34.101233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:34.101945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:34.102407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:34.102844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:34.129431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:16:34.211646 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c77ebc2f-ec8c-4ac3-8aca-6e0c2219a5f7 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 204 len: 0 microversion: 2.1 time: 0.124432 Oct 18 17:16:34.212255 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3934/7830] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:34 2022] DELETE /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:16:34.220312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:34.221017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:34.227294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:34.227771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:34.228198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:34.228877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:34.229369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:34.229791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:34.369739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:34.379776 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b94a70aa-9a9a-4e8d-8af2-98847d190745 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1511 microversion: 2.1 time: 0.163264 Oct 18 17:16:34.380439 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3897/7831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:34 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:16:35.405282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:35.406120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:35.413019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:35.413539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:35.413991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:35.414692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:35.415157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:35.415593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:35.555900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:35.563980 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6e855677-5190-45db-919f-c4951a454987 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1511 microversion: 2.1 time: 0.163897 Oct 18 17:16:35.564562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3935/7832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:35 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:16:36.236228 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279213f5-5f5c-45af-8c29-624f5076ff17", "name": "network-vif-deleted", "tag": "58831f95-4995-4f40-8e09-0e86386dd9cb"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:36.248608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:36.249520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:36.250269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:36.264760 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] Creating event network-vif-deleted:58831f95-4995-4f40-8e09-0e86386dd9cb for instance 279213f5-5f5c-45af-8c29-624f5076ff17 on n-h2-858383-14 Oct 18 17:16:36.270955 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-0f30479c-32d7-47dc-9c99-b49d71173126 req-5001aa78-ff22-4cab-a351-c33d23d27804 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038404 Oct 18 17:16:36.271888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3898/7833] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:16:36.591471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:36.592168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:36.599148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:36.599647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:36.600098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:36.600806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:36.601312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:36.601757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:36.633717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:36.634208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:36.634669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:36.635129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lazy-loading 'fault' on Instance uuid 279213f5-5f5c-45af-8c29-624f5076ff17 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:16:36.678872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:36.687029 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-899e84c0-ff2b-41c9-8e7e-d9f136dabd28 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 200 len: 1306 microversion: 2.1 time: 0.100386 Oct 18 17:16:36.687612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3936/7834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:36 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:37.711415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:37.712113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:37.719127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.719604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.720042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:37.720722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.721234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.721659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:37.734981 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 HTTP/1.1 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '279213f5-5f5c-45af-8c29-624f5076ff17'} Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:37.736577 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 404 to user: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-06e8ce7f-3425-4475-9d44-9f495716311e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 404 len: 111 microversion: 2.1 time: 0.031747 Oct 18 17:16:37.741812 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3899/7835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:37 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:37.747285 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:37.747976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:37.755479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.755925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.756383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:37.757129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.757607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.758056 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:37.776890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:37.896034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:37.904071 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b8f48f3-eb4a-4cd6-b0ff-41f522295fde tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.160779 Oct 18 17:16:37.904651 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3937/7836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:37 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:37.926477 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:37.928698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 218317fa-e2ed-40ae-b61e-6deac8b1f487] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:37.935014 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/218317fa-e2ed-40ae-b61e-6deac8b1f487/action HTTP/1.1 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 32 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: {"resize": {"flavorRef": "452"}} Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '218317fa-e2ed-40ae-b61e-6deac8b1f487', 'body': {'resize': {'flavorRef': '452'}}} Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:37.936817 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 404 to user: Instance 218317fa-e2ed-40ae-b61e-6deac8b1f487 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-61506931-b8d2-4a5d-b952-93e8271fa122 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "POST /compute/v2.1/servers/218317fa-e2ed-40ae-b61e-6deac8b1f487/action" status: 404 len: 111 microversion: 2.1 time: 0.015688 Oct 18 17:16:37.941373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3900/7837] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:16:37 2022] POST /compute/v2.1/servers/218317fa-e2ed-40ae-b61e-6deac8b1f487/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:37.946886 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:37.947515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:37.954273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.954762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.955215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:37.955910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:37.956380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:37.956817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.086140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.094546 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7853abe-ea6a-4e1e-bd6d-006c44b2c7cc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.151422 Oct 18 17:16:38.095124 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3938/7838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:37 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:38.117660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.118273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.125910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.126390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.126825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.127511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.127965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.128643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.263214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.270974 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-02a8edf8-1ded-4085-ab3b-af3b36baf426 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.157142 Oct 18 17:16:38.271541 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3901/7839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:38 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:38.293803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7438eb51-a796-4051-9d8e-21bd2ec38aa2"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:38.296125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.302191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.302726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.303184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.303894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.304369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.304815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.345133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.350432 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: request: POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action HTTP/1.1 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 65 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: {"resize": {"flavorRef": "7438eb51-a796-4051-9d8e-21bd2ec38aa2"}} Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: exception: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9e9a4728-666e-47c9-afe7-0e1cb2970f62', 'body': {'resize': {'flavorRef': '7438eb51-a796-4051-9d8e-21bd2ec38aa2'}}} Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:38.356938 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 400 to user: Flavor 7438eb51-a796-4051-9d8e-21bd2ec38aa2 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-69666190-97b2-4bdc-84e5-9b3c05c8af44 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action" status: 400 len: 107 microversion: 2.1 time: 0.069226 Oct 18 17:16:38.361784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3939/7840] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:16:38 2022] POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 17:16:38.367250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.367873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.374509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.374997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.375466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.376159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.376619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.377086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.516653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.524407 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f254dd3b-d522-474f-9eb4-ce05a879b594 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.161019 Oct 18 17:16:38.524970 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3902/7841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:38 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:38.550612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.551442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.558571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.559088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.559538 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.560284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.560758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.561229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.695124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.703810 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cbafae5c-b045-4960-bc4a-c42874d15b39 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.158467 Oct 18 17:16:38.704393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3940/7842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:38 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:38.726274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-135c7ede-943e-463d-962b-e4873820dfbc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-135c7ede-943e-463d-962b-e4873820dfbc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: request: POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action HTTP/1.1 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 29 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: {"resize": {"flavorRef": ""}} Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '9e9a4728-666e-47c9-afe7-0e1cb2970f62', 'body': {'resize': {'flavorRef': ''}}} Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise error Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi '' Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.729827 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-135c7ede-943e-463d-962b-e4873820dfbc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-135c7ede-943e-463d-962b-e4873820dfbc tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action" status: 400 len: 113 microversion: 2.1 time: 0.008955 Oct 18 17:16:38.735131 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3903/7843] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:16:38 2022] POST /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 17:16:38.739725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.740350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.747579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.748142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.748570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.749323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.749792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.750428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.890546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:38.898536 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a7945473-aaad-40bd-b08f-2b795ecb3321 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1503 microversion: 2.1 time: 0.162567 Oct 18 17:16:38.899122 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3941/7844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:38 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:38.926510 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.927260 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.934698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.935441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.936037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.937044 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.937946 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.938129 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.952801 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 HTTP/1.1 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '279213f5-5f5c-45af-8c29-624f5076ff17'} Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:38.954406 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 404 to user: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-810847ee-52f8-4a50-82c3-9242971118ea tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 404 len: 111 microversion: 2.1 time: 0.034119 Oct 18 17:16:38.958868 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3904/7845] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:38 2022] DELETE /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:38.965121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:38.966528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 279213f5-5f5c-45af-8c29-624f5076ff17] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:38.972307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.972804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.973290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.973994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:38.974469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:38.974938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:38.989424 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 HTTP/1.1 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '279213f5-5f5c-45af-8c29-624f5076ff17'} Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:38.991178 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 404 to user: Instance 279213f5-5f5c-45af-8c29-624f5076ff17 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97a53ce1-78f0-4c05-bc4b-862d81b3fab6 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17" status: 404 len: 111 microversion: 2.1 time: 0.031933 Oct 18 17:16:38.996334 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3942/7846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:38 2022] GET /compute/v2.1/servers/279213f5-5f5c-45af-8c29-624f5076ff17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:16:39.001529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:39.002430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:39.008524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:39.009010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:39.009461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:39.010135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:39.010587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:39.011160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:39.039363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:16:39.116294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f02dc6c-7f96-45e6-ae43-dd063a7563aa tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 204 len: 0 microversion: 2.1 time: 0.118424 Oct 18 17:16:39.116887 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3905/7847] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:16:38 2022] DELETE /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:16:39.125619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:39.126252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:39.132435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:39.132923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:39.133407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:39.134102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:39.134570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:39.135007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:39.267878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:39.275672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1d90e5d-2e29-4e5e-b114-0bef54cdfd7e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1509 microversion: 2.1 time: 0.154086 Oct 18 17:16:39.276239 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3943/7848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:39 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:16:40.300610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:40.301247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:40.307960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:40.308494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:40.308916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:40.309623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:40.310075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:40.310499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:40.442332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:40.450763 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fea5deee-5504-448a-b0f6-6d6fa2b21de3 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1509 microversion: 2.1 time: 0.154533 Oct 18 17:16:40.451340 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3906/7849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:40 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:41.329075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a4728-666e-47c9-afe7-0e1cb2970f62", "name": "network-vif-deleted", "tag": "8d47c48f-5015-412b-8e38-add0d65d9cd5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:16:41.335450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:41.341780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:41.348252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:41.348767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:41.362756 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] Creating event network-vif-deleted:8d47c48f-5015-412b-8e38-add0d65d9cd5 for instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 on n-h1-858383-14 Oct 18 17:16:41.368151 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2fae089b-1bed-4888-a311-840654be43bf req-a37cf96c-5100-41b1-9060-3842ecb51d72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Oct 18 17:16:41.368812 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3944/7850] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:16:41.476168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:41.476785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:41.483759 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:41.484243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:41.484682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:41.485393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:41.485850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:41.486277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:41.519306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:41.519793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:41.520286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:41.520684 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lazy-loading 'fault' on Instance uuid 9e9a4728-666e-47c9-afe7-0e1cb2970f62 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:16:41.562683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2567dc42e4c4e949168bc42f88531ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d328634e984b4ca6449d6c1f63f2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:16:41.570405 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4114dfee-d790-41d6-8d62-5e978fe8159e tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 200 len: 1304 microversion: 2.1 time: 0.098207 Oct 18 17:16:41.570977 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3907/7851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:41 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:16:42.596362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:16:42.597118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] [instance: 9e9a4728-666e-47c9-afe7-0e1cb2970f62] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:16:42.603516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:42.604023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:42.604482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:42.605230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:16:42.605707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:16:42.606152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:16:42.620811 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] HTTP exception thrown: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Request method failure captured: Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 HTTP/1.1 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt9ZQFrPR1U2BhEaVGPQjvEdtFluUOekdTU6ZkwNwGiMMn7Ys1DSmdBIMnP3_yXLUuDQhSv36AJFnSFHWu2EriGYI6EKoFA2SXe-XIVO3SkDlI45Fb2jqqorJWjKrB7ugLzVrCxqus8Yzh2jPvm3NlqQtPERZwByGMnK4j7y80xDzeA Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55d328634e984b4ca6449d6c1f63f2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55d328634e984b4ca6449d6c1f63f2d1"}]}] Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 55d328634e984b4ca6449d6c1f63f2d1 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-ServersNegativeTestJSON-471649851 Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: a2567dc42e4c4e949168bc42f88531ef Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-ServersNegativeTestJSON-471649851-project Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '9e9a4728-666e-47c9-afe7-0e1cb2970f62'} Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:16:42.622514 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] Returning 404 to user: Instance 9e9a4728-666e-47c9-afe7-0e1cb2970f62 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e7bc8359-35a1-4dc8-9bec-a0ffd4424193 tempest-ServersNegativeTestJSON-471649851 tempest-ServersNegativeTestJSON-471649851-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62" status: 404 len: 111 microversion: 2.1 time: 0.033517 Oct 18 17:16:42.627292 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3945/7852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:16:42 2022] GET /compute/v2.1/servers/9e9a4728-666e-47c9-afe7-0e1cb2970f62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:17:13.593999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:13.594590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:13.765240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1928ff1a-0051-4db2-aad6-aaa2c4a06b1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: .version_select at 0x7f5fd0f6f4c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-237728813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRZfTu0QjPpVocQDhusMWgzDCwaVaC59fCtsPjMoJYJai3A09Zu0ko2uNCabOLdzLTm7ImoFF1I+uPiJ8z0fV/GZg0SDjBkcuHEqHbyYYGDOuBCmleQb8LIUaxj97ZJrg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:13.781480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1928ff1a-0051-4db2-aad6-aaa2c4a06b1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:17:13.787123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-1928ff1a-0051-4db2-aad6-aaa2c4a06b1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:17:13.816458 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1928ff1a-0051-4db2-aad6-aaa2c4a06b1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.230404 Oct 18 17:17:13.817991 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3908/7853] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:17:13 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:13.881330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-842321338", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-237728813", "networks": [{"uuid": "9081ec71-59a1-470b-9c1e-71275c851815"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:13.891391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:13.892071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:13.943211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] validate_networks() for [('9081ec71-59a1-470b-9c1e-71275c851815', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:17:14.400869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:17:14.401430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:17:14.402025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:17:14.402617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:17:14.403053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:17:14.415529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:14.416044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:14.416682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:14.417521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:14.417997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:14.418443 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:14.439643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:17:14.445981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:17:14.460974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:17:14.463404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:17:14.517734 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b156268-f06d-4d4a-8ae1-80679ff9f788 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640593 Oct 18 17:17:14.517734 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3946/7854] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:17:14.531798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ed1e8dd8-958d-48ed-83ee-3f78e6774bfd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:14.532485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ed1e8dd8-958d-48ed-83ee-3f78e6774bfd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:14.926397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ed1e8dd8-958d-48ed-83ee-3f78e6774bfd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:14.935690 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ed1e8dd8-958d-48ed-83ee-3f78e6774bfd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1261 microversion: 2.1 time: 0.408121 Oct 18 17:17:14.937239 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3909/7855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:14 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1261 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:15.966626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:15.967372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:15.979494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:15.980032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:15.980502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:15.983378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:15.983900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:15.984361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:16.065428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:16.073826 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-30591ff9-4316-40f1-af5c-93249ef0a1c1 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1319 microversion: 2.1 time: 0.113955 Oct 18 17:17:16.074447 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3947/7856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:15 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:17.098076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:17.098747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:17.105676 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:17.106170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:17.106772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:17.107999 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:17.108520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:17.109307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:17.201727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a8c71e-bfac-4a9e-80d8-e140e0d220e1", "tag": "6cf4de2c-ecbf-40c3-af77-a7530931799c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:17.218634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:17.221404 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:17.222419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:17.251807 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] Creating event network-changed:6cf4de2c-ecbf-40c3-af77-a7530931799c for instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 on n-h1-858383-14 Oct 18 17:17:17.259507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-921e93b6-f665-4363-b5c7-0ad3e66f1059 req-150b221a-6cc5-43a8-85eb-e294953d0e38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061875 Oct 18 17:17:17.260917 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3948/7857] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:17:17.265276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:17.276035 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7fcd4fcd-a43a-4c44-abe8-69052f62fcc8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.182023 Oct 18 17:17:17.276753 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3910/7858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:17 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:18.301819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:18.302552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:18.309137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:18.309644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:18.310820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:18.311554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:18.312028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:18.312477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:18.455838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:18.464081 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0bc140d0-8880-4e3e-8ce8-1922b46e73b4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.167371 Oct 18 17:17:18.464675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3949/7859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:18 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:19.488969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:19.489615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:19.496659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:19.497407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:19.498745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:19.500027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:19.500675 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:19.501162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:19.642134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:19.649901 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9bf1c3bd-a4d5-40ba-abc0-54cc5f74474f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.164854 Oct 18 17:17:19.650677 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3911/7860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:19 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:20.672877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:20.673767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:20.680704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:20.681250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:20.681708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:20.682421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:20.682892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:20.683334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:20.816891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:20.824640 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-223169ec-85b5-431b-99a7-7df9d0c1eeeb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.155757 Oct 18 17:17:20.825246 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3950/7861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:20 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:21.847974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:21.848591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:21.855662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:21.856161 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:21.857209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:21.857969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:21.858436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:21.858865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:21.874831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a8c71e-bfac-4a9e-80d8-e140e0d220e1", "name": "network-vif-plugged", "status": "completed", "tag": "6cf4de2c-ecbf-40c3-af77-a7530931799c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:21.886535 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:21.887046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:21.887698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:21.909618 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] Creating event network-vif-plugged:6cf4de2c-ecbf-40c3-af77-a7530931799c for instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 on n-h1-858383-14 Oct 18 17:17:21.916357 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-d89a26b0-f8b4-46fc-a68f-18143a2398ab req-4552614f-b666-42cd-919a-2b0ab14e7d7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046654 Oct 18 17:17:21.917709 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3951/7862] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:22.016076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:22.024051 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2cf232a3-d1e8-4723-aa09-f4ee16ece508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.179871 Oct 18 17:17:22.024626 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3912/7863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:21 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:23.048692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:23.049468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:23.055754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:23.056248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:23.056699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:23.057428 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:23.057892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:23.058330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:23.208800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:23.218218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-523d9be4-2d9f-4b91-8491-21db273a0982 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1361 microversion: 2.1 time: 0.174655 Oct 18 17:17:23.218822 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3952/7864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:23 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:24.241831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:24.242438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:24.249526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:24.250006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:24.250435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:24.251120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:24.251569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:24.251996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:24.387473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:24.396936 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-09229f0e-3ab8-415e-a319-2968d8e50464 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1553 microversion: 2.1 time: 0.158849 Oct 18 17:17:24.397551 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3913/7865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:24 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:24.419365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:24.420000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:24.426942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:24.427438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:24.427882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:24.428578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:24.429068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:24.429509 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:24.430068 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:24.453820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:24.564934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:24.572697 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ea7649f-a75b-4feb-869c-c0e1c6210fdb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1553 microversion: 2.1 time: 0.157453 Oct 18 17:17:24.573301 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3953/7866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:24 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:26.177060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63a87bf9-2933-4488-9252-c275da41a93b"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:26.179503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:26.181393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:26.188341 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:26.188831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:26.189295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:26.189983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:26.190440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:26.190866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:26.451444 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1ce6bf2-0398-43d5-bd7b-f31e659547c7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278248 Oct 18 17:17:26.452055 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3914/7867] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:17:26 2022] POST /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:37.173838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:37.173838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:37.175747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:37.176524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:37.183308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:37.183867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:37.184630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:37.185358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:37.185828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:37.186265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:37.266342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lazy-loading 'services' on Instance uuid 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:17:37.341203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-be335ec8-1c6f-40fc-bc21-a3b25053e56d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments/63a87bf9-2933-4488-9252-c275da41a93b" status: 202 len: 0 microversion: 2.1 time: 0.171708 Oct 18 17:17:37.341983 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3954/7868] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:17:37 2022] DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments/63a87bf9-2933-4488-9252-c275da41a93b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:17:37.348509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:37.349423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:37.354471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:37.357497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:37.366292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:37.366954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:37.367397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:37.368116 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:37.368573 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:37.369017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:37.401229 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-727adb7c-28be-4aa1-bfba-aba8cd6ccf9a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054393 Oct 18 17:17:37.401703 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3915/7869] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:37 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:38.415728 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:38.418773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:38.426808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:38.427307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:38.427753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:38.428458 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:38.428920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:38.429382 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:38.463179 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ed1d63b9-8630-4c46-856c-8d9d813a7bd7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051806 Oct 18 17:17:38.463746 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3955/7870] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:38 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:39.475195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:39.477394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:39.485027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:39.485514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:39.485956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:39.486664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:39.487127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:39.487553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:39.521410 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0620d348-b66d-49c2-a4a0-cab5c08f5508 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050238 Oct 18 17:17:39.522149 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3916/7871] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:39 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:40.534186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:40.536258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:40.543268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:40.544347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:40.544788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:40.545524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:40.545990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:40.546434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:40.577069 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e903cef0-2b2c-4d40-a0ac-679536ca2168 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Oct 18 17:17:40.577635 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3956/7872] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:40 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:41.589645 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:41.591855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:41.599081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:41.599594 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:41.600027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:41.600753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:41.601244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:41.602288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:41.633843 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c80bec7-289e-4852-b1d7-ea09307e6628 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048251 Oct 18 17:17:41.634418 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3917/7873] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:41 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:42.647203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:42.649477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:42.656672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:42.657205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:42.657664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:42.658370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:42.658841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:42.659286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:42.690484 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-aad76b05-25e5-4265-aa8d-bd968ec07139 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047358 Oct 18 17:17:42.691047 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3957/7874] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:17:42 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 17:17:42.702030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:42.702544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:42.709015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:42.709497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:42.709935 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:42.710618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:42.711075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:42.711500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:42.789241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 is not attached to volume 63a87bf9-2933-4488-9252-c275da41a93b Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments/63a87bf9-2933-4488-9252-c275da41a93b HTTP/1.1 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 is not attached to volume 63a87bf9-2933-4488-9252-c275da41a93b Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '31a8c71e-bfac-4a9e-80d8-e140e0d220e1', 'id': '63a87bf9-2933-4488-9252-c275da41a93b'} Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63a87bf9-2933-4488-9252-c275da41a93b. Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 is not attached to volume 63a87bf9-2933-4488-9252-c275da41a93b Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:17:42.801733 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 is not attached to volume 63a87bf9-2933-4488-9252-c275da41a93b Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 is not attached to volume 63a87bf9-2933-4488-9252-c275da41a93b {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2cb944a-f114-4a96-a07a-4271e6732a3e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments/63a87bf9-2933-4488-9252-c275da41a93b" status: 404 len: 154 microversion: 2.1 time: 0.105647 Oct 18 17:17:42.806929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3918/7875] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:17:42 2022] DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1/os-volume_attachments/63a87bf9-2933-4488-9252-c275da41a93b => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:17:46.155213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:46.155797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:46.163140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:46.163632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:46.164089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:46.164834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:46.165319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:46.165757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:46.194330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:17:46.275364 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c341d727-7b73-4490-a0ed-7d3892b172ae tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 204 len: 0 microversion: 2.1 time: 0.124605 Oct 18 17:17:46.276155 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3958/7876] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:17:46 2022] DELETE /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:17:46.284550 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:46.285215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:46.292297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:46.292774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:46.293311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:46.294117 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:46.294569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:46.294987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:46.433232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:46.441443 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-92ccfe8a-b60c-4afd-bd31-e81c918e4946 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1559 microversion: 2.1 time: 0.161061 Oct 18 17:17:46.442014 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3919/7877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:46 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:47.465875 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:47.466618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:47.474127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:47.474623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:47.475072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:47.475774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:47.476238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:47.476674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:47.609152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:47.617009 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-43512202-b867-4b13-a29a-6ad1cac3433d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1559 microversion: 2.1 time: 0.155483 Oct 18 17:17:47.617597 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3959/7878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:47 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:48.640051 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:48.640761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:48.647709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:48.648180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:48.648610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:48.649330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:48.649775 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:48.650269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:48.804810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:48.813136 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-31348db2-ef56-4dd2-99a8-5227326014eb tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 200 len: 1559 microversion: 2.1 time: 0.177089 Oct 18 17:17:48.813782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3920/7879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:48 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:48.828104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a8c71e-bfac-4a9e-80d8-e140e0d220e1", "name": "network-vif-deleted", "tag": "6cf4de2c-ecbf-40c3-af77-a7530931799c"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:48.839854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:48.840494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:48.840972 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:48.853480 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] Creating event network-vif-deleted:6cf4de2c-ecbf-40c3-af77-a7530931799c for instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 on n-h1-858383-14 Oct 18 17:17:48.860222 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1e69c06c-47d7-4dfa-bfcb-92cdd1994a24 req-fc610d01-eed1-4e3d-bba6-c2432f3d9678 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Oct 18 17:17:48.860899 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3960/7880] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:49.838079 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:49.838637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 31a8c71e-bfac-4a9e-80d8-e140e0d220e1] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:49.846077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:49.846562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:49.847002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:49.847700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:49.848157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:49.848588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:49.862633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 HTTP/1.1 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '31a8c71e-bfac-4a9e-80d8-e140e0d220e1'} Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:49.864181 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance 31a8c71e-bfac-4a9e-80d8-e140e0d220e1 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28770590-875d-4b38-821c-e9cf692cf73e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1" status: 404 len: 111 microversion: 2.1 time: 0.031527 Oct 18 17:17:49.868984 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3921/7881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:49 2022] GET /compute/v2.1/servers/31a8c71e-bfac-4a9e-80d8-e140e0d220e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:17:49.876152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b7c9a2e7-18c8-4a71-a7f5-1ce245d80e22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '.version_select at 0x7f5fd21964c0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:49.896306 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b7c9a2e7-18c8-4a71-a7f5-1ce245d80e22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-237728813" status: 202 len: 0 microversion: 2.1 time: 0.025477 Oct 18 17:17:49.896887 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3961/7882] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-237728813 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:17:49.913986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9e682cce-6774-46d1-a8fc-181577cc2b22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: .version_select at 0x7f5fd0dcd700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-585685299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs74qeI8wXwHpx9QIkWRXeCXv6kRJiDtkEM3ChkicnV8O0BVDCq/IMbwM8imD49MA9/thk29rS5xEO19t6vTexkW/SQQ6wdQcAG4f54u2O9olnnnnwFWfrQSbcL1nvosg=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:49.929993 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9e682cce-6774-46d1-a8fc-181577cc2b22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:17:49.935288 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-9e682cce-6774-46d1-a8fc-181577cc2b22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:17:49.958101 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9e682cce-6774-46d1-a8fc-181577cc2b22 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047996 Oct 18 17:17:49.958705 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3922/7883] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:17:49 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:50.010477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-463747279", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-585685299", "networks": [{"uuid": "9081ec71-59a1-470b-9c1e-71275c851815"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:50.063724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] validate_networks() for [('9081ec71-59a1-470b-9c1e-71275c851815', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:17:50.437121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:17:50.437559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:17:50.438059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:17:50.438490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:17:50.438899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:17:50.447696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:50.448192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:50.448641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:50.449414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:50.449879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:50.450451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:50.468723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:17:50.474625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:17:50.487540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:17:50.490298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:17:50.537994 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-815d96da-1290-4180-b520-fc0b6f4bb5ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531464 Oct 18 17:17:50.538656 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3962/7884] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:17:50.550922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c06ee1a4-c656-4653-adbb-e4273ba62dff tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:50.551644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c06ee1a4-c656-4653-adbb-e4273ba62dff tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:50.605889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c06ee1a4-c656-4653-adbb-e4273ba62dff tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:50.614102 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c06ee1a4-c656-4653-adbb-e4273ba62dff tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1261 microversion: 2.1 time: 0.067043 Oct 18 17:17:50.614925 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3923/7885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:50 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:17:51.640757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:51.641577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:51.659027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:51.659808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:51.660314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:51.661141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:51.661609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:51.662336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:51.750958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:51.759080 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af15d962-e06a-4c10-95f1-0aba5bae1439 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1331 microversion: 2.1 time: 0.124117 Oct 18 17:17:51.759659 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3963/7886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:51 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:52.783366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:52.783958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:52.791165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:52.791660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:52.792106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:52.792817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:52.793354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:52.793905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:52.945340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:52.954256 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10b2d1d0-4c03-49b9-aec3-c0213dc7f6d8 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.176170 Oct 18 17:17:52.954846 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3924/7887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:52 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:53.142147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b924b6-e42a-42cb-8859-39390dc92835", "tag": "7e4e5178-2e79-4778-8b13-bac59c0f58af"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:53.159397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:53.159906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:53.160369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:53.175047 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] Creating event network-changed:7e4e5178-2e79-4778-8b13-bac59c0f58af for instance f1b924b6-e42a-42cb-8859-39390dc92835 on n-h1-858383-14 Oct 18 17:17:53.180917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-1005cc46-de3c-40ec-93b3-7a8307f0ada2 req-41269a85-562a-471e-b1bd-490094957f10 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044664 Oct 18 17:17:53.181768 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3964/7888] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:53.977780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:53.978390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:53.986838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:53.987324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:53.987782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:53.988473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:53.988923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:53.989369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:54.119256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:54.128195 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98fa8718-d020-4a51-b751-941bbaf44450 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.154271 Oct 18 17:17:54.129078 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3925/7889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:53 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:55.153318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:55.154037 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:55.161695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:55.162200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:55.162661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:55.163374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:55.163848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:55.164295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:55.304958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:55.313497 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b5a39d1c-0bff-49a4-9ae8-15fa16864ca4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.165234 Oct 18 17:17:55.314330 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3965/7890] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:55 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:56.336622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:56.337255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:56.344450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:56.344927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:56.345392 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:56.346087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:56.346537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:56.346957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:56.490492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:56.501178 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f2c6cd92-c804-40e8-8c7a-cb6cf4b4c4bc tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.168384 Oct 18 17:17:56.501775 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3926/7891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:56 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:57.523949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:57.524600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:57.532281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:57.532778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:57.533259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:57.533961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:57.534454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:57.534897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:57.665167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:57.673874 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e0065c94-c63d-4a37-ab1d-4120c9364ca3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.153873 Oct 18 17:17:57.674459 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3966/7892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:57 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:58.044337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b924b6-e42a-42cb-8859-39390dc92835", "name": "network-vif-plugged", "status": "completed", "tag": "7e4e5178-2e79-4778-8b13-bac59c0f58af"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:17:58.055102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:58.055591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:58.056021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:58.327172 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] Creating event network-vif-plugged:7e4e5178-2e79-4778-8b13-bac59c0f58af for instance f1b924b6-e42a-42cb-8859-39390dc92835 on n-h1-858383-14 Oct 18 17:17:58.332053 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-86de7350-207b-4a96-baba-db614b437ab0 req-bcd933c7-469d-4dd7-ac18-0bf4d2c820a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291519 Oct 18 17:17:58.332642 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3927/7893] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:17:58.695798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:58.696431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:58.704071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:58.704577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:58.705067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:58.705785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:58.706262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:58.706706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:58.839682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:17:58.848129 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-92cc9a42-140b-429a-a07a-73ef136ff55a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1361 microversion: 2.1 time: 0.156276 Oct 18 17:17:58.848726 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3967/7894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:58 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:17:59.873294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:17:59.874009 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:17:59.880768 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:59.881289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:59.881735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:17:59.882431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:17:59.882884 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:17:59.883570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:00.017876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:00.025599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f092b552-3007-40e9-8684-03c225de06be tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1553 microversion: 2.1 time: 0.157505 Oct 18 17:18:00.026157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3928/7895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:17:59 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:00.048935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:00.049593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:00.056525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:00.057048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:00.057503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:00.058205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:00.058694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:00.059248 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:00.188439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:00.196218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7c7cfbd3-ad45-4ecc-8fdb-19b374314b1b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1553 microversion: 2.1 time: 0.151350 Oct 18 17:18:00.196784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3968/7896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:00 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:01.684930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d18649af-34c3-48c4-b7c0-359b788bc6eb"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:01.687258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:01.689279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:01.696964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:01.697481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:01.697911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:01.698598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:01.699049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:01.699521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:01.961726 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0bc640e9-8f00-4690-b901-f8c16f7ab313 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281036 Oct 18 17:18:01.962334 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3929/7897] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:18:01 2022] POST /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:12.696128 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:12.696678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:12.698637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.699326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.700131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.700888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.708814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:12.709341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:12.709801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:12.710513 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:12.710987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:12.711430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:12.800946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lazy-loading 'services' on Instance uuid f1b924b6-e42a-42cb-8859-39390dc92835 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:18:12.870777 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3ffb35a7-f631-4b7f-b9b2-efa9e44ec95b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments/d18649af-34c3-48c4-b7c0-359b788bc6eb" status: 202 len: 0 microversion: 2.1 time: 0.178662 Oct 18 17:18:12.871391 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3969/7898] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:18:12 2022] DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments/d18649af-34c3-48c4-b7c0-359b788bc6eb => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:18:12.879566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.880490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:12.885899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:12.889393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:12.899816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:12.900501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:12.900950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:12.901679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:12.902139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:12.902568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:12.937665 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-db3df7bb-6f55-4981-987e-c32eac16ce7a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060462 Oct 18 17:18:12.938250 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3930/7899] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:12 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:13.951523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:13.954204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:13.960601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:13.961127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:13.961590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:13.962308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:13.962788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:13.963233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:13.995811 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e5703d8e-8296-4c31-a33b-834ab0f91e29 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049421 Oct 18 17:18:13.996398 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3970/7900] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:13 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:18:15.008221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:15.010498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:15.018773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:15.019276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:15.019723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:15.020451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:15.020914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:15.021378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:15.053963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-94d58273-8016-4c9e-8189-b76d96f9637d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Oct 18 17:18:15.054563 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3931/7901] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:15 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:16.067476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:16.069820 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:16.077752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:16.078396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:16.078890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:16.079618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:16.080093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:16.080568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:16.112609 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-868f8b3e-5b3d-441a-8c59-ccbf302a9b60 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049107 Oct 18 17:18:16.113104 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3971/7902] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:16 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:18:17.124451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:17.127427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:17.134568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:17.135052 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:17.135491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:17.136190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:17.136643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:17.137114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:17.175546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ffd6e8ba-17a0-43ca-a183-7a9ea2450012 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055070 Oct 18 17:18:17.176124 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3932/7903] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:17 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:18.188206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:18.190354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:18.197329 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:18.197832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:18.198287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:18.198993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:18.199464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:18.199909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:18.230347 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-025d9431-f0aa-4db7-b228-2fa2e64a1c6e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046417 Oct 18 17:18:18.230927 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3972/7904] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:18 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 17:18:18.241628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:18.242164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:18.249114 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:18.250102 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:18.250555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:18.251409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:18.251876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:18.252312 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:18.333627 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance f1b924b6-e42a-42cb-8859-39390dc92835 is not attached to volume d18649af-34c3-48c4-b7c0-359b788bc6eb Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments/d18649af-34c3-48c4-b7c0-359b788bc6eb HTTP/1.1 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f1b924b6-e42a-42cb-8859-39390dc92835 is not attached to volume d18649af-34c3-48c4-b7c0-359b788bc6eb Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': 'f1b924b6-e42a-42cb-8859-39390dc92835', 'id': 'd18649af-34c3-48c4-b7c0-359b788bc6eb'} Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d18649af-34c3-48c4-b7c0-359b788bc6eb. Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b924b6-e42a-42cb-8859-39390dc92835 is not attached to volume d18649af-34c3-48c4-b7c0-359b788bc6eb Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:18.335282 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b924b6-e42a-42cb-8859-39390dc92835 is not attached to volume d18649af-34c3-48c4-b7c0-359b788bc6eb Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance f1b924b6-e42a-42cb-8859-39390dc92835 is not attached to volume d18649af-34c3-48c4-b7c0-359b788bc6eb {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c50f6a6-f5e6-4412-8528-0ab6494f80bf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments/d18649af-34c3-48c4-b7c0-359b788bc6eb" status: 404 len: 154 microversion: 2.1 time: 0.099120 Oct 18 17:18:18.343413 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3933/7905] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:18:18 2022] DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835/os-volume_attachments/d18649af-34c3-48c4-b7c0-359b788bc6eb => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:18:21.736339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:21.736924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:21.743873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:21.744367 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:21.744817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:21.745556 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:21.746023 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:21.746465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:21.773062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:18:21.853478 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5d7495ea-5252-406d-aa6f-6fbfdc4f250b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 204 len: 0 microversion: 2.1 time: 0.121268 Oct 18 17:18:21.857682 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3973/7906] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:18:21 2022] DELETE /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:18:21.863274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:21.863906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:21.871906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:21.872411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:21.872867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:21.873610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:21.874074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:21.875486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:22.018274 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:22.026382 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d5635f76-3797-4190-a20a-8873f038bc1f tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1559 microversion: 2.1 time: 0.167636 Oct 18 17:18:22.026951 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3934/7907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:21 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:23.051043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:23.051814 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:23.058779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:23.059277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:23.059730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:23.060434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:23.060907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:23.061373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:23.197934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:23.206638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-02dd4b34-d98f-47b6-a6dc-2fa32bebecbd tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1559 microversion: 2.1 time: 0.159272 Oct 18 17:18:23.206638 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3974/7908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:23 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:24.049945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b924b6-e42a-42cb-8859-39390dc92835", "name": "network-vif-deleted", "tag": "7e4e5178-2e79-4778-8b13-bac59c0f58af"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:24.061136 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:24.061623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:24.062061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:24.075032 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] Creating event network-vif-deleted:7e4e5178-2e79-4778-8b13-bac59c0f58af for instance f1b924b6-e42a-42cb-8859-39390dc92835 on n-h1-858383-14 Oct 18 17:18:24.080633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-a7c4fd8a-d837-4a56-8e35-a26f346a0ed9 req-14b49e34-eeeb-4504-a7ae-657e057dac78 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035122 Oct 18 17:18:24.081520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3935/7909] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:24.230099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:24.231847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:24.239676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:24.240270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:24.240726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:24.241480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:24.241967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:24.242380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:24.282005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:24.282005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:24.282005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:24.282005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lazy-loading 'fault' on Instance uuid f1b924b6-e42a-42cb-8859-39390dc92835 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:18:24.327477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:24.335878 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c1dbaae-a0bf-4185-a8d2-f0ac929aad40 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 200 len: 1351 microversion: 2.1 time: 0.109923 Oct 18 17:18:24.336487 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3975/7910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:24 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:25.362295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:25.363006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: f1b924b6-e42a-42cb-8859-39390dc92835] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:25.369251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:25.369736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:25.370173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:25.370862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:25.371356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:25.371785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:25.386211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 HTTP/1.1 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'f1b924b6-e42a-42cb-8859-39390dc92835'} Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:25.387824 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance f1b924b6-e42a-42cb-8859-39390dc92835 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d71a8433-b85a-444f-8ca6-72452df5f750 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835" status: 404 len: 111 microversion: 2.1 time: 0.033166 Oct 18 17:18:25.392644 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3936/7911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:25 2022] GET /compute/v2.1/servers/f1b924b6-e42a-42cb-8859-39390dc92835 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:18:25.398414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21871c9d-c5c9-4c55-8a0f-6d7c4c2f1ff2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '.version_select at 0x7f5fd2747a60>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:25.418901 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21871c9d-c5c9-4c55-8a0f-6d7c4c2f1ff2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-585685299" status: 202 len: 0 microversion: 2.1 time: 0.024713 Oct 18 17:18:25.419496 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3976/7912] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 17:18:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-585685299 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:18:25.437023 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e35e017-5f34-41cb-9ac3-54394a7f2f4e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: .version_select at 0x7f5fd0d6a3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1576431164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5h/mhhGFr61gjsk9n0jrM5ZPCxRh34heVfuG9OboYvOpgcZHcjI+pQvUTihzy46f1a/p2pw5eon8ARSliDJOuadJQVrXyLr8Wj985RhH5HdX2gVwkdJvvaJNHJrFnPrA=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:25.452745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5e35e017-5f34-41cb-9ac3-54394a7f2f4e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:18:25.458490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-5e35e017-5f34-41cb-9ac3-54394a7f2f4e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:18:25.482325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e35e017-5f34-41cb-9ac3-54394a7f2f4e tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049139 Oct 18 17:18:25.482959 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3937/7913] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:18:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:25.534813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1043544099", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1576431164", "networks": [{"uuid": "9081ec71-59a1-470b-9c1e-71275c851815"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:25.588659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] validate_networks() for [('9081ec71-59a1-470b-9c1e-71275c851815', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:18:26.054703 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:18:26.055072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:18:26.056561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:18:26.056561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:18:26.056561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:18:26.065787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:26.066287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:26.066743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:26.067485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:26.067956 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:26.068401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:26.086413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:18:26.091686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Getting quotas for user 87a4596d671f4015b7c79f313330055a and project c00ba8b4694a4dd3be03cc8409e130bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:18:26.104788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:18:26.107183 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:18:26.156785 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5dd352c4-17db-4c13-881a-01028eb8a1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625754 Oct 18 17:18:26.157847 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3977/7914] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:18:26.168965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d134d48-d1e8-4fb1-9887-57655fce87e5 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:26.169624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d134d48-d1e8-4fb1-9887-57655fce87e5 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:26.229992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d134d48-d1e8-4fb1-9887-57655fce87e5 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:26.237294 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d134d48-d1e8-4fb1-9887-57655fce87e5 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1263 microversion: 2.1 time: 0.072271 Oct 18 17:18:26.237977 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3938/7915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:26 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:27.260967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:27.261711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:27.268459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:27.269125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:27.269596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:27.270322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:27.270923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:27.271438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:27.363635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:27.371662 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c2fe1c80-76d1-4049-8d74-216cf5f7e67b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1323 microversion: 2.1 time: 0.115491 Oct 18 17:18:27.372252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3978/7916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:27 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:28.396902 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:28.397593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:28.404787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:28.405311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:28.405773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:28.407519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:28.408010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:28.408449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:28.544956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:28.553215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0095b5b6-48d5-46ce-9ee6-4e0edc6d81f9 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.161015 Oct 18 17:18:28.553801 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3939/7917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:28 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:28.704891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f51773f-8abc-4d4a-9e8a-73109646c85e", "tag": "29c82475-15f0-433c-ac56-2165c13cb1b0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:28.715725 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:28.716240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:28.716701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:28.728657 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] Creating event network-changed:29c82475-15f0-433c-ac56-2165c13cb1b0 for instance 4f51773f-8abc-4d4a-9e8a-73109646c85e on n-h1-858383-14 Oct 18 17:18:28.733842 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-226b1f3d-aca7-46b8-a7ca-0460826dbd3a req-4189e1a7-8e66-4325-9f81-5ae48a95f0c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033293 Oct 18 17:18:28.734749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3979/7918] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:18:29.576027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:29.576637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:29.583753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:29.584243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:29.584686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:29.585420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:29.585880 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:29.586309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:29.720488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:29.728353 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b0410734-a326-4346-ab47-4f2eddd503f2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.156226 Oct 18 17:18:29.728922 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3940/7919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:29 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:30.753905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:30.754620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:30.761162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:30.761656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:30.762105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:30.762801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:30.763266 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:30.763704 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:30.900747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:30.909277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4866c96c-eb6a-42c0-b3be-4e33b0b4dcc7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.161201 Oct 18 17:18:30.909858 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3980/7920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:30 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:31.932108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:31.932653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:31.940908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:31.941450 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:31.941898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:31.942614 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:31.943078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:31.943540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:32.076761 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:32.084652 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9d28ff52-80f4-4dfd-a07b-908efb6eba4c tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.156792 Oct 18 17:18:32.085281 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3941/7921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:31 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:33.107601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:33.108286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:33.115394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:33.115898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:33.116361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:33.117103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:33.117584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:33.118035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:33.249916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:33.258374 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c8009648-1af6-4aa5-87a9-afd2063ac7ed tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.154768 Oct 18 17:18:33.258956 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3981/7922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:33 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:34.253435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51773f-8abc-4d4a-9e8a-73109646c85e", "name": "network-vif-plugged", "status": "completed", "tag": "29c82475-15f0-433c-ac56-2165c13cb1b0"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:34.264791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:34.265340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:34.265776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:34.278068 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] Creating event network-vif-plugged:29c82475-15f0-433c-ac56-2165c13cb1b0 for instance 4f51773f-8abc-4d4a-9e8a-73109646c85e on n-h1-858383-14 Oct 18 17:18:34.282593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:34.283224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:34.283471 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-038dc3cf-6ea0-44e5-aee4-73666077492c req-28869660-901b-4a54-b721-3f276ef9d689 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034795 Oct 18 17:18:34.284278 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3942/7923] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:34.291123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:34.291615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:34.292122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:34.292962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:34.293478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:34.293918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:34.479994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:34.488590 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e93bdb51-0bc4-432a-b2ce-2f4d786c107a tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.210908 Oct 18 17:18:34.489232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3982/7924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:34 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:18:35.514830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:35.515799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:35.522562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:35.523040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:35.523476 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:35.524159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:35.524607 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:35.525053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:35.655700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:35.663482 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b77589b2-297b-484a-a2a1-bdc28ca66caf tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1363 microversion: 2.1 time: 0.153758 Oct 18 17:18:35.664050 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3943/7925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:35 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:36.686817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:36.687430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:36.690208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:36.690903 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:36.696679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:36.697198 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:36.697648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:36.698347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:36.698810 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:36.699253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:36.830410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:36.838509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a836bcf3-0c7d-4edf-8dcd-3e6e57aff2e6 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1555 microversion: 2.1 time: 0.155730 Oct 18 17:18:36.839090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3983/7926] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:36 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:36.861857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:36.862469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:36.864424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:36.870364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:36.870841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:36.871273 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:36.871957 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:36.872410 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:36.872932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:37.009269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:37.018107 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7c92a4a9-6e51-41f1-b836-4cb202b2f736 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1555 microversion: 2.1 time: 0.159425 Oct 18 17:18:37.018686 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3944/7927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:36 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:38.525841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a2c82bc-7b6f-4527-9822-ce928657fea7"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:18:38.528304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:38.535911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:38.536395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:38.536844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:38.537582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:38.538049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:38.538526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:38.686303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:38.802708 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-259e4c3e-8bf8-4e08-b6d1-1f5b0d0999c3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "POST /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280681 Oct 18 17:18:38.808791 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3984/7928] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:18:38 2022] POST /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:49.544042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:49.544588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:49.546760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:49.547554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=66 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:49.553359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:49.553844 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:49.554276 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:49.554958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:49.555407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:49.555828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:49.636646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lazy-loading 'services' on Instance uuid 4f51773f-8abc-4d4a-9e8a-73109646c85e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:18:49.710408 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4733dd70-b371-44d3-b3ad-76efa391b2a7 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments/6a2c82bc-7b6f-4527-9822-ce928657fea7" status: 202 len: 0 microversion: 2.1 time: 0.170088 Oct 18 17:18:49.711081 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3945/7929] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:18:49 2022] DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments/6a2c82bc-7b6f-4527-9822-ce928657fea7 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:18:49.718065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:49.718883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:49.723312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:49.725954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:49.733643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:49.734137 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:49.734585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:49.735287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:49.735751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:49.736188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:49.771649 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eac5b0b2-9604-4392-a948-5798d69c4b04 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055470 Oct 18 17:18:49.772139 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3985/7930] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:49 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:50.786359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:50.788774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:50.795356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:50.795837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:50.796277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:50.797025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:50.797492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:50.797908 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:50.829533 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-03835453-5fe8-46da-88d4-3e7aa3aa58e3 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049324 Oct 18 17:18:50.830099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3946/7931] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:50 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:51.842245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:51.844477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:51.852633 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:51.853181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:51.853638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:51.854357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:51.854825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:51.855273 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:51.888236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8d5d36bf-f9fe-45e2-900d-90eb41183a67 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Oct 18 17:18:51.889090 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3986/7932] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:51 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:52.901515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:52.903693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:52.911025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:52.911704 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:52.912140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:52.912822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:52.913309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:52.913733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:52.951313 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50747f05-8b30-4355-8b37-19d7f134fe5d tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053928 Oct 18 17:18:52.953252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3947/7933] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:52 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:53.963959 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:53.966295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:53.974094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:53.974602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:53.975063 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:53.975787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:53.976262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:53.976716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:54.008812 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-eccda85d-cc79-49ca-aedc-c5e32ddd8f41 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Oct 18 17:18:54.009419 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3987/7934] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:53 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:18:55.022821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:55.025251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:55.032332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:55.032817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:55.033306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:55.034067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:55.034523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:55.034952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:55.065855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c9eb147a-7823-4816-9cd3-410ea0116d57 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047852 Oct 18 17:18:55.066955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3948/7935] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:18:55 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 17:18:55.077861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:55.078557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:55.086638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:55.087132 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:55.087684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:55.088430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:55.088895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:55.089398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e is not attached to volume 6a2c82bc-7b6f-4527-9822-ce928657fea7 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments/6a2c82bc-7b6f-4527-9822-ce928657fea7 HTTP/1.1 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e is not attached to volume 6a2c82bc-7b6f-4527-9822-ce928657fea7 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '4f51773f-8abc-4d4a-9e8a-73109646c85e', 'id': '6a2c82bc-7b6f-4527-9822-ce928657fea7'} Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6a2c82bc-7b6f-4527-9822-ce928657fea7. Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e is not attached to volume 6a2c82bc-7b6f-4527-9822-ce928657fea7 Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:18:55.181191 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e is not attached to volume 6a2c82bc-7b6f-4527-9822-ce928657fea7 Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e is not attached to volume 6a2c82bc-7b6f-4527-9822-ce928657fea7 {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98314a2e-e58a-48d1-a275-fc349145a82b tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments/6a2c82bc-7b6f-4527-9822-ce928657fea7" status: 404 len: 154 microversion: 2.1 time: 0.107398 Oct 18 17:18:55.186997 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3988/7936] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:18:55 2022] DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e/os-volume_attachments/6a2c82bc-7b6f-4527-9822-ce928657fea7 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 17:18:58.543776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:58.544344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:58.552012 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:58.552506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:58.552955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:58.553699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:58.554160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:58.554592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:58.584373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:18:58.664399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-523c972a-2511-44a6-b694-891624902423 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 204 len: 0 microversion: 2.1 time: 0.124300 Oct 18 17:18:58.665401 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3949/7937] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:18:58 2022] DELETE /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:18:58.673706 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:58.674271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:58.682399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:58.682901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:58.683358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:58.684075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:58.684546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:58.685230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:58.829480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:18:58.837599 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2c873b99-d4af-444c-afa9-2aa435f847e2 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1561 microversion: 2.1 time: 0.167921 Oct 18 17:18:58.838169 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3989/7938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:58 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:18:59.862381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:18:59.863078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:18:59.870688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:59.871163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:59.871598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:18:59.872297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:18:59.872732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:18:59.873196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:00.009511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:00.017530 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91eaa1ba-0b0a-4fe3-b12a-0c37d82cd1ce tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1561 microversion: 2.1 time: 0.159445 Oct 18 17:19:00.018097 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3950/7939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:18:59 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:00.896779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51773f-8abc-4d4a-9e8a-73109646c85e", "name": "network-vif-deleted", "tag": "29c82475-15f0-433c-ac56-2165c13cb1b0"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:00.913550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:00.914757 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:00.915730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:00.931942 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] Creating event network-vif-deleted:29c82475-15f0-433c-ac56-2165c13cb1b0 for instance 4f51773f-8abc-4d4a-9e8a-73109646c85e on n-h1-858383-14 Oct 18 17:19:00.940858 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-4c7a13a5-c266-4887-be56-bad2cac093f2 req-7263f61f-64b2-4df4-81cb-a79c59e8d648 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051348 Oct 18 17:19:00.945422 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3990/7940] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:19:01.042750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:01.043365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:01.055226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:01.055713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:01.056152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:01.056853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:01.057391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:01.057881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:01.094055 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:01.094582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:01.095030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:01.095492 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lazy-loading 'fault' on Instance uuid 4f51773f-8abc-4d4a-9e8a-73109646c85e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:19:01.145454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a4596d671f4015b7c79f313330055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ba8b4694a4dd3be03cc8409e130bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:01.153194 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f4ca1e05-af9a-4c98-bef6-a97e30e74af4 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 200 len: 1353 microversion: 2.1 time: 0.116233 Oct 18 17:19:01.153761 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3951/7941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:01 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 1353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:02.178396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:02.179112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] [instance: 4f51773f-8abc-4d4a-9e8a-73109646c85e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:02.185613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:02.186123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:02.186593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:02.187341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:02.187840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:02.188288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:02.202639 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] HTTP exception thrown: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Request method failure captured: Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e HTTP/1.1 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTt-U3XaZ3hQ61RVLAYMfxbgarGKFNMfY8Uo29DSA0wPVo6lrT4PaW7NFg-9uqmm0S9Bq1O93l08_spKcZKBzScG9XfZxfVAOMqtgNmWIa6M8RirxvOFJEy4I3Qhekl2x-2KmO4ArwqIERAwQF-3o45Knst-_A7GeDORj0e5uChCRlwI Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c00ba8b4694a4dd3be03cc8409e130bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c00ba8b4694a4dd3be03cc8409e130bb"}]}] Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: c00ba8b4694a4dd3be03cc8409e130bb Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1506674833 Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 87a4596d671f4015b7c79f313330055a Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestEncryptedCinderVolumes-1506674833-project Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '4f51773f-8abc-4d4a-9e8a-73109646c85e'} Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:19:02.204306 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Returning 404 to user: Instance 4f51773f-8abc-4d4a-9e8a-73109646c85e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b908849-02f5-4fe7-8a01-5a7d0d4bc366 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e" status: 404 len: 111 microversion: 2.1 time: 0.032587 Oct 18 17:19:02.209754 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3991/7942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:02 2022] GET /compute/v2.1/servers/4f51773f-8abc-4d4a-9e8a-73109646c85e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:19:02.215189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a1addefd-b97b-463a-9299-3b9e91783786 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] Calling method '.version_select at 0x7f5fd18345e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:02.236011 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a1addefd-b97b-463a-9299-3b9e91783786 tempest-TestEncryptedCinderVolumes-1506674833 tempest-TestEncryptedCinderVolumes-1506674833-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1576431164" status: 202 len: 0 microversion: 2.1 time: 0.024628 Oct 18 17:19:02.236584 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3952/7943] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 17:19:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1576431164 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:19:29.643348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0b5ede3a-a466-4b62-958d-a62c6c13e0f5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: .version_select at 0x7f5fd2d18820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-688654218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqkY1WwP3NVWlYyn70XkeJRVueFbvdwHn2uPKNTZ+kby9Ot9wKwXjIFTMTFOPK8tdkxm/znLTO/G6u+QpCvP+BJIGqImZXjZyRjdbMYM23UmJXAvky7BCNbVBtbcgu8tw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:29.650478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=14 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:29.651276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=34 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:29.663900 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0b5ede3a-a466-4b62-958d-a62c6c13e0f5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for project 1648cc7f75e4409480ce034f375a823c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:19:29.669942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-0b5ede3a-a466-4b62-958d-a62c6c13e0f5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for user 42f5b134175446689dc14bbc58323017 and project 1648cc7f75e4409480ce034f375a823c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:19:29.693277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0b5ede3a-a466-4b62-958d-a62c6c13e0f5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053818 Oct 18 17:19:29.693896 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3992/7944] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:19:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:19:29.743036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:29.743914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:29.747787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-245825390", "imageRef": "2b7882ff-3ea9-4a0d-8bc7-d2d40d03975f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-688654218", "networks": [{"uuid": "056d3f4f-cd50-4c02-bc4e-52e41164c264"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:29.801352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] validate_networks() for [('056d3f4f-cd50-4c02-bc4e-52e41164c264', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:19:30.183576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:19:30.184007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:19:30.184488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:19:30.184903 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:19:30.185350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:19:30.194364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:30.194857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:30.195294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:30.196024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:30.197027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:30.197027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:30.215639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for project 1648cc7f75e4409480ce034f375a823c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:19:30.220910 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for user 42f5b134175446689dc14bbc58323017 and project 1648cc7f75e4409480ce034f375a823c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:19:30.233867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:19:30.236131 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b7882ff-3ea9-4a0d-8bc7-d2d40d03975f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:19:30.280193 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:19:31.288145 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55096. Oct 18 17:19:31.292742 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d0804405-32cc-4617-b550-1a8401513ed3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551792 Oct 18 17:19:31.293444 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3953/7945] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:19:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:19:31.306209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-14d1fc4b-1ee9-4a9c-ab70-db837ed5bb82 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:31.306895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-14d1fc4b-1ee9-4a9c-ab70-db837ed5bb82 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:31.364173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-14d1fc4b-1ee9-4a9c-ab70-db837ed5bb82 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:31.371279 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-14d1fc4b-1ee9-4a9c-ab70-db837ed5bb82 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1257 microversion: 2.1 time: 0.070725 Oct 18 17:19:31.371799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3993/7946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:31 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:32.397019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:32.397642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:32.404596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:32.405182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:32.405632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:32.406337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:32.406989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:32.407420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:32.477649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:32.487771 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7258bec-c3ef-4ad3-a576-11af03490d60 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1317 microversion: 2.1 time: 0.096306 Oct 18 17:19:32.489248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3954/7947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:32 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:33.512315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:33.512931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:33.525395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:33.526009 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:33.526652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:33.527655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:33.539275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:33.541736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:33.919293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:33.926562 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-99b6e92e-fa1c-444d-a10b-d5be3363009d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.417466 Oct 18 17:19:33.927178 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3994/7948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:33 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:34.951355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:34.952709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:34.962006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:34.962912 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:34.963579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:34.964520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:34.965237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:34.965894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:35.175126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:35.183019 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-52bc571e-31a7-495e-afd7-11257d0c3a21 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.235671 Oct 18 17:19:35.183597 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3955/7949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:34 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:36.205673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:36.207041 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:36.214686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:36.215182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:36.215630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:36.216348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:36.216813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:36.217275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:36.366551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:36.375885 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cc9fd9e-8993-47ca-90e9-163d620fbc56 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.174109 Oct 18 17:19:36.376777 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3995/7950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:36 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:37.399904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:37.401700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:37.409581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:37.410171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:37.410705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:37.411541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:37.412072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:37.412567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:37.563500 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:37.575030 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ea655505-45c5-4552-b468-2e094f23f271 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.179177 Oct 18 17:19:37.578222 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3956/7951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:37 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:38.599226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:38.599866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:38.606893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:38.607405 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:38.607862 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:38.609560 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:38.610060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:38.610521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:38.762104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:38.770681 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-165c4408-2d3c-4dff-9873-e6e1e2fd0c45 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.175987 Oct 18 17:19:38.771296 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3996/7952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:38 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:39.797209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:39.798076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:39.805525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:39.806020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:39.806465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:39.807172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:39.807639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:39.808096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:39.944008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:39.951946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0e6ec117-c7ba-4283-bb20-c2b3faa992c2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.158788 Oct 18 17:19:39.952521 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3957/7953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:39 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:40.975947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:40.976586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:40.983753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:40.984247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:40.984702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:40.985439 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:40.985925 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:40.986371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:41.117490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:41.125234 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f4f476ef-b76c-405c-b2ce-e82c48961a03 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.153780 Oct 18 17:19:41.125808 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3997/7954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:40 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:42.150372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:42.150995 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:42.153017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:42.153702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:42.159582 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:42.160064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:42.160497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:42.161262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:42.161714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:42.162141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:42.291762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:42.299810 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb42de8a-2b3d-4caf-8eae-5583f3b2a729 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.154392 Oct 18 17:19:42.300379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3958/7955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:42 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:43.321985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:43.322559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:43.324436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:43.330980 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:43.331480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:43.331934 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:43.333155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:43.333635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:43.334075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:43.467500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:43.475441 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-505189a7-44bc-43e2-bcf4-11ebcc3ff6a0 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.157541 Oct 18 17:19:43.476011 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3998/7956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:43 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:44.378600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:44.390094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:44.390576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:44.391003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:44.403248 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] Creating event network-changed:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:19:44.408453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4530e181-66e4-452c-ae98-79b943e33192 req-6dec8b16-6407-46b6-ba4e-b9306f578080 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Oct 18 17:19:44.409649 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3959/7957] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:19:44.566860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:44.578126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:44.587599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:44.588116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:44.588574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:44.589346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:44.589831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:44.590279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:44.802641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:44.810525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cb4cbf52-c6e3-4692-86b7-d9ffb23cec24 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.313487 Oct 18 17:19:44.811110 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 3999/7958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:44 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:45.836097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:45.836802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:45.843022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:45.843504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:45.843937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:45.844617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:45.845196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:45.845626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:45.976138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:45.984005 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b488f152-8223-4a53-b018-ce911fadb797 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.153677 Oct 18 17:19:45.984577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3960/7959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:45 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:47.007838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:47.008469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:47.015607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:47.016109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:47.016566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:47.017299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:47.017781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:47.018225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:47.223318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:47.231630 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-37211097-a719-4c80-91a4-8e62b1a8666f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.228767 Oct 18 17:19:47.232200 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4000/7960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:47 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:48.255379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:48.256086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:48.262737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:48.263221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:48.263656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:48.264335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:48.264789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:48.265237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:48.401016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:48.408694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b961451-3952-49d3-8d2a-7e5dbb254436 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.157617 Oct 18 17:19:48.409311 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3961/7961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:48 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:49.432544 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:49.433201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:49.440157 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:49.440649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:49.441212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:49.441976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:49.442580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:49.443026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:49.572594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:49.580354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c01286e-3354-44e8-992c-2a3e0ec34e57 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.151856 Oct 18 17:19:49.580935 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4001/7962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:49 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:50.604546 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:50.605187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:50.612006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:50.612483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:50.612916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:50.613766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:50.615053 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:50.615178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:50.747000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:50.754817 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b5572f3-ec40-4aba-a515-6dd658036119 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.154269 Oct 18 17:19:50.755391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3962/7963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:50 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:51.777850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:51.778502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:51.785453 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:51.786570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:51.787015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:51.787714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:51.788182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:51.788620 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:51.921209 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:51.929621 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64ad5fc3-c14c-4263-a387-e080adf00bb9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.155625 Oct 18 17:19:51.930410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4002/7964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:51 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:52.593527 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "name": "network-vif-plugged", "status": "completed", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:52.604979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:52.605502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:52.605950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:52.618037 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] Creating event network-vif-plugged:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:19:52.623086 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fddb140a-0881-40db-8f02-67fec83df94f req-4f43aef6-5126-4f97-9882-43bad3dcc324 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Oct 18 17:19:52.623695 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3963/7965] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:19:52.953098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:52.953731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:52.962098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:52.962642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:52.963097 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:52.963813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:52.964290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:52.964735 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:53.094035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:53.102582 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9fcd405a-636e-4ef6-b9d8-9ffa6c8bcad9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.153380 Oct 18 17:19:53.103160 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4003/7966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:52 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:54.127632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:54.128332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:54.135866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:54.136344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:54.136784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:54.137501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:54.137954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:54.138390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:54.285138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:54.293328 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9439725c-156e-4439-b002-d85615ecef6d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1357 microversion: 2.1 time: 0.171057 Oct 18 17:19:54.293899 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3964/7967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:54 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:55.316747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:55.317672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:55.326869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.327393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.327861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.328603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.329242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.330079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.472803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:55.485276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7bc588c4-75aa-4e5b-87b6-cf8f3152965b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1547 microversion: 2.1 time: 0.172694 Oct 18 17:19:55.487975 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4004/7968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:55 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:55.514369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:55.514988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:55.522719 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.523208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.523650 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.524499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.524961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.525415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.676030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:55.688177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b622dfab-5ccb-4cd2-a6b9-0f90457d6ddf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1547 microversion: 2.1 time: 0.177588 Oct 18 17:19:55.688757 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3965/7969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:55 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:19:55.712567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:55.717570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:55.718540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Searching by: {'deleted': False, 'project_id': '1648cc7f75e4409480ce034f375a823c'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 17:19:55.724317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.724880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.725412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.726191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.726655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.727089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.753741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 17:19:55.784539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a84cf52-1790-4f07-8200-3b663ec938f6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.075805 Oct 18 17:19:55.785154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4005/7970] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 17:19:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:19:55.797520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:19:55.799164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:55.805745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.806393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.806834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.807628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:55.808083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:55.808507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:55.971862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:19:55.980039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01e9f6ea-ac4a-48d9-849c-1e05c0d9bfed tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1547 microversion: 2.1 time: 0.186862 Oct 18 17:19:55.980621 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3966/7971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:19:55 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:19:57.558002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe4371a-074f-464c-8de0-32eb1217042b"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:19:57.560393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:19:57.567337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:57.567843 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:57.568305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:57.569071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:19:57.569555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:19:57.570002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:19:57.833170 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d2edfb63-64b5-47e0-8e0c-4bb3d8a6f70f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278124 Oct 18 17:19:57.833868 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4006/7972] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:19:57 2022] POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:20:10.894435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:20:10.895150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:20:10.898268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:10.899203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=72 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:10.906086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:10.906619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:10.907065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:10.907808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:10.908272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:10.908709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:11.061073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:20:11.069660 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b1762be5-4f5e-490e-ab4e-c964dbb8f503 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1593 microversion: 2.1 time: 0.179092 Oct 18 17:20:11.070230 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3967/7973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:20:10 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1593 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:20:13.102893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:20:13.109689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:13.110373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:13.111044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:13.116700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:13.117238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:13.117698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:13.132252 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] Creating event network-changed:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:20:13.138100 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e0ab1e1d-0ef1-4236-ad39-76c4928dcafb req-3240d0c1-26d1-426f-8ea5-89006ff58381 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040789 Oct 18 17:20:13.141832 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4007/7974] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:20:14.276714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-106467697"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:20:14.277447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:20:14.283441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:14.283926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:14.284369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:14.285078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:14.285538 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:14.285968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:14.418586 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Adding security group e612b8fe-5d93-4715-92dc-c4197dd1ae59 to port 8e6aab57-f226-4f8e-a0fb-10092c7402e1 Oct 18 17:20:14.740572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85755a3c-f5cb-4a57-b3d0-17117b41020d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action" status: 202 len: 0 microversion: 2.1 time: 0.467973 Oct 18 17:20:14.741348 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3968/7975] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:20:14 2022] POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:20:14.751964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:20:14.752648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:20:14.760031 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:14.761321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:14.761784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:14.762536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:14.764255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:14.764707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:14.924530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:20:14.933458 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-35a3931e-e36b-42cf-9350-e565a5834b4f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1758 microversion: 2.1 time: 0.187454 Oct 18 17:20:14.934699 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4008/7976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:20:14 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:20:15.153602 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:20:15.163409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:20:15.164153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:20:15.164584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:20:15.176081 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] Creating event network-changed:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:20:15.181401 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3a7d85df-4244-41e7-af42-c61ce689711c req-46049b7c-d44d-4af5-b426-460d3dff8ea9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Oct 18 17:20:15.182291 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3969/7977] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:22:26.892715 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:22:26.893480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:26.894235 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:26.895798 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:22:26.895960 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action (ip 10.222.0.78) !!! Oct 18 17:22:26.898039 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:22:26.898171 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action (ip 10.222.0.78) !!! Oct 18 17:22:26.902705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:22:26.904981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:22:26.916566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:26.917103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:26.917564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:26.918275 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:26.918748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:26.919195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:26.994508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e2cd623b-6cc5-4d43-934a-0e58c6c9a844 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action" status: 202 len: 0 microversion: 2.1 time: 0.103541 Oct 18 17:22:26.995238 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4009/7978] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:22:26 2022] POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:22:27.002717 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:22:27.003583 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:22:27.004330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:27.005183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:27.006410 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 17:22:27.007940 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:22:27.008295 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e (ip 10.222.0.78) !!! Oct 18 17:22:27.017699 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:22:27.018406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:22:27.030778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:27.031256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:27.031688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:27.032391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:27.032841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:27.033296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:27.184564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:22:27.194136 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f1f355f-e98c-4fa3-a518-19220768808e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1760 microversion: 2.1 time: 0.194355 Oct 18 17:22:27.194740 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3970/7979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:22:26 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:22:28.221021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:22:28.221752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:22:28.231378 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:28.232255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:28.233086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:28.234365 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:22:28.235229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:22:28.236046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:22:28.247953 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55346. Oct 18 17:22:28.395168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:22:28.404115 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a20847a-25f6-4034-b82e-ae1de4deb120 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1758 microversion: 2.1 time: 0.188702 Oct 18 17:22:28.404698 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4010/7980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:22:28 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:23:59.548603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:23:59.550040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:23:59.555185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-106467697"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:23:59.555743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:23:59.565596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:23:59.566087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:23:59.566542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:23:59.567223 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:23:59.567677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:23:59.568108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:23:59.572598 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55386. Oct 18 17:23:59.573397 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55384. Oct 18 17:23:59.722327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Removing security group e612b8fe-5d93-4715-92dc-c4197dd1ae59 from port 8e6aab57-f226-4f8e-a0fb-10092c7402e1 Oct 18 17:24:00.062432 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-474f77b8-b5e0-4d5b-95b5-f95d93c5be27 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action" status: 202 len: 0 microversion: 2.1 time: 0.516630 Oct 18 17:24:00.066323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3971/7981] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:23:59 2022] POST /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:24:00.069854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:00.070621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:00.167080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:00.177368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:00.177877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:00.178335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:00.193109 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] Creating event network-changed:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:24:00.199013 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9ff38f7c-902e-4e3d-acf2-d17d2b3782d5 req-ae277714-9459-4747-9c85-a87f017f8802 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131472 Oct 18 17:24:00.199646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4011/7982] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:01.337868 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:01.338452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:01.345449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:01.345733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:01.346173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:01.346930 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:01.347348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:01.347779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:01.437287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lazy-loading 'services' on Instance uuid 3323b997-4832-42ad-9389-eb97ed20e67e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:24:01.516180 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [2fd6fae5-6cb6-415d-9676-251817e9c159] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:24:02.216349 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:02.227902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:02.228305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:02.228940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:02.241359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] Creating event network-changed:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:24:02.247677 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a59b2de6-f5b2-4122-a235-5cc4b0ce127e req-6adf0336-8727-4f36-9677-292e8737e294 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037324 Oct 18 17:24:02.248300 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4012/7983] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:02.525973 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [2fd6fae5-6cb6-415d-9676-251817e9c159] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55416. Oct 18 17:24:02.529785 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88d59f60-8724-4da5-bfbc-f6e6eddc6712 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments/9fe4371a-074f-464c-8de0-32eb1217042b" status: 202 len: 0 microversion: 2.1 time: 1.197529 Oct 18 17:24:02.530395 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3972/7984] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:24:01 2022] DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments/9fe4371a-074f-464c-8de0-32eb1217042b => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:24:02.539575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:02.542166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:02.548838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:02.549786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:02.550018 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:02.550785 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:02.551295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:02.551768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:02.584207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-af4b9872-d734-419c-a667-6cd06e9a1018 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Oct 18 17:24:02.589143 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4013/7985] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:02 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:03.598643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:03.601056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:03.608808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:03.609336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:03.609783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:03.610491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:03.610958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:03.611393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:03.643950 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f08485e-2916-4026-9b42-6a982315213c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050589 Oct 18 17:24:03.644520 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3973/7986] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:03 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:04.657333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:04.659585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:04.667724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:04.668229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:04.668683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:04.669429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:04.669896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:04.670355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:04.703163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c653a560-47da-4410-9f4e-2490f63a2dba tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049812 Oct 18 17:24:04.703959 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4014/7987] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:04 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:05.716693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:05.719003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:05.725915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:05.726435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:05.726882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:05.727589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:05.728056 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:05.728487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:05.758806 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1a7dd8e0-cb28-4302-83b8-64b8140a3c48 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Oct 18 17:24:05.759395 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3974/7988] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:05 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:06.771722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:06.774152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:06.782030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:06.782536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:06.782997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:06.783714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:06.784188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:06.784636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:06.814989 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dcb38484-3034-4917-b3f3-055922eac25b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047226 Oct 18 17:24:06.815571 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4015/7989] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:06 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:07.827487 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:07.829741 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:07.838760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:07.839241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:07.840561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:07.841336 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:07.841801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:07.842238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:07.870855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ad78c566-8370-4e6e-91e6-23709f288c25 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047310 Oct 18 17:24:07.871421 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3975/7990] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:24:07 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 17:24:07.883226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:07.883775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:07.891901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:07.892413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:07.892879 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:07.893646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:07.894158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:07.894610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:07.973912 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] HTTP exception thrown: Instance 3323b997-4832-42ad-9389-eb97ed20e67e is not attached to volume 9fe4371a-074f-464c-8de0-32eb1217042b Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Request method failure captured: Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: request: DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments/9fe4371a-074f-464c-8de0-32eb1217042b HTTP/1.1 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuASbsbIcJYxHUyW9w1Ve-iKblStsHAbLWQcWIEv5zMSYq7S6xVsLjNkAA6LfAySlt_xTvdpseVLkc5PpB1yd714igysrpqddaZXL-YFT_LGeJmVzA_j_RxH-BPm9W_C8gZlO2nkzX2NYMk8mOgmV18EtoVJlytmk4lIcNmhZVnVPMU Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1648cc7f75e4409480ce034f375a823c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}] Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 42f5b134175446689dc14bbc58323017 Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3323b997-4832-42ad-9389-eb97ed20e67e is not attached to volume 9fe4371a-074f-464c-8de0-32eb1217042b Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'server_id': '3323b997-4832-42ad-9389-eb97ed20e67e', 'id': '9fe4371a-074f-464c-8de0-32eb1217042b'} Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9fe4371a-074f-464c-8de0-32eb1217042b. Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3323b997-4832-42ad-9389-eb97ed20e67e is not attached to volume 9fe4371a-074f-464c-8de0-32eb1217042b Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:24:07.975526 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3323b997-4832-42ad-9389-eb97ed20e67e is not attached to volume 9fe4371a-074f-464c-8de0-32eb1217042b Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Returning 404 to user: Instance 3323b997-4832-42ad-9389-eb97ed20e67e is not attached to volume 9fe4371a-074f-464c-8de0-32eb1217042b {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1bc6f7af-89dc-4498-9221-53ac129475ff tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments/9fe4371a-074f-464c-8de0-32eb1217042b" status: 404 len: 154 microversion: 2.1 time: 0.098872 Oct 18 17:24:07.980030 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4016/7991] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:24:07 2022] DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e/os-volume_attachments/9fe4371a-074f-464c-8de0-32eb1217042b => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:24:11.232113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:11.232646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:11.239636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:11.240124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:11.240567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:11.241285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:11.242244 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:11.242674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:11.271823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:24:11.372145 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8c8c4538-cce2-49dd-8f48-12a801f1c695 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 204 len: 0 microversion: 2.1 time: 0.143654 Oct 18 17:24:11.377157 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3976/7992] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:24:11 2022] DELETE /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:24:11.384657 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:11.385320 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:11.392700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:11.393224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:11.393676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:11.394577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:11.395049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:11.395495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:11.534038 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:11.543256 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f8a69bc-1d8d-4e91-ad8f-e4070ec8bda5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1553 microversion: 2.1 time: 0.165738 Oct 18 17:24:11.543831 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4017/7993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:11 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:12.567508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:12.568154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:12.575399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:12.575885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:12.576325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:12.577034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:12.577497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:12.577926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:12.714756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:12.722582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6131370f-b68f-4a50-83ad-46ee163bfa12 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1553 microversion: 2.1 time: 0.159498 Oct 18 17:24:12.723146 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3977/7994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:12 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:13.707413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3323b997-4832-42ad-9389-eb97ed20e67e", "name": "network-vif-deleted", "tag": "8e6aab57-f226-4f8e-a0fb-10092c7402e1"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:13.717447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:13.718084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:13.718600 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:13.731362 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] Creating event network-vif-deleted:8e6aab57-f226-4f8e-a0fb-10092c7402e1 for instance 3323b997-4832-42ad-9389-eb97ed20e67e on n-h1-858383-14 Oct 18 17:24:13.737161 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-894ffd16-b4d7-4e36-9c5f-fe10c252bee3 req-e1c80777-9ca9-488a-8f05-0c41cb44d7e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091106 Oct 18 17:24:13.737771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4018/7995] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:13.746964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:13.747591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:13.754506 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:13.755001 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:13.755453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:13.756156 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:13.756618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:13.757074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:13.790882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:13.791374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:13.791923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:13.792280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lazy-loading 'fault' on Instance uuid 3323b997-4832-42ad-9389-eb97ed20e67e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:24:13.836191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:13.845680 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4ed083e-8a45-434c-adf3-1354133af545 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 200 len: 1347 microversion: 2.1 time: 0.103641 Oct 18 17:24:13.846630 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3978/7996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:13 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:14.872892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:14.873656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 3323b997-4832-42ad-9389-eb97ed20e67e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:14.879955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:14.880451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:14.880904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:14.881639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:14.882111 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:14.882559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:14.895999 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] HTTP exception thrown: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Request method failure captured: Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e HTTP/1.1 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuASbsbIcJYxHUyW9w1Ve-iKblStsHAbLWQcWIEv5zMSYq7S6xVsLjNkAA6LfAySlt_xTvdpseVLkc5PpB1yd714igysrpqddaZXL-YFT_LGeJmVzA_j_RxH-BPm9W_C8gZlO2nkzX2NYMk8mOgmV18EtoVJlytmk4lIcNmhZVnVPMU Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1648cc7f75e4409480ce034f375a823c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}] Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 42f5b134175446689dc14bbc58323017 Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3323b997-4832-42ad-9389-eb97ed20e67e'} Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:24:14.897662 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Returning 404 to user: Instance 3323b997-4832-42ad-9389-eb97ed20e67e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1bc5523f-62f0-45cc-a2c9-4ed7b582947b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e" status: 404 len: 111 microversion: 2.1 time: 0.032036 Oct 18 17:24:14.903087 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4019/7997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:14 2022] GET /compute/v2.1/servers/3323b997-4832-42ad-9389-eb97ed20e67e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:24:14.907977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20152e7e-804c-4581-b7e1-8a52533632e6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '.version_select at 0x7f5fd0e5a5e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:14.936451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20152e7e-804c-4581-b7e1-8a52533632e6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-688654218" status: 202 len: 0 microversion: 2.1 time: 0.031823 Oct 18 17:24:14.937494 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3979/7998] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 17:24:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-688654218 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:24:24.310880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58d12b9b-91cd-431c-9161-d40c03561b5b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: .version_select at 0x7f5fd156a040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1011308765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxTKgUtFp9BWCcJ/7YN9fHay5M2xN+N5+YP/IqGc1lXswOVkrqmEKecLH2KkRNtoz0NOpfmh9NR6TMyefXz0/QqL7B0EJKZYtz703rZeJO8HTOAIHFWp83Ja/T0Qr4wqA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:24.327326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-58d12b9b-91cd-431c-9161-d40c03561b5b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for project 1648cc7f75e4409480ce034f375a823c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:24:24.333419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-58d12b9b-91cd-431c-9161-d40c03561b5b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for user 42f5b134175446689dc14bbc58323017 and project 1648cc7f75e4409480ce034f375a823c. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:24:24.360572 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58d12b9b-91cd-431c-9161-d40c03561b5b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.101844 Oct 18 17:24:24.361321 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4020/7999] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:24:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:24.411314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:24.416504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-266909127", "imageRef": "4d3b3b8b-73b0-45a9-84ae-ea421dbdb32c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1011308765", "networks": [{"uuid": "056d3f4f-cd50-4c02-bc4e-52e41164c264"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:24.470851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] validate_networks() for [('056d3f4f-cd50-4c02-bc4e-52e41164c264', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:24:24.886964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:24:24.887394 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:24:24.887853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:24:24.888259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:24:24.888668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:24:24.897638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:24.898097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:24.898526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:24.899440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:24.899894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:24.900367 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:24.917746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for project 1648cc7f75e4409480ce034f375a823c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:24:24.922945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Getting quotas for user 42f5b134175446689dc14bbc58323017 and project 1648cc7f75e4409480ce034f375a823c. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:24:24.935862 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:24:24.938135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d3b3b8b-73b0-45a9-84ae-ea421dbdb32c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:24:24.984229 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a3209945-7685-4ba5-84d0-a5710e5005bf tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574732 Oct 18 17:24:24.984878 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3980/8000] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:24:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:24:24.996435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6d9bf99c-75ce-4513-9a35-3199e6a704c7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:24.997202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6d9bf99c-75ce-4513-9a35-3199e6a704c7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:25.001909 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=38 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:25.060938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6d9bf99c-75ce-4513-9a35-3199e6a704c7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:25.067958 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6d9bf99c-75ce-4513-9a35-3199e6a704c7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1258 microversion: 2.1 time: 0.076039 Oct 18 17:24:25.068882 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4021/8001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:24 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:26.092119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:26.092747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:26.099727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:26.100218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:26.100664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:26.101397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:26.101860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:26.102927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:26.169308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:26.177503 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-447878bd-b4ae-4923-a351-2cef19e5660d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1318 microversion: 2.1 time: 0.090507 Oct 18 17:24:26.178086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3981/8002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:26 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:27.201835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:27.203098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:27.210754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:27.212011 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:27.212888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:27.213739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:27.214226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:27.214692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:27.363270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:27.381065 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c41dbc3e-dffb-49bf-adf5-bb8f71d6aefd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.183257 Oct 18 17:24:27.381653 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4022/8003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:27 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:28.404501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:28.405211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:28.412426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:28.412923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:28.413401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:28.414113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:28.415130 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:28.416160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:28.578173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:28.586128 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-206284ea-3031-48cc-b508-54da47e36ea4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.185500 Oct 18 17:24:28.587598 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3982/8004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:28 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:29.611681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:29.612323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:29.619167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:29.619753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:29.620110 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:29.620846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:29.621350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:29.621800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:29.784386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:29.793487 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a6f49dba-3300-45d0-98eb-dc57e09ac0d9 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.185413 Oct 18 17:24:29.803800 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4023/8005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:29 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:30.818733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:30.819564 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:30.823503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:30.827343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:30.827996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:30.828449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:30.829491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:30.829968 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:30.830441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:30.983388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:30.991805 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f9fa9917-7c36-4423-ac6d-1b561424f1e5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.179830 Oct 18 17:24:30.998825 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3983/8006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:30 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:32.018593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:32.019321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:32.021882 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:24:32.022652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:32.029389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:32.029989 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:32.030447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:32.031166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:32.031632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:32.032071 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:32.176303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:32.185025 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58099f79-5f0a-4750-b58c-1a107909cb39 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.171326 Oct 18 17:24:32.185735 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4024/8007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:32 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:33.209547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:33.210167 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:33.217480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:33.217980 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:33.218429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:33.219141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:33.219604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:33.220047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:33.360944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:33.369599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-864e00c3-b200-4ebb-be55-1aaf11e34903 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.164412 Oct 18 17:24:33.370127 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3984/8008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:33 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:34.391949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:34.392580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:34.401937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:34.402433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:34.402888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:34.403591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:34.404054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:34.404497 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:34.410128 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55618. Oct 18 17:24:34.608732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:34.616554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ff6e3e9a-093a-431d-9c0d-cfd56a8f5fb7 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.228766 Oct 18 17:24:34.617170 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4025/8009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:34 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:35.641057 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:35.641802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:35.644628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:35.645542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:35.652097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:35.652591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:35.653059 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:35.653760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:35.654250 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:35.654680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:35.831914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:35.841566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba96965f-ec8b-4516-8d95-1bda5e2c133b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.204715 Oct 18 17:24:35.842149 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3985/8010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:35 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:24:36.138973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:36.144750 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:36.153317 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:36.153819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:36.154272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:36.165638 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] Creating event network-changed:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:24:36.171634 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-80a735d6-22a8-4ec9-a540-41a8c4060c43 req-0cf87754-4cca-425a-bf7d-493c0657764a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038070 Oct 18 17:24:36.172745 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4026/8011] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:36.865382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:36.865997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:36.872865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:36.873379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:36.873818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:36.874508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:36.874960 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:36.875385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:37.006325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:37.014973 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-912f77db-7e48-4d6f-9e40-1eb9cfce7bfe tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.153577 Oct 18 17:24:37.015815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3986/8012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:36 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:38.040081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:38.040986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:38.048100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:38.048602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:38.049083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:38.049801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:38.050270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:38.050714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:38.182253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:38.189978 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0d2f8882-e49a-4812-9f08-e6aa18c7b27f tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.154633 Oct 18 17:24:38.190551 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4027/8013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:38 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:39.214264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:39.214838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:39.222121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:39.222610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:39.223050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:39.223746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:39.224203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:39.224631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:39.356750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:39.364502 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d66b0daa-2900-4849-9f4a-10a506b1496b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.155126 Oct 18 17:24:39.365095 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3987/8014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:39 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:40.387642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:40.388173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:40.395564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:40.396075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:40.396506 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:40.397243 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:40.397710 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:40.398149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:40.544380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:40.552615 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-064d176c-db8f-4bf2-b8ef-b9ede05e34fc tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.169277 Oct 18 17:24:40.553411 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4028/8015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:40 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:41.576038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:41.576657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:41.583498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:41.583989 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:41.584427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:41.585149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:41.585610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:41.586042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:41.717896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:41.725707 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b863646-3ce8-432b-8d17-9af9d0d11066 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.153634 Oct 18 17:24:41.726289 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3988/8016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:41 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:42.106171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "name": "network-vif-plugged", "status": "completed", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:42.115658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:42.116151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:42.116603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:42.127616 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] Creating event network-vif-plugged:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:24:42.132695 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-daddfd9b-c636-41f6-adb8-52d562532a05 req-a0028950-0204-45b2-b506-2852b43456a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088806 Oct 18 17:24:42.133390 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4029/8017] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:42.749521 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:42.750124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:42.757047 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:42.757535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:42.758713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:42.759858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:42.760317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:42.760753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:42.897372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:42.905376 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-838ceb79-5183-48ab-b536-aca21a83418d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1358 microversion: 2.1 time: 0.159787 Oct 18 17:24:42.905961 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3989/8018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:42 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:43.930921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:43.931882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:43.938372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:43.938880 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:43.939338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:43.940053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:43.940524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:43.941297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.072677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:44.080567 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6410829b-15ea-4e79-bae2-7781bb31d175 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1548 microversion: 2.1 time: 0.156192 Oct 18 17:24:44.081182 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4030/8019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:43 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:44.103739 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:44.104347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:44.111081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.111554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.111986 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.112667 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.113144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.113569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.243608 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:44.251450 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-510eec5c-fc44-4c7c-a1b0-c40c0b199e95 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1548 microversion: 2.1 time: 0.152157 Oct 18 17:24:44.252029 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3990/8020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:44 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:44.274106 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:44.278877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:44.279690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Searching by: {'deleted': False, 'project_id': '1648cc7f75e4409480ce034f375a823c'} {{(pid=120571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 17:24:44.284974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.285495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.285945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.286677 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.287150 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.287590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.311427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.multi_cell_list [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 17:24:44.338982 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-957073a6-ef9c-4c9d-a9ed-d4154bae0dc5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068816 Oct 18 17:24:44.339576 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4031/8021] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 17:24:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:24:44.352479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:44.353255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:44.359308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.359795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.360240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.360931 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:44.361418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:44.361848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:44.492786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:44.500571 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-68d180c7-ace0-4c79-8133-7b27ddc5406a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1548 microversion: 2.1 time: 0.152657 Oct 18 17:24:44.501187 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3991/8022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:44 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:46.014698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3df0c51c-c922-4de3-ab84-4524cffa3805"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:46.017364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:46.024643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:46.025168 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:46.025621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:46.026321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:46.026813 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:46.027251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:46.295846 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7a291b18-c540-48ca-9e86-0f3a65253246 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285051 Oct 18 17:24:46.296499 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4032/8023] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 18 17:24:46 2022] POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:24:57.074201 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:24:57.074878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:24:57.077819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=17 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:57.078635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=68 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:57.084593 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:57.085107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:57.085553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:57.086373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:57.086752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:57.087184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:57.222680 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:24:57.231513 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6d05d092-667d-4aea-8440-ad3f6b705564 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1594 microversion: 2.1 time: 0.161889 Oct 18 17:24:57.232086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3992/8024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:24:57 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:24:59.175675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:24:59.188313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:59.190142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=17 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:59.191763 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:59.205941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:24:59.206894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:24:59.207781 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:24:59.230521 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] Creating event network-changed:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:24:59.239627 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-dc84a1bb-2a83-40dc-aaac-55f4799efbd5 req-bddc5aef-8cfc-4e60-ac59-58c583866cc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072363 Oct 18 17:24:59.241415 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4033/8025] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:25:00.466134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1874454493"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:25:00.467887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:00.475339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:00.475339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:00.475747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:00.477325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:00.477786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:00.478220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:00.608453 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Adding security group 07e94ab7-87b2-4c95-859d-6889ec9383b4 to port ef875e14-7257-4885-8cc3-11ff77c81d02 Oct 18 17:25:00.939048 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a723c2ef-475f-4d6f-a65d-09096ca68902 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action" status: 202 len: 0 microversion: 2.1 time: 0.476814 Oct 18 17:25:00.939706 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3993/8026] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:25:00 2022] POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:25:00.951102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:00.951986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:00.959764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:00.960167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:00.960904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:00.961931 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:00.962562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:00.963178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:00.978397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:25:00.999542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:01.000297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:01.001019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:01.015440 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] Creating event network-changed:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:25:01.021740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c9b4c2a6-ace3-4844-b180-2532a05b129e req-ce4d3ffa-2f47-479c-b0c7-75afc24c7827 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051661 Oct 18 17:25:01.022287 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3994/8027] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:25:01.159999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:01.168964 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1f2f3d67-3361-40a1-9f06-72a5d5e94597 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1758 microversion: 2.1 time: 0.224572 Oct 18 17:25:01.177965 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4034/8028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:00 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:49.311083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:25:49.313368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:49.316074 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:25:49.316715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:25:49.323882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:49.324369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:49.324808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:49.325530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:49.325985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:49.326439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:49.399569 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-320987d0-e09a-4d30-baf7-d2ee3e88af4a tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action" status: 202 len: 0 microversion: 2.1 time: 0.093045 Oct 18 17:25:49.400216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3995/8029] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:25:49 2022] POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:25:49.408610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:49.409262 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:49.411729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:25:49.412895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=8 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:25:49.414151 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:25:49.414341 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 (ip 10.222.0.78) !!! Oct 18 17:25:49.422223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:49.422740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:49.423240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:49.424061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:49.424532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:49.424971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:49.655568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:49.664083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-44b562b4-1c14-4fa2-84aa-ae888bb66055 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1750 microversion: 2.1 time: 0.259553 Oct 18 17:25:49.664670 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4035/8030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:49 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1750 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:25:50.688327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:50.689758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:50.697616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:50.698098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:50.698533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:50.699220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:50.699674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:50.700095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:51.169365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:51.178153 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5a08c86b-3e7f-4c03-b3cc-4748729e97b2 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.494128 Oct 18 17:25:51.178720 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3996/8031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:50 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:52.202844 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:52.203476 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:52.211701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:52.212200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:52.212653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:52.213400 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:52.213874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:52.214315 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:52.360204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:52.368593 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2f31acec-2a42-4dab-986c-5b1d5a7aeb65 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.169713 Oct 18 17:25:52.369229 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4036/8032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:52 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:53.392973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:53.393615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:53.400717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:53.401239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:53.401682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:53.402374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:53.402828 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:53.403256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:53.549735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:53.558034 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-47cfd2d2-2235-48b9-a972-87af6565294c tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.169251 Oct 18 17:25:53.558532 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3997/8033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:53 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:54.581805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:54.582435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:54.589338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:54.589838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:54.590293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:54.591005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:54.591479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:54.591938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:54.733525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:54.741967 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3574f7bb-8f4a-4a08-bd6f-915194966f46 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.164737 Oct 18 17:25:54.742547 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4037/8034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:54 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:55.765626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:55.766154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:55.773468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:55.773950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:55.774386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:55.775080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:55.775535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:55.775962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:55.922072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:55.931495 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fa62793e-2a77-41f9-9d30-42e5b915c97d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.169562 Oct 18 17:25:55.932160 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3998/8035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:55 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:56.956463 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:56.957129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:56.964047 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:56.964583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:56.965054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:56.965774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:56.966247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:56.966691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:57.115671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:57.124003 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a543d6ac-6790-4f13-a50d-0a3567d44b78 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.172519 Oct 18 17:25:57.124582 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4038/8036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:56 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:58.149441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:58.150062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:58.156899 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:58.157418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:58.157860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:58.159178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:58.159756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:58.160183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:58.304072 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:58.312325 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c47c546-05aa-4d53-a4f5-51bee381ade5 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.166793 Oct 18 17:25:58.312893 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 3999/8037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:58 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:25:59.336642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:25:59.337254 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:25:59.343823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:59.344314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:59.344761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:59.345489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:25:59.346612 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:25:59.347062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:25:59.493661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:25:59.502310 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2fc881d1-3388-4e3d-8294-75bf026249a6 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.169467 Oct 18 17:25:59.502892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4039/8038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:25:59 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:26:00.526237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:26:00.526837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:26:00.533490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:00.533988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:00.534435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:00.535137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:00.535601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:00.536038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:00.682555 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:26:00.691430 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0324c265-c137-4e9a-ab16-489cb022bf8d tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1755 microversion: 2.1 time: 0.169136 Oct 18 17:26:00.692002 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4000/8039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:26:00 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:26:01.717267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:26:01.717929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:26:01.726971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:01.727487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:01.727940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:01.728660 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:01.729167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:01.729610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:01.874559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:26:01.883579 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50571c4d-ec1e-4639-bae5-9deb0cd1301e tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1758 microversion: 2.1 time: 0.170386 Oct 18 17:26:01.884155 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4040/8040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:26:01 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:26:57.374755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1874454493"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:26:57.375368 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:26:57.377750 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:26:57.378569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:26:57.384552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:57.385061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:57.385504 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:57.386197 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:57.386658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:57.387087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:57.517356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.network.security_group_api [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Removing security group 07e94ab7-87b2-4c95-859d-6889ec9383b4 from port ef875e14-7257-4885-8cc3-11ff77c81d02 Oct 18 17:26:57.826135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b773cd35-4a69-494c-857e-1df214260e40 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action" status: 202 len: 0 microversion: 2.1 time: 0.455378 Oct 18 17:26:57.826774 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4001/8041] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:26:57 2022] POST /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:26:57.838332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:26:57.844941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:26:57.845999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:26:57.850566 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:57.851872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:57.852510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:57.866710 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] Creating event network-changed:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:26:57.872266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-b34b8ea0-46fc-481e-b622-035c33cb8921 req-552f1fbd-7faf-486b-89d6-e214548e0c24 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039819 Oct 18 17:26:57.873347 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4041/8042] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:26:58.998575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:26:58.999148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:26:59.005924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:59.006435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:59.006904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:59.007630 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:59.009038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:59.009038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:59.093485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lazy-loading 'services' on Instance uuid 5c733731-663a-4e2b-b126-c22659cf3ce3 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:26:59.168572 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-613e4f0e-baa2-460a-b0f5-8a0d57ab5075 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments/3df0c51c-c922-4de3-ab84-4524cffa3805" status: 202 len: 0 microversion: 2.1 time: 0.174971 Oct 18 17:26:59.169214 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4002/8043] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:26:58 2022] DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments/3df0c51c-c922-4de3-ab84-4524cffa3805 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:26:59.178479 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:26:59.181607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:26:59.189418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:59.190158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:59.190856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:59.191636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:59.192116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:59.193455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:59.225311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-86bebf13-bd17-4b6d-85d6-f3982dc79937 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051224 Oct 18 17:26:59.226008 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4042/8044] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:26:59 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:26:59.891817 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:26:59.905725 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:26:59.906208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:26:59.906644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:26:59.920142 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] Creating event network-changed:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:26:59.925704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-481aff08-45fd-4260-b5bf-8cde075ef94a req-e991f78d-0ec7-4d0e-9ef2-7b7d2f24cce5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038217 Oct 18 17:26:59.927206 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4003/8045] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:00.239000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:00.243321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:00.251932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:00.252434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:00.252884 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:00.253747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:00.254214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:00.254653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:00.287931 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f6bfff10-77f1-4016-bcc5-55c93df3995b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053469 Oct 18 17:27:00.289214 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4043/8046] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:27:00 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:01.302589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:01.304815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:01.311344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:01.311840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:01.312289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:01.313031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:01.313497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:01.313932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:01.351221 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-28b15c16-e884-4f75-bea3-db138ee337ab tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054097 Oct 18 17:27:01.351819 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4004/8047] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:27:01 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:02.363631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:02.365962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:02.372864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:02.373384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:02.373829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:02.374532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:02.375000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:02.375440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:02.406801 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-868106c3-a8c0-4985-aece-65d7e63c3569 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Oct 18 17:27:02.407364 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4044/8048] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:27:02 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:03.419370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:03.421747 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:03.429075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:03.429575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:03.430019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:03.430713 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:03.431185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:03.431616 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:03.462153 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca069869-9286-4f75-a98e-5a0de88be097 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Oct 18 17:27:03.463008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4005/8049] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:27:03 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:04.475314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:04.477667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:04.484336 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:04.484821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:04.485304 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:04.486021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:04.486492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:04.486936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:04.518359 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f7f83cd-40db-4ace-b2c9-f2b7dfcbdf93 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047247 Oct 18 17:27:04.518943 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4045/8050] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 17:27:04 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 17:27:04.530348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:04.530865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:04.538258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:04.538742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:04.539186 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:04.539874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:04.540337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:04.540766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:04.620045 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] HTTP exception thrown: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 is not attached to volume 3df0c51c-c922-4de3-ab84-4524cffa3805 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Request method failure captured: Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: request: DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments/3df0c51c-c922-4de3-ab84-4524cffa3805 HTTP/1.1 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTuASbsbIcJYxHUyW9w1Ve-iKblStsHAbLWQcWIEv5zMSYq7S6xVsLjNkAA6LfAySlt_xTvdpseVLkc5PpB1yd714igysrpqddaZXL-YFT_LGeJmVzA_j_RxH-BPm9W_C8gZlO2nkzX2NYMk8mOgmV18EtoVJlytmk4lIcNmhZVnVPMU Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1648cc7f75e4409480ce034f375a823c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}] Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 42f5b134175446689dc14bbc58323017 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 is not attached to volume 3df0c51c-c922-4de3-ab84-4524cffa3805 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'server_id': '5c733731-663a-4e2b-b126-c22659cf3ce3', 'id': '3df0c51c-c922-4de3-ab84-4524cffa3805'} Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3df0c51c-c922-4de3-ab84-4524cffa3805. Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 is not attached to volume 3df0c51c-c922-4de3-ab84-4524cffa3805 Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:27:04.621730 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 is not attached to volume 3df0c51c-c922-4de3-ab84-4524cffa3805 Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Returning 404 to user: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 is not attached to volume 3df0c51c-c922-4de3-ab84-4524cffa3805 {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ecc43225-74b2-4206-b097-daa890d1c1bd tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments/3df0c51c-c922-4de3-ab84-4524cffa3805" status: 404 len: 154 microversion: 2.1 time: 0.096969 Oct 18 17:27:04.626415 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4006/8051] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 18 17:27:04 2022] DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3/os-volume_attachments/3df0c51c-c922-4de3-ab84-4524cffa3805 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:27:07.903661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:07.904370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:07.912741 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:07.913354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:07.913872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:07.914624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:07.915231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:07.915686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:07.947199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:27:08.034063 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a91594b-65a0-4009-94bb-8720f0b69fc3 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 204 len: 0 microversion: 2.1 time: 0.136003 Oct 18 17:27:08.038085 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4046/8052] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:27:07 2022] DELETE /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:27:08.043424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:08.044049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:08.053138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:08.053678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:08.054138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:08.054871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:08.055329 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:08.055757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:08.200901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:08.209855 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-97163fa9-e007-4042-b334-83bdbc524189 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1554 microversion: 2.1 time: 0.170407 Oct 18 17:27:08.210451 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4007/8053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:08 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:09.234576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:09.235299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:09.243944 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:09.244445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:09.244902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:09.245650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:09.246124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:09.246567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:09.385057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:09.393360 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-372996cb-6223-425b-a026-e32aecb5b5eb tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1554 microversion: 2.1 time: 0.162872 Oct 18 17:27:09.393951 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4047/8054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:09 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:10.416922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c733731-663a-4e2b-b126-c22659cf3ce3", "name": "network-vif-deleted", "tag": "ef875e14-7257-4885-8cc3-11ff77c81d02"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:10.417517 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:10.417952 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:10.425094 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:10.425994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:10.426654 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:10.427680 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:10.428163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:10.428823 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:10.438830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:10.439638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:10.440411 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:10.457121 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] Creating event network-vif-deleted:ef875e14-7257-4885-8cc3-11ff77c81d02 for instance 5c733731-663a-4e2b-b126-c22659cf3ce3 on n-h1-858383-14 Oct 18 17:27:10.462845 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2518517a-963c-4ba7-9e20-2b906c20a95a req-74fe22a1-46c8-45d3-b03d-78b0f9132ff0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050649 Oct 18 17:27:10.477234 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4008/8055] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:10.503868 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f5b134175446689dc14bbc58323017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1648cc7f75e4409480ce034f375a823c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:10.514620 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ec98836-3f67-492b-99f8-ac06f1e51660 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 200 len: 1512 microversion: 2.1 time: 0.101523 Oct 18 17:27:10.515285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4048/8056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:10 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 1512 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:27:11.541191 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:11.541901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [instance: 5c733731-663a-4e2b-b126-c22659cf3ce3] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:11.548240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:11.548730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:11.549234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:11.549932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:11.550393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:11.550824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:11.564852 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] HTTP exception thrown: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Request method failure captured: Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 HTTP/1.1 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTuASbsbIcJYxHUyW9w1Ve-iKblStsHAbLWQcWIEv5zMSYq7S6xVsLjNkAA6LfAySlt_xTvdpseVLkc5PpB1yd714igysrpqddaZXL-YFT_LGeJmVzA_j_RxH-BPm9W_C8gZlO2nkzX2NYMk8mOgmV18EtoVJlytmk4lIcNmhZVnVPMU Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1648cc7f75e4409480ce034f375a823c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1648cc7f75e4409480ce034f375a823c"}]}] Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: 1648cc7f75e4409480ce034f375a823c Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1268533517 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 42f5b134175446689dc14bbc58323017 Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestMinimumBasicScenario-1268533517-project Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '5c733731-663a-4e2b-b126-c22659cf3ce3'} Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:27:11.566570 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Returning 404 to user: Instance 5c733731-663a-4e2b-b126-c22659cf3ce3 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c65b2b66-ac18-4f62-8bba-8bcc97aca1a4 tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3" status: 404 len: 111 microversion: 2.1 time: 0.032507 Oct 18 17:27:11.571448 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4009/8057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:11 2022] GET /compute/v2.1/servers/5c733731-663a-4e2b-b126-c22659cf3ce3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:27:11.576986 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-81df7e04-221f-40bc-8c4b-1f8b2ad46f0b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] Calling method '.version_select at 0x7f5fd6494af0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:11.581511 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81df7e04-221f-40bc-8c4b-1f8b2ad46f0b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:27:12.589874 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [None req-81df7e04-221f-40bc-8c4b-1f8b2ad46f0b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55864. Oct 18 17:27:12.608737 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-81df7e04-221f-40bc-8c4b-1f8b2ad46f0b tempest-TestMinimumBasicScenario-1268533517 tempest-TestMinimumBasicScenario-1268533517-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1011308765" status: 202 len: 0 microversion: 2.1 time: 1.035519 Oct 18 17:27:12.609382 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4049/8058] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 18 17:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1011308765 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:27:21.747071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=18 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:21.747796 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:21.915389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: .version_select at 0x7f5fd6413ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1107193362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU6e/YmZqvhxK+mVHODnNckEiqHFRnoYl5DYbVzKfWQ7Kh0GJJN0YQUknVFXzYlFhy/aU+RvzgFCXkeZwzMEwpK6uV7W1srRC7YKGaKmJT+lRfT8HdVZ8D7LmfdMCofAQ=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:21.932237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:27:21.937528 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:27:21.951044 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:27:22.959176 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 55990. Oct 18 17:27:22.975935 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4cba628-bd34-4860-a58f-97c2ad73fcae tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.234334 Oct 18 17:27:22.976721 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4010/8059] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:27:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:27:28.799846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:28.801393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:28.814322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-810769412", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b9d15394-1210-4cee-8a5e-b1e68d3bf5e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1107193362", "security_groups": [{"name": "tempest-secgroup-smoke-1263643214"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:28.945216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] validate_networks() for [('b9d15394-1210-4cee-8a5e-b1e68d3bf5e3', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:27:29.461665 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:27:29.462121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:27:29.462619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:27:29.463079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:27:29.463547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:27:29.472650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:29.473177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:29.473642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:29.474477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:29.475369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:29.475888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:29.494661 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:27:29.500282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:27:29.514419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:27:29.516817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:27:29.567674 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-776fc5ce-c8b5-4b38-a1f1-80da244de669 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769347 Oct 18 17:27:29.568815 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4050/8060] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:27:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:27:29.580204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9a4371c-b3d0-4976-a2b0-66291776385c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:29.580831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9a4371c-b3d0-4976-a2b0-66291776385c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:29.588124 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:27:29.588321 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 (ip 10.222.0.78) !!! Oct 18 17:27:29.652898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9a4371c-b3d0-4976-a2b0-66291776385c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:29.662459 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9a4371c-b3d0-4976-a2b0-66291776385c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1266 microversion: 2.1 time: 0.085939 Oct 18 17:27:29.663651 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4011/8061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:29 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:30.687920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:30.688656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:30.698284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:30.698805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:30.699306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:30.700059 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:30.700541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:30.701020 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:30.772326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:30.780377 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ccfec505-0770-4c47-b5ee-6bb1ff6b278f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1318 microversion: 2.1 time: 0.098198 Oct 18 17:27:30.781319 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4051/8062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:30 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:31.805810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:31.806480 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:31.813873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:31.814369 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:31.814852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:31.815558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:31.816024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:31.816457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:31.992075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:32.000592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-824ac581-e859-4ea0-a58a-d140e9cda8e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.199030 Oct 18 17:27:32.005216 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4012/8063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:31 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:32.395806 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65ff131-aa83-4641-bb03-90450c6b7b48", "tag": "b46698b0-524a-4fe2-b586-78eb523dc3be"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:32.407167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:32.407676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:32.408131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:32.432986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] Creating event network-changed:b46698b0-524a-4fe2-b586-78eb523dc3be for instance c65ff131-aa83-4641-bb03-90450c6b7b48 on n-h1-858383-14 Oct 18 17:27:32.439550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-155ed6db-32bd-4dc2-967d-21838de78feb req-a0a0d4d5-dbce-4653-9469-d6062f2f10ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055714 Oct 18 17:27:32.440414 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4052/8064] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:33.024892 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:33.025540 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:33.032403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:33.032886 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:33.033355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:33.034042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:33.034498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:33.034924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:33.177400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:33.185501 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eb481f19-4930-476f-aea7-ec273a796787 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.165218 Oct 18 17:27:33.186033 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4013/8065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:33 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:34.210797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:34.211432 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:34.217729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:34.218226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:34.218679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:34.219385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:34.219853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:34.220318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:34.361726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:34.369798 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-506fd51e-b03d-4973-a680-42a96a4065e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.164803 Oct 18 17:27:34.370384 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4053/8066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:34 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:35.392649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:35.393305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:35.401393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:35.401887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:35.402332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:35.403036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:35.403501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:35.404065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:35.544688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:35.553112 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d464aff6-6a44-4766-ba8d-7703fd05909b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.163755 Oct 18 17:27:35.553856 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4014/8067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:35 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:36.576394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:36.577637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:36.584760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:36.585321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:36.585803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:36.586541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:36.587042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:36.587485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:36.719364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:36.727715 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40680fdc-d43c-42e8-98d0-ae44522f5b3d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.155390 Oct 18 17:27:36.728285 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4054/8068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:36 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:37.751040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:37.751632 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:37.759034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:37.759523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:37.759965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:37.760663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:37.761164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:37.761599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:37.896681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:37.904321 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8f3246c-eab8-4a72-b2d8-37c9c4cb73c3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.157304 Oct 18 17:27:37.904888 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4015/8069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:37 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:38.928024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:38.929393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:38.936500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:38.937298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:38.937524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:38.940398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:38.940887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:38.941369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:39.015766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65ff131-aa83-4641-bb03-90450c6b7b48", "name": "network-vif-plugged", "status": "completed", "tag": "b46698b0-524a-4fe2-b586-78eb523dc3be"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:39.029847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:39.030344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:39.030785 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:39.043654 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] Creating event network-vif-plugged:b46698b0-524a-4fe2-b586-78eb523dc3be for instance c65ff131-aa83-4641-bb03-90450c6b7b48 on n-h1-858383-14 Oct 18 17:27:39.048827 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-e26c25bd-2d83-4c32-b62c-92e498a55ba0 req-c4fa3d3e-90c3-406c-9fe8-ddf4d26cbbd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036763 Oct 18 17:27:39.049679 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4016/8070] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:27:39.095745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:39.106904 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-39458ebe-7ef4-4f4b-9f81-9b17fafc0d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.182702 Oct 18 17:27:39.107796 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4055/8071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:38 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:40.127823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:40.133806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:40.134512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:40.140918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:40.141437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:40.141872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:40.142558 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:40.143038 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:40.143467 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:40.277709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:40.285552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-859115d4-d82e-4da6-abfe-ad5703a956dc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1392 microversion: 2.1 time: 0.158682 Oct 18 17:27:40.286148 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4017/8072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:40 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:41.308827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:41.309492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:41.311501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:41.312178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:41.319259 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:41.319761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:41.320214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:41.320919 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:41.321412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:41.321849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:41.457423 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:41.465300 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-534d0368-200c-4d2c-bb80-2963b596662c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1564 microversion: 2.1 time: 0.160299 Oct 18 17:27:41.465871 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4056/8073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:41 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:41.487955 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:41.488566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:41.496189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:41.496670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:41.497192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:41.498435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:41.498826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:41.499252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:41.636700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:41.644645 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fe873baf-3739-4980-ab41-cdd3ac0e9cc4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1564 microversion: 2.1 time: 0.160614 Oct 18 17:27:41.645252 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4018/8074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:41 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:27:43.230286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65ff131-aa83-4641-bb03-90450c6b7b48", "tag": "b46698b0-524a-4fe2-b586-78eb523dc3be"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:27:43.233580 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:27:43.234220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:27:43.240797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:43.241395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:43.241780 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:43.241916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:43.242293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:43.242748 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:43.243469 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:27:43.243945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:27:43.244393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:27:43.253838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] Creating event network-changed:b46698b0-524a-4fe2-b586-78eb523dc3be for instance c65ff131-aa83-4641-bb03-90450c6b7b48 on n-h1-858383-14 Oct 18 17:27:43.259261 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fe3286eb-b28c-4459-bef6-587730bb5471 req-bd64c103-9a5c-4323-8df4-d4f414267a1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032610 Oct 18 17:27:43.259864 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4019/8075] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:27:43.817561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:27:43.826996 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-62ab6bca-302f-415f-b958-188b120e8de4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1564 microversion: 2.1 time: 0.603992 Oct 18 17:27:43.827982 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4057/8076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:27:43 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1564 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:15.115869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:15.116613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=40 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:15.121163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:15.123408 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:15.131496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:15.131983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:15.132420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:15.133146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:15.133604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:15.134029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:15.207932 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d7d6e86f-ee7e-4920-84fb-8d4cf87cf4ad tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action" status: 200 len: 24564 microversion: 2.1 time: 0.094568 Oct 18 17:28:15.208528 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4020/8077] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:28:15 2022] POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action => generated 24564 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:28:45.633028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:45.633663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:45.635586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:45.636250 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:45.642078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:45.642576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:45.643024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:45.643724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:45.644189 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:45.644888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:45.712207 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-71fb3ce1-9368-4357-8ce7-97d036ee927f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action" status: 202 len: 0 microversion: 2.1 time: 0.084583 Oct 18 17:28:45.712849 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4058/8078] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:28:45 2022] POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:28:45.721702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:45.722418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:45.725474 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:45.726232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:45.733633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:45.734126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:45.734565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:45.735266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:45.735723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:45.736148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:46.195621 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:46.203440 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-20537f20-23b1-43e3-ab1c-a4a9b10224f0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1687 microversion: 2.1 time: 0.486124 Oct 18 17:28:46.204010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4021/8079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:45 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1687 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:47.230978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:47.231602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:47.238042 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:47.238532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:47.238981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:47.239688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:47.240264 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:47.240696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:47.378444 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:47.386884 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7821b298-53ee-4135-b0ec-eeedcd7374e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1667 microversion: 2.1 time: 0.161646 Oct 18 17:28:47.387453 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4059/8080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:47 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:48.485877 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:48.488095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:48.496078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.496568 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.497027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.497729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.498192 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.498622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.565147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e447ea7d-264d-45c2-a99f-68f1e08a226b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action" status: 200 len: 32641 microversion: 2.1 time: 0.083029 Oct 18 17:28:48.566078 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4022/8081] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:28:48 2022] POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action => generated 32641 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:28:48.577507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:48.578055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:48.585848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.586342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.586832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.587525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.587997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.588435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.654619 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-13ac2c03-9866-44a3-ab81-5cb711241175 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action" status: 202 len: 0 microversion: 2.1 time: 0.080937 Oct 18 17:28:48.655253 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4060/8082] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:28:48 2022] POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:28:48.664096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:48.664797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:48.672138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.672633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.673115 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.673801 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:48.674253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:48.674693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:48.809889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:48.817686 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ce98bad6-49e0-4c24-b935-5338e3867fbe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1674 microversion: 2.1 time: 0.158020 Oct 18 17:28:48.818877 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4023/8083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:48 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:49.844211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:49.844950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:49.851263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:49.851753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:49.852199 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:49.852894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:49.853386 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:49.853826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:49.986456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:49.995266 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f716d752-a2e3-47b6-8a59-3ac892b30a09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1682 microversion: 2.1 time: 0.156250 Oct 18 17:28:49.995840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4061/8084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:49 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:50.091146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:50.093435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:50.101084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:50.101525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:50.101956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:50.102640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:50.103092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:50.103514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:50.168633 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e910974c-619a-4679-a756-8b3d4a319182 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action" status: 200 len: 36648 microversion: 2.1 time: 0.081237 Oct 18 17:28:50.169318 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4024/8085] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:28:50 2022] POST /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48/action => generated 36648 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:28:51.221563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:51.222076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:51.229216 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65ff131-aa83-4641-bb03-90450c6b7b48", "tag": "b46698b0-524a-4fe2-b586-78eb523dc3be"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:51.237085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:51.237599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:51.238308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:51.238779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:51.239252 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:51.240470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:51.243409 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:51.243895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:51.244324 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:51.256838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] Creating event network-changed:b46698b0-524a-4fe2-b586-78eb523dc3be for instance c65ff131-aa83-4641-bb03-90450c6b7b48 on n-h1-858383-14 Oct 18 17:28:51.261868 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9acffb5f-c0da-40af-ba48-ed4e9e6f5998 req-99d2339c-077f-49b8-bd25-393804ad2686 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036618 Oct 18 17:28:51.262471 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4025/8086] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:28:51.271978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:28:51.357983 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7303b924-7135-4549-a56e-8d36b1e2ac81 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 204 len: 0 microversion: 2.1 time: 0.139727 Oct 18 17:28:51.359003 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4062/8087] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:28:51 2022] DELETE /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:28:51.369563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:51.370519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:51.377432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:51.377915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:51.378388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:51.379314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:51.379795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:51.380285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:51.530333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:51.538582 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4e67d613-1750-439d-8b45-b2c0553a018f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1688 microversion: 2.1 time: 0.174374 Oct 18 17:28:51.539174 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4026/8088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:51 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:52.562715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:52.563381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:52.571194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:52.571754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:52.572251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:52.573029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:52.573558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:52.574043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:52.763592 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:52.771804 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-40fb7e34-7fc1-4f34-bb88-55ab576da1da tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1688 microversion: 2.1 time: 0.213503 Oct 18 17:28:52.772393 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4063/8089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:52 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:53.651671 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65ff131-aa83-4641-bb03-90450c6b7b48", "name": "network-vif-deleted", "tag": "b46698b0-524a-4fe2-b586-78eb523dc3be"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:53.667257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:53.667738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:53.668165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:53.679934 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] Creating event network-vif-deleted:b46698b0-524a-4fe2-b586-78eb523dc3be for instance c65ff131-aa83-4641-bb03-90450c6b7b48 on n-h1-858383-14 Oct 18 17:28:53.685689 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-81a365d6-d4a0-4544-9809-1b22bc1d9466 req-013db1e2-825b-4b60-8120-135f6684ff9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037870 Oct 18 17:28:53.686330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4027/8090] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:28:53.796286 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:53.796923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:53.804446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:53.804954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:53.805440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:53.806161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:53.806640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:53.807086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:53.843784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:53.844216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:53.844659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:53.845156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lazy-loading 'fault' on Instance uuid c65ff131-aa83-4641-bb03-90450c6b7b48 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:28:53.889540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:28:53.898922 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-68980009-910c-490b-b4bd-845dbc8e08ba tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 200 len: 1356 microversion: 2.1 time: 0.106934 Oct 18 17:28:53.899834 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4064/8091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:53 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:28:54.923953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:54.924664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: c65ff131-aa83-4641-bb03-90450c6b7b48] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:28:54.932096 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:54.932589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:54.933062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:54.933772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:28:54.934235 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:28:54.934672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:28:54.948592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] HTTP exception thrown: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Request method failure captured: Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 HTTP/1.1 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTuH5ClNRJpDMCjbfWnc2xQEKS9AWdhWi18cd8jQKMe3HEPf3PnN8hfM8XUUE_zTzKrKl8FIXITkRz91joaCCMsvYcZQ4JpBhtw78wNj1UjSAr0m_SZBfdkmd2FO11wHDXb2oAQghZr702o0Sgc0Xus9UL5cQznYnd13KHPQ6ztSSFLc Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}] Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 80e37568aa09403aaf54055f4defba46 Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': 'c65ff131-aa83-4641-bb03-90450c6b7b48'} Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:28:54.950270 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Returning 404 to user: Instance c65ff131-aa83-4641-bb03-90450c6b7b48 could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7e9ca913-1aee-434a-917a-1498a727ac68 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48" status: 404 len: 111 microversion: 2.1 time: 0.032915 Oct 18 17:28:54.955967 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4028/8092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:28:54 2022] GET /compute/v2.1/servers/c65ff131-aa83-4641-bb03-90450c6b7b48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:28:58.329357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a1279a6-03ec-44d7-9e5b-44c6d098310f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '.version_select at 0x7f5fd15c0b80>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:28:58.350753 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a1279a6-03ec-44d7-9e5b-44c6d098310f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1107193362" status: 202 len: 0 microversion: 2.1 time: 0.024982 Oct 18 17:28:58.351410 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4065/8093] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 17:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1107193362 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:28:58.377887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c8829070-63ad-483f-a01e-d06f2235f3d2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: .version_select at 0x7f5fd6499a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-838390179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOMABtu1TaPe/LMTXg/ufE5nNCswsdX8WwzH0nqdZEG4O6FCtbzoi3qSIAYz0lPhPS2Cen1umnDsysDdbwfQ6exfcFJeZ2HTsEtWEXOW6hPKBIPGZHfCKXwnd4kdIGmZA=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:28:58.395163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c8829070-63ad-483f-a01e-d06f2235f3d2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:28:58.401386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c8829070-63ad-483f-a01e-d06f2235f3d2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:28:58.425049 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c8829070-63ad-483f-a01e-d06f2235f3d2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050947 Oct 18 17:28:58.425582 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4029/8094] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:28:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:29:03.759240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-11843282", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "31170ea6-be20-42e1-ac17-552e0c15c2e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-838390179", "security_groups": [{"name": "tempest-secgroup-smoke-1169105902"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:29:03.884571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] validate_networks() for [('31170ea6-be20-42e1-ac17-552e0c15c2e5', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:29:03.894085 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:04.372201 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:29:04.372642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:29:04.373186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:29:04.373611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:29:04.374046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:29:04.383936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:04.384446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:04.384902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:04.385688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:04.386359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:04.386811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:04.405928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:29:04.411695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:29:04.424388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:29:04.426809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:29:04.479788 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-522159f4-f251-47da-baf4-6cde434f2cfa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725420 Oct 18 17:29:04.486505 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4066/8095] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:29:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:29:04.493942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bbfd43b7-adea-4b2d-8cde-3b13a13923e4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:04.494674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bbfd43b7-adea-4b2d-8cde-3b13a13923e4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:04.571841 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bbfd43b7-adea-4b2d-8cde-3b13a13923e4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:04.579451 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bbfd43b7-adea-4b2d-8cde-3b13a13923e4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1264 microversion: 2.1 time: 0.091636 Oct 18 17:29:04.580137 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4030/8096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:04 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:29:05.605699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:05.606985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:05.615599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:05.616368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:05.617065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:05.618872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:05.619588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:05.620218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:05.705659 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:05.720305 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d84a5334-db22-415f-81fa-d0ffb0127a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1324 microversion: 2.1 time: 0.119267 Oct 18 17:29:05.729578 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4067/8097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:05 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1324 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:06.744922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:06.745705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:06.747736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=32 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:06.756688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:06.757230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:06.757887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:06.758617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:06.759082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:06.759524 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:07.010089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:07.018208 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c49655e8-a99a-4f0b-81f5-c9b769f764fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.277386 Oct 18 17:29:07.018842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4031/8098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:06 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:07.611550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b", "tag": "365a3c15-654a-45d7-8c61-747c57ed3ee5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:29:07.623576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:07.624081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:07.624533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:07.637104 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] Creating event network-changed:365a3c15-654a-45d7-8c61-747c57ed3ee5 for instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b on n-h1-858383-14 Oct 18 17:29:07.642058 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-8e56d797-09f3-4a5f-b2c8-b7c0a56718af req-c6a2f0e6-91df-4309-ac52-8a9fc1e378fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098129 Oct 18 17:29:07.642667 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4068/8099] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:29:08.043824 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:08.044663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:08.053385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:08.053889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:08.054603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:08.055323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:08.055798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:08.056292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:08.195574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:08.204163 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93b441a9-b7bb-4a10-889a-e3530f3123bb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.165233 Oct 18 17:29:08.204760 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4032/8100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:08 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:09.229284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:09.229916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:09.236079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:09.236582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:09.237049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:09.237754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:09.238358 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:09.238899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:09.370554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:09.378271 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c1c8ac15-1e6d-44be-bf69-78c262701573 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.154972 Oct 18 17:29:09.378844 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4069/8101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:09 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:10.402576 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:10.403125 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:10.410848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:10.411885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:10.412333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:10.413068 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:10.413535 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:10.413972 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:10.637357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:10.646211 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-49309269-2f44-4e5e-9309-550bdef71fdb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.246727 Oct 18 17:29:10.646812 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4033/8102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:10 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:11.668838 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:11.669554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:11.676873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:11.677492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:11.677935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:11.678639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:11.679105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:11.679542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:11.815756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:11.823845 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b50c4228-624d-40a9-bb3f-30459afbc945 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.159055 Oct 18 17:29:11.824433 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4070/8103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:11 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:12.847445 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:12.848084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:12.855652 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:12.856143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:12.856583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:12.857303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:12.857766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:12.858196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:12.991951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:12.999847 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ccea7ead-5834-4ab7-9b45-eb6b59aa1d13 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.156328 Oct 18 17:29:13.000455 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4034/8104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:12 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:13.389045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b", "name": "network-vif-plugged", "status": "completed", "tag": "365a3c15-654a-45d7-8c61-747c57ed3ee5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:29:13.400918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:13.401455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:13.401913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:13.413802 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] Creating event network-vif-plugged:365a3c15-654a-45d7-8c61-747c57ed3ee5 for instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b on n-h1-858383-14 Oct 18 17:29:13.418876 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-68f0093f-92b8-4a99-b186-8a365f1050d2 req-e013dd7d-82a1-44ec-a3a4-2ac4e4531201 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Oct 18 17:29:13.419486 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4071/8105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:29:14.023121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:14.023885 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:14.030858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:14.031352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:14.031800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:14.032525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:14.033007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:14.033442 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:14.169172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:14.177480 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-87ae4969-bca8-49f3-973e-3c51284617c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1390 microversion: 2.1 time: 0.157979 Oct 18 17:29:14.178041 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4035/8106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:14 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:15.201296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:15.202133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:15.206449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:15.207190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:15.214922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:15.215422 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:15.215877 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:15.216584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:15.217083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:15.217531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:15.350337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:15.358127 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c12f063a-e623-4f27-8012-fa2d7a222411 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1562 microversion: 2.1 time: 0.158770 Oct 18 17:29:15.358701 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4072/8107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:15 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:15.381770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:15.382423 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:15.384306 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:15.390483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:15.390973 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:15.391420 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:15.392121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:15.392585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:15.393036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:15.532852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:15.543193 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-686ef38f-bc49-45d4-9880-ab581477e997 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1562 microversion: 2.1 time: 0.165816 Oct 18 17:29:15.543782 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4036/8108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:15 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:17.145853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:29:17.147172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:17.147344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b", "tag": "365a3c15-654a-45d7-8c61-747c57ed3ee5"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:29:17.150149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:17.155083 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:17.156149 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:17.156832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:17.157419 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:17.159374 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:17.160043 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:17.160344 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:17.160486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:17.160918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:17.162213 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:17.175664 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] Creating event network-changed:365a3c15-654a-45d7-8c61-747c57ed3ee5 for instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b on n-h1-858383-14 Oct 18 17:29:17.182951 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-90efaa71-e061-445d-bb58-536a2a54ed53 req-a95fa4c8-1f67-47d7-a054-1bdede5dc294 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038827 Oct 18 17:29:17.184518 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4037/8109] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:29:17.308869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:29:17.316843 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9d232278-68c6-4a85-9b7b-751599daaafd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1562 microversion: 2.1 time: 0.175716 Oct 18 17:29:17.321069 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4073/8110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:29:17 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:29:48.620774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=38 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:48.621581 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:48.626025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:29:48.628491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:29:48.635488 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:48.635979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:48.636458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:48.637183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:29:48.637649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:29:48.638088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:29:48.708834 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e7205f1a-e8c7-4c56-8313-49000727f342 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action" status: 200 len: 24569 microversion: 2.1 time: 0.089898 Oct 18 17:29:48.709660 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4038/8111] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:29:48 2022] POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action => generated 24569 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:30:19.188908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:19.189609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:19.193686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:30:19.196520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:19.203399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:19.203899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:19.204354 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:19.205089 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:19.205562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:19.206003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:19.283869 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85182049-3565-4f26-8b5f-38ec2508b22f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action" status: 202 len: 0 microversion: 2.1 time: 0.096465 Oct 18 17:30:19.284805 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4074/8112] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:30:19 2022] POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:30:19.294969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:19.295804 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:19.298625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:19.299362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:19.306147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:19.306646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:19.307087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:19.307923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:19.308432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:19.308861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:19.672498 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:19.683536 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40143e32-4b65-402e-abc2-3ce54e2cefb4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1672 microversion: 2.1 time: 0.393269 Oct 18 17:30:19.684131 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4039/8113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:19 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1672 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:20.708778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:20.709638 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:20.718271 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:20.718775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:20.719229 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:20.719939 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:20.720407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:20.720850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:20.947103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:20.955120 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-06c65b92-a36c-4731-bcd6-a84eb8260695 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.250674 Oct 18 17:30:20.955697 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4075/8114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:20 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:21.981149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:21.981789 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:21.989462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:21.989940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:21.990373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:21.991061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:21.991532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:21.991954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:22.135914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:22.143959 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-35132c43-ece6-4750-a40f-e75a0936adef tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.167338 Oct 18 17:30:22.144532 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4040/8115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:21 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:23.168531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:23.169236 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:23.176284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:23.176859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:23.177347 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:23.178054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:23.178522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:23.178964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:23.319783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:23.332463 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-800b981c-0613-4717-8d40-5f2bcd6fdc46 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.168032 Oct 18 17:30:23.333083 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4076/8116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:23 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:24.361246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:24.361905 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:24.368806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:24.369357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:24.370469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:24.371176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:24.371637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:24.372070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:24.507883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:24.516431 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-01476c9c-b61a-4c33-b73b-8ac566f847c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.159165 Oct 18 17:30:24.517058 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4041/8117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:24 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:25.543238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:25.544022 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:25.554334 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:25.555067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:25.555568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:25.556594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:25.557693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:25.558208 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:25.721954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:25.731909 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9b66874a-370e-461a-a885-6d1e0055e0d1 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.192822 Oct 18 17:30:25.732542 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4077/8118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:25 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:26.757483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:26.758119 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:26.769333 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:26.769827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:26.770279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:26.771237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:26.771700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:26.772132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:26.908278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:26.916047 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b2df445-0007-483e-b90b-2f04daf9d2a7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.162524 Oct 18 17:30:26.916837 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4042/8119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:26 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:27.941950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:27.941950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:27.948406 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:27.948913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:27.949398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:27.950113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:27.950590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:27.951061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:28.084351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:28.092911 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ecdd70b0-96fe-4ea0-8e52-38c0e77f1b54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.156538 Oct 18 17:30:28.093510 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4078/8120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:27 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:29.116241 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:29.116861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:29.124081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:29.124570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:29.125033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:29.125732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:29.126188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:29.126613 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:29.264586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:29.273076 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93028699-200c-4e02-95b3-b39d93894866 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.160761 Oct 18 17:30:29.273647 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4043/8121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:29 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:30.296542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:30.297152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:30.303896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:30.304393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:30.304841 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:30.305577 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:30.306046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:30.306485 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:30.441907 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:30.450218 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a44ef018-21a7-4198-9a95-bb92d20d23d8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1677 microversion: 2.1 time: 0.157796 Oct 18 17:30:30.450799 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4079/8122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:30 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:30:31.474034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:30:31.474583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:30:31.481249 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:31.481737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:31.482177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:31.482867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:30:31.483355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:30:31.483782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:30:31.615984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:30:31.624496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-91b09f48-e3b1-4680-9dff-a890bd15138c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1680 microversion: 2.1 time: 0.154569 Oct 18 17:30:31.625098 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4044/8123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:30:31 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:03.845913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:03.848284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:03.850746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:03.851647 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:03.860637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:03.861181 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:03.861644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:03.862751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:03.863340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:03.863899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:03.947707 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2a804516-fa8e-4240-a6c9-d4dd8e6bb8f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action" status: 200 len: 69086 microversion: 2.1 time: 0.106198 Oct 18 17:31:03.948434 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4080/8124] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:31:03 2022] POST /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b/action => generated 69086 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:31:20.988482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:20.989149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:20.991465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:20.992120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:20.992272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b", "tag": "365a3c15-654a-45d7-8c61-747c57ed3ee5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:20.993872 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 17:31:20.994782 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:31:20.995131 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b (ip 10.222.0.78) !!! Oct 18 17:31:21.003533 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:21.004032 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:21.004649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:21.005347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:21.005514 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:21.006800 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:21.007287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:21.007502 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:21.007722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:21.008421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:21.009572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:21.024792 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] Creating event network-changed:365a3c15-654a-45d7-8c61-747c57ed3ee5 for instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b on n-h1-858383-14 Oct 18 17:31:21.030808 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a9a233f5-b51b-417c-8f9f-83065ffafc61 req-6488b5a6-5c89-41f1-9e14-2669674cdf5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043237 Oct 18 17:31:21.031514 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4081/8125] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:31:21.037798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:31:21.119911 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-83850c91-ff1b-4189-a0b3-d43dfc9db1b8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 204 len: 0 microversion: 2.1 time: 0.134712 Oct 18 17:31:21.121809 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4045/8126] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:31:20 2022] DELETE /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:31:21.131543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:21.132867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:21.140359 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:21.141391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:21.142112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:21.143193 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:21.143901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:21.144564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:21.285394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:21.293371 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e61ea65-c87b-4762-842a-99dd61046460 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1686 microversion: 2.1 time: 0.166982 Oct 18 17:31:21.293903 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4082/8127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:21 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:22.318374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:22.318994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:22.326526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:22.327013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:22.327452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:22.328143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:22.328773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:22.329234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:22.573936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:22.581822 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-99521642-e4e9-4420-b683-7d2762c8c94d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1686 microversion: 2.1 time: 0.267820 Oct 18 17:31:22.582394 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4046/8128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:22 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1686 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:23.441153 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b", "name": "network-vif-deleted", "tag": "365a3c15-654a-45d7-8c61-747c57ed3ee5"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:23.451809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:23.452307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:23.452759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:23.464365 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] Creating event network-vif-deleted:365a3c15-654a-45d7-8c61-747c57ed3ee5 for instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b on n-h1-858383-14 Oct 18 17:31:23.469719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-2a656664-af18-4eeb-a346-5bc344b195e2 req-ea25a705-78b8-4746-8544-fcaa38f5fd66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090582 Oct 18 17:31:23.470598 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4083/8129] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:31:23.607649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:23.608280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:23.615062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:23.615556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:23.616003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:23.616700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:23.617198 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:23.617633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:23.651007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:23.651508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:23.651958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:23.652414 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lazy-loading 'fault' on Instance uuid 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:31:23.700101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:23.708366 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f7b1c933-39c5-4877-b894-7642ab7c2a2c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 200 len: 1354 microversion: 2.1 time: 0.105153 Oct 18 17:31:23.709083 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4047/8130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:23 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:24.733723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:24.734441 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:24.740641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:24.741174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:24.741636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:24.742341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:24.742815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:24.743260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:24.757662 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] HTTP exception thrown: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Request method failure captured: Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b HTTP/1.1 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuH5ClNRJpDMCjbfWnc2xQEKS9AWdhWi18cd8jQKMe3HEPf3PnN8hfM8XUUE_zTzKrKl8FIXITkRz91joaCCMsvYcZQ4JpBhtw78wNj1UjSAr0m_SZBfdkmd2FO11wHDXb2oAQghZr702o0Sgc0Xus9UL5cQznYnd13KHPQ6ztSSFLc Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}] Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 80e37568aa09403aaf54055f4defba46 Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b'} Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:31:24.759293 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Returning 404 to user: Instance 0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-848370c6-7b24-4115-8c5c-a619f8fe5240 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b" status: 404 len: 111 microversion: 2.1 time: 0.032559 Oct 18 17:31:24.765287 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4084/8131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:24 2022] GET /compute/v2.1/servers/0c1a21ef-87c1-4061-99d0-9cb5ee7fea1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:31:28.083760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-14e1ca35-f329-421a-8c63-d31a9ba02561 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '.version_select at 0x7f5fd6481f70>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:28.110902 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-14e1ca35-f329-421a-8c63-d31a9ba02561 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-838390179" status: 202 len: 0 microversion: 2.1 time: 0.032725 Oct 18 17:31:28.111508 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4048/8132] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 18 17:31:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-838390179 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:31:28.142935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9f62313d-b042-43e9-b44c-fd25d05f8037 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: .version_select at 0x7f5fd225e3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1884851131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s3SFNdmhSQqpz93obvgmeS8eS3VqaIjlgiWEK8ncK1hQypDKmeP5io++AthrxgW02nKBLMJIO81GETdkSq5kIGiO9/6diCwO2J86Z5DEQlMEDxWEpOyDJXH8jLOCLeA=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:28.161739 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9f62313d-b042-43e9-b44c-fd25d05f8037 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:31:28.167092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-9f62313d-b042-43e9-b44c-fd25d05f8037 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:31:28.190217 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9f62313d-b042-43e9-b44c-fd25d05f8037 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051556 Oct 18 17:31:28.190830 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4085/8133] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:31:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:31:33.666358 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-756467666", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "b717133f-c8c4-4ec9-8e99-329cfdc0d581"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1884851131", "security_groups": [{"name": "tempest-secgroup-smoke-266852571"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:33.704479 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:33.779660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] validate_networks() for [('b717133f-c8c4-4ec9-8e99-329cfdc0d581', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:31:34.338247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:31:34.339530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:31:34.340207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:31:34.341177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:31:34.341791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:31:34.357802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:34.358578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:34.359268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:34.360034 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:34.360376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:34.361120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:34.401144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:31:34.408569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:31:34.424815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:31:34.427332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:31:34.494629 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54430207-14a1-4b16-a1ef-7e259b577d97 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832880 Oct 18 17:31:34.496580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4049/8134] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:31:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:31:34.509668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-15c9c70d-425f-4a80-9260-d554a47549a6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:34.511589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-15c9c70d-425f-4a80-9260-d554a47549a6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:34.615076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-15c9c70d-425f-4a80-9260-d554a47549a6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:34.626667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-15c9c70d-425f-4a80-9260-d554a47549a6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1266 microversion: 2.1 time: 0.122915 Oct 18 17:31:34.628250 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4086/8135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:34 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:35.655858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:35.669332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:35.677545 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:35.678112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:35.678561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:35.679280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:35.679743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:35.680176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:35.763703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:35.773498 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98019790-4181-4f87-8af3-260ab8ae87f2 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1326 microversion: 2.1 time: 0.125261 Oct 18 17:31:35.775115 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4050/8136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:35 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:36.798078 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:36.798828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:36.801936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:36.807207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:36.807912 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:36.808370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:36.809114 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:36.809585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:36.810027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:37.013526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:37.021436 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a855ae2d-1f8f-46f3-a428-e1c78472b10b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.227380 Oct 18 17:31:37.033323 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4087/8137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:36 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:37.348424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:37.360702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:37.361215 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:37.361657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:37.375695 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] Creating event network-changed:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h1-858383-14 Oct 18 17:31:37.380566 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-75143bf9-8f03-4e20-a8d8-d88a41039355 req-b1e843bb-eb03-46d4-b8aa-71b916cf8e6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036076 Oct 18 17:31:37.381564 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4051/8138] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:31:38.047287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:38.047916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:38.054899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:38.055395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:38.055849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:38.056547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:38.057026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:38.057749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:38.198615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:38.206236 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-415dada9-1065-4e4d-b3b7-e2014974e988 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.163071 Oct 18 17:31:38.206850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4088/8139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:38 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:39.231963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:39.232666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:39.238963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:39.239448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:39.239887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:39.240603 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:39.241158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:39.241590 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:39.375458 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:39.383201 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36edaa2e-6bf7-4012-9595-a6834f221319 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.157341 Oct 18 17:31:39.383777 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4052/8140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:39 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:40.407421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:40.408051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:40.415000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:40.415496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:40.415947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:40.417539 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:40.418390 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:40.418834 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:40.557689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:40.565657 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b2cd0ff7-5132-493d-9f16-f8585d60f80c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.162241 Oct 18 17:31:40.566276 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4089/8141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:40 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:41.588218 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:41.589211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:41.596143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:41.596623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:41.597105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:41.597799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:41.598259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:41.598695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:41.736703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:41.744467 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ec59aa09-fb34-4eaa-9cba-3befc8991d74 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.160278 Oct 18 17:31:41.745071 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4053/8142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:41 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:42.235978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "name": "network-vif-plugged", "status": "completed", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:42.247335 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:42.247819 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:42.248216 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:42.259663 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] Creating event network-vif-plugged:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h1-858383-14 Oct 18 17:31:42.265197 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-c8708533-8740-4264-9737-9efa27ad897a req-77f35955-36e2-439b-8d5b-9dc5a75f5c53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092688 Oct 18 17:31:42.265894 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4090/8143] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:31:42.768452 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:42.769016 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:42.776147 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:42.776792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:42.777256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:42.777948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:42.778399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:42.778819 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:42.911170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:42.919438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1cb01890-2eec-4fa2-be48-a553b7457d31 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1391 microversion: 2.1 time: 0.155024 Oct 18 17:31:42.920010 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4054/8144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:42 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:43.944007 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:43.944722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:43.952233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:43.952760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:43.953291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:43.954004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:43.954478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:43.954922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:44.099276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:44.107185 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6271768a-3285-474b-b0dc-13df7af88218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1564 microversion: 2.1 time: 0.168233 Oct 18 17:31:44.107759 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4091/8145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:43 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:44.130287 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:44.130906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:44.139370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:44.139370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:44.139836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:44.140592 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:44.141031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:44.141472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:44.277818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:44.286601 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd01c87b-60d5-4874-850e-68469e57815f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1564 microversion: 2.1 time: 0.160153 Oct 18 17:31:44.287178 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4055/8146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:44 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:31:46.266918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:31:46.270949 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:31:46.276211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:46.277111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:46.278184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:31:46.281525 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:46.298774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:46.299288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:46.299749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:46.300475 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:46.300954 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:46.301434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:46.307207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:31:46.307700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:31:46.308144 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:31:46.319592 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] Creating event network-changed:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h1-858383-14 Oct 18 17:31:46.325646 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-99e9a879-9218-4545-89b6-645c1add839d req-82481873-7e96-4037-8a10-1b5954066590 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062297 Oct 18 17:31:46.326294 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4056/8147] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:31:46.545368 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:31:46.554933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55217623-6569-46dc-ad24-50fd36bb495a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1564 microversion: 2.1 time: 0.293810 Oct 18 17:31:46.555971 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4092/8148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:31:46 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1564 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:17.848984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:17.849890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:17.854753 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:32:17.857082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:17.865163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:17.865643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:17.866080 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:17.866803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:17.867255 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:17.867674 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:17.937118 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c1d85135-e9bf-4727-bc96-290b4278f5c7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action" status: 200 len: 24571 microversion: 2.1 time: 0.089657 Oct 18 17:32:17.940653 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4057/8149] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:32:17 2022] POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:32:48.367061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:48.367893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=32 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:48.424649 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:32:48.427123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:48.433281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:48.433815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:48.434267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:48.434971 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:48.435448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:48.435894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:48.513280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:48.520261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120571) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 17:32:48.527224 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:32:48.527679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:32:48.528190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:32:48.528619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:32:48.529081 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:32:48.596400 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-087dcf3d-00c7-466c-b2e4-3d77b56ce394 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action" status: 202 len: 0 microversion: 2.1 time: 0.231110 Oct 18 17:32:48.597722 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4093/8150] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:32:48 2022] POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:32:48.605757 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:48.606600 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:48.609124 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:48.610077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:48.616269 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:48.616755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:48.617311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:48.617997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:48.618515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:48.618994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:48.764091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:48.773532 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-18ad7b92-3194-4400-830a-14164edf786f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1692 microversion: 2.1 time: 0.172142 Oct 18 17:32:48.774214 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4058/8151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:48 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:49.801061 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:49.801691 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:49.809803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:49.810303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:49.810753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:49.811456 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:49.811923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:49.812371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:49.960686 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:49.968570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6366920a-368a-4b60-b53f-ee0acf8c4227 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1692 microversion: 2.1 time: 0.173840 Oct 18 17:32:49.969185 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4094/8152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:49 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:50.992619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:50.993262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:51.000433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:51.000916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:51.001389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:51.002084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:51.002544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:51.002966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:51.139570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:51.148207 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-85dc3c8c-9b5c-4650-b27b-f8f95d33c64b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.159229 Oct 18 17:32:51.148768 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4059/8153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:50 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:52.172613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:52.173362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:52.182080 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:52.182585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:52.183033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:52.183745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:52.184213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:52.184720 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:52.334460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:52.342345 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-6784e695-428b-4d83-9834-8cf7e5580e09 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.173958 Oct 18 17:32:52.342923 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4095/8154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:52 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:53.366865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:53.367464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:53.374271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:53.374751 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:53.375180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:53.375861 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:53.376315 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:53.376738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:53.508428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:53.516224 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-34674fdb-d815-4147-8bf9-693daada223c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.153872 Oct 18 17:32:53.516799 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4060/8155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:53 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:54.540671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:54.541300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:54.548122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:54.548621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:54.549171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:54.551013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:54.551492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:54.551941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:54.686311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:54.694824 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ec54a96-0bdd-4b1a-b6be-a2472a0e17fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.158089 Oct 18 17:32:54.695406 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4096/8156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:54 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:32:55.719155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:55.719771 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:55.727437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:55.727849 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:55.728280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:55.728963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:55.729435 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:55.729855 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:55.865782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:55.873506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50f7f689-f126-44c5-88b3-0b7dac341ca7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.158379 Oct 18 17:32:55.874078 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4061/8157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:55 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:56.897425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:56.898309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:56.905237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:56.905740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:56.906200 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:56.906904 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:56.907377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:56.907821 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:57.040870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:57.048835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8ce6cf4d-176d-435c-96d5-3a82ed6ba328 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.155919 Oct 18 17:32:57.050012 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4097/8158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:56 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:58.074134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:58.074748 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:58.082227 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:58.082710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:58.083155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:58.083847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:58.084300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:58.084727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:58.216787 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:58.224917 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-224a6969-93fc-4005-b9b5-ce94fab87b72 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.154573 Oct 18 17:32:58.225527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4062/8159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:58 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:32:59.248486 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:32:59.249054 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:32:59.255716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:59.256214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:59.256668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:59.257393 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:32:59.257864 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:32:59.258303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:32:59.395641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:32:59.403835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-97bd5969-5cc2-4eda-b707-a433ef44039d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.159474 Oct 18 17:32:59.404628 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4098/8160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:32:59 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:00.428342 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:00.428963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:00.435200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:00.435686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:00.436128 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:00.436816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:00.437436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:00.437864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:00.575181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:00.583540 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b126e026-2059-4456-a7f1-eecad2376f3a tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.159537 Oct 18 17:33:00.584113 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4063/8161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:00 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:01.607104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:01.607733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:01.615180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:01.615674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:01.616126 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:01.616831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:01.617330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:01.617768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:01.750233 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:01.758598 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c633ef54-1051-4282-a6f1-626cb71bfb6d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.155340 Oct 18 17:33:01.759181 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4099/8162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:01 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:02.783152 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:02.783729 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:02.791362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:02.791856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:02.792300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:02.793019 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:02.793486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:02.793920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:02.945774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:02.953816 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-224f6df0-d3bf-406c-a965-beba595fd31e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1697 microversion: 2.1 time: 0.174675 Oct 18 17:33:02.954397 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4064/8163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:02 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:03.484413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:33:03.500731 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:03.501644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:03.502459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:03.525952 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Creating event network-vif-unplugged:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h2-858383-14 Oct 18 17:33:03.537309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] Instance 26517088-beae-4e60-a9c9-e843bd24151e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120571) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:33:03.560332 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-efb8af0f-9916-4f78-804c-863220ef05b4 req-dc6d1d3c-2ea0-40de-be74-8669c3fe97d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079982 Oct 18 17:33:03.561468 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4100/8164] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:33:03.978617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:03.979263 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:03.986421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:03.986919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:03.987549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:03.988451 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:03.988917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:03.989379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:04.129882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:04.137860 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7226f9f0-010f-439b-a550-93d1fd8a2442 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1696 microversion: 2.1 time: 0.163172 Oct 18 17:33:04.138453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4065/8165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:03 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:05.164104 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:05.164836 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:05.171883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:05.172434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:05.172918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:05.173721 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:05.174294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:05.174878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:05.310849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:05.318988 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dfd90047-cdb6-4605-ab51-54667fde01c9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1694 microversion: 2.1 time: 0.159941 Oct 18 17:33:05.319577 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4101/8166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:05 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:05.590133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:33:05.600662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:05.601180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:05.601618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:05.614070 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Creating event network-changed:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h2-858383-14 Oct 18 17:33:05.620031 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] Instance 26517088-beae-4e60-a9c9-e843bd24151e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-14', 'n-h2-858383-14'} {{(pid=120570) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 17:33:05.632674 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9d1e2edf-0c24-46f9-b44a-bd897d7edd21 req-b645c39a-08b2-4c61-9c62-eb7144648abb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046777 Oct 18 17:33:05.633335 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4066/8167] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:33:06.344274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:06.344981 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:06.352427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:06.352929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:06.353416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:06.354131 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:06.354608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:06.355057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:06.493778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:06.506235 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-72f83bde-a2b7-4420-b86c-9871e872651d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1694 microversion: 2.1 time: 0.165473 Oct 18 17:33:06.507420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4102/8168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:06 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:07.531596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:07.532359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:07.538906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:07.539389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:07.539832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:07.540534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:07.541011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:07.541444 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:07.680179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:07.687944 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2906d88b-8568-4334-a314-0cce56dca0fe tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1694 microversion: 2.1 time: 0.161499 Oct 18 17:33:07.688522 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4067/8169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:07 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:08.712609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:08.713526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:08.720557 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.722253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.722926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:08.724260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.724924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.725472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:08.865579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:08.873657 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-53728c1d-38ac-445e-a3d4-419f71999efc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1691 microversion: 2.1 time: 0.165506 Oct 18 17:33:08.874244 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4103/8170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:08 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:08.897320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:33:08.898282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:08.905990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.906611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.907061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:08.907767 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.908231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.909229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:08.968147 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3bd24091-715b-43ea-888b-3a177cdb2e5f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action" status: 204 len: 0 microversion: 2.1 time: 0.075256 Oct 18 17:33:08.968831 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4068/8171] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:33:08 2022] POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:33:08.977590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:08.978220 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:08.984737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.985345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.985797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:08.986505 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:08.987192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:08.987859 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:09.197598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:09.205371 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-51bb4662-8054-4e27-869f-3d300905a3aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1691 microversion: 2.1 time: 0.231608 Oct 18 17:33:09.206538 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4104/8172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:08 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:09.229738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:09.230447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:09.236549 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:09.237214 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:09.237663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:09.238352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:09.238810 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:09.239239 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:09.385512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:09.394914 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-054f4328-50c9-4e69-a21a-e020cc6ae65f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1691 microversion: 2.1 time: 0.169201 Oct 18 17:33:09.405714 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4069/8173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:09 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:10.421346 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:33:10.422583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:10.430920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:10.431426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:10.431889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:10.432594 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:10.433129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:10.433572 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:10.575807 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:33:10.584523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1cdf12da-88a3-4b90-98e3-13608faace17 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1683 microversion: 2.1 time: 0.167168 Oct 18 17:33:10.585129 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4105/8174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:33:10 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:33:10.809644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "name": "network-vif-plugged", "status": "completed", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:33:10.822503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:10.823014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:10.823499 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:10.840173 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] Creating event network-vif-plugged:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h2-858383-14 Oct 18 17:33:10.848198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-399eb820-a19b-41f2-9444-3cce6c2593e0 req-e6f7f8d2-231e-4183-be20-1c4ddd152f46 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041785 Oct 18 17:33:10.849081 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4070/8175] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:33:40.807303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:33:40.809593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:33:40.811922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=30 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:33:40.812619 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:33:40.819246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:40.819752 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:40.820213 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:40.820930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:33:40.821442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:33:40.821893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:33:40.891548 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-937bc3ff-ca1f-4eaf-8e3a-cfd025ef9ef8 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action" status: 200 len: 24569 microversion: 2.1 time: 0.088026 Oct 18 17:33:40.892383 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4106/8176] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:33:40 2022] POST /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e/action => generated 24569 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:34:04.750656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=26 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:04.751745 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:04.755496 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:04.756334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:04.756920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:04.765027 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:04.765512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:04.765949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:04.766641 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:04.767091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:04.767512 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:04.774932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:04.775641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:04.782096 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:04.782596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:04.783048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:04.795415 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] Creating event network-changed:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h2-858383-14 Oct 18 17:34:04.796208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:34:04.801399 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-09f60e06-644b-4b59-af52-940eeaf7fd6f req-966daedb-6e6a-46e0-92c9-2af54dd9f9bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049967 Oct 18 17:34:04.801756 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4107/8177] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:34:04.880779 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e1140917-ee12-46b5-a9c9-e0c0dd068619 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 204 len: 0 microversion: 2.1 time: 0.132623 Oct 18 17:34:04.881330 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4071/8178] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:34:04 2022] DELETE /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:34:04.890926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:04.891664 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:04.899683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:04.900207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:04.900672 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:04.901437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:04.901947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:04.902394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:05.092964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:05.101789 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b316fdc5-c52a-4249-9e32-7f57143fb9ab tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1689 microversion: 2.1 time: 0.215701 Oct 18 17:34:05.102652 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4108/8179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:04 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:06.127764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:06.128629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:06.137715 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:06.138246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:06.138701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:06.139417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:06.140018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:06.140473 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:06.313140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:06.321780 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3b1948b3-82ff-49b1-817e-92ea443127f9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1689 microversion: 2.1 time: 0.198749 Oct 18 17:34:06.322385 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4072/8180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:06 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:07.161642 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26517088-beae-4e60-a9c9-e843bd24151e", "name": "network-vif-deleted", "tag": "1e382bd5-13f3-4d45-acaa-f52aa1cf8c00"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:07.171123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:07.171618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:07.172062 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:07.186083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] Creating event network-vif-deleted:1e382bd5-13f3-4d45-acaa-f52aa1cf8c00 for instance 26517088-beae-4e60-a9c9-e843bd24151e on n-h2-858383-14 Oct 18 17:34:07.191539 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-580a35a9-eab8-43b0-8ac7-0ffeaa494eb1 req-b2d875fe-f3a3-4a3b-95f3-f3856532823d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087828 Oct 18 17:34:07.192205 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4109/8181] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:34:07.347415 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:07.348026 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:07.354829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:07.355311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:07.355749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:07.356432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:07.356888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:07.357337 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:07.389765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:07.390253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:07.390685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:07.391139 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lazy-loading 'fault' on Instance uuid 26517088-beae-4e60-a9c9-e843bd24151e {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:34:07.435447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:07.443782 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-872f278e-34d5-4c26-8992-31b415f703c6 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 200 len: 1356 microversion: 2.1 time: 0.100782 Oct 18 17:34:07.444434 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4073/8182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:07 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:08.469418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:08.470130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 26517088-beae-4e60-a9c9-e843bd24151e] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:08.476381 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:08.476874 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:08.477355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:08.478058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:08.478526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:08.478964 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:08.493490 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] HTTP exception thrown: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Request method failure captured: Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e HTTP/1.1 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuH5ClNRJpDMCjbfWnc2xQEKS9AWdhWi18cd8jQKMe3HEPf3PnN8hfM8XUUE_zTzKrKl8FIXITkRz91joaCCMsvYcZQ4JpBhtw78wNj1UjSAr0m_SZBfdkmd2FO11wHDXb2oAQghZr702o0Sgc0Xus9UL5cQznYnd13KHPQ6ztSSFLc Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}] Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 80e37568aa09403aaf54055f4defba46 Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '26517088-beae-4e60-a9c9-e843bd24151e'} Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:34:08.495148 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Returning 404 to user: Instance 26517088-beae-4e60-a9c9-e843bd24151e could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-46355ee3-5e8e-46a0-b3de-565fc2fed7cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e" status: 404 len: 111 microversion: 2.1 time: 0.032489 Oct 18 17:34:08.500339 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4110/8183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:08 2022] GET /compute/v2.1/servers/26517088-beae-4e60-a9c9-e843bd24151e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:34:12.054662 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fdc972c4-f81f-456a-a1f8-a5cd48f306a4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '.version_select at 0x7f5fd19e35e0>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:12.079803 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fdc972c4-f81f-456a-a1f8-a5cd48f306a4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1884851131" status: 202 len: 0 microversion: 2.1 time: 0.029486 Oct 18 17:34:12.081092 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4074/8184] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 17:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1884851131 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:34:12.109025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ef2dec91-3dda-434d-9e17-32cf29380d6c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: .version_select at 0x7f5fd1421dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-353855031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZFygELPoQXXSVnqKuchxdosdGCdDtRvpqpySZevf/ioobFFzElduPpCa0vLEGzniFPojgYSJZLTI488ZjodQHmfbPYlxzJcVq+uHbVcLj+Mf5UnB0//Fy3tcoGn06Jw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:12.126992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ef2dec91-3dda-434d-9e17-32cf29380d6c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:34:12.134045 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-ef2dec91-3dda-434d-9e17-32cf29380d6c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:34:12.160255 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ef2dec91-3dda-434d-9e17-32cf29380d6c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055318 Oct 18 17:34:12.161049 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4111/8185] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:34:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:34:18.085327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1157521097", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8cb74527-cde8-4a59-a5fe-b395208f15ff"}], "key_name": "tempest-TestNetworkAdvancedServerOps-353855031", "security_groups": [{"name": "tempest-secgroup-smoke-1319256514"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:18.108230 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:18.234291 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] validate_networks() for [('8cb74527-cde8-4a59-a5fe-b395208f15ff', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:34:18.694432 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:34:18.694856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:34:18.695370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:34:18.695784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:34:18.696222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:34:18.706036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:18.706783 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:18.707601 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:18.708587 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:18.709292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:18.709947 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:18.731164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:34:18.736660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:34:18.749760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:34:18.752305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:34:18.802399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca76346f-d56e-40f1-9865-8af8e4861a3c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721906 Oct 18 17:34:18.803455 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4075/8186] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:34:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:34:18.815182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c092174a-11bc-4b4f-bec3-93c381ad46aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:18.816064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c092174a-11bc-4b4f-bec3-93c381ad46aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:18.820663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:18.890744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c092174a-11bc-4b4f-bec3-93c381ad46aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:18.899472 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c092174a-11bc-4b4f-bec3-93c381ad46aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1266 microversion: 2.1 time: 0.088000 Oct 18 17:34:18.899472 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4112/8187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:18 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:19.927516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:19.929045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:19.942501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:19.943022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:19.943679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:19.944661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:19.945327 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:19.946011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:20.022417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:20.031980 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8a008895-34ae-4a0f-a3d6-55b00fed34e0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1326 microversion: 2.1 time: 0.112027 Oct 18 17:34:20.048260 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4076/8188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:19 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:21.061163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:21.061815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:21.078433 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:21.078945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:21.079410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:21.090840 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:21.091583 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:21.092060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:21.334263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:21.343061 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-db401721-ebf9-4da6-a62f-b843ebf250df tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.288250 Oct 18 17:34:21.354477 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4113/8189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:21 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:21.707006 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba684e-0a23-42d7-9a83-b22c54f33d07", "tag": "43f8017b-a5cf-417a-a978-f623840b6ade"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:21.718185 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:21.718688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:21.719122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:21.731694 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] Creating event network-changed:43f8017b-a5cf-417a-a978-f623840b6ade for instance afba684e-0a23-42d7-9a83-b22c54f33d07 on n-h1-858383-14 Oct 18 17:34:21.736791 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c57e2c5a-fd43-4cb4-a912-48d3aea1af56 req-f026e8c1-41d4-449d-988f-7261eb9e78b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Oct 18 17:34:21.737441 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4077/8190] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:34:22.368205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:22.369567 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:22.377637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:22.378310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:22.378668 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:22.379426 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:22.379914 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:22.380507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:22.525640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:22.534079 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b6ccdc00-6259-4751-a48e-dfc275fea01c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.170110 Oct 18 17:34:22.534675 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4114/8191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:22 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:23.559058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:23.559765 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:23.566511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:23.566996 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:23.567437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:23.568145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:23.568637 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:23.569095 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:23.717145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:23.726924 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-976a7eb5-e586-457c-98f7-26661535e46f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.173027 Oct 18 17:34:23.727527 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4078/8192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:23 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:24.750102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:24.750784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:24.759438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:24.760000 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:24.760645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:24.761622 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:24.762206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:24.762754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:24.908812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:24.917093 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-01e41cfd-51f2-4bf9-a1c3-fc5a12092f44 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.170988 Oct 18 17:34:24.917688 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4115/8193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:24 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:25.941871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:25.942483 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:25.949811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:25.950343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:25.950820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:25.951567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:25.952022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:25.952447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:26.088913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:26.096897 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93e92c94-a9a8-4006-b1c5-e4cb7afd9521 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.159332 Oct 18 17:34:26.097513 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4079/8194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:25 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:26.982767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afba684e-0a23-42d7-9a83-b22c54f33d07", "name": "network-vif-plugged", "status": "completed", "tag": "43f8017b-a5cf-417a-a978-f623840b6ade"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:26.993708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:26.994210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:26.994655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:27.007407 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] Creating event network-vif-plugged:43f8017b-a5cf-417a-a978-f623840b6ade for instance afba684e-0a23-42d7-9a83-b22c54f33d07 on n-h1-858383-14 Oct 18 17:34:27.012508 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-ceacffeb-ed84-48c9-b363-04c85b8c0bca req-d01dd5ca-51c1-49f9-bc16-1659b7253daa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Oct 18 17:34:27.013196 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4116/8195] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:34:27.119746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:27.120383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:27.128297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:27.128781 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:27.129246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:27.129945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:27.130399 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:27.130829 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:27.272104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:27.280622 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b5a4fd0b-4ed3-4aff-adfe-1f3c137380d7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.164725 Oct 18 17:34:27.281251 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4080/8196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:27 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:28.306958 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:28.307695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:28.315311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:28.315867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:28.316366 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:28.317156 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:28.317681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:28.318214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:28.470133 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:28.479137 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b28e7d32-bdfd-4325-8d36-741355dc5518 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1392 microversion: 2.1 time: 0.178262 Oct 18 17:34:28.479903 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4117/8197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:28 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:29.508502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:29.509343 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:29.511834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:29.512525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:29.520002 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:29.520465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:29.520904 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:29.521619 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:29.522070 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:29.522494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:29.665497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:29.673415 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-96df4272-5582-4957-9546-a06729b54244 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1564 microversion: 2.1 time: 0.168903 Oct 18 17:34:29.674505 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4081/8198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:29 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:29.696926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:29.697585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:29.699626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:29.705990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:29.706487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:29.706938 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:29.707637 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:29.708105 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:29.708547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:29.839751 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:29.848316 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b29db0f1-d2a8-46c5-b52e-73d724aa8891 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1564 microversion: 2.1 time: 0.155312 Oct 18 17:34:29.848918 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4118/8199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:29 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:34:31.808523 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:34:31.809176 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:34:31.811942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba684e-0a23-42d7-9a83-b22c54f33d07", "tag": "43f8017b-a5cf-417a-a978-f623840b6ade"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:34:31.816835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:31.817447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:31.818243 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:31.818985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:31.819566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:31.819873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:31.823392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:34:31.823941 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:34:31.824397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:34:31.839523 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] Creating event network-changed:43f8017b-a5cf-417a-a978-f623840b6ade for instance afba684e-0a23-42d7-9a83-b22c54f33d07 on n-h1-858383-14 Oct 18 17:34:31.845143 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-336339f1-d5a5-401c-a2b5-134cd1d0d833 req-515b2577-05a3-4956-9f9e-1de2ac72369f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037188 Oct 18 17:34:31.846616 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4119/8200] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:34:31.982149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:34:31.990786 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fd7609fb-dddd-43a5-9e49-bae3500cc5fb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1564 microversion: 2.1 time: 0.186383 Oct 18 17:34:31.991726 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4082/8201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:34:31 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:03.287121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:03.287805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=34 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:03.292591 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:35:03.294887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:03.303180 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:03.303681 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:03.304138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:03.304847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:03.305357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:03.305805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:03.380362 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-09534b00-3a05-46a6-a8dc-802963bae3b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action" status: 200 len: 24567 microversion: 2.1 time: 0.095323 Oct 18 17:35:03.381017 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4120/8202] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:35:03 2022] POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action => generated 24567 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:35:33.789722 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:33.790478 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=40 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:33.795395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:35:33.803859 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:33.804347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:33.804793 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:33.828677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Going to try to stop instance {{(pid=120570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 17:35:33.872307 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a4fb5740-0252-4b79-af91-b3d3ab5d0a18 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action" status: 202 len: 0 microversion: 2.1 time: 0.083958 Oct 18 17:35:33.872952 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4083/8203] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:35:33 2022] POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:35:33.882861 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:33.883589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:33.886221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:33.887227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:33.894227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:33.894733 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:33.895186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:33.895927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:33.896402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:33.896846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:34.095411 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:34.103955 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0fb9911a-ff0a-460e-9dd9-da5c9ba0d671 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.226291 Oct 18 17:35:34.104531 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4121/8204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:33 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:35.129653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:35.130357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:35.137764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:35.138246 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:35.138678 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:35.139363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:35.139822 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:35.140245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:35.326628 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:35.334486 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-060b907f-ed02-4ec7-8763-fdc96d4fb3e9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.209914 Oct 18 17:35:35.335063 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4084/8205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:35 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:36.357850 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:36.358512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:36.365815 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:36.366312 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:36.366767 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:36.367473 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:36.367945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:36.368388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:36.500053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:36.508375 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-98742ce8-bc01-42c9-99ae-3341e798654e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.154429 Oct 18 17:35:36.508943 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4122/8206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:36 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:37.532900 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:37.533531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:37.541182 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:37.541705 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:37.542148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:37.542843 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:37.543304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:37.543730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:37.676644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:37.684472 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bf8c8a3b-d8ef-4fce-9a67-cf57a7d2f727 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.155773 Oct 18 17:35:37.685074 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4085/8207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:37 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:38.709805 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:38.710197 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:38.717255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:38.717804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:38.718261 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:38.718983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:38.719457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:38.719928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:38.856740 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:38.865323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-156ca16c-1d55-4898-801d-c8cc66fb6903 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.160321 Oct 18 17:35:38.865902 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4123/8208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:38 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:39.889402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:39.890017 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:39.897501 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:39.897985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:39.898424 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:39.899111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:39.899820 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:39.900252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:40.031356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:40.039150 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b2bcd2b6-f257-47d2-a8b6-b8e475e14a10 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.153728 Oct 18 17:35:40.039732 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4086/8209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:39 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:41.063098 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:41.063754 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:41.071017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:41.071519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:41.071973 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:41.072682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:41.073196 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:41.073643 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:41.208161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:41.216847 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-569ae3d9-2e49-4430-861c-1e9643a12540 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.157782 Oct 18 17:35:41.217922 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4124/8210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:41 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:42.241874 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:42.242495 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:42.249290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:42.249773 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:42.250209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:42.250895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:42.251348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:42.251772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:42.388454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:42.396776 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6f8bf5a9-df0d-4e04-b4a9-6635425ff92c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.159573 Oct 18 17:35:42.397373 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4087/8211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:42 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:43.419674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:43.420301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:43.427676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:43.428167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:43.428615 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:43.429341 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:43.429808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:43.430245 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:43.568464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:43.576354 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-50717565-0024-4c85-8c2e-875c5faa9a5d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1693 microversion: 2.1 time: 0.160510 Oct 18 17:35:43.576933 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4125/8212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:43 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:44.599314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:44.599951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:44.607308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:44.607798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:44.608238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:44.608938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:44.609426 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:44.609858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:44.741803 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:44.749493 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-07172a8f-d208-490a-92af-1ea6720a5409 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1670 microversion: 2.1 time: 0.154707 Oct 18 17:35:44.750065 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4088/8213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:44 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:45.849881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:35:45.852120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:45.859167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:45.859667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:45.860122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:45.860832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:45.861339 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:45.861786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:45.923991 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-95f7d774-596e-4c5d-b681-61572baea990 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action" status: 200 len: 38116 microversion: 2.1 time: 0.078762 Oct 18 17:35:45.924640 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4126/8214] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:35:45 2022] POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action => generated 38116 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 17:35:45.937257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:35:45.944205 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:45.944691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:45.945168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:45.967086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Going to try to start instance {{(pid=120570) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 17:35:46.008740 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e02f1be3-3c7a-4a44-817c-e69e8dde64b0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action" status: 202 len: 0 microversion: 2.1 time: 0.075286 Oct 18 17:35:46.009580 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4089/8215] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:35:45 2022] POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:35:46.018472 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:46.019288 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:46.027324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:46.027927 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:46.028394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:46.029155 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:46.029709 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:46.030163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:46.212935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:46.220905 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-28c5bf4b-384f-4fc7-a196-ae6bb7df36fc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1679 microversion: 2.1 time: 0.206673 Oct 18 17:35:46.221766 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4127/8216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:46 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:35:47.246605 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:35:47.247234 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:35:47.255021 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:47.255631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:47.256076 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:47.256772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:35:47.257256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:35:47.257690 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:35:47.400386 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:35:47.408238 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9f82bbae-323d-475a-b902-834115d1660f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1683 microversion: 2.1 time: 0.166001 Oct 18 17:35:47.408823 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4090/8217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:35:47 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:19.649223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:19.651700 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:19.654470 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=14 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:19.655152 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:19.656083 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:36:19.656258 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action (ip 10.222.0.78) !!! Oct 18 17:36:19.657337 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:36:19.657506 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action (ip 10.222.0.78) !!! Oct 18 17:36:19.667338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:19.667338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:19.667779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:19.668511 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:19.668977 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:19.669460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:19.747452 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-321780b0-1cca-4e94-9cf1-4b2e9ec72218 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action" status: 200 len: 62678 microversion: 2.1 time: 0.103061 Oct 18 17:36:19.748120 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4128/8218] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:36:19 2022] POST /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07/action => generated 62678 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:36:36.978413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:36.978991 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:36.980531 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba684e-0a23-42d7-9a83-b22c54f33d07", "tag": "43f8017b-a5cf-417a-a978-f623840b6ade"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:36.981395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=16 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:36.982063 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:36.988548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:36.989064 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:36.989508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:36.990830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:36.991635 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:36.992153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:36.993182 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:36.994524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=4 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:36.996894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:36.997416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:36.997923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:37.011884 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] Creating event network-changed:43f8017b-a5cf-417a-a978-f623840b6ade for instance afba684e-0a23-42d7-9a83-b22c54f33d07 on n-h1-858383-14 Oct 18 17:36:37.017894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-97c92ea9-ff21-49a4-9d66-a4b9d43e4886 req-1997e45d-2831-4b59-8466-0155bd9a88d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041338 Oct 18 17:36:37.018700 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4129/8219] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:36:37.024137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:36:37.119042 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3449342f-6a70-4e72-9222-4e857be2c2b3 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 204 len: 0 microversion: 2.1 time: 0.145648 Oct 18 17:36:37.123026 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4091/8220] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:36:36 2022] DELETE /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:36:37.128856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:37.129978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:37.138058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:37.138887 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:37.139604 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:37.140590 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:37.141363 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:37.142044 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:37.666280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:37.674195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4c2e3af1-b4cd-4401-8e46-55a4bd7b9768 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1689 microversion: 2.1 time: 0.549543 Oct 18 17:36:37.674865 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4130/8221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:37 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1689 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:38.700716 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:38.701363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:38.708852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:38.709365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:38.709802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:38.710927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:38.711382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:38.711808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:38.849889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:38.858438 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2e5781ac-291f-4a53-9ba6-0479b4b54568 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1689 microversion: 2.1 time: 0.162081 Oct 18 17:36:38.859220 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4092/8222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:38 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:39.387554 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afba684e-0a23-42d7-9a83-b22c54f33d07", "name": "network-vif-deleted", "tag": "43f8017b-a5cf-417a-a978-f623840b6ade"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:39.400885 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:39.401678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:39.402130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:39.414819 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] Creating event network-vif-deleted:43f8017b-a5cf-417a-a978-f623840b6ade for instance afba684e-0a23-42d7-9a83-b22c54f33d07 on n-h1-858383-14 Oct 18 17:36:39.419985 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-61b879e5-6b0b-49f8-a799-667376daa88f req-659b53ab-e589-48b0-bb36-9db4e6545ec5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Oct 18 17:36:39.420609 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4131/8223] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:36:39.883441 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:39.884105 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:39.890711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:39.891292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:39.891809 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:39.892586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:39.893272 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:39.893776 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:39.927548 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:39.927962 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:39.928412 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:39.928866 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lazy-loading 'fault' on Instance uuid afba684e-0a23-42d7-9a83-b22c54f33d07 {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:36:39.975596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:39.983135 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-65360f2c-9f97-48db-83d1-0a94020a32b7 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 200 len: 1356 microversion: 2.1 time: 0.104665 Oct 18 17:36:39.983738 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4093/8224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:39 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:36:41.008586 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:41.009447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: afba684e-0a23-42d7-9a83-b22c54f33d07] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:41.015674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:41.016177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:41.016635 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:41.017384 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:41.017858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:41.018307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:41.031887 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] HTTP exception thrown: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Request method failure captured: Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 HTTP/1.1 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuH5ClNRJpDMCjbfWnc2xQEKS9AWdhWi18cd8jQKMe3HEPf3PnN8hfM8XUUE_zTzKrKl8FIXITkRz91joaCCMsvYcZQ4JpBhtw78wNj1UjSAr0m_SZBfdkmd2FO11wHDXb2oAQghZr702o0Sgc0Xus9UL5cQznYnd13KHPQ6ztSSFLc Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}] Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 80e37568aa09403aaf54055f4defba46 Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': 'afba684e-0a23-42d7-9a83-b22c54f33d07'} Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:36:41.033569 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Returning 404 to user: Instance afba684e-0a23-42d7-9a83-b22c54f33d07 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a2a5a4ba-e2a5-42d4-8ed2-43f09374f0bc tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07" status: 404 len: 111 microversion: 2.1 time: 0.032198 Oct 18 17:36:41.038854 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4132/8225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:41 2022] GET /compute/v2.1/servers/afba684e-0a23-42d7-9a83-b22c54f33d07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:36:44.414453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0575c045-3027-4be1-a5e1-a58c845f7aaa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '.version_select at 0x7f5fd651ad30>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:44.422832 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0575c045-3027-4be1-a5e1-a58c845f7aaa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:36:45.430513 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-0575c045-3027-4be1-a5e1-a58c845f7aaa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [807efa8e-c978-45f8-9fee-c1dd211d7306] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 56874. Oct 18 17:36:45.450854 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0575c045-3027-4be1-a5e1-a58c845f7aaa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-353855031" status: 202 len: 0 microversion: 2.1 time: 1.042035 Oct 18 17:36:45.451560 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4094/8226] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 18 17:36:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-353855031 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:36:45.484356 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5add7e59-d652-4b1a-9a50-a8164cd25c54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: .version_select at 0x7f5fd1481040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1616284083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCoeIBXGWEQwAinkv4EycPAd5yxUnx/zr85o5yWZx22a417OhqloBUr6JDTrqRphVKjK3G1WhKpf/YnVOaXjLedbNsTtxU6Ex1cGDA8dwd3SgSTE3DSFw719lzLQGDcCw=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:45.501184 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5add7e59-d652-4b1a-9a50-a8164cd25c54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:36:45.507214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5add7e59-d652-4b1a-9a50-a8164cd25c54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:36:45.536169 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5add7e59-d652-4b1a-9a50-a8164cd25c54 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055662 Oct 18 17:36:45.536784 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4133/8227] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:36:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:36:50.836544 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:50.841520 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-532880318", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "networks": [{"uuid": "8046f75b-e14e-4b03-9310-c5cbad7d752d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1616284083", "security_groups": [{"name": "tempest-secgroup-smoke-746451099"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:50.970381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] validate_networks() for [('8046f75b-e14e-4b03-9310-c5cbad7d752d', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:36:51.437029 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:36:51.437453 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:36:51.437984 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:36:51.438352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:36:51.438777 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:36:51.449964 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:51.450468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:51.450909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:51.451851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:51.452525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:51.453166 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:51.472154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:36:51.478724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Getting quotas for user 80e37568aa09403aaf54055f4defba46 and project b583e593adb54b4da76722c3cb93d92b. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:36:51.495087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:36:51.497468 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:36:51.549032 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:36:52.556799 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [7dd163cf-07a4-4ed6-ae79-d8d85d21d6ba] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 56924. Oct 18 17:36:52.560857 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40fef91b-4dbc-44d4-b11b-62b2bfc174fd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.727092 Oct 18 17:36:52.561605 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4095/8228] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:36:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:36:52.572242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:52.576963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc836c2a-9f98-4969-8292-0a949cec81f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:52.577629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc836c2a-9f98-4969-8292-0a949cec81f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:52.649687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc836c2a-9f98-4969-8292-0a949cec81f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:52.662247 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc836c2a-9f98-4969-8292-0a949cec81f4 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1266 microversion: 2.1 time: 0.092244 Oct 18 17:36:52.669401 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4134/8229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:52 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:53.687438 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:53.688004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:53.695640 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:53.696134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:53.696710 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:53.697382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:53.697937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:53.698439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:53.802030 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:53.814187 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2697e171-2cf1-4cd3-a5e0-2dd25bc1edfb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1326 microversion: 2.1 time: 0.130548 Oct 18 17:36:53.815323 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4096/8230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:53 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:54.840217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:54.840878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:54.848490 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:54.849013 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:54.849484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:54.850178 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:54.850652 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:54.852204 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:54.991258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:55.000714 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1ec6670e-451f-4044-ab0f-40cae6a355dd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.164840 Oct 18 17:36:55.001337 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4135/8231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:54 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:55.187427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6d0a32-81f2-4d48-a67f-8519c788a199", "tag": "78c61d79-7021-4875-a555-34e708cdbfcf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:36:55.199107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:55.199588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:55.200232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:55.211752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] Creating event network-changed:78c61d79-7021-4875-a555-34e708cdbfcf for instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 on n-h1-858383-14 Oct 18 17:36:55.217046 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-90e3465e-2378-4734-a6d2-bc40fab8171a req-ffaee650-e203-46e0-876d-983d133f8c8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 Oct 18 17:36:55.217663 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4097/8232] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:36:56.024362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:56.024984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:56.032135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:56.032625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:56.033102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:56.033804 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:56.034270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:56.034708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:56.169468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:56.177213 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-82527547-3890-4417-918a-83139f5a70ec tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.157344 Oct 18 17:36:56.177984 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4136/8233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:56 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:57.201943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:57.202557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:57.208711 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:57.209232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:57.209731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:57.211087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:57.211565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:57.211985 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:57.343911 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:57.351546 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4710e1ab-dc9b-4f35-b944-c9ce664330cb tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.154782 Oct 18 17:36:57.352104 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4098/8234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:57 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:36:58.374397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:58.375025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:58.381593 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:58.382202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:58.382747 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:58.383454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:58.383924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:58.384362 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:58.522563 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:58.530748 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7298ba7b-4bcc-429a-a887-cdda19b2b2af tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.160532 Oct 18 17:36:58.531354 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4137/8235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:58 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:36:59.554578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:36:59.555187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:36:59.562258 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:59.562953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:59.563398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:59.564352 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:36:59.564815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:36:59.565388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:36:59.706395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:36:59.714649 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cc4e637d-8e00-4af7-ac33-48222f7cdaff tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.164506 Oct 18 17:36:59.715224 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4099/8236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:36:59 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:37:00.738629 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:00.739263 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:00.746324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:00.746830 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:00.747291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:00.748002 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:00.748482 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:00.749072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:00.885520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:00.893311 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a587da20-2ac6-4bb3-bb82-ba5bbfdae816 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.158531 Oct 18 17:37:00.893888 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4138/8237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:00 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:37:01.581155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:01.581913 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:01.634571 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6d0a32-81f2-4d48-a67f-8519c788a199", "name": "network-vif-plugged", "status": "completed", "tag": "78c61d79-7021-4875-a555-34e708cdbfcf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:37:01.643987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:01.644625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:01.644888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:01.657166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] Creating event network-vif-plugged:78c61d79-7021-4875-a555-34e708cdbfcf for instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 on n-h1-858383-14 Oct 18 17:37:01.662238 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-73b148ca-abcc-4d8f-8c1c-8c6388d47b00 req-89489b64-f115-4a05-88b3-1c5b995058aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086404 Oct 18 17:37:01.662841 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4100/8238] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:37:01.917206 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:01.917846 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:01.924786 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:01.925338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:01.925803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:01.926522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:01.926999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:01.927445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:02.065901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:02.074806 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-457d0c56-189f-4206-82ce-75ef2b3d05d5 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.162397 Oct 18 17:37:02.075402 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4139/8239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:01 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:37:03.099898 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:03.101259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:03.107807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:03.108289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:03.108724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:03.109443 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:03.109907 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:03.110330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:03.261362 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:03.269327 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d3df5355-ccc4-4616-87fb-a12ea78c496f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1391 microversion: 2.1 time: 0.174479 Oct 18 17:37:03.269906 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4101/8240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:03 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:37:04.293360 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:04.293917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:04.295856 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:04.302171 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:04.302670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:04.303123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:04.305095 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:04.305584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:04.306034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:04.437639 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:04.445464 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-223c21ad-2243-41a5-8e21-d6259989168c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1564 microversion: 2.1 time: 0.156090 Oct 18 17:37:04.446055 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4140/8241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:04 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:37:04.467449 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:04.468078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:04.474808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:04.475285 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:04.476242 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:04.476920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:04.477446 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:04.477867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:04.617668 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:04.625389 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-020b7ab9-ad69-43e8-a70c-05ff29bbb4cd tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1564 microversion: 2.1 time: 0.161751 Oct 18 17:37:04.625954 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4102/8242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:04 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:37:06.547144 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:37:06.547963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:06.550588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6d0a32-81f2-4d48-a67f-8519c788a199", "tag": "78c61d79-7021-4875-a555-34e708cdbfcf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:37:06.555611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:06.556296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:06.556832 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:06.557663 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:06.558399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:06.558923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:06.562878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:06.563366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:06.564936 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:06.577109 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] Creating event network-changed:78c61d79-7021-4875-a555-34e708cdbfcf for instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 on n-h1-858383-14 Oct 18 17:37:06.582714 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-ef38846c-26ad-4fa3-b43a-5175f8acda5d req-dfee0a42-06b3-4d9b-8887-fecf291758f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037730 Oct 18 17:37:06.583537 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4103/8243] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:37:06.721561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:37:06.730323 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-20d7bd77-dda4-4116-bcdb-5a282033a84c tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1564 microversion: 2.1 time: 0.187452 Oct 18 17:37:06.731275 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4141/8244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:37:06 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:37:38.012552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:38.013339 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=38 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:38.017895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:37:38.020143 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:37:38.031617 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:38.032106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:38.032543 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:38.033257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:37:38.033714 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:37:38.034140 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:37:38.103338 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11cba71d-af38-4f24-9d78-a04a46a660b9 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action" status: 200 len: 24562 microversion: 2.1 time: 0.093123 Oct 18 17:37:38.104003 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4104/8245] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:37:38 2022] POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action => generated 24562 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 17:38:08.364808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:08.365599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=42 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:08.559025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:08.559576 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:08.565606 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:08.566135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:08.566646 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:08.567427 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:08.568227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:08.568385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:08.592854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lazy-loading 'flavor' on Instance uuid 3b6d0a32-81f2-4d48-a67f-8519c788a199 {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:38:08.661995 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8f5ef00c-51d0-40fb-9e87-cff36870b01b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action" status: 202 len: 0 microversion: 2.1 time: 0.299019 Oct 18 17:38:08.662736 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4142/8246] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:38:08 2022] POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:38:08.672103 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:08.673036 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:08.675672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:08.676461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:08.683489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:08.683974 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:08.684431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:08.685169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:08.685615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:08.686037 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:08.829928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:08.838931 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba0bfffa-1340-406c-b881-9a7a27a982aa tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1691 microversion: 2.1 time: 0.171217 Oct 18 17:38:08.839506 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4105/8247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:08 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:09.867210 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:09.868240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:09.874202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:09.874702 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:09.875159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:09.875867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:09.876337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:09.876782 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:10.015673 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:10.023712 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d59c294a-c297-4470-b870-2563ec06eb9d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1691 microversion: 2.1 time: 0.163065 Oct 18 17:38:10.024293 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4143/8248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:09 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:11.047872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:11.048743 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:11.057569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:11.058132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:11.058588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:11.059418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:11.060039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:11.060484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:11.198920 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:11.207177 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-135d2f01-4666-41c2-ac58-cb4621cb0d4d tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1674 microversion: 2.1 time: 0.163255 Oct 18 17:38:11.207863 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4106/8249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:11 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:12.302895 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:12.305758 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:12.312955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.313503 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.313955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.314666 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.315134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.315569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.378625 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d1b82a63-7400-4be5-981c-d4794db73d50 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action" status: 200 len: 38453 microversion: 2.1 time: 0.079407 Oct 18 17:38:12.379574 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4144/8250] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:38:12 2022] POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action => generated 38453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:38:12.391860 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:12.392686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:12.400077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.400563 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.401259 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.401970 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.402427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.402854 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.475507 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a8c3fce1-dc6b-4f74-bdb6-e8aca4ab580b tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action" status: 202 len: 0 microversion: 2.1 time: 0.087347 Oct 18 17:38:12.476284 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4107/8251] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:38:12 2022] POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:38:12.485718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:12.486494 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:12.495722 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.496215 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.496670 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.497434 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:12.497913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:12.498512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:12.650617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:12.664089 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c6cefcfe-1a8a-4bb5-9571-03f35483d288 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1680 microversion: 2.1 time: 0.182384 Oct 18 17:38:12.664966 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4145/8252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:12 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:13.696164 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:13.696875 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:13.703979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:13.704471 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:13.704916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:13.705673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:13.706135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:13.706565 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:13.843847 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:13.852166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2c0cf1df-fc37-4d2a-a4c3-bdd9e4da21a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1680 microversion: 2.1 time: 0.160374 Oct 18 17:38:13.852751 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4108/8253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:13 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:14.875656 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:14.876348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:14.884202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:14.884701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:14.885185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:14.885896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:14.886395 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:14.886839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:15.019924 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:15.028132 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-12b02833-6e5b-4c3d-b1d3-2949272153be tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1683 microversion: 2.1 time: 0.156405 Oct 18 17:38:15.028708 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4146/8254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:14 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:15.463695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:15.465937 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:15.472718 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:15.473322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:15.473764 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:15.474459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:15.474909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:15.475332 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:15.543198 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-13b76963-f693-4cf7-9a62-683cf2e16205 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action" status: 200 len: 38453 microversion: 2.1 time: 0.083372 Oct 18 17:38:15.543862 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4109/8255] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:38:15 2022] POST /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199/action => generated 38453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 17:38:16.539845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6d0a32-81f2-4d48-a67f-8519c788a199", "tag": "78c61d79-7021-4875-a555-34e708cdbfcf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:16.542321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:16.543796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:16.551192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:16.551500 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:16.551727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:16.551915 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:16.552556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:16.553134 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:16.553568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:16.554687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:16.555158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:16.570489 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] Creating event network-changed:78c61d79-7021-4875-a555-34e708cdbfcf for instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 on n-h1-858383-14 Oct 18 17:38:16.576223 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-675fd71b-d12f-4bcf-aa1f-ef714dcf7618 req-2f0b2f70-4bba-4db8-beca-dd156ccf9f47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041461 Oct 18 17:38:16.576850 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4110/8256] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:38:16.583016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:38:16.676917 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f41765a5-46fb-4651-af6a-d335309eb350 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 204 len: 0 microversion: 2.1 time: 0.144214 Oct 18 17:38:16.677816 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4147/8257] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:38:16 2022] DELETE /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:38:16.688634 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:16.689481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:16.696141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:16.696627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:16.697086 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:16.697784 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:16.698237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:16.698658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:16.880290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:16.889427 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-685d2634-287a-4b05-9328-265d8dd95971 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1689 microversion: 2.1 time: 0.206028 Oct 18 17:38:16.889929 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4111/8258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:16 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:17.916795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:17.917542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:17.924543 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:17.925101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:17.925581 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:17.926294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:17.926764 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:17.927205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:18.064946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:18.073509 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d13a21b3-8f58-4a7b-ae44-c562079b4609 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1689 microversion: 2.1 time: 0.161862 Oct 18 17:38:18.074085 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4148/8259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:17 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:19.097447 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:19.099010 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:19.107167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:19.107742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:19.108299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:19.109324 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:19.109888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:19.110552 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:19.172133 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6d0a32-81f2-4d48-a67f-8519c788a199", "name": "network-vif-deleted", "tag": "78c61d79-7021-4875-a555-34e708cdbfcf"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:19.183579 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e37568aa09403aaf54055f4defba46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583e593adb54b4da76722c3cb93d92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:19.184233 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:19.184724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:19.185222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:19.192743 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-55736513-0ae2-4223-9e7d-82edfcec37a0 tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 200 len: 1351 microversion: 2.1 time: 0.099005 Oct 18 17:38:19.193327 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4149/8260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:19 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:19.201316 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] Creating event network-vif-deleted:78c61d79-7021-4875-a555-34e708cdbfcf for instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 on n-h1-858383-14 Oct 18 17:38:19.207241 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-58d687c8-1d0d-48e8-8ef4-7205831225fb req-d7b72b42-a828-4c9c-88b5-1dc1accd2644 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131540 Oct 18 17:38:19.208292 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4112/8261] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:38:20.216935 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:20.217603 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] [instance: 3b6d0a32-81f2-4d48-a67f-8519c788a199] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:20.224454 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:20.224950 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:20.225429 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:20.226218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:20.226803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:20.227240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:20.240360 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] HTTP exception thrown: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Request method failure captured: Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 HTTP/1.1 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTuH5ClNRJpDMCjbfWnc2xQEKS9AWdhWi18cd8jQKMe3HEPf3PnN8hfM8XUUE_zTzKrKl8FIXITkRz91joaCCMsvYcZQ4JpBhtw78wNj1UjSAr0m_SZBfdkmd2FO11wHDXb2oAQghZr702o0Sgc0Xus9UL5cQznYnd13KHPQ6ztSSFLc Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b583e593adb54b4da76722c3cb93d92b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b583e593adb54b4da76722c3cb93d92b"}]}] Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: b583e593adb54b4da76722c3cb93d92b Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-616759966 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 80e37568aa09403aaf54055f4defba46 Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestNetworkAdvancedServerOps-616759966-project Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '3b6d0a32-81f2-4d48-a67f-8519c788a199'} Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:38:20.242743 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Returning 404 to user: Instance 3b6d0a32-81f2-4d48-a67f-8519c788a199 could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a249d079-57a6-45e8-9d22-7471b797991e tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199" status: 404 len: 111 microversion: 2.1 time: 0.031107 Oct 18 17:38:20.248240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4150/8262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:20 2022] GET /compute/v2.1/servers/3b6d0a32-81f2-4d48-a67f-8519c788a199 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:38:23.338918 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d79f2cce-7416-4339-b7a3-5212ab0cb43f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] Calling method '.version_select at 0x7f5fd652ec10>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:23.360612 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d79f2cce-7416-4339-b7a3-5212ab0cb43f tempest-TestNetworkAdvancedServerOps-616759966 tempest-TestNetworkAdvancedServerOps-616759966-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1616284083" status: 202 len: 0 microversion: 2.1 time: 0.026681 Oct 18 17:38:23.361248 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4113/8263] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 18 17:38:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1616284083 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:38:35.246546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:35.247409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:35.424457 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e910be06-979a-4f88-b854-efd53f98592b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'create', calling method: .version_select at 0x7f5fd159f310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1247821695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+t3E/8gILQ4NkZjM7VYjAhppNjW1IutE9Yw1ZFLJnLllSJYEF72lMMHBjqQQPkAVLldf5O9jxr6S/KaBsOOC7qG/crTGkjhvNEiwFNNRqtGw7+NGnktriDurC/9qfEYg=="}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:35.440004 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e910be06-979a-4f88-b854-efd53f98592b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:38:35.449940 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-e910be06-979a-4f88-b854-efd53f98592b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for user 81c0d4489f15472dbc1dd55e0f528f46 and project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'key_pairs'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:38:35.480074 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e910be06-979a-4f88-b854-efd53f98592b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.237326 Oct 18 17:38:35.481023 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4151/8264] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:38:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:38:36.499872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:36.500624 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:36.504724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-883992856", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1247821695", "security_groups": [{"name": "tempest-secgroup-smoke-26154673"}], "networks": [{"uuid": "119876b4-deae-4f0b-8a06-ca31ad202dd9"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:36.637330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] validate_networks() for [('119876b4-deae-4f0b-8a06-ca31ad202dd9', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:38:37.039926 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:38:37.040355 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:38:37.040865 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:38:37.041303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:38:37.041717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:38:37.050992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:37.051482 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:37.051922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:37.052647 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:37.053132 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:37.053599 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:37.073958 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:38:37.079842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for user 81c0d4489f15472dbc1dd55e0f528f46 and project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:38:37.093921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:38:37.096357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:38:37.144752 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7dde9d6f-a533-40c3-a8ec-c638ec48b520 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.646627 Oct 18 17:38:37.145659 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4114/8265] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:38:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:38:37.159030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-41ace739-2ebb-4016-81b2-6038bafc3625 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:37.159667 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-41ace739-2ebb-4016-81b2-6038bafc3625 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:37.227284 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-41ace739-2ebb-4016-81b2-6038bafc3625 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:37.234863 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-41ace739-2ebb-4016-81b2-6038bafc3625 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1246 microversion: 2.1 time: 0.080451 Oct 18 17:38:37.235547 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4152/8266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:37 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:38.267542 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:38.268813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:38.277876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:38.278636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:38.279286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:38.280183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:38.280821 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:38.281464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:38.368211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:38.377215 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51ca6889-ed24-4ed5-a0d5-a418568e7179 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1298 microversion: 2.1 time: 0.120378 Oct 18 17:38:38.378515 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4115/8267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:38 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:39.403448 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:39.404272 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:39.411827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:39.412407 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:39.413100 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:39.413976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:39.414526 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:39.415101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:39.674134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:39.682597 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e387bfcd-4e48-4790-bab5-4fed69523723 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.283792 Oct 18 17:38:39.683186 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4153/8268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:39 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:40.106698 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:40.121121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:40.121797 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:40.122097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:40.134946 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] Creating event network-changed:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:38:40.140210 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-275b051f-866b-4f9e-93d4-c7d26c91899e req-934a0b1c-3593-48d4-85b0-8260f997c7c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 Oct 18 17:38:40.140815 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4116/8269] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:38:40.707436 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:40.708188 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:40.715795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:40.716291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:40.716760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:40.717547 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:40.718017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:40.718450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:40.861247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:40.869862 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-470bed2f-95a3-48ba-b161-3e31ae661bd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.166332 Oct 18 17:38:40.870456 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4154/8270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:40 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:41.894062 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:41.894802 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:41.902170 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:41.902687 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:41.903188 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:41.903840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:41.904307 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:41.904742 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:42.039961 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:42.047698 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bb001984-45c1-41fd-ac33-c09a06b56512 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.158838 Oct 18 17:38:42.048274 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4117/8271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:41 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:43.071163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:43.071898 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:43.078923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:43.079519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:43.079988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:43.080711 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:43.081237 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:43.081690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:43.223280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:43.232024 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-58334dc1-a7f3-466e-8c3f-ba44c0560f74 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.165355 Oct 18 17:38:43.232639 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4155/8272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:43 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:44.255691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:44.256393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:44.263615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:44.264089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:44.264534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:44.265256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:44.265721 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:44.266153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:44.412872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:44.420739 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-74d10e4e-25cd-4b4e-a001-33a81a175a6a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.168993 Oct 18 17:38:44.421386 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4118/8273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:44 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:45.443626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:45.444911 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:45.451942 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:45.452380 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:45.452829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:45.453561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:45.454026 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:45.454461 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:45.589701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:45.597525 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f80b93be-f284-4480-b351-6b9506276c6c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.157781 Oct 18 17:38:45.598106 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4156/8274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:45 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:46.067363 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "name": "network-vif-plugged", "status": "completed", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:46.078331 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:46.078805 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:46.079232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:46.091853 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] Creating event network-vif-plugged:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:38:46.097029 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-6353e831-2b7b-4cca-b14f-df5df917f690 req-b7cd05b7-f714-455d-9147-57c4deb3a4ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Oct 18 17:38:46.097618 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4119/8275] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:38:46.620523 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:46.621173 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:46.628409 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:46.628905 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:46.629383 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:46.630107 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:46.630575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:46.631012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:46.773655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:46.783623 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c9c2b6e0-65df-4511-8731-4d05eb8fe91a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1370 microversion: 2.1 time: 0.167097 Oct 18 17:38:46.784203 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4157/8276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:46 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:38:47.804916 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:47.806639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:47.810799 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:47.811525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:47.818740 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:47.819219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:47.819656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:47.820407 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:47.820924 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:47.821326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:47.963494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:47.972815 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0de09127-261f-42de-9c8a-bd1ead00f0a2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1555 microversion: 2.1 time: 0.168967 Oct 18 17:38:47.973457 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4120/8277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:47 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:47.998387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:38:47.999202 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:38:48.001397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:48.008640 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:48.009705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:48.010218 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:48.010803 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:48.011345 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:48.011783 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:48.162039 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:38:48.172083 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e30426c6-91e5-40a4-857f-8220f545eb1d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1555 microversion: 2.1 time: 0.177734 Oct 18 17:38:48.172771 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4158/8278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:38:47 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:38:49.897397 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:38:49.908334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:38:49.908818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:38:49.909280 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:38:49.921276 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] Creating event network-changed:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:38:49.926377 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-5c39bf6e-9689-47e1-88bc-63321a741c6c req-d8bd703f-57a3-4312-8f07-1fe9568ee817 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032639 Oct 18 17:38:49.926987 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4121/8279] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:41:15.830343 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:41:15.831507 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:41:15.832034 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:15.832848 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=36 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:15.833919 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:41:15.834068 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action (ip 10.222.0.78) !!! Oct 18 17:41:15.836017 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:41:15.836161 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action (ip 10.222.0.78) !!! Oct 18 17:41:15.847762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:41:15.848308 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:15.857012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:15.857512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:15.857962 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:15.858674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:15.859138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:15.859571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:15.884048 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lazy-loading 'flavor' on Instance uuid 11c6218c-1dec-44e7-9b96-c2a0558f965b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:41:16.258554 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a63acefa-ff04-4a20-8729-f90dfb028e28 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action" status: 202 len: 0 microversion: 2.1 time: 0.429914 Oct 18 17:41:16.259176 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4159/8280] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:41:15 2022] POST /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:41:16.265580 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:41:16.266400 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:41:16.267008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:16.267752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=32 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:16.269233 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:41:16.269391 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b (ip 10.222.0.78) !!! Oct 18 17:41:16.270734 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:41:16.270734 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b (ip 10.222.0.78) !!! Oct 18 17:41:16.271871 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:41:16.272000 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b (ip 10.222.0.78) !!! Oct 18 17:41:16.278792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:16.279561 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:16.292396 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:16.293406 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:16.294049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:16.295534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:16.295534 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:16.295782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:16.490145 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:16.498315 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9c4bba11-9fa8-402b-9b68-f8b166f77465 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.234571 Oct 18 17:41:16.498896 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4122/8281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:16 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:17.525297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:17.526086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:17.538894 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57294. Oct 18 17:41:17.543024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:17.543540 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:17.544001 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:17.544719 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:17.545228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:17.545714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:17.552310 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57296. Oct 18 17:41:17.760005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:17.767987 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c68a7ce1-1586-4358-9a1f-2d1cc597028a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.249808 Oct 18 17:41:17.768612 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4160/8282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:17 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:18.792266 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:18.792894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:18.801494 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:18.801982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:18.802421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:18.803112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:18.803575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:18.804004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:18.811669 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57302. Oct 18 17:41:18.822011 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57300. Oct 18 17:41:18.943695 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:18.952298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-76571c8d-3092-4b41-9dcd-39ff238986f5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.164240 Oct 18 17:41:18.952872 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4123/8283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:18 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:19.975984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:19.976614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:19.983684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:19.984186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:19.984644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:19.985397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:19.985876 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:19.986484 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:20.125631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:20.133736 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-85180b65-b12a-454d-8701-a5affede7c2c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.161709 Oct 18 17:41:20.134317 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4161/8284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:19 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:21.158077 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:21.158672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:21.165448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:21.165928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:21.166948 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:21.167636 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:21.168082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:21.168505 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:21.301193 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:21.308919 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-93024e65-5d12-498f-a8a4-bc4352930f65 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.154695 Oct 18 17:41:21.309512 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4124/8285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:21 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:22.333437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:22.334064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:22.341588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:22.342088 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:22.342536 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:22.343255 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:22.343724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:22.344158 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:22.483947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:22.492056 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bfa904f2-8888-4fef-8c3b-46a3b014c194 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.162478 Oct 18 17:41:22.492644 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4162/8286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:22 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:41:23.515728 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:23.516348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:23.523222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:23.523712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:23.524153 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:23.524842 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:23.525340 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:23.525950 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:23.665677 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:23.675250 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3d03e65-21cc-42c5-8eef-3d703bba1892 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.163431 Oct 18 17:41:23.675846 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4125/8287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:23 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:24.699913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:24.700542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:24.707546 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:24.708040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:24.708492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:24.709219 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:24.709685 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:24.710121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:24.840714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:24.848601 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d434e067-ec79-4ec2-90c0-397baf4916d4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.153230 Oct 18 17:41:24.849214 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4163/8288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:24 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:25.873150 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:25.873772 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:25.880643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:25.881172 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:25.881623 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:25.882318 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:25.882779 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:25.883211 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:26.019712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:26.027556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5044fd8b-e935-4276-8241-40dae96e7a1b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.159451 Oct 18 17:41:26.028379 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4126/8289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:25 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:27.051431 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:27.052040 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:27.059827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:27.060351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:27.060801 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:27.061524 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:27.061992 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:27.062430 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:27.198630 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:27.206427 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-63e3a749-d8be-4e5a-82bf-881ba39f98be tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.158835 Oct 18 17:41:27.207013 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4164/8290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:27 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:28.230190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:28.230766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:28.237896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:28.238387 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:28.238825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:28.239519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:28.239977 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:28.240402 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:28.375195 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:28.383000 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-7544f72a-a69c-4a3e-9d34-22d32566e683 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1701 microversion: 2.1 time: 0.156859 Oct 18 17:41:28.383577 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4127/8291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:28 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:29.408449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:29.409121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:29.415993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:29.417129 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:29.417589 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:29.418307 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:29.418777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:29.419222 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:29.558314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:29.566209 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1365dcdf-3c93-437a-a127-d30e363f22ab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1701 microversion: 2.1 time: 0.161656 Oct 18 17:41:29.566789 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4165/8292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:29 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:30.589833 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:30.590398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:30.598149 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:30.598646 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:30.599091 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:30.599791 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:30.600251 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:30.600682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:30.737464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:30.746039 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51d0ccdd-794e-4472-8e24-ec599e04940b tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1701 microversion: 2.1 time: 0.160154 Oct 18 17:41:30.746626 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4128/8293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:30 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:30.842983 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "name": "network-vif-plugged", "status": "completed", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:41:30.854127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:30.854627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:30.855077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:30.866432 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] Creating event network-vif-plugged:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:41:30.872976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9dd5940a-4559-400b-8b2c-d9acb5da33ab req-a432ef61-0f87-4fab-8342-02e196aaff9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Oct 18 17:41:30.873929 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4166/8294] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:41:31.770696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:31.771401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:31.779245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:31.779727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:31.780163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:31.780851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:31.781335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:31.781758 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:31.919398 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:31.927504 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c90f012-3732-479f-9c5f-b2c1f4e6f031 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1701 microversion: 2.1 time: 0.160735 Oct 18 17:41:31.928086 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4129/8295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:31 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:32.957826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:32.959194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:32.970283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:32.970799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:32.971257 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:32.971988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:32.972464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:32.972915 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:33.140370 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:33.153286 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-00e8c9d5-836e-49bd-9289-bdfe2cff2895 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.199800 Oct 18 17:41:33.153892 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4167/8296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:32 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:34.178703 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:34.179464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:34.189127 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:34.190455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:34.191717 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:34.192665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:34.193382 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:34.193881 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:34.370909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:34.383288 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-fae8ad22-f235-4d0d-857b-bf294f8c1f9e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.207951 Oct 18 17:41:34.384402 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4130/8297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:34 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:41:35.411364 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:35.411990 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:35.421398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:35.422113 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:35.422920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:35.423817 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:35.424298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:35.424737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:35.574994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:35.583163 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9270fb62-c981-4a81-a2bf-3197baa02510 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.175648 Oct 18 17:41:35.583748 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4168/8298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:35 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:36.611295 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:36.612724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:36.621067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:36.621686 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:36.622229 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:36.623005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:36.623553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:36.624179 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:36.794003 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:36.802003 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-98fe8f83-f80c-4f3a-b331-2d0dc8b48fab tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.195105 Oct 18 17:41:36.817057 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4131/8299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:36 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:37.827753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:37.828493 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:37.838809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:37.839522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:37.839988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:37.840729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:37.841251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:37.841699 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:38.014532 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:38.024721 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3737cc8f-0d79-460c-bc2a-b9320272b4d5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.200552 Oct 18 17:41:38.026898 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4169/8300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:37 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:41:39.050882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:39.051440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:39.059347 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:39.059944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:39.060569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:39.061517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:39.062296 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:39.062766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:39.234087 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:39.252419 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dd5b63ac-48c6-4434-8bb0-46e6c06dc2a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.205642 Oct 18 17:41:39.253042 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4132/8301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:39 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:40.276809 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:40.279883 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:40.288512 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:40.289416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:40.290140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:40.291240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:40.292102 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:40.292784 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:40.454558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:40.464342 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b96a17b6-21a4-455f-8371-a59b2ad5f7db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.190373 Oct 18 17:41:40.464342 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4170/8302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:40 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:41.489265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:41.490007 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:41.497812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:41.498309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:41.498834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:41.499643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:41.500169 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:41.500654 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:41.642890 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:41.650885 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d792777d-a83a-4680-bbcd-3ada6f31ce62 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1696 microversion: 2.1 time: 0.166448 Oct 18 17:41:41.651609 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4133/8303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:41 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:42.677164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:42.677797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:42.685828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:42.686605 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:42.687064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:42.687787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:42.688251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:42.688687 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:42.905521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:42.913871 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0eff7c0c-e969-475c-98a3-ad98067b698a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1678 microversion: 2.1 time: 0.241309 Oct 18 17:41:42.914673 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4171/8304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:42 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:43.939189 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:43.939919 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:43.946814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:43.947299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:43.947735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:43.948591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:43.949168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:43.949620 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:44.093093 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:44.100939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a08dccee-f72c-4bc0-b713-690d938b8d40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1678 microversion: 2.1 time: 0.166293 Oct 18 17:41:44.101588 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4134/8305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:43 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:44.887195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "name": "network-vif-unplugged", "status": "completed", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:41:44.898118 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:44.898847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:44.899299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:44.912325 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] Creating event network-vif-unplugged:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:41:44.919580 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-78216c88-1af2-4be2-8889-e5e2004292b0 req-ff80f464-290c-46e4-8e47-173e36cd19fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035982 Oct 18 17:41:44.920154 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4172/8306] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:41:45.125769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:45.126376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:45.133240 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.133706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.134142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.134825 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.135279 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.135732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.280299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:45.288561 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-26bd0229-4053-413c-abf7-92d5f78fc9a5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1681 microversion: 2.1 time: 0.166626 Oct 18 17:41:45.289169 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4135/8307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:45 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:41:45.314759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:41:45.315459 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:45.322136 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.322632 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.323352 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.324234 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.324716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.325225 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.414230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 17:41:45.469122 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:45.485550 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7458e02e-27d0-494d-9464-24facf546fd0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action" status: 202 len: 0 microversion: 2.1 time: 0.175113 Oct 18 17:41:45.486177 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4173/8308] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:41:45 2022] POST /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:41:45.494560 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:45.495430 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:45.501871 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.502359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.502798 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.503536 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:45.504141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:45.504567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:45.646737 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:45.655511 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a725b036-9336-423a-9cfd-cdd7e9777f44 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1629 microversion: 2.1 time: 0.165073 Oct 18 17:41:45.656411 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4136/8309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:45 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1629 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:41:46.682027 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:46.683385 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:46.685361 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:46.691508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:46.692012 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:46.692595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:46.693392 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:46.693866 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:46.694303 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:46.837623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:46.847851 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0471864a-6c3c-4e27-88d9-b49c99809ad6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.171339 Oct 18 17:41:46.848443 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4174/8310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:46 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:47.878826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:47.879975 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:47.889547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=31 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:47.891183 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:47.891708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:47.892298 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:47.893204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:47.893922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:47.894610 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:47.898838 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=91 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:48.130696 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:48.140165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e0d357cd-9236-4e87-952f-86ad7c80a290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.268296 Oct 18 17:41:48.141101 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4137/8311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:47 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:49.170994 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:49.172414 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:49.179678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:49.180274 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:49.180839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:49.181716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:49.182217 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:49.182831 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:49.342175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:49.352363 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3de93d50-9c02-4a16-9763-955d9fdc021d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.186253 Oct 18 17:41:49.353656 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4175/8312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:49 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:50.377956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:50.378738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:50.387421 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:50.388106 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:50.388670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:50.390078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:50.390749 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:50.391519 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:50.551529 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:50.560803 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a36cfd7f-5800-45e0-9a70-d8a3f7728e26 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.187759 Oct 18 17:41:50.561403 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4138/8313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:50 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:51.586029 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:51.586682 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:51.594529 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:51.595075 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:51.595521 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:51.596226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:51.596692 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:51.597166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:51.754707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:51.761672 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-88987828-0eea-404b-8c49-c3649657a3e5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.179306 Oct 18 17:41:51.773804 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4176/8314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:51 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:52.788378 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:52.789942 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:52.797284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:52.797782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:52.798365 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:52.799267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:52.799730 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:52.800157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:52.947370 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:52.956168 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-54b4e3d1-5e93-422c-92fa-6713a842626a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.172106 Oct 18 17:41:52.956746 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4139/8315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:52 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:53.980480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:53.981227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:53.988163 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:53.988662 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:53.989141 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:53.989854 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:53.990527 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:53.990968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:54.161449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:54.176815 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d976120-7aa8-45ce-8467-bf7db1141021 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.200559 Oct 18 17:41:54.177563 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4177/8316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:53 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:55.200818 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:55.201456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:55.208208 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:55.208693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:55.209173 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:55.209872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:55.210335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:55.210766 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:55.355484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:55.363517 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1f80f377-61c1-4ea6-bfb1-f55fb57de7bd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.167668 Oct 18 17:41:55.364099 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4140/8317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:55 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:56.388839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:56.389465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:56.396340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:56.396833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:56.397314 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:56.398021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:56.398489 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:56.401371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:56.535882 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:56.544203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c7eca90e-db4f-4cb6-9dcc-5231001ccffa tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.159943 Oct 18 17:41:56.544773 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4178/8318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:56 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:57.567823 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:57.568439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:57.575516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:57.575992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:57.576425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:57.577141 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:57.577591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:57.578008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:57.716113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:57.723907 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8ad34930-d092-4276-ac83-c69c58194a49 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.160037 Oct 18 17:41:57.724480 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4141/8319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:57 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:58.747519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:58.748142 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:58.755294 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:58.755795 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:58.756249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:58.756957 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:58.757455 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:58.757899 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:58.904186 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:41:58.912544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4275bb7b-6814-4b41-884b-701ba88a1923 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.169053 Oct 18 17:41:58.913173 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4179/8320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:58 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:41:59.936547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:41:59.936952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:41:59.943850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:59.944345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:59.944762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:41:59.945485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:41:59.945938 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:41:59.946366 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:00.085024 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:00.093279 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-72ea9bc5-5d63-4d3f-87f5-2fc5d0a759e2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.161391 Oct 18 17:42:00.093918 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4142/8321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:41:59 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:01.118060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:01.118693 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:01.126299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:01.126799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:01.127251 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:01.127961 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:01.128425 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:01.128870 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:01.273099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:01.281976 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e591e3f3-9f24-4ca2-9733-6ce5e7eeb6b9 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.167875 Oct 18 17:42:01.282562 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4180/8322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:01 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:02.305754 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:02.306356 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:02.314180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:02.314665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:02.315137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:02.315832 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:02.316289 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:02.316720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:02.452305 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:02.460225 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ac025784-cd7b-4f5c-ab4e-1631abf63769 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.158389 Oct 18 17:42:02.460803 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4143/8323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:02 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:03.484017 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:03.484573 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:03.491541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:03.492046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:03.492507 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:03.493246 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:03.493730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:03.494671 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:03.630698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:03.639195 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-df9a3463-f533-46b1-a8d4-f6b6ea0d6ebb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.159257 Oct 18 17:42:03.639820 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4181/8324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:03 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:04.663380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:04.663982 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:04.671682 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:04.672168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:04.672606 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:04.673320 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:04.673780 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:04.674204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:04.816708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:04.825115 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-36390068-015e-4a46-a1dc-b4f1a60a55b3 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.165590 Oct 18 17:42:04.825717 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4144/8325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:04 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:05.160674 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "name": "network-vif-plugged", "status": "completed", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:42:05.170922 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:05.171420 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:05.171872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:05.183873 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] Creating event network-vif-plugged:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:42:05.189544 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-0d042cc7-98ae-498f-932c-05d2f427f2f1 req-f9525854-9e6a-445f-be48-7b2cd5451933 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094520 Oct 18 17:42:05.190159 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4182/8326] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:42:05.850025 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:05.850618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:05.858281 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:05.858769 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:05.859383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:05.860308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:05.860786 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:05.860971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:06.331901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:06.340365 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-211f7d38-2efe-41a4-a64b-a67070f4b50f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.494339 Oct 18 17:42:06.340941 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4145/8327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:05 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:07.366889 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:07.367621 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:07.374930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:07.375438 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:07.375968 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:07.376985 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:07.377495 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:07.377947 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:07.516172 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:07.524022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4c221ac-6783-4b9a-8fbe-62b2dc4b3972 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1687 microversion: 2.1 time: 0.162435 Oct 18 17:42:07.524611 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4183/8328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:07 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:42:08.548350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:42:08.548969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:42:08.555896 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:08.556375 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:08.556815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:08.558085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:42:08.558547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:42:08.558979 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:42:08.693199 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:42:08.701923 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-104419f3-c305-42fa-aef6-3e9d5d2674db tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1674 microversion: 2.1 time: 0.157547 Oct 18 17:42:08.702521 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4146/8329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:42:08 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:43:45.709863 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=19 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:45.711253 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=56 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:45.712209 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=19 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:45.712626 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:43:45.712626 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:43:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b (ip 10.222.0.78) !!! Oct 18 17:43:45.715317 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=59 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:45.719778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:45.720401 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:43:45.747091 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:45.747618 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:45.748799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:45.749828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:45.750318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:45.750761 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:45.782450 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:43:45.805184 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:43:45.816004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:45.816503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:45.816945 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:45.831982 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] Creating event network-changed:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:43:45.838378 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-b172e199-a80d-40e0-9c78-a71dae29e3af req-118f9796-6062-4e94-bacd-84d2f8f86e96 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128143 Oct 18 17:43:45.839464 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4147/8330] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:43:45.873351 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-23d37d26-d320-42fb-ac04-1862e79523b5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "DELETE /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 204 len: 0 microversion: 2.1 time: 0.164443 Oct 18 17:43:45.874295 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4184/8331] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:43:45 2022] DELETE /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:43:45.884082 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:45.885163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:43:45.893126 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:45.893921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:45.894557 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:45.895345 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:45.895811 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:45.896284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:46.054851 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:43:46.064166 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bc4fc34e-bdb1-4f3a-9992-0a85d72bce58 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.184933 Oct 18 17:43:46.064842 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4148/8332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:43:45 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:43:47.089545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:47.090276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:43:47.098296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:47.098811 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:47.099270 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:47.100127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:47.100669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:47.101175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:47.280626 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:43:47.288894 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ac566a65-9873-40b3-87f3-97c28fef73fb tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1680 microversion: 2.1 time: 0.203956 Oct 18 17:43:47.289510 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4185/8333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:43:47 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:43:48.314657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:48.315308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:43:48.322706 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:48.323177 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:48.323649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:48.324364 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:48.324848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:48.325997 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:48.396643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:43:48.408632 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ba6711a3-7f6e-4702-bda3-b09f4ee76e40 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 200 len: 1495 microversion: 2.1 time: 0.099041 Oct 18 17:43:48.409365 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4149/8334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:43:48 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 1495 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:43:48.519194 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c6218c-1dec-44e7-9b96-c2a0558f965b", "name": "network-vif-deleted", "tag": "ab466ac9-353c-4b02-8bab-ed9cc4d6842f"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:43:48.531082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:48.531588 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:48.532074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:48.544787 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] Creating event network-vif-deleted:ab466ac9-353c-4b02-8bab-ed9cc4d6842f for instance 11c6218c-1dec-44e7-9b96-c2a0558f965b on n-h1-858383-14 Oct 18 17:43:48.558408 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-a37a2d56-1588-4876-ba65-cc6bed6b07ff req-5517b1a5-0c41-4a2c-a1bf-dcea82daa17d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Oct 18 17:43:48.558850 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4186/8335] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:43:49.433373 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:49.434014 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 11c6218c-1dec-44e7-9b96-c2a0558f965b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:43:49.440665 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:49.441180 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:49.441618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:49.442304 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:43:49.442760 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:43:49.443190 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:43:49.457298 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] HTTP exception thrown: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Request method failure captured: Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b HTTP/1.1 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTuSVz8ymIXHOeUHP1hVxtUNmqYI5yOzrWroIWCw8Aecn9PvaR3ZjioaCOl7cnG61biwFVy2Hr0UPAPg5doeI7F2H0TbbXdBdMiEwQYKookTrNJkLIugnORghtWaI5EkbyA7kC-blj_tHxpE4OJ7WupKpVIUeHWi6-q4gkXSu4vy5gjc Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: dc6222a154d3498ea4bcb82b8ac622df Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestShelveInstance-139156370 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dc6222a154d3498ea4bcb82b8ac622df"}]}] Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestShelveInstance-139156370 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: dc6222a154d3498ea4bcb82b8ac622df Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestShelveInstance-139156370 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestShelveInstance-139156370-project Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 81c0d4489f15472dbc1dd55e0f528f46 Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestShelveInstance-139156370-project Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '11c6218c-1dec-44e7-9b96-c2a0558f965b'} Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:43:49.458952 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Returning 404 to user: Instance 11c6218c-1dec-44e7-9b96-c2a0558f965b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-4d44a454-c8f3-4af8-9e74-83fe68d89604 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b" status: 404 len: 111 microversion: 2.1 time: 0.031234 Oct 18 17:43:49.465008 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4150/8336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:43:49 2022] GET /compute/v2.1/servers/11c6218c-1dec-44e7-9b96-c2a0558f965b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:43:49.632402 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-ebf73956-d6df-498f-b5dc-32adbc13df21 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '.version_select at 0x7f5fd15c4700>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:43:49.658421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-ebf73956-d6df-498f-b5dc-32adbc13df21 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1247821695" status: 202 len: 0 microversion: 2.1 time: 0.031189 Oct 18 17:43:49.659273 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4187/8337] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 17:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1247821695 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:43:49.681837 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-71ae5a44-3756-4828-bd3d-cf7106fdfa84 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'create', calling method: .version_select at 0x7f5fd0d5eee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-969465457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADTm3MJ/bpHB7eKxrtYltCskhKrDiMvt0/WmEfbXVuzGQUDHlNJh+86+j0wyC/Wa5QyBS9TV/RonwplPUodcmJi/aayp7+uz+zdmGia4DItIW/eH+Ad+eiMtBZzlF1rrA=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:43:49.699437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-71ae5a44-3756-4828-bd3d-cf7106fdfa84 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:43:49.705372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-71ae5a44-3756-4828-bd3d-cf7106fdfa84 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for user 81c0d4489f15472dbc1dd55e0f528f46 and project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:43:49.732762 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-71ae5a44-3756-4828-bd3d-cf7106fdfa84 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054898 Oct 18 17:43:49.733408 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4151/8338] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:43:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:44:07.077058 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1408678029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-969465457", "security_groups": [{"name": "tempest-secgroup-smoke-2119870589"}], "networks": [{"uuid": "119876b4-deae-4f0b-8a06-ca31ad202dd9"}], "block_device_mapping_v2": [{"uuid": "14c42a18-d711-4037-8542-f23825281b2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:44:07.089403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.090065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.198551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] validate_networks() for [('119876b4-deae-4f0b-8a06-ca31ad202dd9', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:44:07.595391 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:44:07.595839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:44:07.596338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:44:07.596773 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:44:07.597239 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:44:07.607176 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:07.607694 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:07.608151 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:07.609093 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:07.609705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:07.610159 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:07.628597 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:44:07.634099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Getting quotas for user 81c0d4489f15472dbc1dd55e0f528f46 and project dc6222a154d3498ea4bcb82b8ac622df. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:44:07.693749 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:44:07.695999 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14c42a18-d711-4037-8542-f23825281b2e',volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:44:07.827095 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5f04effa-1c73-4734-b92c-ff11613474f4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753952 Oct 18 17:44:07.828649 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4188/8339] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:44:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:44:07.840028 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-bd8be0f5-e250-4200-af26-21e9e8ebb283 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:07.840639 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-bd8be0f5-e250-4200-af26-21e9e8ebb283 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:07.847330 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=16 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.848033 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=4 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.849466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.904727 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-bd8be0f5-e250-4200-af26-21e9e8ebb283 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:07.911786 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-bd8be0f5-e250-4200-af26-21e9e8ebb283 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1088 microversion: 2.1 time: 0.075697 Oct 18 17:44:07.912374 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4152/8340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:07 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:08.937377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:08.938070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:08.947397 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:08.948125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:08.948762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:08.949658 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:08.950135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:08.951625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:09.050161 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:09.058428 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4307e4d8-34f0-40e8-8fdb-c4ccba626ce0 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1194 microversion: 2.1 time: 0.127116 Oct 18 17:44:09.059414 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4189/8341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:08 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:10.083168 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:10.084436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:10.091058 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:10.091553 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:10.091994 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:10.092693 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:10.094085 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:10.094683 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:10.253586 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:10.263160 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-77c99e1b-a838-4f8a-8902-dd9a0e048711 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1272 microversion: 2.1 time: 0.184024 Oct 18 17:44:10.278565 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4153/8342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:10 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:10.524279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:44:10.540072 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:10.540575 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:10.541053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:10.561526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] Creating event network-changed:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:44:10.570103 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-5fe94519-c26c-4385-97f4-6c3522b25dca req-44994f33-38af-470b-bdac-8cd581498f12 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055795 Oct 18 17:44:10.571510 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4190/8343] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:44:11.289022 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:11.289940 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:11.298566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:11.299433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:11.300257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:11.301220 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:11.301891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:11.302526 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:11.475679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:11.485169 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e43484c3-3615-4db8-bec7-281bd921b290 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1272 microversion: 2.1 time: 0.200062 Oct 18 17:44:11.486426 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4154/8344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:11 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:12.510988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:12.511713 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:12.518684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:12.519192 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:12.519648 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:12.520357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:12.520829 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:12.521305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:12.665918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:12.673933 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d154339f-cb80-48ea-aa76-692201680148 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1272 microversion: 2.1 time: 0.168170 Oct 18 17:44:12.674526 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4191/8345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:12 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:13.697089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:13.697657 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:13.704724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:13.705245 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:13.705691 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:13.706400 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:13.706872 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:13.707303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:13.849146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:13.857462 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-270ad681-3db9-4600-a595-e871a1a857ce tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1272 microversion: 2.1 time: 0.164388 Oct 18 17:44:13.858056 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4155/8346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:13 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:44:14.879913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:14.880518 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:14.887541 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:14.888064 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:14.888508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:14.889244 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:14.890478 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:14.890926 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:15.024608 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:15.033203 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e4100b8a-b5c4-4822-b50b-f9b67bfadcad tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.157055 Oct 18 17:44:15.034166 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4192/8347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:14 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:16.056673 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:16.057313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:16.064836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:16.065350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:16.065795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:16.066490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:16.066954 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:16.067389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:16.202966 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:16.210810 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-dba0ab4e-0517-41a9-a055-726795a5f650 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.157866 Oct 18 17:44:16.211391 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4156/8348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:16 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:17.235120 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:17.235683 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:17.242584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:17.243082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:17.243520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:17.244230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:17.244697 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:17.245162 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:17.382143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:17.390229 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-625031fb-af42-4855-96eb-df24f6f92255 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.159604 Oct 18 17:44:17.390807 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4193/8349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:17 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:18.413643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:18.414277 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:18.417015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:18.422836 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:18.423325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:18.423914 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:18.424692 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:18.425247 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:18.425808 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:18.558060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:18.566556 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-0721f5f4-7cf2-4693-b921-51ff98c49263 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.156816 Oct 18 17:44:18.567129 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4157/8350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:18 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:19.588901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:19.589578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:19.591701 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:19.592398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:19.600724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:19.601267 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:19.601766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:19.602724 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:19.603376 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:19.604005 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:19.729380 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "name": "network-vif-plugged", "status": "completed", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:44:19.741348 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:19.741988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:19.742282 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:19.745627 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:19.755128 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-64b30828-ce6d-4e23-aabb-e8f731cc2b23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.170186 Oct 18 17:44:19.756150 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4194/8351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:19 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:19.757803 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] Creating event network-vif-plugged:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:44:19.771589 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-9754b761-1052-4c1a-ac30-c6138567af66 req-4141b385-11c8-4386-b3ef-f9f6b22fd5bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046473 Oct 18 17:44:19.772471 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4158/8352] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:44:20.780295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:20.780901 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:20.787827 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:20.788330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:20.788779 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:20.789522 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:20.789988 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:20.790424 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:20.923906 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:20.932022 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-345fbb55-c6c8-49e3-a645-2138c692f939 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1260 microversion: 2.1 time: 0.155910 Oct 18 17:44:20.932634 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4195/8353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:20 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:21.957850 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:21.958574 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:21.964888 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:21.965418 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:21.965853 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:21.966530 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:21.966983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:21.967405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:22.103113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:22.110995 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-762f19e1-4f21-45d1-83ff-a558ce632969 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1444 microversion: 2.1 time: 0.158948 Oct 18 17:44:22.111586 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4159/8354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:21 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:22.133726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:44:22.134355 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:44:22.141793 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:22.142291 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:22.142744 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:22.143446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:22.143916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:22.144357 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:22.274092 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:44:22.282336 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-e1114c71-523e-4e1d-b507-eef6a78caa30 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1444 microversion: 2.1 time: 0.152608 Oct 18 17:44:22.282918 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4196/8355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:44:22 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:44:23.915998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:44:23.926615 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:44:23.927221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:44:23.927625 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:44:23.939948 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] Creating event network-changed:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:44:23.945170 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-3899c2fe-4bfe-4136-bec4-dfa62f8e405e req-c8ac45d1-d092-4ef1-a3eb-ae50e2f3d5fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Oct 18 17:44:23.945853 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4160/8356] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:46:19.128898 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:46:19.129857 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:46:19.130516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:19.131269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=46 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:19.132571 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:46:19.132717 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action (ip 10.222.0.78) !!! Oct 18 17:46:19.134064 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:46:19.134341 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action (ip 10.222.0.78) !!! Oct 18 17:46:19.140480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:46:19.141053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:19.152892 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:19.153413 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:19.153860 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:19.154561 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:19.155282 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:19.155715 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:19.181582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lazy-loading 'flavor' on Instance uuid 21df0a3c-57c5-4875-a924-1238b62eac6b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:46:19.256869 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-c157bbc0-6289-4fdb-b267-2f27af36336c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action" status: 202 len: 0 microversion: 2.1 time: 0.129747 Oct 18 17:46:19.258033 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4197/8357] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:46:19 2022] POST /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:46:19.264424 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:46:19.265323 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:46:19.265923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=20 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:19.266724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=40 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:19.267615 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:46:19.267748 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b (ip 10.222.0.78) !!! Oct 18 17:46:19.269345 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:46:19.269508 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b (ip 10.222.0.78) !!! Oct 18 17:46:19.275701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:19.276428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:19.288146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:19.289284 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:19.289732 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:19.290437 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:19.290895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:19.291325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:19.509061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:19.516870 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-b21add60-2a9a-4707-8f5b-bc74f58d3a2a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.254430 Oct 18 17:46:19.517473 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4161/8358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:19 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:20.543488 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:20.544212 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:20.552330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:20.552825 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:20.553319 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:20.554437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:20.554888 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:20.555337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:20.560179 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57858. Oct 18 17:46:20.563565 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57856. Oct 18 17:46:20.751019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:20.758962 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8e4a354e-0933-4037-8867-1e01a86c0557 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.221671 Oct 18 17:46:20.759527 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4198/8359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:20 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:21.782589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:21.783314 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:21.792075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:21.792570 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:21.793039 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:21.793752 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:21.794210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:21.794642 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:21.802298 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57870. Oct 18 17:46:21.813078 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57868. Oct 18 17:46:21.928723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:21.937397 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f1f736d3-f404-463f-acc6-0db74180aba7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.158942 Oct 18 17:46:21.937986 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4162/8360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:21 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:22.962227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:22.964028 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:22.970331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:22.970828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:22.971277 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:22.971987 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:22.972452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:22.972891 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:23.108322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:23.116187 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-dc09a9da-38f4-4e5a-bae8-d2f7cd651cc6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.158936 Oct 18 17:46:23.117297 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4199/8361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:22 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:24.141120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:24.141746 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:24.149354 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:24.149846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:24.150290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:24.150988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:24.151448 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:24.151879 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:24.287379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:24.295319 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1eac6a6f-58ed-42f9-97ec-e2736541fdd7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.158214 Oct 18 17:46:24.295903 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4163/8362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:24 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:25.319332 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:25.320016 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:25.327116 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:25.327613 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:25.328065 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:25.328770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:25.329268 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:25.329707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:25.466049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:25.473926 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-bade78ed-edef-4777-a848-f7ce60e41bb1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.158608 Oct 18 17:46:25.474500 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4200/8363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:25 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:26.499015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:26.499659 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:26.506465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:26.507485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:26.507939 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:26.508661 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:26.509154 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:26.509585 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:26.642795 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:26.650971 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-540bbca9-56d0-435e-9c6a-a77b8150547a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.155889 Oct 18 17:46:26.651538 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4164/8364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:26 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:27.675445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:27.676074 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:27.683623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:27.684121 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:27.684574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:27.685313 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:27.685788 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:27.686228 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:27.823283 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:27.831278 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0e641fdd-7306-4fe1-a185-ca4f0fbd6089 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.159776 Oct 18 17:46:27.831858 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4201/8365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:27 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:28.855264 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:28.855895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:28.862956 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:28.863436 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:28.864000 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:28.864812 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:28.865299 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:28.865724 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:29.006262 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:29.015442 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c84f1e1d-c077-4353-9a6e-49281de003b8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.164337 Oct 18 17:46:29.016030 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4165/8366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:28 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:30.038816 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:30.040177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:30.047135 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:30.047634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:30.048084 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:30.048920 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:30.049416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:30.049852 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:30.183249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:30.191028 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4bfbf8ce-1ec0-413a-99e4-1e46c4e25667 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.156349 Oct 18 17:46:30.191548 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4202/8367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:30 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:31.215856 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:31.216425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:31.223322 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:31.223806 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:31.224237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:31.224917 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:31.225393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:31.225815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:31.362381 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:31.370404 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-addca19d-937a-40b0-8cb4-7b29df8bbb2e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.159086 Oct 18 17:46:31.370982 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4166/8368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:31 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:46:32.394057 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:32.394705 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:32.402676 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:32.403195 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:32.403655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:32.404389 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:32.404890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:32.405617 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:32.554578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:32.563514 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4cf7ff60-6c01-4fa2-a654-89c08789db5a tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.173375 Oct 18 17:46:32.564117 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4203/8369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:32 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:33.587633 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:33.588267 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:33.595388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.595894 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.596503 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:33.597232 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.597709 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.598210 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:33.730490 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:33.738552 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f3a91bd1-78a2-4b4f-8edf-d747ec83c543 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1570 microversion: 2.1 time: 0.155013 Oct 18 17:46:33.739138 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4167/8370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:33 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:33.762190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:46:33.762732 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:33.769675 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.770191 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.770746 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:33.771372 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.771849 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.772321 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:33.802894 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120571) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 17:46:33.874395 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d345df70-93b2-4c8c-a1a2-91c2e036f9a6 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "POST /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action" status: 202 len: 0 microversion: 2.1 time: 0.116102 Oct 18 17:46:33.875219 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4204/8371] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:46:33 2022] POST /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:46:33.883357 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:33.884401 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:33.890491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.891120 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.891459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:33.892222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:33.892660 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:33.893157 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:34.032178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:34.041356 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-480390df-fda0-42e4-b045-6c6d81a72a17 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1518 microversion: 2.1 time: 0.161877 Oct 18 17:46:34.041955 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4168/8372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:33 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:34.335558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "name": "network-vif-unplugged", "status": "completed", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:46:34.348578 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:34.349087 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:34.350083 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:34.364333 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.compute.server_external_events [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] Unable to find a host for instance 21df0a3c-57c5-4875-a924-1238b62eac6b. Dropping event network-vif-unplugged {{(pid=120571) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 17:46:34.365327 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-03bb4313-925d-404b-930d-0196cb19effc req-cd8b5da5-4ef5-4489-916b-e5f9cfb07a6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033611 Oct 18 17:46:34.365930 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4205/8373] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 17:46:35.065906 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:35.066469 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:35.074702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:35.075204 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:35.075644 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:35.076360 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:35.076815 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:35.077278 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:35.222376 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:35.231381 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-11344eb2-6d7b-4f36-98d1-4f0a8ef26865 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1520 microversion: 2.1 time: 0.169922 Oct 18 17:46:35.231972 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4169/8374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:35 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:36.256289 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:36.256867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:36.263881 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:36.264373 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:36.264878 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:36.265943 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:36.266410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:36.266847 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:36.401609 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:36.409757 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b9645de5-3dcc-4ee9-b1ab-a9ba8587be23 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1520 microversion: 2.1 time: 0.157565 Oct 18 17:46:36.410331 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4206/8375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:36 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:37.437846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:37.438502 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:37.447252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:37.447813 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:37.448457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:37.449254 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:37.449790 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:37.450338 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:37.611723 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:37.622739 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-e9f81cb6-e14c-48a2-b511-413f037e4481 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1520 microversion: 2.1 time: 0.191841 Oct 18 17:46:37.623446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4170/8376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:37 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:38.647024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:38.647564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:38.655551 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:38.656055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:38.656508 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:38.657249 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:38.657723 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:38.658164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:38.796227 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:38.804201 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a4ac2ce9-3b97-43eb-aea2-1c961aa29c31 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1520 microversion: 2.1 time: 0.161266 Oct 18 17:46:38.804787 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4207/8377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:38 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:39.827953 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:39.828511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:39.835707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:39.836663 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:39.837123 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:39.837830 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:39.838283 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:39.838733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:39.979643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:39.987492 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-88afa341-b56b-4fa6-88bb-e3277da753a4 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.163616 Oct 18 17:46:39.988436 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4171/8378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:39 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:41.012797 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:41.013446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:41.020487 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:41.020982 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:41.021468 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:41.022174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:41.022641 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:41.023076 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:41.160792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:41.169892 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2616efcd-fcef-4844-8636-6f7473789427 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.161556 Oct 18 17:46:41.170485 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4208/8379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:41 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:42.193883 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:42.194456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:42.202092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:42.202578 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:42.203015 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:42.203708 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:42.204162 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:42.204584 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:42.339835 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:42.347654 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-50986ba0-4203-4626-858d-8f6f273f5bcd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.157758 Oct 18 17:46:42.348234 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4172/8380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:42 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:43.372101 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:43.372726 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:43.379559 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:43.380053 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:43.380501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:43.381298 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:43.381768 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:43.382207 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:43.515051 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:43.522988 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f764c871-8951-4a02-8fbd-e1b7ea19f0f7 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.155436 Oct 18 17:46:43.523646 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4209/8381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:43 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:44.546889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:44.547439 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:44.555069 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:44.556292 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:44.556733 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:44.557460 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:44.557921 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:44.558351 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:44.706547 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:44.714628 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-90bc91bf-e392-4ab7-ba6c-bfa221d13f72 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.171922 Oct 18 17:46:44.715208 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4173/8382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:44 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:46:45.737464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:45.738099 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:45.746008 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:45.746542 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:45.746997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:45.747716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:45.748260 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:45.748712 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:45.883124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:45.890970 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-80bc7f9b-f0ee-48d7-b2fb-83d1feb6c853 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.157510 Oct 18 17:46:45.891558 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4210/8383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:45 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:46.915485 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:46.916089 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:46.922992 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:46.923475 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:46.923943 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:46.924631 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:46.925121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:46.925551 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:47.058433 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:47.066557 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5bef3404-4a20-4281-8db8-eb334d2bf87e tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.155828 Oct 18 17:46:47.067135 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4174/8384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:46 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:48.091318 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:48.091946 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:48.098802 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:48.099297 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:48.099753 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:48.100452 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:48.100928 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:48.102050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:48.106230 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:48.242564 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:48.251301 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-08a3d34b-31c1-4e43-b1d4-9bf6e4b7f200 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.163925 Oct 18 17:46:48.251908 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4211/8385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:48 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:49.276010 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:49.276655 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:49.283927 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:49.284405 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:49.284846 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:49.285566 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:49.286221 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:49.286656 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:49.289222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=85 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:49.427782 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:49.436424 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-aafb602c-12ad-448f-ad89-fd0913af7754 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.164405 Oct 18 17:46:49.437012 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4175/8386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:49 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:50.420570 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "name": "network-vif-plugged", "status": "completed", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:46:50.426351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:50.432305 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:50.432826 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:50.433296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:50.446312 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] Creating event network-vif-plugged:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:46:50.451507 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-e0386535-ca16-4a8c-9898-60f0bfe8563a req-c7cc24dc-fdea-49d9-8ec2-c334ab9e78cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Oct 18 17:46:50.452133 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4212/8387] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:46:50.461155 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:50.462181 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:50.465178 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=31 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:50.471873 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:50.472532 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:50.472827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:50.473580 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:50.474294 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:50.474738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:50.620622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:50.635423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9a1953ad-4cae-4205-9a51-d7d89775bcb8 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.178034 Oct 18 17:46:50.636710 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4176/8388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:50 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:51.664082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:51.665955 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:51.672205 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:51.672708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:51.673203 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:51.673918 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:51.674388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:51.674833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:51.811645 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:51.819800 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-5530be33-f603-44d7-9f76-7657e1a39ce5 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1576 microversion: 2.1 time: 0.161026 Oct 18 17:46:51.820387 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4213/8389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:51 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:46:52.843271 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:46:52.843887 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:46:52.850303 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:52.850707 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:52.851146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:52.851878 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:46:52.852688 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:46:52.853323 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:46:52.991390 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:46:52.999882 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-9351d62b-a1b6-43dd-9f37-6024e1027800 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1563 microversion: 2.1 time: 0.160753 Oct 18 17:46:53.000453 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4177/8390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:46:52 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:05.677936 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:05.678865 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=12 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:05.679982 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:48:05.680125 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b (ip 10.222.0.78) !!! Oct 18 17:48:05.680238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:05.681163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=17 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:05.683974 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:48:05.684115 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:48:05.686921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:05.687688 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:05.696281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:05.696897 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:05.698167 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:05.698857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:05.699231 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:05.699770 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:05.700287 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:05.713256 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:05.714226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:05.714226 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:05.728737 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:48:05.729131 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] Creating event network-changed:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:48:05.736603 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-4ff12d3b-a48c-44da-8221-de3f557b5215 req-544dbcdf-febe-45e1-93b7-dbf50329c626 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058385 Oct 18 17:48:05.737144 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4178/8391] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:48:05.822631 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2cf3f4a1-b509-4abc-9987-82d6b2177790 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "DELETE /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 204 len: 0 microversion: 2.1 time: 0.146530 Oct 18 17:48:05.823240 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4214/8392] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:48:05 2022] DELETE /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:48:05.832425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:05.833165 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:05.839511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:05.840011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:05.840456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:05.841200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:05.841664 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:05.842094 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:05.983858 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:05.991884 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5b49365d-1d6d-436e-a45d-44d99c56dfb2 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.164173 Oct 18 17:48:05.992468 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4179/8393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:05 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:07.017624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:07.018471 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:07.026070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:07.026610 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:07.027117 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:07.027835 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:07.028301 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:07.028766 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:07.189727 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:07.198305 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-8a8a0cec-2184-4498-b250-14a1fa398998 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1569 microversion: 2.1 time: 0.185050 Oct 18 17:48:07.198999 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4215/8394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:07 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:08.139237 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21df0a3c-57c5-4875-a924-1238b62eac6b", "name": "network-vif-deleted", "tag": "abd3f888-52b4-4070-ba54-efb386ff0f23"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:08.152731 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:08.153537 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:08.153951 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:08.167399 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] Creating event network-vif-deleted:abd3f888-52b4-4070-ba54-efb386ff0f23 for instance 21df0a3c-57c5-4875-a924-1238b62eac6b on n-h1-858383-14 Oct 18 17:48:08.173700 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-2705a917-89f2-4866-951b-f694a61ff890 req-a391c831-f127-4368-b9de-0f46a0f0a853 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038511 Oct 18 17:48:08.174232 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4180/8395] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:48:08.222164 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:08.222790 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:08.230634 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:08.231138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:08.231599 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:08.232322 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:08.232799 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:08.233279 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:08.302394 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:08.311277 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-0c5d5692-1237-4ca8-aa08-c36a60d4fb09 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1219 microversion: 2.1 time: 0.093503 Oct 18 17:48:08.311867 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4216/8396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:08 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:09.335108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:09.335701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:09.343073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:09.343554 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:09.343987 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:09.344679 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:09.345159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:09.345583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:09.410685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:09.418682 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-19888722-60d9-4c31-9ea0-e456eeecdc6d tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1219 microversion: 2.1 time: 0.087992 Oct 18 17:48:09.419476 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4181/8397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:09 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:10.442300 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:10.443060 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:10.450338 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:10.450921 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:10.451650 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:10.452446 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:10.453025 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:10.453584 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:10.519302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:10.530401 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-d754b9ea-da1f-481f-bf2d-99d5ed36cfdd tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1219 microversion: 2.1 time: 0.091945 Oct 18 17:48:10.531683 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4217/8398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:10 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:11.554456 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:11.555100 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:11.562171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:11.562720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:11.563159 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:11.565111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:11.565111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:11.565111 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:11.632075 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:11.640069 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-51002283-643b-4cf8-8e37-96251af089e1 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1219 microversion: 2.1 time: 0.089542 Oct 18 17:48:11.640968 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4182/8399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:11 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:12.663932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:12.664582 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:12.672278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:12.672776 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:12.673323 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:12.674175 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:12.674708 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:12.675214 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:12.708602 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:12.709130 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:12.709585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:12.710046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.objects.instance [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lazy-loading 'fault' on Instance uuid 21df0a3c-57c5-4875-a924-1238b62eac6b {{(pid=120571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:48:13.139562 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81c0d4489f15472dbc1dd55e0f528f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6222a154d3498ea4bcb82b8ac622df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:13.147355 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-21e34e5f-0caf-48ba-9913-02eb360cda1f tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 200 len: 1178 microversion: 2.1 time: 0.487339 Oct 18 17:48:13.148043 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4218/8400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:12 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 1178 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:14.172148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:14.172965 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] [instance: 21df0a3c-57c5-4875-a924-1238b62eac6b] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:14.181393 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:14.181969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:14.182525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:14.183389 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:14.183944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:14.184425 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:14.202617 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] HTTP exception thrown: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Request method failure captured: Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b HTTP/1.1 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTuSVz8ymIXHOeUHP1hVxtUNmqYI5yOzrWroIWCw8Aecn9PvaR3ZjioaCOl7cnG61biwFVy2Hr0UPAPg5doeI7F2H0TbbXdBdMiEwQYKookTrNJkLIugnORghtWaI5EkbyA7kC-blj_tHxpE4OJ7WupKpVIUeHWi6-q4gkXSu4vy5gjc Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: dc6222a154d3498ea4bcb82b8ac622df Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestShelveInstance-139156370 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dc6222a154d3498ea4bcb82b8ac622df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dc6222a154d3498ea4bcb82b8ac622df"}]}] Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestShelveInstance-139156370 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: dc6222a154d3498ea4bcb82b8ac622df Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestShelveInstance-139156370 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestShelveInstance-139156370-project Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 81c0d4489f15472dbc1dd55e0f528f46 Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestShelveInstance-139156370-project Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '21df0a3c-57c5-4875-a924-1238b62eac6b'} Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:48:14.204497 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Returning 404 to user: Instance 21df0a3c-57c5-4875-a924-1238b62eac6b could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-cd58b320-8dac-48d3-960a-172789f6920c tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b" status: 404 len: 111 microversion: 2.1 time: 0.038395 Oct 18 17:48:14.211834 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4183/8401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:14 2022] GET /compute/v2.1/servers/21df0a3c-57c5-4875-a924-1238b62eac6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:48:14.391440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4d2205f4-37c3-4281-b01d-dc460aa0ea66 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] Calling method '.version_select at 0x7f5fd642a790>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:14.425526 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4d2205f4-37c3-4281-b01d-dc460aa0ea66 tempest-TestShelveInstance-139156370 tempest-TestShelveInstance-139156370-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-969465457" status: 202 len: 0 microversion: 2.1 time: 0.038270 Oct 18 17:48:14.426261 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4219/8402] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 17:48:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-969465457 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:48:32.507762 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=12 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:32.508522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=24 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:32.721429 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d41c0e4a-6d57-4131-8fc6-30f0e3c95eff tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Action: 'create', calling method: .version_select at 0x7f5fd0fc8670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1844304173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqAudAaMUoRIILUagwUtKLaroK+WGyFmAtQ3g+MVZkMIEa2hl85KvmDf+GcnUIMQ02NaiIQVUbpIaDfBuUoa/RnacTOZqyI3cn1+RZg3Buv0t9HKlbyRh1fSBV6Ayb20Q=="}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:32.740252 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d41c0e4a-6d57-4131-8fc6-30f0e3c95eff tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for project f4adb7dd22784511b0603632ab9ee795. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:48:32.746081 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-d41c0e4a-6d57-4131-8fc6-30f0e3c95eff tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for user 5ad2dec71f4a4cc3b8b585247b6aae19 and project f4adb7dd22784511b0603632ab9ee795. Resources: {'key_pairs'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:48:32.774165 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d41c0e4a-6d57-4131-8fc6-30f0e3c95eff tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.271630 Oct 18 17:48:32.774786 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4184/8403] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 18 17:48:32 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:48:33.779290 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1185841064", "imageRef": "716a8cb0-5725-40db-af07-5a18594590ce", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1844304173", "security_groups": [{"name": "tempest-secgroup-smoke-858733317"}], "networks": [{"uuid": "f6c93adf-de80-47db-94dd-9f9acec07bbc"}]}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:33.790716 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:33.791082 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:33.894769 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.network.neutron [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] validate_networks() for [('f6c93adf-de80-47db-94dd-9f9acec07bbc', None, None, None, None, None)] {{(pid=120571) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:48:34.378669 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Flavor limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:48:34.379112 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Image limits 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:48:34.379631 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Flavor pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:48:34.380190 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Image pref 0:0:0 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:48:34.380625 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.virt.hardware [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:48:34.390049 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:34.390326 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:34.390778 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:34.391519 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:34.391991 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:34.392435 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:34.410755 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for project f4adb7dd22784511b0603632ab9ee795. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:48:34.416717 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.quota [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for user 5ad2dec71f4a4cc3b8b585247b6aae19 and project f4adb7dd22784511b0603632ab9ee795. Resources: {'instances', 'ram', 'cores'} {{(pid=120571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:48:34.429937 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Going to run 1 instances... {{(pid=120571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:48:34.432696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716a8cb0-5725-40db-af07-5a18594590ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:48:34.483560 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-756a2458-c387-41ca-a382-953084092f91 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709174 Oct 18 17:48:34.490718 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4220/8404] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:48:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:48:34.496541 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1c691cbb-c209-4fe5-a846-d2d9b9f129d9 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:34.498004 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1c691cbb-c209-4fe5-a846-d2d9b9f129d9 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:34.564901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1c691cbb-c209-4fe5-a846-d2d9b9f129d9 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:34.575963 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1c691cbb-c209-4fe5-a846-d2d9b9f129d9 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1249 microversion: 2.1 time: 0.084081 Oct 18 17:48:34.578133 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4185/8405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:34 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:48:35.600978 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:35.601734 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:35.609480 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:35.610077 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:35.610624 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:35.611416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:35.611963 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:35.612477 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:35.691917 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:35.700666 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fb6b1073-2ef8-4629-8e5b-45f6b041b314 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1301 microversion: 2.1 time: 0.104497 Oct 18 17:48:35.701354 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4221/8406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:35 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:36.724638 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:36.725976 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:36.734932 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:36.735552 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:36.735701 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:36.737384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:36.737384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:36.737384 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:36.942481 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:36.952255 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-846aaa3b-9b13-4d3d-a1a0-823d6f87e8dc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.231686 Oct 18 17:48:36.953037 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4186/8407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:36 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:37.481388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:37.493331 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:37.493833 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:37.494280 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:37.505873 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] Creating event network-changed:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:48:37.511652 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-97359bbd-5379-4060-9a27-ebb3b9a81ac8 req-d74bd889-1cd8-4654-a95e-f82f06f19882 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034097 Oct 18 17:48:37.512254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4222/8408] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:48:37.975738 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:37.976472 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:37.983963 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:37.984455 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:37.984895 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:37.985618 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:37.986078 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:37.986507 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:38.131944 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:38.140326 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5feda628-3705-412e-918e-b48dc364fa26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.168549 Oct 18 17:48:38.140926 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4187/8409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:37 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:39.166124 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:39.166774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:39.173174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:39.173684 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:39.174147 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:39.174869 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:39.175348 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:39.175798 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:39.317079 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:39.325268 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7b75052f-6ba6-4dc1-8214-5bd2602d4fe2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.164941 Oct 18 17:48:39.325877 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4223/8410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:39 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:40.348702 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:40.349383 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:40.356909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:40.357431 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:40.357869 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:40.358575 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:40.359032 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:40.359462 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:40.505112 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:40.513506 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-57964d2a-aa0a-401a-b4c0-71c7cfc41e09 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.168579 Oct 18 17:48:40.514084 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4188/8411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:40 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:41.537375 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:41.538036 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:41.545501 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:41.545997 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:41.546445 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:41.547143 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:41.547644 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:41.548090 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:41.679351 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:41.687313 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-fcfd6130-44ca-4df2-bccd-9a8779a90168 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.153919 Oct 18 17:48:41.687847 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4224/8412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:41 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:42.710681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:42.711428 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:42.719816 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:42.720308 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:42.720807 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:42.721459 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:42.721923 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:42.722388 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:42.864238 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:42.873257 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-6b71d649-d193-4d7a-bbaf-d40184fcc80c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.166312 Oct 18 17:48:42.873999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4189/8413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:42 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:42.923690 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "name": "network-vif-plugged", "status": "completed", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:42.938067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:42.938067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:42.938067 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:42.946986 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] Creating event network-vif-plugged:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:48:42.952367 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-9fbbccb7-94f2-404b-ad53-2aa1bdd33842 req-b2c8ef34-9a1f-48a2-8755-ae737eefd461 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117258 Oct 18 17:48:42.952967 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4225/8414] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:48:43.897148 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:43.897681 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:43.904901 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:43.905413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:43.908065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:43.908065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:43.908065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:43.908065 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:44.042531 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:44.050615 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-d35a7013-63fa-4ceb-b8b5-833e81aa0ffd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1374 microversion: 2.1 time: 0.157396 Oct 18 17:48:44.051192 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4190/8415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:43 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:45.075035 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:45.075756 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:45.078545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:45.079549 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=6 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:45.085689 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:45.087736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:45.087736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:45.087736 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:45.088070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:45.088226 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:45.226872 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:45.235258 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-3c25b9b8-2b78-4824-bb51-88a696779b97 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1557 microversion: 2.1 time: 0.165123 Oct 18 17:48:45.235839 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4226/8416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:45 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:45.258629 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:48:45.259385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:48:45.261300 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:45.267583 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:45.268073 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:45.301447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:45.301447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:45.301447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:45.301447 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:45.415651 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:48:45.425703 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1465adc2-6b5b-427d-820b-3e0d19a5eddd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1557 microversion: 2.1 time: 0.171147 Oct 18 17:48:45.426282 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4191/8417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:48:45 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:48:47.146412 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:48:47.157418 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:48:47.157932 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:48:47.158379 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:48:47.172570 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] Creating event network-changed:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:48:47.177719 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-71d6799e-ef73-425b-94c8-db5333cf7749 req-2fb51c84-5be8-418a-bea1-c3ff4c3ceac2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096807 Oct 18 17:48:47.178340 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4227/8418] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:51:13.321739 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:51:13.322832 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:51:13.323377 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:13.324200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=36 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:13.325171 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:51:13.325316 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f/action (ip 10.222.0.78) !!! Oct 18 17:51:13.326730 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:51:13.326907 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f/action (ip 10.222.0.78) !!! Oct 18 17:51:13.333990 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-325147414"}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:13.336395 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:13.349579 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:13.350067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:13.350509 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:13.351200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:13.351658 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:13.352084 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:13.552747 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-1022d6b7-ca9b-4c46-b9a1-2910bc1a6a45 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "POST /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f/action" status: 202 len: 0 microversion: 2.1 time: 0.232710 Oct 18 17:51:13.553423 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4192/8419] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:51:13 2022] POST /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 17:51:19.548706 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:51:19.549640 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:51:19.550449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:19.551310 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=32 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:19.552458 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:51:19.552680 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:51:19.555068 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:51:19.555194 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:51:19.557115 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:51:19.557218 n-d-858383-14 devstack@n-api.service[120571]: Tue Oct 18 17:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:51:19.580800 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "name": "network-vif-plugged", "status": "completed", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:19.592410 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:19.592902 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:19.593371 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:19.604730 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] Creating event network-vif-plugged:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:51:19.611334 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-3ef28ee2-243b-48f5-bb52-2143b2002f4e req-41101667-b6e6-4a91-9fee-4d50004e3c37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064294 Oct 18 17:51:19.611962 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4228/8420] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:51:33.282465 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:33.283848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:33.289067 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1419491524", "imageRef": "a3892bae-45bf-451a-9687-1b6a9ac30edf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1844304173", "security_groups": [{"name": "tempest-secgroup-smoke-858733317"}], "networks": [{"uuid": "f6c93adf-de80-47db-94dd-9f9acec07bbc"}]}} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:33.318067 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58430. Oct 18 17:51:33.318715 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58432. Oct 18 17:51:33.603827 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.network.neutron [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] validate_networks() for [('f6c93adf-de80-47db-94dd-9f9acec07bbc', None, None, None, None, None)] {{(pid=120570) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 17:51:34.103325 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Flavor limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:51:34.104011 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Image limits 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:51:34.104514 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Flavor pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:51:34.104666 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Image pref 0:0:0 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:51:34.105113 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.virt.hardware [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:51:34.115694 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:34.116175 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:34.116622 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:34.117374 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:34.117831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:34.118297 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:34.135454 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for project f4adb7dd22784511b0603632ab9ee795. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:51:34.140734 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.quota [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Getting quotas for user 5ad2dec71f4a4cc3b8b585247b6aae19 and project f4adb7dd22784511b0603632ab9ee795. Resources: {'instances', 'ram', 'cores'} {{(pid=120570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:51:34.153653 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Going to run 1 instances... {{(pid=120570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:51:34.156158 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3892bae-45bf-451a-9687-1b6a9ac30edf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:51:34.207138 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c558a7e8-3311-4f49-a009-9556f998adbc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.927223 Oct 18 17:51:34.209303 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4193/8421] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 17:51:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:51:34.220775 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-2ea1e0ff-773f-4d3f-8f8d-c942c7726b65 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:34.221520 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-2ea1e0ff-773f-4d3f-8f8d-c942c7726b65 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:34.228377 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:34.229258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:34.240141 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [eed8284c-0c4c-437f-a737-d8ae0afff70b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58460. Oct 18 17:51:34.249437 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0e259fe-c659-4155-bf57-44ebe7ac3173] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58458. Oct 18 17:51:34.391762 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-2ea1e0ff-773f-4d3f-8f8d-c942c7726b65 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:34.399829 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-2ea1e0ff-773f-4d3f-8f8d-c942c7726b65 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1249 microversion: 2.1 time: 0.183193 Oct 18 17:51:34.400413 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4229/8422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:34 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1249 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:35.424556 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:35.425203 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:35.433092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:35.433826 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:35.435489 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:35.436253 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:35.436726 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:35.437196 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:35.532720 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:35.541904 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-ca3b9a73-0544-4de3-9849-e0ca4f9bd58c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1319 microversion: 2.1 time: 0.122066 Oct 18 17:51:35.542500 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4194/8423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:35 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1319 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:36.566174 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:36.569330 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:36.581974 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:36.582528 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:36.583069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:36.583890 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:36.584533 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:36.585166 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:36.801696 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:36.819287 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1c5e8b04-e8eb-447d-b9f3-1aef1448036c tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.257330 Oct 18 17:51:36.820436 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4230/8424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:36 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:37.640770 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "name": "network-vif-unplugged", "status": "completed", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:37.651755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:37.652522 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:37.652959 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:37.667423 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] Creating event network-vif-unplugged:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:51:37.673508 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-1d469024-fad3-49d2-9734-421971f44ef8 req-6d3a55dc-3c5b-4590-ad37-72db181d2c72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037095 Oct 18 17:51:37.674424 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4195/8425] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:51:37.844760 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:37.845437 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:37.853278 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:37.853774 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:37.854223 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:37.854929 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:37.855396 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:37.855837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:38.015585 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:38.024421 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-9bcf259e-d633-457f-86c5-79cd076b05f2 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.183499 Oct 18 17:51:38.025216 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4231/8426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:37 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:39.050649 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:39.052712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:39.062207 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:39.063060 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:39.063840 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:39.064774 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:39.065466 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:39.065969 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:39.211109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:39.221185 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-76f5f8c9-8840-4389-a358-41bc4a1bcd89 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.176722 Oct 18 17:51:39.221783 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4196/8427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:39 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:40.247729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:40.249440 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:40.258893 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:40.259510 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:40.260024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:40.260759 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:40.261421 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:40.261858 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:40.439970 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:40.449926 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-f5ae285b-86b4-4822-bdc2-fb36121f48e8 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.207101 Oct 18 17:51:40.450840 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4232/8428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:40 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:41.471983 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:41.472864 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:41.485857 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:41.486403 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:41.486891 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:41.487685 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:41.488146 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:41.488670 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:41.636326 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:41.645781 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-3620cde8-6eaf-4d8a-a7aa-f50d402e2f70 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.177203 Oct 18 17:51:41.662117 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4197/8429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:41 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:42.669316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:42.670086 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:42.678707 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:42.679337 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:42.679873 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:42.680678 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:42.681258 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:42.681777 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:42.829140 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:42.837749 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4ee778e2-4b75-40e8-b73c-122496b886af tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.172434 Oct 18 17:51:42.838915 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4233/8430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:42 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:43.863160 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:43.863852 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:43.871005 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:43.871484 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:43.871922 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:43.872604 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:43.873088 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:43.873516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:44.025309 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:44.034420 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-40baa136-3f2c-4456-8f11-d616e5849f46 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.175215 Oct 18 17:51:44.034999 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4198/8431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:43 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:45.058003 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:45.058729 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:45.061449 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell0:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:45.068299 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:45.068808 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:45.069340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:45.070070 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:45.070545 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:45.070993 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:45.554718 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:45.562653 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a51b74a3-16c0-48a7-bd00-054eeb27a669 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.508506 Oct 18 17:51:45.563232 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4234/8432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:45 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:46.503018 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:46.508257 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:46.509163 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell0:SELECT=6 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:46.518098 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:46.518589 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:46.519200 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:46.530728 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] Creating event network-changed:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:51:46.536634 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-19228043-af03-4775-9803-ce83d2a7a2c7 req-d6996dfc-e436-46aa-86e6-0859b6b84baf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037426 Oct 18 17:51:46.537383 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4199/8433] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:51:46.586679 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:46.587350 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:46.594387 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:46.594828 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:46.595316 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:46.596033 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:46.596516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:46.596967 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:46.746398 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:46.755645 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-7476156e-3092-45c4-8d30-515fbf4e8d29 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.172845 Oct 18 17:51:46.756254 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4235/8434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:46 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:47.781020 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:47.781735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:47.789413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:47.789909 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:47.790350 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:47.791049 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:47.791508 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:47.791934 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:47.933567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:47.941568 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5c06fb48-0d60-4f9b-9f45-9e71d807b4e1 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.165601 Oct 18 17:51:47.942226 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4200/8435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:47 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:48.965185 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:48.965913 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:48.973530 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:48.974388 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:48.974839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:48.975555 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:48.976021 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:48.976464 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:49.119015 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:49.126897 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-cc176453-a69a-47b4-b5d2-208fa189989b tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.166194 Oct 18 17:51:49.127549 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4236/8436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:48 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:50.149778 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:50.150391 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:50.157567 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:50.158050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:50.158486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:50.159171 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:50.159626 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:50.160050 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:50.295231 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:50.303838 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-5e6bd8e5-667c-4567-85f8-6b6c8cfd8fc5 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.157930 Oct 18 17:51:50.304409 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4201/8437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:50 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:51.327311 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:51.327896 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:51.335066 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:51.335568 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:51.336024 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:51.336730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:51.337240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:51.337698 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:51.474611 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:51.482492 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-45ed93b7-8709-418b-a7d7-032b747a54d7 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.159166 Oct 18 17:51:51.483077 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4237/8438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:51 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:52.505464 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:52.506071 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:52.513122 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:52.513611 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:52.514046 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:52.514736 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:52.515525 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:52.515952 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:52.653265 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:52.661598 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-eabd23d5-629e-4cd4-9612-00d56bf16254 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.160230 Oct 18 17:51:52.662191 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4202/8439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:52 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:53.685247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:53.685910 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:53.693306 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:53.693812 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:53.694269 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:53.694984 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:53.695460 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:53.695908 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:53.827550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:53.836144 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b35fef4b-f893-48ef-affa-fb6b1fa1efdd tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.155405 Oct 18 17:51:53.836724 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4238/8440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:53 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:54.061792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "name": "network-vif-plugged", "status": "completed", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:54.073013 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:54.073515 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:54.073949 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:54.085821 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] Creating event network-vif-plugged:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:51:54.090755 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c39b7566-ab1c-4ec5-9cae-0ec3cd298303 req-c95a77bf-eb48-4e2f-8f5b-78a4a7ac9e1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Oct 18 17:51:54.091345 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4203/8441] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:51:54.859211 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:54.859837 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:54.867442 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:54.867945 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:54.868403 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:54.869134 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:54.869607 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:54.870050 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:55.007046 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:55.014835 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-abe5e862-97b1-4225-a672-cc61472e9506 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1374 microversion: 2.1 time: 0.159591 Oct 18 17:51:55.015420 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4239/8442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:54 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:56.039516 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:56.040222 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:56.046511 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:56.046998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:56.047440 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:56.048135 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:56.048591 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:56.049040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:56.185268 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:56.193741 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-8f862b38-8812-43b2-92b4-49a6cf11d312 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1556 microversion: 2.1 time: 0.159474 Oct 18 17:51:56.194314 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4204/8443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:56 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:56.216369 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:51:56.217030 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:51:56.224240 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:56.224745 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:56.225221 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:56.225930 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:56.226399 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:56.226839 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:56.362109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:51:56.370667 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-1230d1e5-ebc4-48a6-acc3-081a78761368 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1556 microversion: 2.1 time: 0.158504 Oct 18 17:51:56.371252 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4240/8444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:51:56 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:51:58.008643 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:51:58.019045 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:51:58.020321 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:51:58.020848 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:51:58.032529 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] Creating event network-changed:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:51:58.038704 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-d702750c-ddc2-4412-8295-912f49bb5c37 req-ec31a666-2c5d-4689-bde9-56fbb420ee2a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034355 Oct 18 17:51:58.039322 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4205/8445] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:53:57.041655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=26 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:53:57.043138 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=66 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:53:57.097238 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1359913150"}} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:53:57.099653 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:53:57.106916 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:53:57.107416 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:53:57.107867 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:53:57.108571 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:53:57.109069 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:53:57.109515 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:53:57.314228 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-b8db47f6-f187-427a-a53a-6fcefdcf46fc tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "POST /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c/action" status: 202 len: 0 microversion: 2.1 time: 0.274519 Oct 18 17:53:57.314802 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4241/8446] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 18 17:53:57 2022] POST /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 17:54:04.601305 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:54:04.602339 n-d-858383-14 devstack@n-api.service[120570]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:54:04.602998 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:04.603928 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=58 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:04.604860 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:54:04.605303 n-d-858383-14 devstack@n-api.service[120570]: Tue Oct 18 17:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Oct 18 17:54:04.675138 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "name": "network-vif-plugged", "status": "completed", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:04.686882 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:04.687417 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:04.687792 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:04.699092 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] Creating event network-vif-plugged:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:54:04.704285 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-fa409ffb-e40e-4be5-acd9-1c5eeda9bbd4 req-57dbb968-90fe-407d-b8f6-24a7a5243bcf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105064 Oct 18 17:54:04.704920 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4206/8447] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:16.399623 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_api:SELECT=2 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:16.400465 n-d-858383-14 devstack@n-api.service[120571]: DEBUG dbcounter [-] [120571] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:16.403988 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_api:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:16.404792 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:16.405845 n-d-858383-14 devstack@n-api.service[120570]: DEBUG dbcounter [-] [120570] Writing DB stats nova_cell1:SELECT=2 {{(pid=120570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:16.406242 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:16.413146 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:16.413655 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:16.414296 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:16.415019 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:16.416636 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:16.417265 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:16.420386 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [48ee2ae7-63bb-4a75-a057-0a7126d096aa] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58810. Oct 18 17:54:16.421355 n-d-858383-14 devstack@n-api.service[120570]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d7a0185-f2b7-4aca-bbae-3bab3899bc1f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58808. Oct 18 17:54:16.447742 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Going to try to terminate instance {{(pid=120571) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:54:16.476379 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:16.488121 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:16.488876 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:16.489491 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:16.501496 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] Creating event network-changed:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:54:16.507802 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-62da9dbc-09df-4369-aea8-db0a3bbee709 req-1e27aa8b-2dae-4d8b-b9f9-0edf12484b13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105299 Oct 18 17:54:16.509036 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4207/8448] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:16.538046 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-326e00a9-93b3-4f52-b498-5122b3a36176 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "DELETE /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 204 len: 0 microversion: 2.1 time: 0.140484 Oct 18 17:54:16.538749 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4242/8449] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:54:16 2022] DELETE /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 17:54:16.551385 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:16.552372 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:16.561889 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:16.562577 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:16.563217 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:16.564311 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:16.565108 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:16.566461 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:16.720335 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:54:16.732320 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-a03710ff-eb2d-4eb5-9aea-34b3d5be4e26 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1681 microversion: 2.1 time: 0.185524 Oct 18 17:54:16.733407 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4208/8450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:16 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:54:17.757714 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:17.758342 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:17.766055 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:17.766550 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:17.766998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:17.767695 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:17.768160 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:17.768595 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:17.906738 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:54:17.914748 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-4014aa0b-2b62-46c0-80e1-9854b08c91aa tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1681 microversion: 2.1 time: 0.161462 Oct 18 17:54:17.915320 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4243/8451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:17 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:54:18.622486 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "name": "network-vif-unplugged", "status": "completed", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:18.634413 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:18.635427 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:18.635867 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:18.647560 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.compute.server_external_events [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] Creating event network-vif-unplugged:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:54:18.653595 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [req-c3bdd994-6ae9-4381-b751-e0f0ef2d2253 req-dd32767b-89ba-486b-90c2-dd5759e02ec6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035284 Oct 18 17:54:18.654210 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4209/8452] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:18.935569 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c", "name": "network-vif-deleted", "tag": "25871683-adb3-4da7-9477-9fcd3c077712"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:18.944562 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:18.945359 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:18.948516 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:18.949109 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:18.949730 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:18.953971 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:18.954569 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:18.955061 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:18.955863 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:18.956334 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:18.956814 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:18.965979 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] Creating event network-vif-deleted:25871683-adb3-4da7-9477-9fcd3c077712 for instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c on n-h2-858383-14 Oct 18 17:54:18.971162 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-520e33f6-d8da-4b39-ae06-88e80f92e8f6 req-587fe034-ef38-46ec-8d40-b7cefe1358a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101947 Oct 18 17:54:18.971963 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4244/8453] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:18.991107 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:18.991598 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:18.992042 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:18.992496 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.objects.instance [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lazy-loading 'fault' on Instance uuid 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c {{(pid=120570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:54:19.036313 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:54:19.045218 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-c3ebf4b2-bfc7-4a5f-91cf-6e69137cac49 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 200 len: 1339 microversion: 2.1 time: 0.105095 Oct 18 17:54:19.045798 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4210/8454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:18 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:54:20.068340 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:20.069125 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:20.076295 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:20.076796 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:20.077281 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:20.077998 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:20.078474 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:20.078923 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:20.092332 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.wsgi [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] HTTP exception thrown: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Request method failure captured: Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: request: GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c HTTP/1.1 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Accept: application/json Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Accept-Encoding: identity Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Connection: close Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Content-Length: 0 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Content-Type: application/json Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Host: 10.222.0.78 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: Openstack-System-Scope: None Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: User-Agent: python-urllib3/1.26.12 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Auth-Token: gAAAAABjTubr2L7jAWf0TIEx_X3XZalTX9XRn_P-YoMwwVHpshe0I2FWVZZH8TH5JBt9VrzK1-GHwUrUYunSsl-IjOWyFvEKxfAsKp84ZCe3jZwy-JhVsAW_f663bxeUlU40rur9ZANpAO1cc_XJndITjjcPFTniwl1HjhUhxQKuQVpQLvfSCGU Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Id: None Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Domain-Name: None Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Identity-Status: Confirmed Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Is-Admin-Project: True Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Id: default Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Domain-Name: Default Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Id: f4adb7dd22784511b0603632ab9ee795 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Project-Name: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Role: member,reader Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Roles: member,reader Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4adb7dd22784511b0603632ab9ee795"}]}] Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Id: f4adb7dd22784511b0603632ab9ee795 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-Tenant-Name: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-User: tempest-TestSnapshotPattern-1346556205-project Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Id: default Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-User-Domain-Name: Default Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-User-Id: 5ad2dec71f4a4cc3b8b585247b6aae19 Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: X-User-Name: tempest-TestSnapshotPattern-1346556205-project Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: method: > Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: exception: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: action_args: {'id': '18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c'} Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:54:20.093976 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: ERROR nova.api.openstack.wsgi Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Returning 404 to user: Instance 18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c could not be found. {{(pid=120571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-807e9d9a-ecdd-4e6e-9ef3-017321ccecec tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c" status: 404 len: 111 microversion: 2.1 time: 0.031341 Oct 18 17:54:20.098276 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4245/8455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:20 2022] GET /compute/v2.1/servers/18bb0ed9-7b5b-4ec8-8d1f-b3ea1d2e344c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:54:21.433109 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:21.433689 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:21.435596 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:21.441627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:21.442187 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:21.442700 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:21.443457 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:21.444092 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:21.444517 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:21.447302 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:21.447853 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:21.448492 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:21.459400 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] Creating event network-changed:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:54:21.465617 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-714b87ee-bd1f-430e-88a0-8a61a0e26b91 req-f671a469-61ee-45c1-a26d-16796a4b8d1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Oct 18 17:54:21.466512 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4246/8456] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:21.472735 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Going to try to terminate instance {{(pid=120570) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:54:21.561599 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-2818b146-6d73-49a3-85e3-52c0336afe08 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "DELETE /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 204 len: 0 microversion: 2.1 time: 0.132311 Oct 18 17:54:21.562503 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4211/8457] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 17:54:21 2022] DELETE /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:54:21.571177 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:21.572614 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.compute.api [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120571) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:21.579601 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:21.580103 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:21.580558 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:21.581309 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:21.581787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:21.582247 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:21.724127 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.policy [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120571) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:54:21.732589 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-a69ad968-6138-424c-b815-821f38d30a44 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1681 microversion: 2.1 time: 0.165801 Oct 18 17:54:21.733180 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4247/8458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:21 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:54:22.756316 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:22.757040 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:22.764137 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:22.764627 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:22.765104 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:22.765831 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:22.766286 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:22.766712 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:22.973756 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.policy [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad2dec71f4a4cc3b8b585247b6aae19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4adb7dd22784511b0603632ab9ee795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120570) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:54:22.981866 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-f8eb67f5-da15-46cb-b13c-231c6925c091 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 200 len: 1563 microversion: 2.1 time: 0.229843 Oct 18 17:54:22.982446 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4212/8459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:22 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 1563 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:54:23.053451 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583da0b2-9c47-4f30-857b-4bf72432738f", "name": "network-vif-deleted", "tag": "f688c757-ddb8-4322-8c78-22f11f60d14b"}]} {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:54:23.064598 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:23.065123 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:23.065574 n-d-858383-14 devstack@n-api.service[120571]: DEBUG oslo_concurrency.lockutils [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:23.077132 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.compute.server_external_events [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] Creating event network-vif-deleted:f688c757-ddb8-4322-8c78-22f11f60d14b for instance 583da0b2-9c47-4f30-857b-4bf72432738f on n-h1-858383-14 Oct 18 17:54:23.081979 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [req-16f51b1b-5c32-4a8b-9aba-2276517b7e6f req-e0e7d453-0f51-4191-8034-c5a1abea3fa5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Oct 18 17:54:23.082591 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4248/8460] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 18 17:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:54:24.005142 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '>' {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:24.005755 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.compute.api [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [instance: 583da0b2-9c47-4f30-857b-4bf72432738f] Fetching instance by UUID {{(pid=120570) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:54:24.012588 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:24.013101 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:24.013539 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:24.014219 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Acquiring lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:54:24.014672 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:54:24.015097 n-d-858383-14 devstack@n-api.service[120570]: DEBUG oslo_concurrency.lockutils [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Lock "7d78fc6f-3bd2-4209-b2d1-7724df142ab0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:54:24.028939 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.wsgi [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] HTTP exception thrown: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Request method failure captured: Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: request: GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f HTTP/1.1 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Accept: application/json Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Accept-Encoding: identity Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Connection: close Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Content-Length: 0 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Content-Type: application/json Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Host: 10.222.0.78 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: Openstack-System-Scope: None Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: User-Agent: python-urllib3/1.26.12 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Auth-Token: gAAAAABjTubr2L7jAWf0TIEx_X3XZalTX9XRn_P-YoMwwVHpshe0I2FWVZZH8TH5JBt9VrzK1-GHwUrUYunSsl-IjOWyFvEKxfAsKp84ZCe3jZwy-JhVsAW_f663bxeUlU40rur9ZANpAO1cc_XJndITjjcPFTniwl1HjhUhxQKuQVpQLvfSCGU Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Id: None Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Domain-Name: None Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Identity-Status: Confirmed Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Is-Admin-Project: True Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Id: default Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Domain-Name: Default Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Id: f4adb7dd22784511b0603632ab9ee795 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Project-Name: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Role: member,reader Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Roles: member,reader Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4adb7dd22784511b0603632ab9ee795"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4adb7dd22784511b0603632ab9ee795"}]}] Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Id: f4adb7dd22784511b0603632ab9ee795 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-Tenant-Name: tempest-TestSnapshotPattern-1346556205 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-User: tempest-TestSnapshotPattern-1346556205-project Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Id: default Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-User-Domain-Name: Default Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-User-Id: 5ad2dec71f4a4cc3b8b585247b6aae19 Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: X-User-Name: tempest-TestSnapshotPattern-1346556205-project Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: method: > Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: exception: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: action_args: {'id': '583da0b2-9c47-4f30-857b-4bf72432738f'} Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: {{(pid=120570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:54:24.030596 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: ERROR nova.api.openstack.wsgi Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: DEBUG nova.api.openstack.wsgi [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Returning 404 to user: Instance 583da0b2-9c47-4f30-857b-4bf72432738f could not be found. {{(pid=120570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: INFO nova.api.openstack.requestlog [None req-10e80f46-6b45-47c2-ace0-0e8d4e2cab23 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f" status: 404 len: 111 microversion: 2.1 time: 0.031008 Oct 18 17:54:24.035290 n-d-858383-14 devstack@n-api.service[120570]: [pid: 120570|app: 0|req: 4213/8461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 17:54:24 2022] GET /compute/v2.1/servers/583da0b2-9c47-4f30-857b-4bf72432738f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:54:24.196787 n-d-858383-14 devstack@n-api.service[120571]: DEBUG nova.api.openstack.wsgi [None req-34c7c5b3-c99d-46b4-bda7-ae1b23bbd088 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] Calling method '.version_select at 0x7f5fd03f4dc0>' {{(pid=120571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:54:24.201441 n-d-858383-14 devstack@n-api.service[120571]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34c7c5b3-c99d-46b4-bda7-ae1b23bbd088 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:54:25.209277 n-d-858383-14 devstack@n-api.service[120571]: INFO oslo.messaging._drivers.impl_rabbit [None req-34c7c5b3-c99d-46b4-bda7-ae1b23bbd088 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] [0129f62c-9a59-4aed-ab83-1b6e54311e46] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58886. Oct 18 17:54:25.231413 n-d-858383-14 devstack@n-api.service[120571]: INFO nova.api.openstack.requestlog [None req-34c7c5b3-c99d-46b4-bda7-ae1b23bbd088 tempest-TestSnapshotPattern-1346556205 tempest-TestSnapshotPattern-1346556205-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1844304173" status: 202 len: 0 microversion: 2.1 time: 1.039838 Oct 18 17:54:25.232044 n-d-858383-14 devstack@n-api.service[120571]: [pid: 120571|app: 0|req: 4249/8462] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 17:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1844304173 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)